[----] I, [2016-09-13T03:33:06.133713 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:33:06.379694 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75738], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:33:06.858115 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:33:07.020721 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75738], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.880995775] seconds [----] I, [2016-09-13T03:33:07.020918 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75738], Delivering... [----] I, [2016-09-13T03:33:07.027369 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003418445587158203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034377574920654297, :pending_vm_jobs=>0.0007252693176269531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006009101867675781} [----] I, [2016-09-13T03:33:07.027781 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75738], State: [ok], Delivered in [0.006844703] seconds [----] I, [2016-09-13T03:33:13.431289 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004286050796508789, :worker_monitor=>1.5581505298614502, :worker_dequeue=>0.00591588020324707, :total_time=>1.5686981678009033} [----] I, [2016-09-13T03:33:18.431820 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:33:18 UTC]... [----] I, [2016-09-13T03:33:18.444964 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:33:18 UTC]...Complete [----] I, [2016-09-13T03:33:21.393728 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T03:33:21.405720 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75739], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:33:21.416745 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75740], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:33:21.433837 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75741], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:33:21.451113 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75742], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:33:21.462283 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75743], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:33:21.479468 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75744], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:33:23.468597 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:33:23.537399 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75739], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.138786444] seconds [----] I, [2016-09-13T03:33:23.537634 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [75739], Delivering... [----] I, [2016-09-13T03:33:23.538659 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T03:33:23.538831 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5302763520 [----] I, [2016-09-13T03:33:23.538911 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5091307520 [----] I, [2016-09-13T03:33:23.538984 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 211456000 [----] I, [2016-09-13T03:33:23.539056 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1306525696 [----] I, [2016-09-13T03:33:23.539124 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5037621248 [----] I, [2016-09-13T03:33:23.539193 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T03:33:23.539259 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T03:33:23.539327 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 531828736 [----] I, [2016-09-13T03:33:23.539394 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T03:33:23.539492 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7846756352 [----] I, [2016-09-13T03:33:23.539567 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T03:33:23.539661 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T03:33:23.539738 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T03:33:23.539807 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 32768 [----] I, [2016-09-13T03:33:23.539876 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T03:33:23.539942 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T03:33:23.540029 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T03:33:23.540100 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T03:33:23.540165 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T03:33:23.540231 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T03:33:23.540314 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272891904 [----] I, [2016-09-13T03:33:23.540390 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56131584 [----] I, [2016-09-13T03:33:23.540491 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216760320 [----] I, [2016-09-13T03:33:23.540575 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T03:33:23.540666 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140263424 [----] I, [2016-09-13T03:33:23.540740 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2631102464 [----] I, [2016-09-13T03:33:23.540828 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2324738048 [----] I, [2016-09-13T03:33:23.540897 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T03:33:23.540964 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T03:33:23.541027 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T03:33:23.541095 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37240832 [----] I, [2016-09-13T03:33:23.541162 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102260736 [----] I, [2016-09-13T03:33:23.541230 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53075968 [----] I, [2016-09-13T03:33:23.541298 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 109834240 [----] I, [2016-09-13T03:33:23.541364 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155336704 [----] I, [2016-09-13T03:33:23.541460 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T03:33:23.541540 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T03:33:23.541622 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T03:33:23.541700 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T03:33:23.541773 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T03:33:23.541841 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T03:33:23.541919 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T03:33:23.541990 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T03:33:23.542061 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T03:33:23.583850 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T03:33:23.583972 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T03:33:23.585911 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T03:33:23.587244 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T03:33:23.588869 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T03:33:23.590463 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T03:33:23.592031 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T03:33:23.593682 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 833 MB 1.18 GB 41% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T03:33:23.594654 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75742], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.157102502] seconds [----] I, [2016-09-13T03:33:23.594845 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75742], Delivering... [----] I, [2016-09-13T03:33:23.595265 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T03:33:23.596835 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.3 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T03:33:23.598360 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.5 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T03:33:23.600024 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T03:33:23.601613 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 173 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T03:33:23.603123 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T03:33:23.604812 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>2}} [----] I, [2016-09-13T03:33:23.604893 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T03:33:23.604950 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>3, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T03:33:23.607544 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [147137.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T03:33:23.607868 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [75739], State: [ok], Delivered in [0.07025915] seconds [----] I, [2016-09-13T03:33:23.645400 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75744], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.174473993] seconds [----] I, [2016-09-13T03:33:23.645538 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75744], Delivering... [----] I, [2016-09-13T03:33:23.649102 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0019757747650146484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.001987457275390625, :pending_vm_jobs=>0.00040912628173828125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003326892852783203} [----] I, [2016-09-13T03:33:23.649333 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75744], State: [ok], Delivered in [0.003792952] seconds [----] I, [2016-09-13T03:33:23.653017 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75742], State: [ok], Delivered in [0.058154533] seconds [----] I, [2016-09-13T03:33:25.069699 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75741], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.649217777] seconds [----] I, [2016-09-13T03:33:25.069939 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75741], Delivering... [----] I, [2016-09-13T03:33:25.074771 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75741], State: [ok], Delivered in [0.004840534] seconds [----] I, [2016-09-13T03:33:25.104821 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75743], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.648734988] seconds [----] I, [2016-09-13T03:33:25.104987 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75743], Delivering... [----] I, [2016-09-13T03:33:25.107855 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75743], State: [ok], Delivered in [0.002857567] seconds [----] I, [2016-09-13T03:33:29.885706 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:33:29.892294 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004217863082885742, :worker_monitor=>1.4036388397216797, :worker_dequeue=>0.011682748794555664, :total_time=>1.4198887348175049} [----] I, [2016-09-13T03:33:30.716039 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75740], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [9.306662821] seconds [----] I, [2016-09-13T03:33:30.716243 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [75740], Delivering... [----] I, [2016-09-13T03:33:30.724295 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:33:29 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [146218.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T03:33:30.724907 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:33:28 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169067000], Memory % [3.14], CPU Time [50000.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T03:33:30.725371 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:33:21 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347147000], Memory % [5.04], CPU Time [102591.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T03:33:30.725883 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:33:19 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [47743.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T03:33:30.726404 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:33:21 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [232701.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T03:33:30.727007 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:33:27 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162414000], Memory % [3.1], CPU Time [36859.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T03:33:30.727622 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:33:28 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [195221.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T03:33:30.728138 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:33:29 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [147157.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T03:33:30.731049 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [93], PID [20377], GUID [e54475e4-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:33:23 UTC], Process Info: Memory Usage [583127040], Memory Size [922296320], Proportional Set Size: [415970000], Memory % [7.11], CPU Time [1751.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T03:33:30.733115 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [95], PID [22463], GUID [db78f78e-7978-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:33:28 UTC], Process Info: Memory Usage [583344128], Memory Size [912166912], Proportional Set Size: [422882000], Memory % [7.11], CPU Time [829.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T03:33:30.735313 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:33:22 UTC], Process Info: Memory Usage [558129152], Memory Size [911982592], Proportional Set Size: [405619000], Memory % [6.8], CPU Time [4097.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T03:33:30.737776 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:33:25 UTC], Process Info: Memory Usage [580628480], Memory Size [924086272], Proportional Set Size: [412916000], Memory % [7.08], CPU Time [743.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T03:33:30.738310 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:33:28 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [205334.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T03:33:30.738876 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:33:28 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177791000], Memory % [3.2], CPU Time [50022.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T03:33:30.739339 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:33:27 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165799000], Memory % [3.16], CPU Time [37722.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T03:33:30.739766 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [75740], State: [ok], Delivered in [0.023530613] seconds [----] I, [2016-09-13T03:33:36.491444 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:33:36.515971 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75745], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:33:39.918779 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:33:40.179612 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75745], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.678053622] seconds [----] I, [2016-09-13T03:33:40.179804 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75745], Delivering... [----] I, [2016-09-13T03:33:40.186541 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003599882125854492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036199092864990234, :pending_vm_jobs=>0.000823974609375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00630497932434082} [----] I, [2016-09-13T03:33:40.186936 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75745], State: [ok], Delivered in [0.00712387] seconds [----] I, [2016-09-13T03:33:46.213339 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0042209625244140625, :worker_monitor=>1.2687664031982422, :worker_dequeue=>0.01331186294555664, :total_time=>1.2865819931030273} [----] I, [2016-09-13T03:33:51.214066 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:33:51 UTC]... [----] I, [2016-09-13T03:33:51.236049 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:33:51 UTC]...Complete [----] I, [2016-09-13T03:33:51.528043 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:33:51.544687 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75746], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:33:51.557472 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75747], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:33:56.364407 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:33:56.895263 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75747], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.345206807] seconds [----] I, [2016-09-13T03:33:56.895567 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75747], Delivering... [----] I, [2016-09-13T03:33:56.901320 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029976367950439453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003017425537109375, :pending_vm_jobs=>0.0006976127624511719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005371570587158203} [----] I, [2016-09-13T03:33:56.901689 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75747], State: [ok], Delivered in [0.006133419] seconds [----] I, [2016-09-13T03:33:58.295136 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75746], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.762647015] seconds [----] I, [2016-09-13T03:33:58.295317 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75746], Delivering... [----] I, [2016-09-13T03:33:58.300020 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75746], State: [ok], Delivered in [0.004694355] seconds [----] I, [2016-09-13T03:34:02.554270 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00640416145324707, :worker_monitor=>1.1634747982025146, :worker_dequeue=>0.010870218276977539, :total_time=>1.1812973022460938} [----] I, [2016-09-13T03:34:06.569672 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T03:34:06.597821 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75748], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:34:06.614923 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75749], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:34:07.563914 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:34:08.016924 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75749], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.41096235] seconds [----] I, [2016-09-13T03:34:08.017105 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75749], Delivering... [----] I, [2016-09-13T03:34:08.023258 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033071041107177734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033326148986816406, :pending_vm_jobs=>0.0007164478302001953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005828857421875} [----] I, [2016-09-13T03:34:08.023610 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75749], State: [ok], Delivered in [0.006487176] seconds [----] I, [2016-09-13T03:34:10.318231 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75748], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.732290581] seconds [----] I, [2016-09-13T03:34:10.318483 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75748], Delivering... [----] I, [2016-09-13T03:34:10.346904 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75750], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T03:34:10.363956 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75751], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T03:34:10.364289 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75748], State: [ok], Delivered in [0.04585099] seconds [----] I, [2016-09-13T03:34:12.584133 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T03:34:12.586521 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T03:34:13.307677 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [75751], MiqWorker id: [93], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [2.954513333] seconds [----] I, [2016-09-13T03:34:13.307921 #20377:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75751], Delivering... [----] I, [2016-09-13T03:34:13.311806 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T03:34:13.312024 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T03:34:13.312203 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T03:34:13.312383 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T03:34:13.312652 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:13.755950 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:14.051892 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:14.052142 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:14.544009 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:14.902749 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:14.902973 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:15.440973 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:15.740737 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:15.740956 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:16.245628 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:16.543748 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:16.543951 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:17.006196 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:17.314369 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:17.314638 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:17.842395 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:18.143900 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:18.144102 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:18.358719 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [75750], MiqWorker id: [95], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [8.023340786] seconds [----] I, [2016-09-13T03:34:18.359001 #22463:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75750], Delivering... [----] I, [2016-09-13T03:34:18.363329 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T03:34:18.363558 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T03:34:18.363741 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T03:34:18.363929 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T03:34:18.364099 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:18.608032 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:18.650850 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:18.857143 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:18.857320 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:18.886814 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004599094390869141, :worker_monitor=>1.283113956451416, :worker_dequeue=>0.011656522750854492, :total_time=>1.2996747493743896} [----] I, [2016-09-13T03:34:18.901811 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:18.902008 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:19.189761 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:19.283773 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:19.369634 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:19.376357 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:19.671018 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:19.671229 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:19.865189 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:19.973035 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:20.067945 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:20.160377 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:20.168064 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:20.252532 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:20.344774 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:20.437835 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:20.480677 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:20.480854 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:20.530536 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:20.623835 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:20.716972 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:20.810814 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:20.903984 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:20.949409 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:20.998254 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:21.090815 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:21.184260 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:21.257948 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:21.258162 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:21.277363 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:21.370891 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:34:21.603799 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T03:34:21.604042 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004083156585693359, :collect_inventory_for_targets=>5.7697296142578125e-05, :parse_legacy_inventory=>21.03833031654358, :parse_targeted_inventory=>21.038496255874634, :save_inventory=>1.2688915729522705, :ems_refresh=>22.310691356658936} [----] I, [2016-09-13T03:34:21.626654 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:34:21.626722 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T03:34:21.627098 #22463:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75750], State: [ok], Delivered in [3.268117798] seconds [----] I, [2016-09-13T03:34:21.643769 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75752], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:34:21.655059 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75753], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:34:21.666541 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75754], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:34:21.683709 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75755], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:34:21.748459 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:22.063704 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:22.063949 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:22.556145 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:22.877541 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:22.877848 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:23.361943 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:23.526350 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:23.666705 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:23.808398 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:23.887339 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:34:23 UTC]... [----] I, [2016-09-13T03:34:23.906440 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:34:23 UTC]...Complete [----] I, [2016-09-13T03:34:23.917409 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:34:23.947364 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:24.084244 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:24.101235 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75753], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.453700351] seconds [----] I, [2016-09-13T03:34:24.101455 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75753], Delivering... [----] I, [2016-09-13T03:34:24.141048 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75755], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.465514868] seconds [----] I, [2016-09-13T03:34:24.141208 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75755], Delivering... [----] I, [2016-09-13T03:34:24.146627 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75753], State: [ok], Delivered in [0.045174] seconds [----] I, [2016-09-13T03:34:24.146996 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029065608978271484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029239654541015625, :pending_vm_jobs=>0.0007429122924804688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005423545837402344} [----] I, [2016-09-13T03:34:24.147300 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75755], State: [ok], Delivered in [0.006082592] seconds [----] I, [2016-09-13T03:34:24.217693 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:24.361221 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:24.497891 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:24.633610 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:24.766091 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:24.905995 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:25.046533 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:25.187083 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:25.436469 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75752], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.805010838] seconds [----] I, [2016-09-13T03:34:25.436723 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75752], Delivering... [----] I, [2016-09-13T03:34:25.441962 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75752], State: [ok], Delivered in [0.005220551] seconds [----] I, [2016-09-13T03:34:25.449887 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75754], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.78980414] seconds [----] I, [2016-09-13T03:34:25.450076 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75754], Delivering... [----] I, [2016-09-13T03:34:25.453474 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75754], State: [ok], Delivered in [0.00336166] seconds [----] I, [2016-09-13T03:34:25.677988 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:25.831205 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:25.971192 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:26.113919 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:26.258609 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:26.401574 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:26.537795 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:26.683973 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:26.823660 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:26.965054 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:27.111163 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:27.251715 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:27.391296 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:27.531686 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:27.671221 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:33.821524 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:34.086002 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:34.546116 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:34.697747 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:34.838566 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:34.977492 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:35.123524 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:35.259739 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:35.399264 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:35.491758 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006740093231201172, :worker_monitor=>1.5247571468353271, :worker_dequeue=>0.011139392852783203, :total_time=>1.5431478023529053} [----] I, [2016-09-13T03:34:35.538246 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:35.681236 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:35.817098 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:35.989297 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:36.127043 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:36.267772 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:36.408372 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:36.546641 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:36.681873 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:36.695655 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:34:36.712561 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75756], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:34:36.819488 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:37.262328 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:37.419385 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:37.561036 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:37.702491 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:37.847496 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:37.989222 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:38.135534 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:38.275249 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:38.414861 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:38.552708 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:38.697242 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:38.840183 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:39.014871 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:39.155716 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:39.304701 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:39.439286 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:39.649095 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:40.070551 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:40.236366 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:40.380134 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:40.507768 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:34:40.519704 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:40.538729 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75756], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.836577756] seconds [----] I, [2016-09-13T03:34:40.538905 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75756], Delivering... [----] I, [2016-09-13T03:34:40.545482 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035076141357421875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035271644592285156, :pending_vm_jobs=>0.0007779598236083984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006196022033691406} [----] I, [2016-09-13T03:34:40.545815 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75756], State: [ok], Delivered in [0.006897968] seconds [----] I, [2016-09-13T03:34:40.668728 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:40.809322 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:40.943739 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:41.084757 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:41.229739 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:41.368165 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:41.501056 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:41.635857 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:41.780478 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:41.926162 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:42.066486 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:42.208918 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:42.350085 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:42.856925 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:43.022885 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:43.166682 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:43.310802 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:43.450684 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:43.595951 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:43.736081 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:43.877449 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:44.012935 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:44.158246 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:44.297783 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:44.438971 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:44.605501 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:50.762881 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:50.905783 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:51.045276 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:51.184045 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:51.578483 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:51.724333 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:34:51.736044 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:51.745632 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75757], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:34:51.756935 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75758], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:34:51.785926 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:34:51.792319 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004038333892822266, :worker_monitor=>1.2451350688934326, :worker_dequeue=>0.011488199234008789, :total_time=>1.260979413986206} [----] I, [2016-09-13T03:34:51.870628 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:52.013456 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:52.167375 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:52.305046 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:52.375549 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75758], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.624199912] seconds [----] I, [2016-09-13T03:34:52.375782 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75758], Delivering... [----] I, [2016-09-13T03:34:52.384269 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037627220153808594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037870407104492188, :pending_vm_jobs=>0.001367807388305664, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008025407791137695} [----] I, [2016-09-13T03:34:52.384728 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75758], State: [ok], Delivered in [0.00893294] seconds [----] I, [2016-09-13T03:34:52.443820 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:52.568622 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75757], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.839733912] seconds [----] I, [2016-09-13T03:34:52.568794 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75757], Delivering... [----] I, [2016-09-13T03:34:52.572285 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75757], State: [ok], Delivered in [0.003502778] seconds [----] I, [2016-09-13T03:34:52.583208 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:52.728579 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:52.866467 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:53.007821 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:53.148452 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:53.291803 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:53.433003 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:53.578783 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:53.720927 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:53.855404 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:54.290360 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:54.449541 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:54.587223 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:54.732234 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:54.864368 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:54.996274 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:55.134926 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:55.277857 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:55.415635 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:55.555281 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:55.692365 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:55.838178 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:55.974442 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:56.114661 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:56.251531 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:56.387099 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:56.528809 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:56.792886 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:34:56 UTC]... [----] I, [2016-09-13T03:34:56.808262 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:34:56 UTC]...Complete [----] I, [2016-09-13T03:34:56.942555 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:57.095726 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:57.229044 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:57.375222 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:57.520357 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:57.654119 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:57.798067 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:57.941182 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:58.087912 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:58.223699 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:58.360242 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:58.502552 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:58.647933 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:58.790039 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:58.927509 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:59.063146 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:59.208447 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:59.691032 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:59.849370 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:34:59.993049 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:00.135445 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:00.279653 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:00.420131 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:00.566060 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:00.711214 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:00.851035 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:00.991111 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:01.128847 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:01.270023 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:01.410128 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:01.556678 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:01.703981 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:06.768478 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:35:06.785615 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75759], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:35:07.859939 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:07.996974 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:08.414946 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:08.571209 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:08.648302 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:35:08.654603 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038793087005615234, :worker_monitor=>1.7041699886322021, :worker_dequeue=>0.01119375228881836, :total_time=>1.7195472717285156} [----] I, [2016-09-13T03:35:08.779039 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:08.921755 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:09.069519 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:09.210101 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:09.351382 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:09.460117 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75759], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.685774874] seconds [----] I, [2016-09-13T03:35:09.460290 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75759], Delivering... [----] I, [2016-09-13T03:35:09.466323 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003077983856201172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030944347381591797, :pending_vm_jobs=>0.0007293224334716797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005610227584838867} [----] I, [2016-09-13T03:35:09.466719 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75759], State: [ok], Delivered in [0.006431205] seconds [----] I, [2016-09-13T03:35:09.489157 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:09.637559 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:09.785952 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:09.928578 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:10.069540 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:10.208048 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:10.395082 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:10.544135 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:10.678071 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:10.813212 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:11.264446 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:11.428355 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:11.582946 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:11.726770 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:11.867575 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:12.016485 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:12.156811 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:12.307866 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:12.451927 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:12.590578 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:12.726842 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:12.863620 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:13.002312 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:13.147109 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:13.283320 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:13.428186 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:13.565512 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:13.931540 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:14.079653 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:14.223762 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:14.373496 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:14.517755 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:14.657727 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:14.801268 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:14.941502 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:15.080463 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:15.225848 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:15.359250 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:15.499735 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:15.642911 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:15.783902 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:15.937833 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:16.075542 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:35:16.213149 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T03:35:16.406765 #20377:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T03:35:16.407093 #20377:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T03:35:16.407395 #20377:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T03:35:16.407532 #20377:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T03:35:16.407657 #20377:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T03:35:16.454534 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T03:35:16.454981 #20377:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [75751], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T03:35:16.455229 #20377:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T03:35:16.455496 #20377:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T03:35:16.455717 #20377:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75751], State: [error], Delivered in [63.147817531] seconds [----] I, [2016-09-13T03:35:21.796943 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:35:21.821314 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75760], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:35:21.837112 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75761], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:35:21.859951 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75762], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:35:21.888690 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75763], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:35:24.974179 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:35:24.980819 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005029201507568359, :worker_monitor=>1.276637077331543, :worker_dequeue=>0.011986255645751953, :total_time=>1.2940802574157715} [----] I, [2016-09-13T03:35:25.577322 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75761], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.7521684] seconds [----] I, [2016-09-13T03:35:25.577519 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75761], Delivering... [----] I, [2016-09-13T03:35:25.640027 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75761], State: [ok], Delivered in [0.062454282] seconds [----] I, [2016-09-13T03:35:25.657324 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75763], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.78862672] seconds [----] I, [2016-09-13T03:35:25.657531 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75763], Delivering... [----] I, [2016-09-13T03:35:25.663105 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75760], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.86168224] seconds [----] I, [2016-09-13T03:35:25.663273 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75760], Delivering... [----] I, [2016-09-13T03:35:25.664097 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003200054168701172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032248497009277344, :pending_vm_jobs=>0.0007855892181396484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006155967712402344} [----] I, [2016-09-13T03:35:25.664534 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75763], State: [ok], Delivered in [0.006996508] seconds [----] I, [2016-09-13T03:35:25.667688 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75760], State: [ok], Delivered in [0.00439832] seconds [----] I, [2016-09-13T03:35:25.700338 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75762], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.85809951] seconds [----] I, [2016-09-13T03:35:25.700639 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75762], Delivering... [----] I, [2016-09-13T03:35:25.704940 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75762], State: [ok], Delivered in [0.004311683] seconds [----] I, [2016-09-13T03:35:29.981261 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:35:29 UTC]... [----] I, [2016-09-13T03:35:29.993729 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:35:29 UTC]...Complete [----] I, [2016-09-13T03:35:36.901206 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:35:36.919909 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75764], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:35:41.229947 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:35:41.236447 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00419926643371582, :worker_monitor=>1.2001609802246094, :worker_dequeue=>0.011309385299682617, :total_time=>1.215996265411377} [----] I, [2016-09-13T03:35:41.765849 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75764], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.856436441] seconds [----] I, [2016-09-13T03:35:41.766028 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75764], Delivering... [----] I, [2016-09-13T03:35:41.772203 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003270864486694336, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032889842987060547, :pending_vm_jobs=>0.0007431507110595703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005825042724609375} [----] I, [2016-09-13T03:35:41.772563 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75764], State: [ok], Delivered in [0.006526862] seconds [----] I, [2016-09-13T03:35:51.932513 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:35:51.948517 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75765], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:35:51.959840 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75766], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:35:57.667025 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:35:57.674681 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040433406829833984, :worker_monitor=>1.3839547634124756, :worker_dequeue=>0.013222694396972656, :total_time=>1.4015116691589355} [----] I, [2016-09-13T03:35:57.857359 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75766], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.903641715] seconds [----] I, [2016-09-13T03:35:57.857570 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75766], Delivering... [----] I, [2016-09-13T03:35:57.863864 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032885074615478516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033118724822998047, :pending_vm_jobs=>0.0007681846618652344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00582432746887207} [----] I, [2016-09-13T03:35:57.864251 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75766], State: [ok], Delivered in [0.006677804] seconds [----] I, [2016-09-13T03:35:58.811501 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75765], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.87426661] seconds [----] I, [2016-09-13T03:35:58.811623 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75765], Delivering... [----] I, [2016-09-13T03:35:58.817327 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75765], State: [ok], Delivered in [0.005691502] seconds [----] I, [2016-09-13T03:36:02.675233 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:36:02 UTC]... [----] I, [2016-09-13T03:36:02.704234 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:36:02 UTC]...Complete [----] I, [2016-09-13T03:36:06.971919 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:36:06.984288 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75767], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:36:07.827382 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:36:07.851898 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75767], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.873904045] seconds [----] I, [2016-09-13T03:36:07.852067 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75767], Delivering... [----] I, [2016-09-13T03:36:07.858259 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031614303588867188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031805038452148438, :pending_vm_jobs=>0.0007865428924560547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005831003189086914} [----] I, [2016-09-13T03:36:07.858614 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75767], State: [ok], Delivered in [0.006518763] seconds [----] I, [2016-09-13T03:36:14.352053 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039119720458984375, :worker_monitor=>1.5044326782226562, :worker_dequeue=>0.012112140655517578, :total_time=>1.5207750797271729} [----] I, [2016-09-13T03:36:19.369401 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T03:36:21.996261 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:36:22.015096 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75768], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:36:22.026306 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75769], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:36:22.037702 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75770], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:36:22.057860 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75771], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:36:24.392689 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:36:25.058147 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75769], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.039207847] seconds [----] I, [2016-09-13T03:36:25.058297 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75769], Delivering... [----] I, [2016-09-13T03:36:25.070229 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75771], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.022925092] seconds [----] I, [2016-09-13T03:36:25.070513 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75771], Delivering... [----] I, [2016-09-13T03:36:25.076943 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003319978713989258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034475326538085938, :pending_vm_jobs=>0.0007693767547607422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005978107452392578} [----] I, [2016-09-13T03:36:25.077288 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75771], State: [ok], Delivered in [0.006790631] seconds [----] I, [2016-09-13T03:36:25.103823 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75769], State: [ok], Delivered in [0.045504029] seconds [----] I, [2016-09-13T03:36:25.956496 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75768], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.955389] seconds [----] I, [2016-09-13T03:36:25.956732 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75768], Delivering... [----] I, [2016-09-13T03:36:25.961825 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75768], State: [ok], Delivered in [0.005089916] seconds [----] I, [2016-09-13T03:36:25.989775 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75770], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.957901572] seconds [----] I, [2016-09-13T03:36:25.989958 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75770], Delivering... [----] I, [2016-09-13T03:36:25.994159 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75770], State: [ok], Delivered in [0.004183081] seconds [----] I, [2016-09-13T03:36:30.698913 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004803895950317383, :worker_monitor=>1.284447431564331, :worker_dequeue=>0.009297609329223633, :total_time=>1.2988717555999756} [----] I, [2016-09-13T03:36:35.699397 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:36:35 UTC]... [----] I, [2016-09-13T03:36:35.726508 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:36:35 UTC]...Complete [----] I, [2016-09-13T03:36:37.070206 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:36:37.086595 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75772], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:36:40.757154 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:36:41.201598 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75772], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.125053902] seconds [----] I, [2016-09-13T03:36:41.201801 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75772], Delivering... [----] I, [2016-09-13T03:36:41.211244 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005147457122802734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005179643630981445, :pending_vm_jobs=>0.0013399124145507812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008998632431030273} [----] I, [2016-09-13T03:36:41.211763 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75772], State: [ok], Delivered in [0.009943432] seconds [----] I, [2016-09-13T03:36:46.924655 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038902759552001953, :worker_monitor=>1.1416430473327637, :worker_dequeue=>0.011573076248168945, :total_time=>1.1574413776397705} [----] I, [2016-09-13T03:36:52.097984 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:36:52.109642 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75773], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:36:52.126795 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75774], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:36:56.949201 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:36:57.361713 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75774], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.24668192] seconds [----] I, [2016-09-13T03:36:57.361918 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75774], Delivering... [----] I, [2016-09-13T03:36:57.368180 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034084320068359375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003428936004638672, :pending_vm_jobs=>0.0007109642028808594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005899906158447266} [----] I, [2016-09-13T03:36:57.368539 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75774], State: [ok], Delivered in [0.00661705] seconds [----] I, [2016-09-13T03:36:59.367254 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75773], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.26479169] seconds [----] I, [2016-09-13T03:36:59.367513 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75773], Delivering... [----] I, [2016-09-13T03:36:59.374068 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75773], State: [ok], Delivered in [0.006543962] seconds [----] I, [2016-09-13T03:37:03.409564 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0046994686126708984, :worker_monitor=>1.4328899383544922, :worker_dequeue=>0.015798568725585938, :total_time=>1.4537086486816406} [----] I, [2016-09-13T03:37:07.141065 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:37:07.155528 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75775], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:37:08.410230 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:37:08 UTC]... [----] I, [2016-09-13T03:37:08.429798 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:37:08 UTC]...Complete [----] I, [2016-09-13T03:37:08.556065 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:37:08.955784 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75775], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.808700079] seconds [----] I, [2016-09-13T03:37:08.955962 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75775], Delivering... [----] I, [2016-09-13T03:37:08.962189 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003290891647338867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003313302993774414, :pending_vm_jobs=>0.0007770061492919922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005867958068847656} [----] I, [2016-09-13T03:37:08.962548 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75775], State: [ok], Delivered in [0.006583114] seconds [----] I, [2016-09-13T03:37:20.243900 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038352012634277344, :worker_monitor=>1.645012617111206, :worker_dequeue=>0.011437416076660156, :total_time=>1.660654067993164} [----] I, [2016-09-13T03:37:22.168749 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:37:22.185236 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75776], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:37:22.209477 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75777], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:37:22.246955 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75778], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:37:22.275708 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75779], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:37:25.257182 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:37:26.054070 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75777], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.865042283] seconds [----] I, [2016-09-13T03:37:26.054240 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75777], Delivering... [----] I, [2016-09-13T03:37:26.094068 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75779], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.835759082] seconds [----] I, [2016-09-13T03:37:26.094231 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75779], Delivering... [----] I, [2016-09-13T03:37:26.100122 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003107786178588867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031280517578125, :pending_vm_jobs=>0.0006954669952392578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005560398101806641} [----] I, [2016-09-13T03:37:26.100505 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75779], State: [ok], Delivered in [0.006267489] seconds [----] I, [2016-09-13T03:37:26.126946 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75777], State: [ok], Delivered in [0.072667546] seconds [----] I, [2016-09-13T03:37:26.465546 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75776], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.291925758] seconds [----] I, [2016-09-13T03:37:26.465776 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75776], Delivering... [----] I, [2016-09-13T03:37:26.471145 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75776], State: [ok], Delivered in [0.005362602] seconds [----] I, [2016-09-13T03:37:26.503954 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75778], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.289152103] seconds [----] I, [2016-09-13T03:37:26.504138 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75778], Delivering... [----] I, [2016-09-13T03:37:26.507624 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75778], State: [ok], Delivered in [0.003454434] seconds [----] I, [2016-09-13T03:37:36.529997 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003523111343383789, :worker_monitor=>1.2371487617492676, :worker_dequeue=>0.008930683135986328, :total_time=>1.249819040298462} [----] I, [2016-09-13T03:37:37.288017 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:37:37.300661 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75780], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:37:41.530593 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:37:41 UTC]... [----] I, [2016-09-13T03:37:41.575341 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:37:41 UTC]...Complete [----] I, [2016-09-13T03:37:41.587822 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:37:41.627033 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75780], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.333351555] seconds [----] I, [2016-09-13T03:37:41.627329 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75780], Delivering... [----] I, [2016-09-13T03:37:41.636451 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005423307418823242, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005455732345581055, :pending_vm_jobs=>0.0009036064147949219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008446455001831055} [----] I, [2016-09-13T03:37:41.636842 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75780], State: [ok], Delivered in [0.009545538] seconds [----] I, [2016-09-13T03:37:52.312380 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:37:52.323785 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75781], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:37:52.336061 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75782], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:37:52.892636 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:37:52.897090 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004167318344116211, :worker_monitor=>1.2718274593353271, :worker_dequeue=>0.007954835891723633, :total_time=>1.2843198776245117} [----] I, [2016-09-13T03:37:53.372978 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75782], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.044048407] seconds [----] I, [2016-09-13T03:37:53.373148 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75782], Delivering... [----] I, [2016-09-13T03:37:53.378582 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00296783447265625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029850006103515625, :pending_vm_jobs=>0.0006570816040039062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005100250244140625} [----] I, [2016-09-13T03:37:53.378907 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75782], State: [ok], Delivered in [0.005759017] seconds [----] I, [2016-09-13T03:37:53.625765 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75781], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.30872505] seconds [----] I, [2016-09-13T03:37:53.626057 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75781], Delivering... [----] I, [2016-09-13T03:37:53.633745 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75781], State: [ok], Delivered in [0.007666971] seconds [----] I, [2016-09-13T03:38:07.348040 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:38:07.366150 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75783], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:38:09.501108 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:38:09.508862 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0043942928314208984, :worker_monitor=>1.5561981201171875, :worker_dequeue=>0.01381063461303711, :total_time=>1.5747096538543701} [----] I, [2016-09-13T03:38:10.502837 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75783], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.14829169] seconds [----] I, [2016-09-13T03:38:10.503072 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75783], Delivering... [----] I, [2016-09-13T03:38:10.510712 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004037141799926758, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0040853023529052734, :pending_vm_jobs=>0.0008745193481445312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007127523422241211} [----] I, [2016-09-13T03:38:10.511226 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75783], State: [ok], Delivered in [0.008146806] seconds [----] I, [2016-09-13T03:38:14.510231 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:38:14 UTC]... [----] I, [2016-09-13T03:38:14.530723 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:38:14 UTC]...Complete [----] I, [2016-09-13T03:38:22.378139 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T03:38:22.393937 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75784], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:38:22.416627 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75785], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:38:22.439486 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75786], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:38:22.462298 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75787], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:38:22.485015 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75788], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:38:22.502048 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75789], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:38:26.077275 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:38:26.080489 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004087686538696289, :worker_monitor=>1.4046111106872559, :worker_dequeue=>0.006018161773681641, :total_time=>1.415024757385254} [----] I, [2016-09-13T03:38:26.581989 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75784], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.19942128] seconds [----] I, [2016-09-13T03:38:26.582185 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [75784], Delivering... [----] I, [2016-09-13T03:38:26.583657 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T03:38:26.583886 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5317259264 [----] I, [2016-09-13T03:38:26.583988 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5105541120 [----] I, [2016-09-13T03:38:26.584079 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 211718144 [----] I, [2016-09-13T03:38:26.584159 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1306525696 [----] I, [2016-09-13T03:38:26.584240 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5051817984 [----] I, [2016-09-13T03:38:26.584317 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T03:38:26.584402 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T03:38:26.584530 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 532148224 [----] I, [2016-09-13T03:38:26.584629 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T03:38:26.584713 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8016777216 [----] I, [2016-09-13T03:38:26.584794 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T03:38:26.584873 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T03:38:26.584951 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T03:38:26.585036 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T03:38:26.585110 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T03:38:26.585186 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T03:38:26.585260 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T03:38:26.585344 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T03:38:26.585448 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T03:38:26.585568 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T03:38:26.585679 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272924672 [----] I, [2016-09-13T03:38:26.585770 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56143872 [----] I, [2016-09-13T03:38:26.585857 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216780800 [----] I, [2016-09-13T03:38:26.585939 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6225920 [----] I, [2016-09-13T03:38:26.586015 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140324864 [----] I, [2016-09-13T03:38:26.586094 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2616090624 [----] I, [2016-09-13T03:38:26.586173 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2309435392 [----] I, [2016-09-13T03:38:26.586251 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T03:38:26.586332 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T03:38:26.586434 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T03:38:26.586536 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 38047744 [----] I, [2016-09-13T03:38:26.586641 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102273024 [----] I, [2016-09-13T03:38:26.586728 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53465088 [----] I, [2016-09-13T03:38:26.586811 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 109867008 [----] I, [2016-09-13T03:38:26.586891 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155738112 [----] I, [2016-09-13T03:38:26.586968 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T03:38:26.587056 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T03:38:26.587142 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T03:38:26.587224 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T03:38:26.587308 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T03:38:26.587452 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T03:38:26.587563 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T03:38:26.587690 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T03:38:26.587778 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T03:38:26.624465 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T03:38:26.624750 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T03:38:26.629170 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T03:38:26.632358 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T03:38:26.636078 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T03:38:26.639712 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T03:38:26.643205 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T03:38:26.646893 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 834 MB 1.18 GB 41% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T03:38:26.650590 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T03:38:26.654347 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T03:38:26.657977 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T03:38:26.661398 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75787], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.218264774] seconds [----] I, [2016-09-13T03:38:26.661529 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75787], Delivering... [----] I, [2016-09-13T03:38:26.661737 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T03:38:26.665204 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 173 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T03:38:26.668717 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T03:38:26.671942 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>2}} [----] I, [2016-09-13T03:38:26.672107 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T03:38:26.672228 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>3, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T03:38:26.676903 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [146311.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T03:38:26.677275 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [75784], State: [ok], Delivered in [0.095082572] seconds [----] I, [2016-09-13T03:38:26.701359 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75787], State: [ok], Delivered in [0.039812409] seconds [----] I, [2016-09-13T03:38:26.712910 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75789], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.219438344] seconds [----] I, [2016-09-13T03:38:26.713094 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75789], Delivering... [----] I, [2016-09-13T03:38:26.719672 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00334930419921875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003373861312866211, :pending_vm_jobs=>0.0008208751678466797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0061953067779541016} [----] I, [2016-09-13T03:38:26.720034 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75789], State: [ok], Delivered in [0.006941555] seconds [----] I, [2016-09-13T03:38:26.735943 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75786], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.314917065] seconds [----] I, [2016-09-13T03:38:26.736128 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75786], Delivering... [----] I, [2016-09-13T03:38:26.741373 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75786], State: [ok], Delivered in [0.005232264] seconds [----] I, [2016-09-13T03:38:26.770329 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75788], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.303174312] seconds [----] I, [2016-09-13T03:38:26.770548 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75788], Delivering... [----] I, [2016-09-13T03:38:26.773913 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75788], State: [ok], Delivered in [0.003359287] seconds [----] I, [2016-09-13T03:38:31.086258 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:38:31.793390 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75785], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [9.394938934] seconds [----] I, [2016-09-13T03:38:31.793705 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [75785], Delivering... [----] I, [2016-09-13T03:38:31.806790 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:38:21 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347146000], Memory % [5.04], CPU Time [102606.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T03:38:31.807750 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:38:25 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [147262.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T03:38:31.808482 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:38:19 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212538000], Memory % [3.5], CPU Time [47751.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T03:38:31.809345 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:38:23 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169067000], Memory % [3.14], CPU Time [50016.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T03:38:31.810236 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:38:22 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [232820.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T03:38:31.811231 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:38:25 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162413000], Memory % [3.1], CPU Time [36868.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T03:38:31.812138 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:38:23 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358681000], Memory % [5.28], CPU Time [195293.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T03:38:31.813040 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:38:25 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [146324.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T03:38:31.817494 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [95], PID [22463], GUID [db78f78e-7978-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:38:21 UTC], Process Info: Memory Usage [583692288], Memory Size [926846976], Proportional Set Size: [423222000], Memory % [7.12], CPU Time [868.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T03:38:31.820859 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [93], PID [20377], GUID [e54475e4-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:38:16 UTC], Process Info: Memory Usage [592142336], Memory Size [1033908224], Proportional Set Size: [424825000], Memory % [7.22], CPU Time [1883.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T03:38:31.824168 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:38:22 UTC], Process Info: Memory Usage [558399488], Memory Size [930906112], Proportional Set Size: [406131000], Memory % [6.81], CPU Time [4108.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T03:38:31.827482 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:38:25 UTC], Process Info: Memory Usage [580849664], Memory Size [938242048], Proportional Set Size: [413175000], Memory % [7.08], CPU Time [754.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T03:38:31.828361 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:38:23 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [205405.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T03:38:31.829177 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:38:23 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177791000], Memory % [3.2], CPU Time [50069.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T03:38:31.829949 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:38:15 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165797000], Memory % [3.16], CPU Time [37732.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T03:38:31.830365 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [75785], State: [ok], Delivered in [0.036670811] seconds [----] I, [2016-09-13T03:38:37.513120 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:38:37.558537 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75790], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:38:42.784100 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:38:42.790838 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004266500473022461, :worker_monitor=>1.6690735816955566, :worker_dequeue=>0.01187586784362793, :total_time=>1.6855323314666748} [----] I, [2016-09-13T03:38:42.855762 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75790], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.334278828] seconds [----] I, [2016-09-13T03:38:42.855904 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75790], Delivering... [----] I, [2016-09-13T03:38:42.859964 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021936893463134766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022094249725341797, :pending_vm_jobs=>0.0005223751068115234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038192272186279297} [----] I, [2016-09-13T03:38:42.860232 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75790], State: [ok], Delivered in [0.004327701] seconds [----] I, [2016-09-13T03:38:47.791411 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:38:47 UTC]... [----] I, [2016-09-13T03:38:47.821368 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:38:47 UTC]...Complete [----] I, [2016-09-13T03:38:52.570133 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:38:52.581372 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75791], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:38:52.599175 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75792], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:38:52.858904 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:38:52.962801 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75792], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.375768249] seconds [----] I, [2016-09-13T03:38:52.962976 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75792], Delivering... [----] I, [2016-09-13T03:38:52.968511 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028259754180908203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029075145721435547, :pending_vm_jobs=>0.0007500648498535156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005159616470336914} [----] I, [2016-09-13T03:38:52.968833 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75792], State: [ok], Delivered in [0.005844708] seconds [----] I, [2016-09-13T03:38:53.855756 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75791], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.280562885] seconds [----] I, [2016-09-13T03:38:53.856019 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75791], Delivering... [----] I, [2016-09-13T03:38:53.862269 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75791], State: [ok], Delivered in [0.006259706] seconds [----] I, [2016-09-13T03:38:59.287798 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0045926570892333984, :worker_monitor=>1.4075703620910645, :worker_dequeue=>0.00898432731628418, :total_time=>1.4215140342712402} [----] I, [2016-09-13T03:39:07.613934 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:39:07.625614 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75793], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:39:09.313546 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:39:10.117736 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75793], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.497606371] seconds [----] I, [2016-09-13T03:39:10.117958 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75793], Delivering... [----] I, [2016-09-13T03:39:10.125563 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004096508026123047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004148721694946289, :pending_vm_jobs=>0.0008690357208251953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0071523189544677734} [----] I, [2016-09-13T03:39:10.125950 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75793], State: [ok], Delivered in [0.00798874] seconds [----] I, [2016-09-13T03:39:15.748374 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004358053207397461, :worker_monitor=>1.4139809608459473, :worker_dequeue=>0.010472774505615234, :total_time=>1.4290847778320312} [----] I, [2016-09-13T03:39:20.749043 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:39:20 UTC]... [----] I, [2016-09-13T03:39:20.768597 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:39:20 UTC]...Complete [----] I, [2016-09-13T03:39:22.638089 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:39:22.648322 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75794], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:39:22.660930 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75795], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:39:22.671148 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75796], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:39:22.682548 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75797], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:39:25.900137 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:39:26.220220 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75795], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.56909143] seconds [----] I, [2016-09-13T03:39:26.220359 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75795], Delivering... [----] I, [2016-09-13T03:39:26.260066 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75795], State: [ok], Delivered in [0.039680365] seconds [----] I, [2016-09-13T03:39:26.277038 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75797], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.600242987] seconds [----] I, [2016-09-13T03:39:26.277147 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75797], Delivering... [----] I, [2016-09-13T03:39:26.281131 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021142959594726562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002128124237060547, :pending_vm_jobs=>0.00047135353088378906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003747701644897461} [----] I, [2016-09-13T03:39:26.281337 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75797], State: [ok], Delivered in [0.004185241] seconds [----] I, [2016-09-13T03:39:26.974489 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75794], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.331889476] seconds [----] I, [2016-09-13T03:39:26.974700 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75794], Delivering... [----] I, [2016-09-13T03:39:26.979626 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75794], State: [ok], Delivered in [0.004913358] seconds [----] I, [2016-09-13T03:39:26.985884 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75796], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.319385294] seconds [----] I, [2016-09-13T03:39:26.986036 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75796], Delivering... [----] I, [2016-09-13T03:39:26.991752 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75796], State: [ok], Delivered in [0.005715288] seconds [----] I, [2016-09-13T03:39:32.547378 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006162881851196289, :worker_monitor=>1.626352310180664, :worker_dequeue=>0.008355855941772461, :total_time=>1.6413028240203857} [----] I, [2016-09-13T03:39:37.690958 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:39:37.707538 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75798], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:39:42.572155 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:39:43.416592 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75798], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.719834799] seconds [----] I, [2016-09-13T03:39:43.416801 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75798], Delivering... [----] I, [2016-09-13T03:39:43.424753 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003844022750854492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038721561431884766, :pending_vm_jobs=>0.0015232563018798828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007537364959716797} [----] I, [2016-09-13T03:39:43.425187 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75798], State: [ok], Delivered in [0.00836581] seconds [----] I, [2016-09-13T03:39:48.963632 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004149198532104492, :worker_monitor=>1.368617296218872, :worker_dequeue=>0.011497974395751953, :total_time=>1.3846142292022705} [----] I, [2016-09-13T03:39:52.719060 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:39:52.759462 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75799], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:39:52.782405 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75800], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:39:53.964230 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:39:53 UTC]... [----] I, [2016-09-13T03:39:53.987875 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:39:53 UTC]...Complete [----] I, [2016-09-13T03:39:53.999866 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:39:54.096756 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75799], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.373409322] seconds [----] I, [2016-09-13T03:39:54.096918 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75799], Delivering... [----] I, [2016-09-13T03:39:54.100245 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75799], State: [ok], Delivered in [0.003330546] seconds [----] I, [2016-09-13T03:39:54.102294 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75800], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.337309172] seconds [----] I, [2016-09-13T03:39:54.102531 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75800], Delivering... [----] I, [2016-09-13T03:39:54.109732 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037429332733154297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037696361541748047, :pending_vm_jobs=>0.0008454322814941406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006695747375488281} [----] I, [2016-09-13T03:39:54.110087 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75800], State: [ok], Delivered in [0.007558943] seconds [----] I, [2016-09-13T03:40:05.527992 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004607200622558594, :worker_monitor=>1.4891893863677979, :worker_dequeue=>0.01149606704711914, :total_time=>1.5056660175323486} [----] I, [2016-09-13T03:40:07.793142 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T03:40:07.816493 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75801], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:40:07.833700 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75802], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:40:07.850557 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75803], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:40:07.869354 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75804], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:40:10.543176 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:40:10.634476 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75804], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.779624114] seconds [----] I, [2016-09-13T03:40:10.634799 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75804], Delivering... [----] I, [2016-09-13T03:40:10.642802 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034949779510498047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003519296646118164, :pending_vm_jobs=>0.0008602142333984375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007333040237426758} [----] I, [2016-09-13T03:40:10.643181 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75804], State: [ok], Delivered in [0.008398687] seconds [----] I, [2016-09-13T03:40:12.165838 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75801], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.367873593] seconds [----] I, [2016-09-13T03:40:12.166032 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75801], Delivering... [----] I, [2016-09-13T03:40:12.168661 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75801], State: [ok], Delivered in [0.002626823] seconds [----] I, [2016-09-13T03:40:12.171010 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75802], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.350322765] seconds [----] I, [2016-09-13T03:40:12.171196 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75802], Delivering... [----] I, [2016-09-13T03:40:12.182665 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75802], State: [ok], Delivered in [0.011450836] seconds [----] I, [2016-09-13T03:40:12.194028 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75803], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.356152333] seconds [----] I, [2016-09-13T03:40:12.194218 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75803], Delivering... [----] I, [2016-09-13T03:40:12.200631 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75803], State: [ok], Delivered in [0.006390104] seconds [----] I, [2016-09-13T03:40:21.903924 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003824949264526367, :worker_monitor=>1.31498122215271, :worker_dequeue=>0.014679193496704102, :total_time=>1.333824634552002} [----] I, [2016-09-13T03:40:22.879632 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:40:22.895134 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75805], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:40:22.906319 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75806], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:40:22.917850 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75807], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:40:22.935036 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75808], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:40:26.904559 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:40:26 UTC]... [----] I, [2016-09-13T03:40:26.924136 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:40:26 UTC]...Complete [----] I, [2016-09-13T03:40:27.025996 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:40:27.243836 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75806], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.345258795] seconds [----] I, [2016-09-13T03:40:27.244016 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75806], Delivering... [----] I, [2016-09-13T03:40:27.255250 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75808], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.328135443] seconds [----] I, [2016-09-13T03:40:27.255460 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75808], Delivering... [----] I, [2016-09-13T03:40:27.262479 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035881996154785156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036094188690185547, :pending_vm_jobs=>0.0008530616760253906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006561994552612305} [----] I, [2016-09-13T03:40:27.262845 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75808], State: [ok], Delivered in [0.00740693] seconds [----] I, [2016-09-13T03:40:27.300865 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75805], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.416613814] seconds [----] I, [2016-09-13T03:40:27.301040 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75805], Delivering... [----] I, [2016-09-13T03:40:27.305844 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75805], State: [ok], Delivered in [0.004791027] seconds [----] I, [2016-09-13T03:40:27.318158 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75806], State: [ok], Delivered in [0.074086991] seconds [----] I, [2016-09-13T03:40:27.340965 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75807], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.429868961] seconds [----] I, [2016-09-13T03:40:27.341141 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75807], Delivering... [----] I, [2016-09-13T03:40:27.344202 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75807], State: [ok], Delivered in [0.00305014] seconds [----] I, [2016-09-13T03:40:37.984790 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:40:38.003626 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75809], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:40:38.369884 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:40:38.374705 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0032045841217041016, :worker_monitor=>1.311671495437622, :worker_dequeue=>0.008892059326171875, :total_time=>1.3240203857421875} [----] I, [2016-09-13T03:40:38.884044 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75809], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.892167586] seconds [----] I, [2016-09-13T03:40:38.884252 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75809], Delivering... [----] I, [2016-09-13T03:40:38.891591 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003612518310546875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00374603271484375, :pending_vm_jobs=>0.0009098052978515625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006890058517456055} [----] I, [2016-09-13T03:40:38.892009 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75809], State: [ok], Delivered in [0.007741284] seconds [----] I, [2016-09-13T03:40:53.018234 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:40:53.038273 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75810], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:40:53.049649 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75811], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:40:54.864260 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:40:54.871280 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004575967788696289, :worker_monitor=>1.4388961791992188, :worker_dequeue=>0.012516975402832031, :total_time=>1.4563188552856445} [----] I, [2016-09-13T03:40:55.012899 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75811], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.968696752] seconds [----] I, [2016-09-13T03:40:55.013154 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75811], Delivering... [----] I, [2016-09-13T03:40:55.021190 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004098176956176758, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004125833511352539, :pending_vm_jobs=>0.0009877681732177734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007516622543334961} [----] I, [2016-09-13T03:40:55.021721 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75811], State: [ok], Delivered in [0.008575126] seconds [----] I, [2016-09-13T03:40:57.475821 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75810], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.452503913] seconds [----] I, [2016-09-13T03:40:57.476046 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75810], Delivering... [----] I, [2016-09-13T03:40:57.482223 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75810], State: [ok], Delivered in [0.006146312] seconds [----] I, [2016-09-13T03:40:59.871923 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:40:59 UTC]... [----] I, [2016-09-13T03:40:59.899347 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:40:59 UTC]...Complete [----] I, [2016-09-13T03:41:08.062079 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:41:08.081070 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75812], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:41:11.137779 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:41:11.141916 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004144430160522461, :worker_monitor=>1.1845982074737549, :worker_dequeue=>0.017020702362060547, :total_time=>1.2060630321502686} [----] I, [2016-09-13T03:41:11.163830 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75812], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.095477751] seconds [----] I, [2016-09-13T03:41:11.164075 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75812], Delivering... [----] I, [2016-09-13T03:41:11.171696 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037801265716552734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038170814514160156, :pending_vm_jobs=>0.0009233951568603516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0070972442626953125} [----] I, [2016-09-13T03:41:11.172081 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75812], State: [ok], Delivered in [0.008002646] seconds [----] I, [2016-09-13T03:41:21.170018 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T03:41:23.092993 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:41:23.122201 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75813], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:41:23.133479 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75814], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:41:23.144867 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75815], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:41:23.162118 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75816], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:41:27.469487 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:41:27.476504 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00415492057800293, :worker_monitor=>1.2780416011810303, :worker_dequeue=>0.012397289276123047, :total_time=>1.2949192523956299} [----] I, [2016-09-13T03:41:27.545607 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75814], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.419301973] seconds [----] I, [2016-09-13T03:41:27.545851 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75814], Delivering... [----] I, [2016-09-13T03:41:27.585494 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75816], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.431890144] seconds [----] I, [2016-09-13T03:41:27.585729 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75816], Delivering... [----] I, [2016-09-13T03:41:27.593040 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038166046142578125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003845691680908203, :pending_vm_jobs=>0.0009555816650390625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006884336471557617} [----] I, [2016-09-13T03:41:27.593378 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75816], State: [ok], Delivered in [0.00765985] seconds [----] I, [2016-09-13T03:41:27.613832 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75814], State: [ok], Delivered in [0.067978437] seconds [----] I, [2016-09-13T03:41:27.620815 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75813], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.522669046] seconds [----] I, [2016-09-13T03:41:27.620992 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75813], Delivering... [----] I, [2016-09-13T03:41:27.626216 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75813], State: [ok], Delivered in [0.005207583] seconds [----] I, [2016-09-13T03:41:27.642344 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75815], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.503635624] seconds [----] I, [2016-09-13T03:41:27.642552 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75815], Delivering... [----] I, [2016-09-13T03:41:27.646045 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75815], State: [ok], Delivered in [0.003440805] seconds [----] I, [2016-09-13T03:41:32.477060 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:41:32 UTC]... [----] I, [2016-09-13T03:41:32.500548 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:41:32 UTC]...Complete [----] I, [2016-09-13T03:41:38.175873 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:41:38.192888 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75817], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:41:44.104556 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:41:44.108667 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005025386810302734, :worker_monitor=>1.4527983665466309, :worker_dequeue=>0.006770133972167969, :total_time=>1.4649767875671387} [----] I, [2016-09-13T03:41:44.363710 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75817], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.179884272] seconds [----] I, [2016-09-13T03:41:44.363882 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75817], Delivering... [----] I, [2016-09-13T03:41:44.368721 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002721548080444336, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002741098403930664, :pending_vm_jobs=>0.0005736351013183594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0045185089111328125} [----] I, [2016-09-13T03:41:44.369020 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75817], State: [ok], Delivered in [0.005133103] seconds [----] I, [2016-09-13T03:41:53.207752 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:41:53.219802 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75818], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:41:53.231031 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75819], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:41:54.146870 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:41:54.477039 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75819], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.25148913] seconds [----] I, [2016-09-13T03:41:54.477264 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75819], Delivering... [----] I, [2016-09-13T03:41:54.484349 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003738880157470703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003760099411010742, :pending_vm_jobs=>0.0008974075317382812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006618499755859375} [----] I, [2016-09-13T03:41:54.484782 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75819], State: [ok], Delivered in [0.007512813] seconds [----] I, [2016-09-13T03:41:54.739800 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75818], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.526740951] seconds [----] I, [2016-09-13T03:41:54.740025 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75818], Delivering... [----] I, [2016-09-13T03:41:54.746451 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75818], State: [ok], Delivered in [0.006377633] seconds [----] I, [2016-09-13T03:42:00.546081 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004591703414916992, :worker_monitor=>1.375321388244629, :worker_dequeue=>0.01114344596862793, :total_time=>1.391385555267334} [----] I, [2016-09-13T03:42:05.546594 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:42:05 UTC]... [----] I, [2016-09-13T03:42:05.574797 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:42:05 UTC]...Complete [----] I, [2016-09-13T03:42:08.242856 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:42:08.266258 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75820], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:42:10.601802 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:42:11.576014 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75820], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.327678165] seconds [----] I, [2016-09-13T03:42:11.576200 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75820], Delivering... [----] I, [2016-09-13T03:42:11.583007 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035872459411621094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036096572875976562, :pending_vm_jobs=>0.0008432865142822266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006406307220458984} [----] I, [2016-09-13T03:42:11.583360 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75820], State: [ok], Delivered in [0.007157114] seconds [----] I, [2016-09-13T03:42:16.664864 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007170677185058594, :worker_monitor=>1.0367772579193115, :worker_dequeue=>0.011410236358642578, :total_time=>1.0556378364562988} [----] I, [2016-09-13T03:42:23.280658 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:42:23.296215 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75821], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:42:23.307489 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75822], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:42:23.324694 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75823], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:42:23.341823 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75824], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:42:26.703640 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:42:27.713707 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75822], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.41365596] seconds [----] I, [2016-09-13T03:42:27.713893 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75822], Delivering... [----] I, [2016-09-13T03:42:27.719222 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75824], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.385345438] seconds [----] I, [2016-09-13T03:42:27.719461 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75824], Delivering... [----] I, [2016-09-13T03:42:27.727050 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004068851470947266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004091024398803711, :pending_vm_jobs=>0.0008890628814697266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007128000259399414} [----] I, [2016-09-13T03:42:27.727470 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75824], State: [ok], Delivered in [0.008010746] seconds [----] I, [2016-09-13T03:42:27.770588 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75822], State: [ok], Delivered in [0.056647362] seconds [----] I, [2016-09-13T03:42:27.827880 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75821], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.542007933] seconds [----] I, [2016-09-13T03:42:27.828111 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75821], Delivering... [----] I, [2016-09-13T03:42:27.834359 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75821], State: [ok], Delivered in [0.006242206] seconds [----] I, [2016-09-13T03:42:27.839116 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75823], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.526455729] seconds [----] I, [2016-09-13T03:42:27.839298 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75823], Delivering... [----] I, [2016-09-13T03:42:27.842673 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75823], State: [ok], Delivered in [0.003364497] seconds [----] I, [2016-09-13T03:42:33.024527 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004687786102294922, :worker_monitor=>1.2994146347045898, :worker_dequeue=>0.009105205535888672, :total_time=>1.3135273456573486} [----] I, [2016-09-13T03:42:38.025120 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:42:38 UTC]... [----] I, [2016-09-13T03:42:38.067848 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:42:38 UTC]...Complete [----] I, [2016-09-13T03:42:38.354283 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:42:38.370640 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75825], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:42:43.207692 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:42:43.862297 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75825], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.501237329] seconds [----] I, [2016-09-13T03:42:43.862590 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75825], Delivering... [----] I, [2016-09-13T03:42:43.869338 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034775733947753906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035011768341064453, :pending_vm_jobs=>0.0008223056793212891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063402652740478516} [----] I, [2016-09-13T03:42:43.869772 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75825], State: [ok], Delivered in [0.007202387] seconds [----] I, [2016-09-13T03:42:49.393014 #2763:34713c] INFO -- : MIQ(MiqServer#validate_worker) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [93], PID: [20377], GUID: [e54475e4-7974-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit [----] I, [2016-09-13T03:42:49.404294 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75826], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_uptime_exceeded", {:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [93], PID: [20377], GUID: [e54475e4-7974-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T03:42:49.404532 #2763:34713c] INFO -- : MIQ(MiqServer#stop_worker) Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [93], PID: [20377], GUID: [e54475e4-7974-11e6-87c1-fa163e7d01a3], status [started]... [----] I, [2016-09-13T03:42:49.415623 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75827], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [93], PID: [20377], GUID: [e54475e4-7974-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T03:42:49.431163 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [93], PID: [20377], GUID: [e54475e4-7974-11e6-87c1-fa163e7d01a3] is being requested to exit [----] I, [2016-09-13T03:42:49.664681 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:42:49.672856 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004745960235595703, :worker_monitor=>1.436415433883667, :worker_dequeue=>0.014542102813720703, :total_time=>1.4561705589294434} [----] I, [2016-09-13T03:42:52.026837 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75826], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_uptime_exceeded", {:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [93], PID: [20377], GUID: [e54475e4-7974-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [2.632040336] seconds [----] I, [2016-09-13T03:42:52.027071 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75826], Delivering... [----] I, [2016-09-13T03:42:52.033163 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75827], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [93], PID: [20377], GUID: [e54475e4-7974-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [2.627047041] seconds [----] I, [2016-09-13T03:42:52.033362 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75827], Delivering... [----] I, [2016-09-13T03:42:52.054940 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_uptime_exceeded"> inputs=<{:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [93], PID: [20377], GUID: [e54475e4-7974-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1066, :miq_event_id=>1066, "EventStream::event_stream"=>1066, :event_stream_id=>1066}> [----] I, [2016-09-13T03:42:52.060308 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_stop"> inputs=<{:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [93], PID: [20377], GUID: [e54475e4-7974-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1067, :miq_event_id=>1067, "EventStream::event_stream"=>1067, :event_stream_id=>1067}> [----] I, [2016-09-13T03:42:52.084797 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75828], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [93], PID: [20377], GUID: [e54475e4-7974-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1066, :miq_event_id=>1066, "EventStream::event_stream"=>1066, :event_stream_id=>1066}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T03:42:52.085203 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75826], State: [ok], Delivered in [0.058126207] seconds [----] I, [2016-09-13T03:42:52.090266 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75829], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [93], PID: [20377], GUID: [e54475e4-7974-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1067, :miq_event_id=>1067, "EventStream::event_stream"=>1067, :event_stream_id=>1067}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T03:42:52.090703 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75827], State: [ok], Delivered in [0.057333606] seconds [----] I, [2016-09-13T03:42:53.382109 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:42:53.398005 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75830], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:42:53.414885 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75831], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:42:54.682313 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:42:55.070794 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75828], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [93], PID: [20377], GUID: [e54475e4-7974-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1066, :miq_event_id=>1066, "EventStream::event_stream"=>1066, :event_stream_id=>1066}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [2.99972159] seconds [----] I, [2016-09-13T03:42:55.071031 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75828], Delivering... [----] I, [2016-09-13T03:42:55.072956 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [93], PID: [20377], GUID: [e54475e4-7974-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1066, :miq_event_id=>1066, "EventStream::event_stream"=>1066, :event_stream_id=>1066} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T03:42:55.077237 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1066&MiqEvent%3A%3Amiq_event=1066&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B93%5D%2C%20PID%3A%20%5B20377%5D%2C%20GUID%3A%20%5Be54475e4-7974-11e6-87c1-fa163e7d01a3%5D%20uptime%20has%20reached%20the%20interval%20of%207200%20seconds%2C%20requesting%20worker%20to%20exit&event_stream_id=1066&event_type=evm_worker_uptime_exceeded&miq_event_id=1066&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T03:42:55.079033 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75829], MiqWorker id: [16], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [93], PID: [20377], GUID: [e54475e4-7974-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1067, :miq_event_id=>1067, "EventStream::event_stream"=>1067, :event_stream_id=>1067}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [3.003202229] seconds [----] I, [2016-09-13T03:42:55.079263 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75829], Delivering... [----] I, [2016-09-13T03:42:55.081388 #2957:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [93], PID: [20377], GUID: [e54475e4-7974-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1067, :miq_event_id=>1067, "EventStream::event_stream"=>1067, :event_stream_id=>1067} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T03:42:55.087611 #2957:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1067&MiqEvent%3A%3Amiq_event=1067&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B93%5D%2C%20PID%3A%20%5B20377%5D%2C%20GUID%3A%20%5Be54475e4-7974-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1067&event_type=evm_worker_stop&miq_event_id=1067&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T03:42:55.100463 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1066&MiqEvent%3A%3Amiq_event=1066&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B93%5D%2C%20PID%3A%20%5B20377%5D%2C%20GUID%3A%20%5Be54475e4-7974-11e6-87c1-fa163e7d01a3%5D%20uptime%20has%20reached%20the%20interval%20of%207200%20seconds%2C%20requesting%20worker%20to%20exit&event_stream_id=1066&event_type=evm_worker_uptime_exceeded&miq_event_id=1066&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T03:42:55.123975 #2957:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1067&MiqEvent%3A%3Amiq_event=1067&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B93%5D%2C%20PID%3A%20%5B20377%5D%2C%20GUID%3A%20%5Be54475e4-7974-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1067&event_type=evm_worker_stop&miq_event_id=1067&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T03:42:55.152355 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75831], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.747272648] seconds [----] I, [2016-09-13T03:42:55.152594 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75831], Delivering... [----] I, [2016-09-13T03:42:55.157967 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75830], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.771982163] seconds [----] I, [2016-09-13T03:42:55.158211 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75830], Delivering... [----] I, [2016-09-13T03:42:55.160242 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003384828567504883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034024715423583984, :pending_vm_jobs=>0.0009491443634033203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007245779037475586} [----] I, [2016-09-13T03:42:55.160674 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75831], State: [ok], Delivered in [0.008091809] seconds [----] I, [2016-09-13T03:42:55.163536 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create] [----] I, [2016-09-13T03:42:55.164848 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75830], State: [ok], Delivered in [0.00666586] seconds [----] I, [2016-09-13T03:42:55.178092 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T03:42:55.192707 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T03:42:55.207262 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T03:42:55.211147 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T03:42:55.214921 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T03:42:55.223082 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T03:42:55.229101 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T03:42:55.232482 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 07:42:38", os_priority: 30, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 432046080, memory_size: 729399296, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 357917000, has_active_websocket: true>] [----] I, [2016-09-13T03:42:55.232689 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_uptime_exceeded] [----] I, [2016-09-13T03:42:55.235720 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T03:42:55.248737 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_uptime_exceeded] [----] I, [2016-09-13T03:42:55.248900 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_uptime_exceeded] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T03:42:55.254664 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T03:42:55.255050 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create] [----] I, [2016-09-13T03:42:55.255629 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75828], State: [ok], Delivered in [0.184618145] seconds [----] I, [2016-09-13T03:42:55.257650 #2957:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_stop] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T03:42:55.281016 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T03:42:55.286361 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T03:42:55.303305 #2957:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T03:42:55.311912 #2957:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T03:42:55.316627 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 07:42:38", os_priority: 30, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 432046080, memory_size: 729399296, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 357917000, has_active_websocket: true>] [----] I, [2016-09-13T03:42:55.316878 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_stop] [----] I, [2016-09-13T03:42:55.340207 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_stop] [----] I, [2016-09-13T03:42:55.340475 #2957:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_stop] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T03:42:55.348904 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T03:42:55.349477 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T03:42:55.350281 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75829], State: [ok], Delivered in [0.271014159] seconds [----] I, [2016-09-13T03:42:57.179665 #20377:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [93], PID [20377], GUID [e54475e4-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:42:47 UTC], Process Info: Memory Usage [592142336], Memory Size [1033908224], Proportional Set Size: [424848000], Memory % [7.22], CPU Time [1893.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T03:42:57.180212 #20377:34713c] INFO -- : EMS [livingontheedge.hawkular.org] as [jdoe] ID [93] PID [20377] GUID [e54475e4-7974-11e6-87c1-fa163e7d01a3] Exit request received. Worker exiting. [----] I, [2016-09-13T03:43:04.811032 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker.sync_workers) Workers are being synchronized: Current: ["ems_15"], Desired: ["ems_15", "ems_16"] [----] I, [2016-09-13T03:43:04.908089 #2763:34713c] INFO -- : :kill_algorithm: [----] I, [2016-09-13T03:43:04.908213 #2763:34713c] INFO -- : :name: :used_swap_percent_gt_value [----] I, [2016-09-13T03:43:04.908264 #2763:34713c] INFO -- : :value: 80 [----] I, [2016-09-13T03:43:04.908302 #2763:34713c] INFO -- : :miq_server_time_threshold: 120 [----] I, [2016-09-13T03:43:04.908337 #2763:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T03:43:04.908371 #2763:34713c] INFO -- : :poll: 2 [----] I, [2016-09-13T03:43:04.908519 #2763:34713c] INFO -- : :start_algorithm: [----] I, [2016-09-13T03:43:04.908579 #2763:34713c] INFO -- : :name: :used_swap_percent_lt_value [----] I, [2016-09-13T03:43:04.908620 #2763:34713c] INFO -- : :value: 60 [----] I, [2016-09-13T03:43:04.908653 #2763:34713c] INFO -- : :sync_interval: 1800 [----] I, [2016-09-13T03:43:04.908686 #2763:34713c] INFO -- : :wait_for_started_timeout: 600 [----] I, [2016-09-13T03:43:05.281513 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker.close_pg_sockets_inherited_from_parent) Closing socket: 21 [----] I, [2016-09-13T03:43:05.444950 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75832], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T03:43:05.445134 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#start) Worker started: ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3] [----] I, [2016-09-13T03:43:05.673721 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T03:43:05.674640 #28071:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T03:43:05.674702 #28071:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T03:43:05.674732 #28071:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T03:43:05.674757 #28071:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T03:43:05.674795 #28071:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T03:43:05.674824 #28071:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T03:43:05.674848 #28071:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T03:43:05.674884 #28071:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T03:43:05.674912 #28071:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T03:43:05.674933 #28071:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T03:43:05.674968 #28071:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T03:43:05.674993 #28071:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T03:43:05.675017 #28071:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T03:43:05.675060 #28071:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T03:43:05.675087 #28071:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T03:43:05.675110 #28071:34713c] INFO -- : --- [----] I, [2016-09-13T03:43:05.675393 #28071:34713c] INFO -- : :guid: b49c1882-7985-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T03:43:05.675470 #28071:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T03:43:06.161512 #28071:34713c] INFO -- : MIQ(AuthUseridPassword#validation_successful) [ExtManagementSystem] [16], previously valid/invalid on: [2016-09-13 05:42:52 UTC]/[], previous status: [Valid] [----] I, [2016-09-13T03:43:06.192767 #28071:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75833], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 16], "ems_auth_valid", {}] [----] I, [2016-09-13T03:43:06.593829 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:43:06.599847 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004080772399902344, :worker_monitor=>1.8783869743347168, :worker_dequeue=>0.010763883590698242, :total_time=>1.8935215473175049} [----] I, [2016-09-13T03:43:06.649260 #28071:34713c] INFO -- : ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner started. ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Zone [default], Role [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket] [----] I, [2016-09-13T03:43:06.649621 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_wait_for_worker_monitor) EMS [livingontheedge.hawkular.org] as [jdoe] Checking that worker monitor has started before doing work [----] I, [2016-09-13T03:43:06.653310 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_wait_for_worker_monitor) EMS [livingontheedge.hawkular.org] as [jdoe] Starting work since worker monitor has started [----] I, [2016-09-13T03:43:06.653391 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_before_work_loop) EMS [livingontheedge.hawkular.org] as [jdoe] Queueing initial refresh for EMS. [----] I, [2016-09-13T03:43:06.677908 #28071:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75834], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T03:43:06.680049 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#worker_monitor_drb) EMS [livingontheedge.hawkular.org] as [jdoe] Initializing DRb Connection to MiqServer with ID=[1], NAME=[EVM], PID=[2763], GUID=[36647afc-71a3-11e6-838a-fa163e68952f] DRb URI=[druby://127.0.0.1:41718] [----] I, [2016-09-13T03:43:07.221510 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75832], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [1.856685568] seconds [----] I, [2016-09-13T03:43:07.221716 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75832], Delivering... [----] I, [2016-09-13T03:43:07.227223 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75833], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 16], "ems_auth_valid", {}], Dequeued in: [1.044585154] seconds [----] I, [2016-09-13T03:43:07.227446 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75833], Delivering... [----] I, [2016-09-13T03:43:07.243843 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_start"> inputs=<{:event_details=>"Worker started: ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1068, :miq_event_id=>1068, "EventStream::event_stream"=>1068, :event_stream_id=>1068}> [----] I, [2016-09-13T03:43:07.249236 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"ems_auth_valid"> inputs=<{"MiqEvent::miq_event"=>1069, :miq_event_id=>1069, "EventStream::event_stream"=>1069, :event_stream_id=>1069}> [----] I, [2016-09-13T03:43:07.267542 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75835], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1068, :miq_event_id=>1068, "EventStream::event_stream"=>1068, :event_stream_id=>1068}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T03:43:07.267933 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75832], State: [ok], Delivered in [0.046192879] seconds [----] I, [2016-09-13T03:43:07.273160 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75836], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>16, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1069, :miq_event_id=>1069, "EventStream::event_stream"=>1069, :event_stream_id=>1069}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T03:43:07.273541 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75833], State: [ok], Delivered in [0.046132096] seconds [----] I, [2016-09-13T03:43:08.426366 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:43:08.443641 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75837], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:43:11.600394 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:43:11 UTC]... [----] I, [2016-09-13T03:43:11.615162 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:43:11 UTC]...Complete [----] I, [2016-09-13T03:43:11.625908 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:43:11.632163 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=3, priority=200 [----] I, [2016-09-13T03:43:12.479151 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75835], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1068, :miq_event_id=>1068, "EventStream::event_stream"=>1068, :event_stream_id=>1068}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [5.226449154] seconds [----] I, [2016-09-13T03:43:12.479324 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75835], Delivering... [----] I, [2016-09-13T03:43:12.481236 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1068, :miq_event_id=>1068, "EventStream::event_stream"=>1068, :event_stream_id=>1068} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T03:43:12.486207 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1068&MiqEvent%3A%3Amiq_event=1068&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B96%5D%2C%20PID%20%5B28071%5D%2C%20GUID%20%5Bb49c1882-7985-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1068&event_type=evm_worker_start&miq_event_id=1068&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T03:43:12.490670 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75836], MiqWorker id: [16], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>16, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1069, :miq_event_id=>1069, "EventStream::event_stream"=>1069, :event_stream_id=>1069}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [5.229955168] seconds [----] I, [2016-09-13T03:43:12.490839 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75836], Delivering... [----] I, [2016-09-13T03:43:12.492740 #2957:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1069, :miq_event_id=>1069, "EventStream::event_stream"=>1069, :event_stream_id=>1069} for object [ManageIQ::Providers::Hawkular::MiddlewareManager.16] with state [] to Automate [----] I, [2016-09-13T03:43:12.497879 #2957:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1069&ExtManagementSystem%3A%3Aext_management_system=16&MiqEvent%3A%3Amiq_event=1069&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1069&event_type=ems_auth_valid&miq_event_id=1069&object_name=Event&vmdb_object_type=ext_management_system] [----] I, [2016-09-13T03:43:12.514808 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1068&MiqEvent%3A%3Amiq_event=1068&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B96%5D%2C%20PID%20%5B28071%5D%2C%20GUID%20%5Bb49c1882-7985-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1068&event_type=evm_worker_start&miq_event_id=1068&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T03:43:12.526231 #2957:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1069&ExtManagementSystem%3A%3Aext_management_system=16&MiqEvent%3A%3Amiq_event=1069&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1069&event_type=ems_auth_valid&miq_event_id=1069&object_name=Event&vmdb_object_type=ext_management_system ManageIQ/System] [----] I, [2016-09-13T03:43:12.603498 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T03:43:12.608701 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T03:43:12.626995 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T03:43:12.629875 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T03:43:12.649852 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_start] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T03:43:12.650221 #2957:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/ems_auth_valid] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T03:43:12.669452 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T03:43:12.672147 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T03:43:12.674909 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T03:43:12.678094 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T03:43:12.691268 #2957:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T03:43:12.696877 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T03:43:12.699700 #2957:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T03:43:12.703857 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#] [----] I, [2016-09-13T03:43:12.704149 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [ems_auth_valid] [----] I, [2016-09-13T03:43:12.705838 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T03:43:12.710630 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 07:43:11", os_priority: 30, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 432046080, memory_size: 729399296, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 357917000, has_active_websocket: true>] [----] I, [2016-09-13T03:43:12.710993 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_start] [----] I, [2016-09-13T03:43:12.746718 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [ems_auth_valid] [----] I, [2016-09-13T03:43:12.746995 #2957:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [ems_auth_valid] Target: ManageIQ::Providers::Hawkular::MiddlewareManager Name: [Hawkular-Provider], Id: [16] [----] I, [2016-09-13T03:43:12.751960 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T03:43:12.752209 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_start] [----] I, [2016-09-13T03:43:12.752539 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T03:43:12.752547 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_start] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T03:43:12.753371 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75836], State: [ok], Delivered in [0.262515429] seconds [----] I, [2016-09-13T03:43:12.757366 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T03:43:12.758236 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T03:43:12.759106 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75835], State: [ok], Delivered in [0.27977196] seconds [----] I, [2016-09-13T03:43:12.792685 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75837], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.359525274] seconds [----] I, [2016-09-13T03:43:12.792948 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75837], Delivering... [----] I, [2016-09-13T03:43:12.801576 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0050525665283203125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005074262619018555, :pending_vm_jobs=>0.0012445449829101562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008142471313476562} [----] I, [2016-09-13T03:43:12.801921 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75837], State: [ok], Delivered in [0.008995812] seconds [----] I, [2016-09-13T03:43:16.648259 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=3, priority=200 [----] I, [2016-09-13T03:43:17.136079 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [75834], MiqWorker id: [96], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [10.470690081] seconds [----] I, [2016-09-13T03:43:17.136363 #28071:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75834], Delivering... [----] I, [2016-09-13T03:43:17.151812 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T03:43:17.152041 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T03:43:17.152203 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T03:43:17.152450 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T03:43:17.158178 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:22.814394 #2763:34713c] INFO -- : MIQ(MiqServer#clean_worker_records) SQL Record for Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [93], PID: [20377], GUID: [e54475e4-7974-11e6-87c1-fa163e7d01a3], Status: [stopped] is being deleted [----] I, [2016-09-13T03:43:23.142583 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005991935729980469, :worker_monitor=>1.475529432296753, :worker_dequeue=>0.011769533157348633, :total_time=>1.4937121868133545} [----] I, [2016-09-13T03:43:23.456081 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T03:43:23.480215 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75838], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:43:23.518583 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75839], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:43:23.535811 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75840], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:43:23.564754 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75841], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:43:23.581094 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75842], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:43:23.609790 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75843], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:43:23.619141 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:23.924795 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:23.925001 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:24.417050 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:24.714054 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:24.714259 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:25.204389 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:25.500602 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:25.500814 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:25.976584 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:26.292216 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:26.292459 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:26.765894 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:27.064905 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:27.065226 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:27.572523 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:28.153086 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:43:28.352938 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75838], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.88966267] seconds [----] I, [2016-09-13T03:43:28.353143 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [75838], Delivering... [----] I, [2016-09-13T03:43:28.354399 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T03:43:28.354666 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5312630784 [----] I, [2016-09-13T03:43:28.354774 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5100666880 [----] I, [2016-09-13T03:43:28.354857 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 211963904 [----] I, [2016-09-13T03:43:28.354936 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1310720000 [----] I, [2016-09-13T03:43:28.355008 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5047017472 [----] I, [2016-09-13T03:43:28.355089 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T03:43:28.355194 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T03:43:28.355282 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 532406272 [----] I, [2016-09-13T03:43:28.355355 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T03:43:28.355457 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7826710528 [----] I, [2016-09-13T03:43:28.355571 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T03:43:28.355662 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T03:43:28.355736 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T03:43:28.355811 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 12288 [----] I, [2016-09-13T03:43:28.355886 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T03:43:28.355962 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T03:43:28.356034 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T03:43:28.356107 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T03:43:28.356195 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T03:43:28.356275 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T03:43:28.356344 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272932864 [----] I, [2016-09-13T03:43:28.356442 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56135680 [----] I, [2016-09-13T03:43:28.356540 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216797184 [----] I, [2016-09-13T03:43:28.356637 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6225920 [----] I, [2016-09-13T03:43:28.356709 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140275712 [----] I, [2016-09-13T03:43:28.356775 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2622001152 [----] I, [2016-09-13T03:43:28.356848 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2315083776 [----] I, [2016-09-13T03:43:28.356915 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T03:43:28.356990 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T03:43:28.357067 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T03:43:28.357142 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37507072 [----] I, [2016-09-13T03:43:28.357217 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102277120 [----] I, [2016-09-13T03:43:28.357292 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53018624 [----] I, [2016-09-13T03:43:28.357365 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 109867008 [----] I, [2016-09-13T03:43:28.357474 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155295744 [----] I, [2016-09-13T03:43:28.357593 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T03:43:28.357677 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T03:43:28.357754 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T03:43:28.357826 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T03:43:28.357909 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T03:43:28.357996 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T03:43:28.358069 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T03:43:28.358148 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T03:43:28.358233 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T03:43:28.358694 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75839], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.871578935] seconds [----] I, [2016-09-13T03:43:28.358901 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [75839], Delivering... [----] I, [2016-09-13T03:43:28.367467 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:43:22 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200498000], Memory % [3.36], CPU Time [147366.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T03:43:28.368048 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:43:21 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347146000], Memory % [5.04], CPU Time [102663.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T03:43:28.368814 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:43:21 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169064000], Memory % [3.14], CPU Time [50062.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T03:43:28.369374 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:43:08 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205289000], Memory % [3.5], CPU Time [232934.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T03:43:28.369896 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:43:19 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212538000], Memory % [3.5], CPU Time [47788.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T03:43:28.370513 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:43:19 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162408000], Memory % [3.1], CPU Time [36906.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T03:43:28.371152 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:43:22 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358680000], Memory % [5.28], CPU Time [195344.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T03:43:28.371741 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:43:22 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202017000], Memory % [3.38], CPU Time [146433.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T03:43:28.375158 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:43:17 UTC], Process Info: Memory Usage [584933376], Memory Size [915906560], Proportional Set Size: [420954000], Memory % [7.13], CPU Time [139.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T03:43:28.377741 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [95], PID [22463], GUID [db78f78e-7978-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:43:12 UTC], Process Info: Memory Usage [582459392], Memory Size [910184448], Proportional Set Size: [421811000], Memory % [7.1], CPU Time [938.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T03:43:28.380211 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:43:13 UTC], Process Info: Memory Usage [557678592], Memory Size [894844928], Proportional Set Size: [405222000], Memory % [6.8], CPU Time [4167.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T03:43:28.382696 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:43:15 UTC], Process Info: Memory Usage [580468736], Memory Size [909148160], Proportional Set Size: [419761000], Memory % [7.08], CPU Time [804.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T03:43:28.383335 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:43:22 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357916000], Memory % [5.27], CPU Time [205456.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T03:43:28.383935 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:43:21 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177788000], Memory % [3.2], CPU Time [50085.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T03:43:28.384453 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:43:15 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165791000], Memory % [3.16], CPU Time [37771.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T03:43:28.384880 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [75839], State: [ok], Delivered in [0.025993777] seconds [----] I, [2016-09-13T03:43:28.415992 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75841], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.872761558] seconds [----] I, [2016-09-13T03:43:28.416211 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75841], Delivering... [----] I, [2016-09-13T03:43:28.425891 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T03:43:28.426151 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T03:43:28.430548 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T03:43:28.434410 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T03:43:28.438053 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T03:43:28.441403 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T03:43:28.445147 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T03:43:28.448805 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 834 MB 1.18 GB 41% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T03:43:28.451940 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T03:43:28.455675 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T03:43:28.459212 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T03:43:28.462687 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T03:43:28.466161 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 173 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T03:43:28.469674 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T03:43:28.472966 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{"ems_inventory"=>1, nil=>2}} [----] I, [2016-09-13T03:43:28.473166 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T03:43:28.473293 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1, nil=>2, "smartstate"=>1}} [----] I, [2016-09-13T03:43:28.478341 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [146373.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T03:43:28.478893 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [75838], State: [ok], Delivered in [0.125711816] seconds [----] I, [2016-09-13T03:43:28.502648 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75841], State: [ok], Delivered in [0.086377693] seconds [----] I, [2016-09-13T03:43:28.530298 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75843], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.939690497] seconds [----] I, [2016-09-13T03:43:28.530540 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75843], Delivering... [----] I, [2016-09-13T03:43:28.535867 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75840], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.010846448] seconds [----] I, [2016-09-13T03:43:28.536047 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75840], Delivering... [----] I, [2016-09-13T03:43:28.537898 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038993358612060547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0039250850677490234, :pending_vm_jobs=>0.0009369850158691406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006846427917480469} [----] I, [2016-09-13T03:43:28.538292 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75843], State: [ok], Delivered in [0.007758724] seconds [----] I, [2016-09-13T03:43:28.541315 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75840], State: [ok], Delivered in [0.005259789] seconds [----] I, [2016-09-13T03:43:28.564583 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75842], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.993403117] seconds [----] I, [2016-09-13T03:43:28.564841 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75842], Delivering... [----] I, [2016-09-13T03:43:28.568867 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75842], State: [ok], Delivered in [0.004017562] seconds [----] I, [2016-09-13T03:43:29.339937 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:29.340153 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:29.823608 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:30.131395 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:30.131655 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:30.605952 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:30.901660 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:30.901854 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:31.413957 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:31.722585 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:31.722799 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:32.215630 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:32.529760 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:32.529971 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:33.005502 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:33.323994 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:33.324202 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:33.813016 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:34.110042 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:34.110268 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:34.595043 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:34.743873 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:34.879287 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:35.020054 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:35.155921 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:35.292358 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:35.428891 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:35.569590 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:35.706578 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:35.845312 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:35.978179 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:36.114333 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:36.254275 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:36.392125 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:36.818302 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:36.996887 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:37.138590 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:37.286310 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:37.422876 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:37.585577 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:37.730497 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:37.871784 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:38.011730 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:38.162970 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:38.302996 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:38.449354 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:38.593771 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:38.629716 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:43:38.684267 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75844], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:43:38.728006 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:38.865080 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:39.003385 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:39.144383 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:39.545008 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:39.708250 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:39.907006 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:43:39.917219 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004018306732177734, :server_monitor=>0.09893655776977539, :worker_monitor=>1.6215932369232178, :worker_dequeue=>0.015566349029541016, :total_time=>1.7404696941375732} [----] I, [2016-09-13T03:43:39.947852 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75844], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.308046781] seconds [----] I, [2016-09-13T03:43:39.948106 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75844], Delivering... [----] I, [2016-09-13T03:43:39.958411 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0052568912506103516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00529026985168457, :pending_vm_jobs=>0.0014004707336425781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009757280349731445} [----] I, [2016-09-13T03:43:39.958921 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75844], State: [ok], Delivered in [0.010806224] seconds [----] I, [2016-09-13T03:43:44.917797 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:43:44 UTC]... [----] I, [2016-09-13T03:43:44.935400 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:43:44 UTC]...Complete [----] I, [2016-09-13T03:43:45.860655 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:46.008236 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:46.162101 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:46.295989 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:46.436948 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:46.595774 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:46.737870 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:46.882505 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:47.026711 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:47.174922 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:47.323278 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:47.466440 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:47.611843 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:47.755792 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:47.896889 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:48.259331 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:48.410914 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:48.550059 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:48.691989 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:48.832278 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:48.987607 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:49.127731 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:49.273004 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:49.453995 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:49.600200 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:49.753665 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:49.893090 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:50.029387 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:50.164883 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:50.314752 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:50.454939 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:50.597688 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:50.999791 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:51.153830 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:51.290082 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:51.433346 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:51.589364 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:51.726186 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:51.865840 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:52.007591 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:52.149763 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:52.288849 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:52.426482 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:52.571666 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:52.710609 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:52.856922 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:52.997470 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:53.136518 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:53.281830 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:53.553494 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:53.696697 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:43:53.722137 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:53.736011 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75845], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:43:53.758820 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75846], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:43:53.861526 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:54.042846 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:54.182063 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:54.331632 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:54.469071 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:54.609030 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:54.749943 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:54.886871 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:55.031855 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:55.169698 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:55.305929 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:55.445823 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:55.589061 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:55.725399 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:55.870664 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:56.164201 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:43:56.170701 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003849506378173828, :worker_monitor=>1.1885104179382324, :worker_dequeue=>0.01151895523071289, :total_time=>1.2042021751403809} [----] I, [2016-09-13T03:43:56.264353 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:56.427281 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:56.572832 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:56.724468 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:43:57.084755 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75846], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.342749023] seconds [----] I, [2016-09-13T03:43:57.084990 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75846], Delivering... [----] I, [2016-09-13T03:43:57.092660 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003885507583618164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003911256790161133, :pending_vm_jobs=>0.0010476112365722656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007208585739135742} [----] I, [2016-09-13T03:43:57.093068 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75846], State: [ok], Delivered in [0.008087925] seconds [----] I, [2016-09-13T03:43:58.667782 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75845], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.966184486] seconds [----] I, [2016-09-13T03:43:58.667989 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75845], Delivering... [----] I, [2016-09-13T03:43:58.673276 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75845], State: [ok], Delivered in [0.005266698] seconds [----] I, [2016-09-13T03:44:02.885352 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:03.024871 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:03.164221 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:03.305015 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:03.446377 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:03.629763 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:03.768676 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:03.902185 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:04.043397 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:04.185098 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:04.327711 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:04.478764 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:04.629905 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:04.987076 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:05.139960 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:05.282674 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:05.424084 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:05.563619 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:05.704243 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:05.845163 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:05.986592 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:06.129219 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:06.271634 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:06.413593 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:06.555748 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:06.697486 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:06.841542 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:06.978780 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:07.121601 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:07.464690 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:07.911009 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:08.055593 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:08.198573 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:08.341300 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:08.478655 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:08.635960 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:08.772714 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:44:08.779952 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:08.795314 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75847], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:44:08.924950 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:09.066742 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:09.208057 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:09.351464 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:09.495981 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:09.668288 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:09.806703 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:09.945435 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:10.095506 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:10.242008 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:10.626568 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:10.785019 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:10.924453 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:11.062511 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:11.203236 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:11.346161 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:11.483455 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:11.619759 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:11.758622 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:11.895159 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:12.031587 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:12.182775 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:12.328962 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:12.382053 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:44:12.385693 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003452777862548828, :worker_monitor=>1.1744635105133057, :worker_dequeue=>0.00652623176574707, :total_time=>1.1847059726715088} [----] I, [2016-09-13T03:44:12.471455 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:12.610476 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:12.744154 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:12.881652 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:13.198548 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75847], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.418212316] seconds [----] I, [2016-09-13T03:44:13.198860 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75847], Delivering... [----] I, [2016-09-13T03:44:13.205724 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037009716033935547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037224292755126953, :pending_vm_jobs=>0.0008215904235839844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006444692611694336} [----] I, [2016-09-13T03:44:13.206101 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75847], State: [ok], Delivered in [0.007245314] seconds [----] I, [2016-09-13T03:44:13.372666 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:13.521981 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:13.663943 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:17.386405 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:44:17 UTC]... [----] I, [2016-09-13T03:44:17.403547 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:44:17 UTC]...Complete [----] I, [2016-09-13T03:44:19.824037 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:19.967105 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:20.108889 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:20.255895 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:20.396837 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:20.538539 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:20.681353 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:20.822548 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:20.965164 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:21.104516 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:21.247144 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:21.390376 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:21.528313 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:21.673839 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:22.012727 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:22.166297 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:22.302757 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:22.442572 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:22.644319 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:22.784060 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:22.932715 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:23.079891 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:23.218970 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:23.358339 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:23.499236 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:23.635633 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:23.771296 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:23.915920 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:24.056472 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:24.161897 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:44:24.197655 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:24.227023 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75848], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:44:24.250053 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75849], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:44:24.272488 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75850], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:44:24.295130 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75851], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:44:24.333634 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:24.799067 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:24.959876 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:25.102189 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:25.248382 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:25.393921 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:25.540239 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:25.675812 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:25.823527 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:25.965921 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:26.122056 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:26.266244 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:26.418712 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:26.554528 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:26.695378 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:26.837021 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:26.973360 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:44:27.112770 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T03:44:27.308395 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T03:44:27.309031 #28071:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T03:44:27.309589 #28071:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T03:44:27.309800 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T03:44:27.310063 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T03:44:27.357997 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T03:44:27.358513 #28071:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [75834], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T03:44:27.358891 #28071:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T03:44:27.359151 #28071:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T03:44:27.359411 #28071:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75834], State: [error], Delivered in [70.223079958] seconds [----] I, [2016-09-13T03:44:28.913850 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:44:28.919242 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004082918167114258, :worker_monitor=>1.4565088748931885, :worker_dequeue=>0.009967803955078125, :total_time=>1.4709224700927734} [----] I, [2016-09-13T03:44:29.284079 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75849], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.051185358] seconds [----] I, [2016-09-13T03:44:29.284256 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75849], Delivering... [----] I, [2016-09-13T03:44:29.329676 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75849], State: [ok], Delivered in [0.045386439] seconds [----] I, [2016-09-13T03:44:29.342541 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75851], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.055371056] seconds [----] I, [2016-09-13T03:44:29.342761 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75851], Delivering... [----] I, [2016-09-13T03:44:29.348503 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031561851501464844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031747817993164062, :pending_vm_jobs=>0.0007188320159912109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0053708553314208984} [----] I, [2016-09-13T03:44:29.348843 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75851], State: [ok], Delivered in [0.00607614] seconds [----] I, [2016-09-13T03:44:31.792542 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75848], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.584349253] seconds [----] I, [2016-09-13T03:44:31.792776 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75848], Delivering... [----] I, [2016-09-13T03:44:31.797681 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75848], State: [ok], Delivered in [0.004882272] seconds [----] I, [2016-09-13T03:44:31.804084 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75850], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.544725648] seconds [----] I, [2016-09-13T03:44:31.804291 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75850], Delivering... [----] I, [2016-09-13T03:44:31.808307 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75850], State: [ok], Delivered in [0.004015947] seconds [----] I, [2016-09-13T03:44:39.308775 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:44:39.323933 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75852], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:44:45.455291 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:44:45.459579 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006562232971191406, :worker_monitor=>1.3718323707580566, :worker_dequeue=>0.007641315460205078, :total_time=>1.386326551437378} [----] I, [2016-09-13T03:44:45.489659 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75852], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.175192451] seconds [----] I, [2016-09-13T03:44:45.489789 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75852], Delivering... [----] I, [2016-09-13T03:44:45.494181 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022735595703125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022881031036376953, :pending_vm_jobs=>0.0005776882171630859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004138469696044922} [----] I, [2016-09-13T03:44:45.494474 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75852], State: [ok], Delivered in [0.00467488] seconds [----] I, [2016-09-13T03:44:50.460197 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:44:50 UTC]... [----] I, [2016-09-13T03:44:50.485383 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:44:50 UTC]...Complete [----] I, [2016-09-13T03:44:54.337724 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:44:54.352735 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75853], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:44:54.363958 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75854], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:44:55.512916 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:44:55.564323 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75854], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.205997401] seconds [----] I, [2016-09-13T03:44:55.564594 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75854], Delivering... [----] I, [2016-09-13T03:44:55.571786 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037665367126464844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037894248962402344, :pending_vm_jobs=>0.0009336471557617188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006761074066162109} [----] I, [2016-09-13T03:44:55.572180 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75854], State: [ok], Delivered in [0.007623589] seconds [----] I, [2016-09-13T03:44:55.907141 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75853], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.564762807] seconds [----] I, [2016-09-13T03:44:55.907347 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75853], Delivering... [----] I, [2016-09-13T03:44:55.912220 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75853], State: [ok], Delivered in [0.004854437] seconds [----] I, [2016-09-13T03:45:01.971004 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004503011703491211, :worker_monitor=>1.4391860961914062, :worker_dequeue=>0.009348154067993164, :total_time=>1.45340895652771} [----] I, [2016-09-13T03:45:09.376582 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:45:09.392908 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75855], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:45:11.998158 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:45:12.696517 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75855], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.312990045] seconds [----] I, [2016-09-13T03:45:12.696850 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75855], Delivering... [----] I, [2016-09-13T03:45:12.706625 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0053331851959228516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005362749099731445, :pending_vm_jobs=>0.0012438297271728516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009088754653930664} [----] I, [2016-09-13T03:45:12.707123 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75855], State: [ok], Delivered in [0.010295687] seconds [----] I, [2016-09-13T03:45:18.192039 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003266572952270508, :worker_monitor=>1.171375036239624, :worker_dequeue=>0.011847734451293945, :total_time=>1.1867527961730957} [----] I, [2016-09-13T03:45:23.192817 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:45:23 UTC]... [----] I, [2016-09-13T03:45:23.222318 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:45:23 UTC]...Complete [----] I, [2016-09-13T03:45:24.408293 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:45:24.427633 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75856], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:45:24.444880 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75857], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:45:24.461974 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75858], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:45:24.490514 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75859], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:45:28.253048 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:45:28.805023 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75857], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.372998647] seconds [----] I, [2016-09-13T03:45:28.805289 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75857], Delivering... [----] I, [2016-09-13T03:45:28.862003 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75859], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.389671314] seconds [----] I, [2016-09-13T03:45:28.862167 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75859], Delivering... [----] I, [2016-09-13T03:45:28.867620 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028748512268066406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028913021087646484, :pending_vm_jobs=>0.0006916522979736328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005137443542480469} [----] I, [2016-09-13T03:45:28.867949 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75859], State: [ok], Delivered in [0.005776053] seconds [----] I, [2016-09-13T03:45:28.879101 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75857], State: [ok], Delivered in [0.073804645] seconds [----] I, [2016-09-13T03:45:29.012757 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75856], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.5965331] seconds [----] I, [2016-09-13T03:45:29.013109 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75856], Delivering... [----] I, [2016-09-13T03:45:29.019177 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75856], State: [ok], Delivered in [0.006107368] seconds [----] I, [2016-09-13T03:45:29.033715 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75858], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.582464055] seconds [----] I, [2016-09-13T03:45:29.033911 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75858], Delivering... [----] I, [2016-09-13T03:45:29.041328 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75858], State: [ok], Delivered in [0.007408707] seconds [----] I, [2016-09-13T03:45:34.594140 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030159950256347656, :worker_monitor=>1.321079969406128, :worker_dequeue=>0.011483192443847656, :total_time=>1.335874319076538} [----] I, [2016-09-13T03:45:39.504983 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:45:39.521450 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75860], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:45:39.715611 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:45:39.996346 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75860], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.484223239] seconds [----] I, [2016-09-13T03:45:39.996543 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75860], Delivering... [----] I, [2016-09-13T03:45:40.002748 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033915042877197266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034093856811523438, :pending_vm_jobs=>0.0007610321044921875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005867481231689453} [----] I, [2016-09-13T03:45:40.003076 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75860], State: [ok], Delivered in [0.006532035] seconds [----] I, [2016-09-13T03:45:51.196341 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004225015640258789, :worker_monitor=>1.4334490299224854, :worker_dequeue=>0.008114814758300781, :total_time=>1.4460563659667969} [----] I, [2016-09-13T03:45:54.533353 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:45:54.551143 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75861], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:45:54.561193 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75862], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:45:56.196851 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:45:56 UTC]... [----] I, [2016-09-13T03:45:56.212723 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:45:56 UTC]...Complete [----] I, [2016-09-13T03:45:56.222489 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:45:57.110252 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75862], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.553749536] seconds [----] I, [2016-09-13T03:45:57.110511 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75862], Delivering... [----] I, [2016-09-13T03:45:57.116837 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003365039825439453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003386974334716797, :pending_vm_jobs=>0.0007641315460205078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005919694900512695} [----] I, [2016-09-13T03:45:57.117206 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75862], State: [ok], Delivered in [0.006695333] seconds [----] I, [2016-09-13T03:45:59.173674 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75861], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.635455925] seconds [----] I, [2016-09-13T03:45:59.173980 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75861], Delivering... [----] I, [2016-09-13T03:45:59.180301 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75861], State: [ok], Delivered in [0.006345439] seconds [----] I, [2016-09-13T03:46:07.644507 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00439906120300293, :worker_monitor=>1.3890223503112793, :worker_dequeue=>0.006808280944824219, :total_time=>1.4005720615386963} [----] I, [2016-09-13T03:46:09.572510 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:46:09.593401 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75863], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:46:12.655133 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:46:13.268333 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75863], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.688978484] seconds [----] I, [2016-09-13T03:46:13.268624 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75863], Delivering... [----] I, [2016-09-13T03:46:13.275666 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003817319869995117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038378238677978516, :pending_vm_jobs=>0.0008711814880371094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006567716598510742} [----] I, [2016-09-13T03:46:13.276075 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75863], State: [ok], Delivered in [0.007475487] seconds [----] I, [2016-09-13T03:46:22.693997 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T03:46:24.110872 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004677534103393555, :log_active_servers=>0.012777090072631836, :worker_monitor=>1.4054601192474365, :worker_dequeue=>0.011030435562133789, :total_time=>1.4343340396881104} [----] I, [2016-09-13T03:46:24.605233 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:46:24.622267 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75864], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:46:24.633584 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75865], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:46:24.644966 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75866], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:46:24.662169 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75867], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:46:29.111347 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:46:29 UTC]... [----] I, [2016-09-13T03:46:29.126232 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:46:29 UTC]...Complete [----] I, [2016-09-13T03:46:29.134059 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:46:29.245202 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75865], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.619113897] seconds [----] I, [2016-09-13T03:46:29.245350 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75865], Delivering... [----] I, [2016-09-13T03:46:29.279740 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75867], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.62595362] seconds [----] I, [2016-09-13T03:46:29.279919 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75867], Delivering... [----] I, [2016-09-13T03:46:29.286459 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035026073455810547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035352706909179688, :pending_vm_jobs=>0.00078582763671875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00613856315612793} [----] I, [2016-09-13T03:46:29.286826 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75867], State: [ok], Delivered in [0.006893406] seconds [----] I, [2016-09-13T03:46:29.302362 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75865], State: [ok], Delivered in [0.056980108] seconds [----] I, [2016-09-13T03:46:29.326224 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75864], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.716319781] seconds [----] I, [2016-09-13T03:46:29.326452 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75864], Delivering... [----] I, [2016-09-13T03:46:29.330974 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75864], State: [ok], Delivered in [0.004534784] seconds [----] I, [2016-09-13T03:46:29.336649 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75866], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.697982632] seconds [----] I, [2016-09-13T03:46:29.336818 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75866], Delivering... [----] I, [2016-09-13T03:46:29.339856 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75866], State: [ok], Delivered in [0.003032545] seconds [----] I, [2016-09-13T03:46:39.675646 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:46:39.690893 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75868], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:46:40.458033 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:46:40.464092 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004358768463134766, :worker_monitor=>1.2966010570526123, :worker_dequeue=>0.010732173919677734, :total_time=>1.3119966983795166} [----] I, [2016-09-13T03:46:41.382602 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75868], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.700638282] seconds [----] I, [2016-09-13T03:46:41.382793 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75868], Delivering... [----] I, [2016-09-13T03:46:41.388988 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032079219818115234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032300949096679688, :pending_vm_jobs=>0.0007920265197753906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058498382568359375} [----] I, [2016-09-13T03:46:41.389336 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75868], State: [ok], Delivered in [0.006533753] seconds [----] I, [2016-09-13T03:46:54.706774 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:46:54.725710 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75869], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:46:54.754358 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75870], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:46:57.051260 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:46:57.056002 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0047762393951416016, :worker_monitor=>1.432457685470581, :worker_dequeue=>0.008321046829223633, :total_time=>1.4459545612335205} [----] I, [2016-09-13T03:46:57.595277 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75870], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.863837295] seconds [----] I, [2016-09-13T03:46:57.595532 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75870], Delivering... [----] I, [2016-09-13T03:46:57.602111 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003369569778442383, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003388643264770508, :pending_vm_jobs=>0.0008420944213867188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006134986877441406} [----] I, [2016-09-13T03:46:57.602503 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75870], State: [ok], Delivered in [0.006973782] seconds [----] I, [2016-09-13T03:46:59.480404 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75869], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.767529866] seconds [----] I, [2016-09-13T03:46:59.480705 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75869], Delivering... [----] I, [2016-09-13T03:46:59.486375 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75869], State: [ok], Delivered in [0.00567231] seconds [----] I, [2016-09-13T03:47:02.056614 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:47:02 UTC]... [----] I, [2016-09-13T03:47:02.074004 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:47:02 UTC]...Complete [----] I, [2016-09-13T03:47:09.766712 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:47:09.800742 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75871], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:47:13.601709 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:47:13.606410 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0047588348388671875, :worker_monitor=>1.4840443134307861, :worker_dequeue=>0.008643627166748047, :total_time=>1.4978392124176025} [----] I, [2016-09-13T03:47:13.723907 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75871], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.946999685] seconds [----] I, [2016-09-13T03:47:13.724157 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75871], Delivering... [----] I, [2016-09-13T03:47:13.731642 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004027843475341797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004050254821777344, :pending_vm_jobs=>0.0009133815765380859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0069963932037353516} [----] I, [2016-09-13T03:47:13.732043 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75871], State: [ok], Delivered in [0.007886085] seconds [----] I, [2016-09-13T03:47:24.816187 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:47:24.848180 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75872], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:47:24.875459 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75873], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:47:24.892754 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75874], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:47:24.904009 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75875], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:47:29.947693 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:47:29.954307 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004008293151855469, :worker_monitor=>1.2964518070220947, :worker_dequeue=>0.012685775756835938, :total_time=>1.3135173320770264} [----] I, [2016-09-13T03:47:30.834709 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75873], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.983787292] seconds [----] I, [2016-09-13T03:47:30.834897 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75873], Delivering... [----] I, [2016-09-13T03:47:30.882176 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75875], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.98459423] seconds [----] I, [2016-09-13T03:47:30.882383 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75875], Delivering... [----] I, [2016-09-13T03:47:30.887713 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75873], State: [ok], Delivered in [0.052788858] seconds [----] I, [2016-09-13T03:47:30.889236 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003536224365234375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003559112548828125, :pending_vm_jobs=>0.0008795261383056641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00642085075378418} [----] I, [2016-09-13T03:47:30.889611 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75875], State: [ok], Delivered in [0.007199731] seconds [----] I, [2016-09-13T03:47:32.556655 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75872], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.735871361] seconds [----] I, [2016-09-13T03:47:32.556848 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75872], Delivering... [----] I, [2016-09-13T03:47:32.561564 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75872], State: [ok], Delivered in [0.004696804] seconds [----] I, [2016-09-13T03:47:32.594754 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75874], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.71620013] seconds [----] I, [2016-09-13T03:47:32.594916 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75874], Delivering... [----] I, [2016-09-13T03:47:32.597840 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75874], State: [ok], Delivered in [0.002896071] seconds [----] I, [2016-09-13T03:47:34.954860 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:47:34 UTC]... [----] I, [2016-09-13T03:47:34.973458 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:47:34 UTC]...Complete [----] I, [2016-09-13T03:47:39.912355 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:47:39.933827 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75876], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:47:40.005946 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:47:41.008148 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75876], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.089702696] seconds [----] I, [2016-09-13T03:47:41.008488 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75876], Delivering... [----] I, [2016-09-13T03:47:41.019496 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005878925323486328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005909442901611328, :pending_vm_jobs=>0.0014312267303466797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010375499725341797} [----] I, [2016-09-13T03:47:41.020050 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75876], State: [ok], Delivered in [0.011581064] seconds [----] I, [2016-09-13T03:47:46.588864 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003907680511474609, :worker_monitor=>1.5598676204681396, :worker_dequeue=>0.00812077522277832, :total_time=>1.572157382965088} [----] I, [2016-09-13T03:47:54.947641 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:47:54.961529 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75877], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:47:54.974032 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75878], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:47:56.724908 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:47:57.110804 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75878], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.143788183] seconds [----] I, [2016-09-13T03:47:57.111020 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75878], Delivering... [----] I, [2016-09-13T03:47:57.117828 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036995410919189453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037202835083007812, :pending_vm_jobs=>0.0008280277252197266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006378173828125} [----] I, [2016-09-13T03:47:57.118211 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75878], State: [ok], Delivered in [0.00718513] seconds [----] I, [2016-09-13T03:47:59.699199 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75877], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.746555174] seconds [----] I, [2016-09-13T03:47:59.699378 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75877], Delivering... [----] I, [2016-09-13T03:47:59.703853 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75877], State: [ok], Delivered in [0.004473636] seconds [----] I, [2016-09-13T03:48:03.415666 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004639148712158203, :worker_monitor=>1.6657147407531738, :worker_dequeue=>0.012607336044311523, :total_time=>1.68336820602417} [----] I, [2016-09-13T03:48:08.416288 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:48:08 UTC]... [----] I, [2016-09-13T03:48:08.442114 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:48:08 UTC]...Complete [----] I, [2016-09-13T03:48:09.987657 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:48:10.014579 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75879], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:48:13.471370 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:48:14.311688 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75879], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.316859564] seconds [----] I, [2016-09-13T03:48:14.311880 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75879], Delivering... [----] I, [2016-09-13T03:48:14.318004 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031282901763916016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032460689544677734, :pending_vm_jobs=>0.0007491111755371094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005751371383666992} [----] I, [2016-09-13T03:48:14.318351 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75879], State: [ok], Delivered in [0.00645644] seconds [----] I, [2016-09-13T03:48:20.034855 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003968238830566406, :worker_monitor=>1.537604808807373, :worker_dequeue=>0.01161813735961914, :total_time=>1.5535423755645752} [----] I, [2016-09-13T03:48:25.027274 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T03:48:25.037290 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75880], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:48:25.045120 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:48:25.048503 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75881], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:48:25.060051 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75882], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:48:25.071595 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75883], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:48:25.082949 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75884], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:48:25.100112 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75885], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:48:25.340273 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75880], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.308385729] seconds [----] I, [2016-09-13T03:48:25.340456 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [75880], Delivering... [----] I, [2016-09-13T03:48:25.341472 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T03:48:25.341673 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5322448896 [----] I, [2016-09-13T03:48:25.341764 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5110243328 [----] I, [2016-09-13T03:48:25.341836 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 212205568 [----] I, [2016-09-13T03:48:25.341903 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1310720000 [----] I, [2016-09-13T03:48:25.341970 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5056557056 [----] I, [2016-09-13T03:48:25.342033 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T03:48:25.342113 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T03:48:25.342202 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 532623360 [----] I, [2016-09-13T03:48:25.342269 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T03:48:25.342340 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7930015744 [----] I, [2016-09-13T03:48:25.342407 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T03:48:25.342519 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T03:48:25.342610 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T03:48:25.342676 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 20480 [----] I, [2016-09-13T03:48:25.342746 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T03:48:25.342812 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T03:48:25.342876 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T03:48:25.342938 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T03:48:25.343016 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T03:48:25.343084 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T03:48:25.343145 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272928768 [----] I, [2016-09-13T03:48:25.343211 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56123392 [----] I, [2016-09-13T03:48:25.343274 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216805376 [----] I, [2016-09-13T03:48:25.343337 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6225920 [----] I, [2016-09-13T03:48:25.343401 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140275712 [----] I, [2016-09-13T03:48:25.343506 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2612174848 [----] I, [2016-09-13T03:48:25.343594 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2305003520 [----] I, [2016-09-13T03:48:25.343665 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T03:48:25.343732 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T03:48:25.343794 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T03:48:25.343856 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37347328 [----] I, [2016-09-13T03:48:25.343921 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102281216 [----] I, [2016-09-13T03:48:25.343981 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53174272 [----] I, [2016-09-13T03:48:25.344040 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 109834240 [----] I, [2016-09-13T03:48:25.344102 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155455488 [----] I, [2016-09-13T03:48:25.344161 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T03:48:25.344224 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T03:48:25.344288 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T03:48:25.344348 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T03:48:25.344433 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T03:48:25.344520 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T03:48:25.344612 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T03:48:25.344676 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T03:48:25.344747 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T03:48:25.379050 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T03:48:25.379246 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T03:48:25.382488 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T03:48:25.384813 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T03:48:25.387564 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T03:48:25.390297 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T03:48:25.393036 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T03:48:25.395827 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 834 MB 1.18 GB 41% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T03:48:25.398532 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T03:48:25.401231 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T03:48:25.404029 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T03:48:25.406774 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T03:48:25.409517 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 173 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T03:48:25.412227 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T03:48:25.414882 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T03:48:25.415018 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T03:48:25.415114 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>4, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T03:48:25.419191 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202018000], Memory % [3.38], CPU Time [146483.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T03:48:25.419568 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [75880], State: [ok], Delivered in [0.079105372] seconds [----] I, [2016-09-13T03:48:30.061211 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:48:30.431859 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75881], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.390613145] seconds [----] I, [2016-09-13T03:48:30.432032 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [75881], Delivering... [----] I, [2016-09-13T03:48:30.439042 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:48:19 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [47797.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T03:48:30.439655 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:48:17 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [195389.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T03:48:30.440164 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:48:19 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169066000], Memory % [3.14], CPU Time [50077.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T03:48:30.440698 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:48:09 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205291000], Memory % [3.5], CPU Time [233103.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T03:48:30.441122 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:48:10 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347146000], Memory % [5.04], CPU Time [102681.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T03:48:30.441679 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:48:17 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162413000], Memory % [3.1], CPU Time [36917.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T03:48:30.442188 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:48:19 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202018000], Memory % [3.38], CPU Time [146495.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T03:48:30.442667 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:48:19 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [147421.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T03:48:30.443110 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:48:17 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [205499.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T03:48:30.443570 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:48:19 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177789000], Memory % [3.2], CPU Time [50100.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T03:48:30.443980 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:48:16 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165796000], Memory % [3.16], CPU Time [37782.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T03:48:30.447159 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [95], PID [22463], GUID [db78f78e-7978-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:48:13 UTC], Process Info: Memory Usage [582459392], Memory Size [910184448], Proportional Set Size: [421832000], Memory % [7.1], CPU Time [949.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T03:48:30.449128 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:48:17 UTC], Process Info: Memory Usage [593367040], Memory Size [1008074752], Proportional Set Size: [430210000], Memory % [7.23], CPU Time [283.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T03:48:30.451129 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:48:13 UTC], Process Info: Memory Usage [557948928], Memory Size [910049280], Proportional Set Size: [405476000], Memory % [6.8], CPU Time [4179.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T03:48:30.453073 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:48:15 UTC], Process Info: Memory Usage [580706304], Memory Size [924352512], Proportional Set Size: [420016000], Memory % [7.08], CPU Time [816.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T03:48:30.453450 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [75881], State: [ok], Delivered in [0.021389113] seconds [----] I, [2016-09-13T03:48:30.471803 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75883], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.408127382] seconds [----] I, [2016-09-13T03:48:30.471967 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75883], Delivering... [----] I, [2016-09-13T03:48:30.483196 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75885], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.391397326] seconds [----] I, [2016-09-13T03:48:30.483357 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75885], Delivering... [----] I, [2016-09-13T03:48:30.489350 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030291080474853516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030519962310791016, :pending_vm_jobs=>0.0007495880126953125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055942535400390625} [----] I, [2016-09-13T03:48:30.489758 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75885], State: [ok], Delivered in [0.006395377] seconds [----] I, [2016-09-13T03:48:30.523285 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75883], State: [ok], Delivered in [0.051294692] seconds [----] I, [2016-09-13T03:48:32.809482 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75882], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.757134969] seconds [----] I, [2016-09-13T03:48:32.809765 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75882], Delivering... [----] I, [2016-09-13T03:48:32.815145 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75884], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.738315678] seconds [----] I, [2016-09-13T03:48:32.815285 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75882], State: [ok], Delivered in [0.005533245] seconds [----] I, [2016-09-13T03:48:32.815383 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75884], Delivering... [----] I, [2016-09-13T03:48:32.826033 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75884], State: [ok], Delivered in [0.010613783] seconds [----] I, [2016-09-13T03:48:40.111658 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:48:40.128807 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75886], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:48:41.029770 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:48:41 UTC]... [----] I, [2016-09-13T03:48:41.050390 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:48:41 UTC]...Complete [----] I, [2016-09-13T03:48:41.063179 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:48:41.587752 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75886], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.467550706] seconds [----] I, [2016-09-13T03:48:41.587968 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75886], Delivering... [----] I, [2016-09-13T03:48:41.598878 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003725290298461914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0078582763671875, :pending_vm_jobs=>0.0008280277252197266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010526180267333984} [----] I, [2016-09-13T03:48:41.599318 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75886], State: [ok], Delivered in [0.011354545] seconds [----] I, [2016-09-13T03:48:52.164766 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006035804748535156, :worker_monitor=>1.0598750114440918, :worker_dequeue=>0.005861520767211914, :total_time=>1.0721158981323242} [----] I, [2016-09-13T03:48:55.140750 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:48:55.157765 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75887], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:48:55.180687 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75888], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:48:57.279351 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:48:57.723877 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75888], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.561950855] seconds [----] I, [2016-09-13T03:48:57.724072 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75888], Delivering... [----] I, [2016-09-13T03:48:57.730486 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033652782440185547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003384828567504883, :pending_vm_jobs=>0.000820159912109375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005969047546386719} [----] I, [2016-09-13T03:48:57.730895 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75888], State: [ok], Delivered in [0.006809422] seconds [----] I, [2016-09-13T03:48:59.941643 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75887], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.796272621] seconds [----] I, [2016-09-13T03:48:59.941956 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75887], Delivering... [----] I, [2016-09-13T03:48:59.950092 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75887], State: [ok], Delivered in [0.008113631] seconds [----] I, [2016-09-13T03:49:08.692435 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0045664310455322266, :worker_monitor=>1.3734228610992432, :worker_dequeue=>0.007146358489990234, :total_time=>1.3854601383209229} [----] I, [2016-09-13T03:49:10.191979 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T03:49:10.220656 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75889], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:49:10.237688 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75890], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:49:13.692908 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:49:13 UTC]... [----] I, [2016-09-13T03:49:13.717879 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:49:13 UTC]...Complete [----] I, [2016-09-13T03:49:13.729345 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:49:13.832592 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75890], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.60330964] seconds [----] I, [2016-09-13T03:49:13.832925 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75890], Delivering... [----] I, [2016-09-13T03:49:13.843270 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0053462982177734375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005449056625366211, :pending_vm_jobs=>0.0014307498931884766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009724140167236328} [----] I, [2016-09-13T03:49:13.843844 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75890], State: [ok], Delivered in [0.010932079] seconds [----] I, [2016-09-13T03:49:15.003847 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75889], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.790957866] seconds [----] I, [2016-09-13T03:49:15.004072 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75889], Delivering... [----] I, [2016-09-13T03:49:15.045255 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75891], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T03:49:15.059755 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75892], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T03:49:15.060136 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75889], State: [ok], Delivered in [0.0560634] seconds [----] I, [2016-09-13T03:49:18.745676 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T03:49:18.747283 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T03:49:23.506302 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [75892], MiqWorker id: [95], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [8.454556513] seconds [----] I, [2016-09-13T03:49:23.506577 #22463:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75892], Delivering... [----] I, [2016-09-13T03:49:23.510570 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T03:49:23.510751 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T03:49:23.510866 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T03:49:23.511065 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T03:49:23.511234 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:23.795864 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:23.998003 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:23.998192 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:24.416636 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:24.511160 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:24.601936 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:24.933585 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:25.038553 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:25.131411 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:25.223315 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:25.247213 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T03:49:25.271058 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75893], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:49:25.294089 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75894], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:49:25.316649 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75895], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:49:25.317257 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:25.350993 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75896], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:49:25.351032 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:49:25.357666 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T03:49:25.357856 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004324913024902344, :worker_monitor=>1.593456745147705, :worker_dequeue=>0.01199197769165039, :total_time=>1.6101844310760498} [----] I, [2016-09-13T03:49:25.368080 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75897], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:49:25.408924 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:25.501581 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:25.593820 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:25.688168 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:25.783241 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:25.876334 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:25.968620 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:25.979924 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75894], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.706332718] seconds [----] I, [2016-09-13T03:49:25.980099 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75894], Delivering... [----] I, [2016-09-13T03:49:26.036976 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75894], State: [ok], Delivered in [0.056830665] seconds [----] I, [2016-09-13T03:49:26.070295 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:26.164083 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:26.258595 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:26.351810 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:26.445939 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T03:49:26.697718 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T03:49:26.698047 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004083156585693359, :collect_inventory_for_targets=>6.556510925292969e-05, :parse_legacy_inventory=>24.093182802200317, :parse_targeted_inventory=>24.09337091445923, :save_inventory=>1.400423526763916, :ems_refresh=>25.49763059616089} [----] I, [2016-09-13T03:49:26.722686 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T03:49:26.723155 #22463:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75892], State: [ok], Delivered in [3.216596293] seconds [----] I, [2016-09-13T03:49:27.083396 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75893], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.833284032] seconds [----] I, [2016-09-13T03:49:27.083737 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75893], Delivering... [----] I, [2016-09-13T03:49:27.090734 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75893], State: [ok], Delivered in [0.006971454] seconds [----] I, [2016-09-13T03:49:27.123243 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75895], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.82387424] seconds [----] I, [2016-09-13T03:49:27.123504 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75895], Delivering... [----] I, [2016-09-13T03:49:27.127734 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75895], State: [ok], Delivered in [0.0041917] seconds [----] I, [2016-09-13T03:49:27.936656 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [75891], MiqWorker id: [96], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [12.915821677] seconds [----] I, [2016-09-13T03:49:27.936920 #28071:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75891], Delivering... [----] I, [2016-09-13T03:49:27.941187 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T03:49:27.941362 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T03:49:27.941555 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T03:49:27.941788 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T03:49:27.942189 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:28.383484 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:28.683523 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:28.683792 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:29.156722 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:29.469205 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:29.469401 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:29.997657 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:30.317764 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:30.318082 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:30.367322 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:49:30.824567 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:31.100101 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75896], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.778282125] seconds [----] I, [2016-09-13T03:49:31.100284 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75896], Delivering... [----] I, [2016-09-13T03:49:31.106908 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003506183624267578, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003525257110595703, :pending_vm_jobs=>0.0008831024169921875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006235599517822266} [----] I, [2016-09-13T03:49:31.107291 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75896], State: [ok], Delivered in [0.006987225] seconds [----] I, [2016-09-13T03:49:31.119048 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:31.119214 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:31.610678 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:31.921817 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:31.922018 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:32.381147 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:32.664773 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:32.664964 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:33.131991 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:33.157314 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75897], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.803855567] seconds [----] I, [2016-09-13T03:49:33.157563 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75897], Delivering... [----] I, [2016-09-13T03:49:33.280371 #2937:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 07:49:30 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_16' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 07:49:30.371343') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2927,,2016-09-13 07:49:32 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2936,,2016-09-13 07:49:33 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2946,2016-09-13 07:49:33 UTC,2016-09-13 07:49:33 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 07:49:33 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 07:49:33 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 07:49:31 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2986,,2016-09-13 07:49:31 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2997,,2016-09-13 07:49:25 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 07:49:10.243155')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,7, 3011,,2016-09-13 07:23:38 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1554, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,495128, 3030,,2016-09-13 06:53:18 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3374, 3054,,2016-09-13 07:23:30 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1562, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,495126, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,495126, 3160,,2016-09-13 06:23:04 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5188, 22471,,2016-09-13 07:49:26 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,6, 703,,2016-09-13 07:23:31 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1561, 27056,,2016-09-13 06:53:16 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3376, 28888,,2016-09-13 07:23:32 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1560, 28079,,2016-09-13 07:49:27 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5, 20394,,2016-09-13 07:23:34 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1559, ACTIVITY_STATS_CSV [----] I, [2016-09-13T03:49:33.280837 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75897], State: [ok], Delivered in [0.123272003] seconds [----] I, [2016-09-13T03:49:33.419070 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:33.419283 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:33.910117 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:34.209270 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:34.209467 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:34.683064 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:34.993634 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:34.993800 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:35.488368 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:35.796704 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:35.796879 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:36.274168 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:36.569859 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:36.570059 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:40.376976 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:49:40.391296 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75898], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:49:41.690057 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:49:41.693730 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00432896614074707, :worker_monitor=>1.294480562210083, :worker_dequeue=>0.0065250396728515625, :total_time=>1.3056275844573975} [----] I, [2016-09-13T03:49:42.203095 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75898], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.820052875] seconds [----] I, [2016-09-13T03:49:42.203266 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75898], Delivering... [----] I, [2016-09-13T03:49:42.212289 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004355430603027344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0043811798095703125, :pending_vm_jobs=>0.0012423992156982422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008585453033447266} [----] I, [2016-09-13T03:49:42.212704 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75898], State: [ok], Delivered in [0.009411567] seconds [----] I, [2016-09-13T03:49:43.092002 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:43.403277 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:43.403623 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:43.897972 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:44.079093 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:44.218875 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:44.349047 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:44.488566 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:44.625189 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:44.760104 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:44.897396 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:45.039153 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:45.179605 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:45.317770 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:45.454257 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:45.589192 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:45.722920 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:46.168938 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:46.312608 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:46.454720 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:46.602085 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:46.694238 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:49:46 UTC]... [----] I, [2016-09-13T03:49:46.722920 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:49:46 UTC]...Complete [----] I, [2016-09-13T03:49:46.779567 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:46.984273 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:47.121664 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:47.263216 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:47.405491 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:47.551549 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:47.683247 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:47.821854 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:47.969921 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:48.111762 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:48.253064 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:48.388388 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:48.529628 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:48.874559 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:49.032442 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:49.173352 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:49.312331 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:49.450932 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:49.617946 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:49.762302 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:49.908237 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:50.063507 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:50.212582 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:50.360731 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:50.498055 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:50.639333 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:50.773518 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:50.914038 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:51.057103 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:51.198099 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:51.631093 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:51.788828 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:51.934815 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:52.069684 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:52.208287 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:52.359152 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:52.502460 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:52.642967 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:52.785888 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:52.924860 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:53.062117 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:53.200501 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:53.343909 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:53.483478 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:53.677409 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:55.402305 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:49:55.437496 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75899], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:49:55.477379 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75900], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:49:55.511467 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75901], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:49:55.522799 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75902], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:49:55.557152 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75903], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:49:58.494163 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:49:58.500483 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004467010498046875, :worker_monitor=>1.7214996814727783, :worker_dequeue=>0.011429548263549805, :total_time=>1.7378060817718506} [----] I, [2016-09-13T03:49:59.341610 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75900], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.898301194] seconds [----] I, [2016-09-13T03:49:59.341807 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75900], Delivering... [----] I, [2016-09-13T03:49:59.348038 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032935142517089844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033111572265625, :pending_vm_jobs=>0.0007827281951904297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058689117431640625} [----] I, [2016-09-13T03:49:59.348393 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75900], State: [ok], Delivered in [0.006582887] seconds [----] I, [2016-09-13T03:49:59.838811 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:49:59.979968 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:00.277851 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75899], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.871135994] seconds [----] I, [2016-09-13T03:50:00.278060 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75899], Delivering... [----] I, [2016-09-13T03:50:00.283225 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75899], State: [ok], Delivered in [0.005158108] seconds [----] I, [2016-09-13T03:50:00.308265 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75901], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.825158537] seconds [----] I, [2016-09-13T03:50:00.308512 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75901], Delivering... [----] I, [2016-09-13T03:50:00.311170 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75901], State: [ok], Delivered in [0.002642321] seconds [----] I, [2016-09-13T03:50:00.347304 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75902], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.830279593] seconds [----] I, [2016-09-13T03:50:00.347651 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75902], Delivering... [----] I, [2016-09-13T03:50:00.349678 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:00.364372 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75902], State: [ok], Delivered in [0.016714373] seconds [----] I, [2016-09-13T03:50:00.411291 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75903], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.883397766] seconds [----] I, [2016-09-13T03:50:00.411634 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75903], Delivering... [----] I, [2016-09-13T03:50:00.420737 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75903], State: [ok], Delivered in [0.009096342] seconds [----] I, [2016-09-13T03:50:00.510646 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:00.655760 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:00.796557 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:00.947090 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:01.090858 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:01.239435 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:01.380740 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:01.522213 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:01.664077 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:01.804030 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:01.942253 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:02.081122 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:02.217063 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:02.361815 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:02.510753 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:02.646983 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:03.027345 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:03.172799 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:03.310404 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:03.454093 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:03.590954 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:03.731187 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:03.873638 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:04.012575 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:04.155844 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:04.304584 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:04.441102 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:04.575151 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:04.715558 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:04.855217 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:04.990623 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:05.129613 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:05.261830 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:05.662843 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:05.815069 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:05.956221 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:06.092913 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:06.241298 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:06.383336 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:06.521997 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:06.660144 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:06.810140 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:06.948616 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:07.091412 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:07.231029 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:07.372720 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:07.511820 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:07.657206 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:07.800898 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:07.939349 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:08.279509 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:08.445455 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:08.589883 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:08.761623 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:08.923256 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:09.061979 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:09.205992 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:09.354807 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:09.498785 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:09.640311 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:09.779365 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:09.926340 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:10.072032 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:10.221507 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:10.365338 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:10.509604 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:10.569043 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:50:10.582064 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75904], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:50:10.593370 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75905], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:50:10.616689 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75906], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:50:10.652597 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:15.594267 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:50:15.597695 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0044591426849365234, :worker_monitor=>1.938857078552246, :worker_dequeue=>0.006231784820556641, :total_time=>1.9499609470367432} [----] I, [2016-09-13T03:50:16.484928 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75906], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.885992337] seconds [----] I, [2016-09-13T03:50:16.485118 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75906], Delivering... [----] I, [2016-09-13T03:50:16.490980 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030701160430908203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003087759017944336, :pending_vm_jobs=>0.0007174015045166016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005509853363037109} [----] I, [2016-09-13T03:50:16.491314 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75906], State: [ok], Delivered in [0.006201099] seconds [----] I, [2016-09-13T03:50:17.140140 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:17.309304 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:17.450252 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:17.585717 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:17.729647 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:17.869643 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:18.010067 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:18.150399 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:18.294228 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:18.431706 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:18.439228 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75904], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.865714424] seconds [----] I, [2016-09-13T03:50:18.439347 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75904], Delivering... [----] I, [2016-09-13T03:50:18.451337 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75907], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 07:50:18 UTC] [----] I, [2016-09-13T03:50:18.467957 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75908], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 07:50:18 UTC] [----] I, [2016-09-13T03:50:18.468243 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75904], State: [ok], Delivered in [0.028873917] seconds [----] I, [2016-09-13T03:50:18.490550 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75905], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.904390384] seconds [----] I, [2016-09-13T03:50:18.490736 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75905], Delivering... [----] I, [2016-09-13T03:50:18.510006 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75909], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 07:50:18 UTC] [----] I, [2016-09-13T03:50:18.532910 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75910], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 07:50:18 UTC] [----] I, [2016-09-13T03:50:18.533235 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75905], State: [ok], Delivered in [0.042493806] seconds [----] I, [2016-09-13T03:50:18.570736 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:18.707638 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:18.849068 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:18.982388 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:19.121858 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:19.258975 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:19.405188 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:19.778348 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:19.930800 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:20.066386 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:20.213778 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:20.348169 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:20.487506 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:20.598058 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:50:20 UTC]... [----] I, [2016-09-13T03:50:20.606395 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:50:20 UTC]...Complete [----] I, [2016-09-13T03:50:20.612922 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:50:20.627013 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:20.762075 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:20.903080 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:21.044517 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:21.184699 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:21.331828 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:21.471442 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:21.505748 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75907], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 07:50:18 UTC], Dequeued in: [3.061946921] seconds [----] I, [2016-09-13T03:50:21.505970 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75907], Delivering... [----] I, [2016-09-13T03:50:21.506384 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 07:50:18 UTC]... [----] I, [2016-09-13T03:50:21.509524 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T03:50:21.512209 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 07:50:18 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T03:50:21.512572 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75907], State: [ok], Delivered in [0.00660245] seconds [----] I, [2016-09-13T03:50:21.562040 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75908], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 07:50:18 UTC], Dequeued in: [3.104061852] seconds [----] I, [2016-09-13T03:50:21.562235 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75908], Delivering... [----] I, [2016-09-13T03:50:21.562566 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 07:50:18 UTC]... [----] I, [2016-09-13T03:50:21.565199 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T03:50:21.567477 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 07:50:18 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T03:50:21.567869 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75908], State: [ok], Delivered in [0.005611723] seconds [----] I, [2016-09-13T03:50:21.573697 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75909], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 07:50:18 UTC], Dequeued in: [3.076747417] seconds [----] I, [2016-09-13T03:50:21.573884 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75909], Delivering... [----] I, [2016-09-13T03:50:21.574186 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 07:50:18 UTC]... [----] I, [2016-09-13T03:50:21.577123 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T03:50:21.596483 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75910], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 07:50:18 UTC], Dequeued in: [3.081202529] seconds [----] I, [2016-09-13T03:50:21.596696 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75910], Delivering... [----] I, [2016-09-13T03:50:21.597044 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 07:50:18 UTC]... [----] I, [2016-09-13T03:50:21.599949 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T03:50:21.617812 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:21.650393 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 07:50:18 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T03:50:21.650806 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75909], State: [ok], Delivered in [0.076908553] seconds [----] I, [2016-09-13T03:50:21.682787 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 07:50:18 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T03:50:21.683200 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75910], State: [ok], Delivered in [0.086485561] seconds [----] I, [2016-09-13T03:50:21.755890 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:21.906798 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:22.054230 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:22.350752 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:22.523847 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:22.664679 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:22.803155 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:22.955919 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:23.096645 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:23.236995 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:23.376659 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:23.516842 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:23.653890 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:23.788798 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:23.931284 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:24.067977 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:24.203262 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:24.341260 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:24.481103 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:24.643345 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:25.123713 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:25.277151 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:25.420963 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:25.608136 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:25.630672 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:50:25.675731 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75911], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:50:25.692866 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75912], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:50:25.715747 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75913], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:50:25.732804 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75914], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:50:25.753678 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:25.894103 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:26.041161 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:26.179605 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:26.325856 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:26.471844 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:26.615463 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:26.758787 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:26.901649 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:27.039078 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:27.177746 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:27.318262 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:27.452381 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:27.760766 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:32.263891 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:50:32.271412 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004270315170288086, :worker_monitor=>1.6094329357147217, :worker_dequeue=>0.012814044952392578, :total_time=>1.626880407333374} [----] I, [2016-09-13T03:50:32.596232 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75913], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.889981644] seconds [----] I, [2016-09-13T03:50:32.596468 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75913], Delivering... [----] I, [2016-09-13T03:50:32.613170 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75914], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.888697393] seconds [----] I, [2016-09-13T03:50:32.613365 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75914], Delivering... [----] I, [2016-09-13T03:50:32.619848 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034401416778564453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003458261489868164, :pending_vm_jobs=>0.0008101463317871094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006064176559448242} [----] I, [2016-09-13T03:50:32.620182 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75914], State: [ok], Delivered in [0.006801219] seconds [----] I, [2016-09-13T03:50:32.659234 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75913], State: [ok], Delivered in [0.062730491] seconds [----] I, [2016-09-13T03:50:33.761664 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75911], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.126061974] seconds [----] I, [2016-09-13T03:50:33.761869 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75911], Delivering... [----] I, [2016-09-13T03:50:33.766588 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75911], State: [ok], Delivered in [0.004694882] seconds [----] I, [2016-09-13T03:50:33.767591 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75912], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.085580915] seconds [----] I, [2016-09-13T03:50:33.767843 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75912], Delivering... [----] I, [2016-09-13T03:50:33.777412 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75912], State: [ok], Delivered in [0.009522953] seconds [----] I, [2016-09-13T03:50:34.019373 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:34.162129 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:34.302040 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:34.446793 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:34.585247 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:34.727944 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:34.866444 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:35.009219 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:35.147188 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:35.287725 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:35.429326 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:35.572560 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:35.713549 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:35.853740 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:35.999726 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T03:50:36.144829 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T03:50:36.348395 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T03:50:36.348955 #28071:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T03:50:36.349290 #28071:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T03:50:36.349396 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T03:50:36.349588 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T03:50:36.384855 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T03:50:36.385558 #28071:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [75891], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T03:50:36.386020 #28071:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T03:50:36.386524 #28071:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T03:50:36.386872 #28071:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75891], State: [error], Delivered in [68.449934749] seconds [----] I, [2016-09-13T03:50:40.750157 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:50:40.767227 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75915], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:50:42.306299 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:50:42.722061 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75915], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.965233185] seconds [----] I, [2016-09-13T03:50:42.722326 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75915], Delivering... [----] I, [2016-09-13T03:50:42.731951 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005056142807006836, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005084514617919922, :pending_vm_jobs=>0.0011768341064453125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009070158004760742} [----] I, [2016-09-13T03:50:42.732483 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75915], State: [ok], Delivered in [0.01011138] seconds [----] I, [2016-09-13T03:50:48.560503 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004692792892456055, :worker_monitor=>1.2298879623413086, :worker_dequeue=>0.0071563720703125, :total_time=>1.2421014308929443} [----] I, [2016-09-13T03:50:53.561047 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:50:53 UTC]... [----] I, [2016-09-13T03:50:53.607504 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:50:53 UTC]...Complete [----] I, [2016-09-13T03:50:55.780813 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:50:55.795988 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75916], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:50:55.813165 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75917], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:50:58.636646 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:50:58.876025 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75917], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.074148734] seconds [----] I, [2016-09-13T03:50:58.876215 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75917], Delivering... [----] I, [2016-09-13T03:50:58.882400 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031702518463134766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003237009048461914, :pending_vm_jobs=>0.0007679462432861328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00578761100769043} [----] I, [2016-09-13T03:50:58.882820 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75917], State: [ok], Delivered in [0.006604975] seconds [----] I, [2016-09-13T03:51:00.910496 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75916], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.124594296] seconds [----] I, [2016-09-13T03:51:00.910764 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75916], Delivering... [----] I, [2016-09-13T03:51:00.915875 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75916], State: [ok], Delivered in [0.005095082] seconds [----] I, [2016-09-13T03:51:05.294216 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0031981468200683594, :server_monitor=>0.07971978187561035, :worker_monitor=>1.5595309734344482, :worker_dequeue=>0.007549285888671875, :total_time=>1.6503124237060547} [----] I, [2016-09-13T03:51:10.825217 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:51:10.840661 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75918], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:51:15.320711 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:51:15.919699 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75918], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.088521049] seconds [----] I, [2016-09-13T03:51:15.919889 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75918], Delivering... [----] I, [2016-09-13T03:51:15.925760 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003147125244140625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031652450561523438, :pending_vm_jobs=>0.0007288455963134766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00552821159362793} [----] I, [2016-09-13T03:51:15.926098 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75918], State: [ok], Delivered in [0.006215065] seconds [----] I, [2016-09-13T03:51:21.628315 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004099369049072266, :worker_monitor=>1.288482904434204, :worker_dequeue=>0.008311748504638672, :total_time=>1.3011674880981445} [----] I, [2016-09-13T03:51:25.852095 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:51:25.874326 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75919], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:51:25.891560 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75920], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:51:25.914320 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75921], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:51:25.937067 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75922], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:51:26.628764 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:51:26 UTC]... [----] I, [2016-09-13T03:51:26.679732 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:51:26 UTC]...Complete [----] I, [2016-09-13T03:51:26.696612 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T03:51:26.702100 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:51:27.057092 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75920], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.178711197] seconds [----] I, [2016-09-13T03:51:27.057242 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75920], Delivering... [----] I, [2016-09-13T03:51:27.062880 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75922], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.139197341] seconds [----] I, [2016-09-13T03:51:27.063088 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75922], Delivering... [----] I, [2016-09-13T03:51:27.069144 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003245115280151367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032629966735839844, :pending_vm_jobs=>0.0006821155548095703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0056841373443603516} [----] I, [2016-09-13T03:51:27.069507 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75922], State: [ok], Delivered in [0.006417088] seconds [----] I, [2016-09-13T03:51:27.108655 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75920], State: [ok], Delivered in [0.051386123] seconds [----] I, [2016-09-13T03:51:27.977254 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75919], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.120815101] seconds [----] I, [2016-09-13T03:51:27.977489 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75919], Delivering... [----] I, [2016-09-13T03:51:27.982775 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75919], State: [ok], Delivered in [0.005319875] seconds [----] I, [2016-09-13T03:51:28.005937 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75921], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.109083797] seconds [----] I, [2016-09-13T03:51:28.006125 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75921], Delivering... [----] I, [2016-09-13T03:51:28.009197 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75921], State: [ok], Delivered in [0.003061405] seconds [----] I, [2016-09-13T03:51:38.026789 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00395965576171875, :worker_monitor=>1.2857375144958496, :worker_dequeue=>0.005951881408691406, :total_time=>1.2959527969360352} [----] I, [2016-09-13T03:51:40.948608 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:51:40.968327 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75923], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:51:43.036591 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:51:43.196906 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75923], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.243254984] seconds [----] I, [2016-09-13T03:51:43.197071 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75923], Delivering... [----] I, [2016-09-13T03:51:43.202979 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00308990478515625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031080245971679688, :pending_vm_jobs=>0.0007116794586181641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005588531494140625} [----] I, [2016-09-13T03:51:43.203338 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75923], State: [ok], Delivered in [0.006258281] seconds [----] I, [2016-09-13T03:51:54.611902 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003956317901611328, :worker_monitor=>1.5284762382507324, :worker_dequeue=>0.011298894882202148, :total_time=>1.5440165996551514} [----] I, [2016-09-13T03:51:55.979738 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:51:56.077030 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75924], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:51:56.128826 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75925], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:51:59.612455 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:51:59 UTC]... [----] I, [2016-09-13T03:51:59.677162 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:51:59 UTC]...Complete [----] I, [2016-09-13T03:51:59.688167 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:52:00.351338 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75925], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.268702729] seconds [----] I, [2016-09-13T03:52:00.351605 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75925], Delivering... [----] I, [2016-09-13T03:52:00.358066 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003204345703125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003222227096557617, :pending_vm_jobs=>0.0007772445678710938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006032466888427734} [----] I, [2016-09-13T03:52:00.358515 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75925], State: [ok], Delivered in [0.006898015] seconds [----] I, [2016-09-13T03:52:01.523349 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75924], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.537880294] seconds [----] I, [2016-09-13T03:52:01.523625 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75924], Delivering... [----] I, [2016-09-13T03:52:01.529337 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75924], State: [ok], Delivered in [0.005708281] seconds [----] I, [2016-09-13T03:52:11.060038 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007311344146728516, :worker_monitor=>1.222424030303955, :worker_dequeue=>0.008693933486938477, :total_time=>1.2387840747833252} [----] I, [2016-09-13T03:52:11.143735 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:52:11.163138 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75926], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:52:16.067187 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:52:16.597705 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75926], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.446721074] seconds [----] I, [2016-09-13T03:52:16.597968 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75926], Delivering... [----] I, [2016-09-13T03:52:16.607153 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004782438278198242, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004814863204956055, :pending_vm_jobs=>0.0011949539184570312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008623838424682617} [----] I, [2016-09-13T03:52:16.607588 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75926], State: [ok], Delivered in [0.009605416] seconds [----] I, [2016-09-13T03:52:26.180599 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:52:26.204744 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75927], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:52:26.225363 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75928], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:52:26.254944 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75929], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:52:26.283332 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75930], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:52:28.117248 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:52:28.124148 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004099845886230469, :worker_monitor=>2.0160343647003174, :worker_dequeue=>0.011906623840332031, :total_time=>2.03234601020813} [----] I, [2016-09-13T03:52:28.675231 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75928], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.463998011] seconds [----] I, [2016-09-13T03:52:28.675469 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75928], Delivering... [----] I, [2016-09-13T03:52:28.692349 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75930], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.427048703] seconds [----] I, [2016-09-13T03:52:28.692580 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75930], Delivering... [----] I, [2016-09-13T03:52:28.699411 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035247802734375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003546476364135742, :pending_vm_jobs=>0.0008835792541503906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0064656734466552734} [----] I, [2016-09-13T03:52:28.699795 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75930], State: [ok], Delivered in [0.007228801] seconds [----] I, [2016-09-13T03:52:28.744110 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75927], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.556630154] seconds [----] I, [2016-09-13T03:52:28.744392 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75927], Delivering... [----] I, [2016-09-13T03:52:28.752020 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75927], State: [ok], Delivered in [0.007624662] seconds [----] I, [2016-09-13T03:52:28.789474 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75928], State: [ok], Delivered in [0.113973931] seconds [----] I, [2016-09-13T03:52:28.978032 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75929], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.746612131] seconds [----] I, [2016-09-13T03:52:28.978234 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75929], Delivering... [----] I, [2016-09-13T03:52:28.981690 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75929], State: [ok], Delivered in [0.003448424] seconds [----] I, [2016-09-13T03:52:33.124815 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:52:33 UTC]... [----] I, [2016-09-13T03:52:33.143301 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:52:33 UTC]...Complete [----] I, [2016-09-13T03:52:41.296500 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:52:41.308898 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75931], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:52:44.474628 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:52:44.478609 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004311800003051758, :worker_monitor=>1.290515422821045, :worker_dequeue=>0.007181406021118164, :total_time=>1.3022918701171875} [----] I, [2016-09-13T03:52:45.098072 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75931], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.796039868] seconds [----] I, [2016-09-13T03:52:45.098289 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75931], Delivering... [----] I, [2016-09-13T03:52:45.105643 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036172866821289062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036385059356689453, :pending_vm_jobs=>0.000804901123046875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006777286529541016} [----] I, [2016-09-13T03:52:45.106103 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75931], State: [ok], Delivered in [0.007788529] seconds [----] I, [2016-09-13T03:52:56.318784 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:52:56.338058 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75932], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:52:56.366629 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75933], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:53:00.453023 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:53:01.246594 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75933], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.902245332] seconds [----] I, [2016-09-13T03:53:01.246839 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75933], Delivering... [----] I, [2016-09-13T03:53:01.255108 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004247188568115234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004275321960449219, :pending_vm_jobs=>0.0011014938354492188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007807731628417969} [----] I, [2016-09-13T03:53:01.255555 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75933], State: [ok], Delivered in [0.008703703] seconds [----] I, [2016-09-13T03:53:02.070228 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75932], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.747002963] seconds [----] I, [2016-09-13T03:53:02.070435 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75932], Delivering... [----] I, [2016-09-13T03:53:02.074641 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75932], State: [ok], Delivered in [0.004224681] seconds [----] I, [2016-09-13T03:53:05.459265 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:53:05 UTC]... [----] I, [2016-09-13T03:53:05.480686 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:53:05 UTC]...Complete [----] I, [2016-09-13T03:53:11.378726 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:53:11.395003 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75934], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:53:17.064934 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:53:17.072569 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0043048858642578125, :worker_monitor=>1.4261693954467773, :worker_dequeue=>0.024515628814697266, :total_time=>1.4553313255310059} [----] I, [2016-09-13T03:53:17.141063 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75934], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.756503444] seconds [----] I, [2016-09-13T03:53:17.141249 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75934], Delivering... [----] I, [2016-09-13T03:53:17.147361 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033817291259765625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034089088439941406, :pending_vm_jobs=>0.0007297992706298828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00571751594543457} [----] I, [2016-09-13T03:53:17.147729 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75934], State: [ok], Delivered in [0.006479343] seconds [----] I, [2016-09-13T03:53:26.406977 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T03:53:26.426604 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75935], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:53:26.462219 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75936], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:53:26.489313 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75937], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:53:26.523602 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75938], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:53:26.563609 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75939], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:53:26.592221 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75940], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:53:27.103333 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:53:27.421782 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75935], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.009850347] seconds [----] I, [2016-09-13T03:53:27.422133 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [75935], Delivering... [----] I, [2016-09-13T03:53:27.424299 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T03:53:27.424684 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5330313216 [----] I, [2016-09-13T03:53:27.424865 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5117825024 [----] I, [2016-09-13T03:53:27.425039 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 212488192 [----] I, [2016-09-13T03:53:27.425207 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1310720000 [----] I, [2016-09-13T03:53:27.425361 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5064122368 [----] I, [2016-09-13T03:53:27.425588 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T03:53:27.425755 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T03:53:27.425912 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 532905984 [----] I, [2016-09-13T03:53:27.426070 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T03:53:27.426233 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7995019264 [----] I, [2016-09-13T03:53:27.426392 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T03:53:27.426628 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T03:53:27.426792 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T03:53:27.426946 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T03:53:27.427124 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T03:53:27.427284 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T03:53:27.427491 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T03:53:27.427686 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T03:53:27.427845 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T03:53:27.427996 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T03:53:27.428156 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272928768 [----] I, [2016-09-13T03:53:27.428322 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56123392 [----] I, [2016-09-13T03:53:27.428516 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216805376 [----] I, [2016-09-13T03:53:27.428713 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T03:53:27.428873 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140275712 [----] I, [2016-09-13T03:53:27.429031 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2603974656 [----] I, [2016-09-13T03:53:27.429190 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2296520704 [----] I, [2016-09-13T03:53:27.429344 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T03:53:27.429587 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T03:53:27.429749 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T03:53:27.429907 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37425152 [----] I, [2016-09-13T03:53:27.430055 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102281216 [----] I, [2016-09-13T03:53:27.430222 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53313536 [----] I, [2016-09-13T03:53:27.430410 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 109834240 [----] I, [2016-09-13T03:53:27.430644 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155594752 [----] I, [2016-09-13T03:53:27.430794 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T03:53:27.430938 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T03:53:27.431088 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T03:53:27.431232 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T03:53:27.431406 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T03:53:27.431650 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T03:53:27.431812 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T03:53:27.431957 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T03:53:27.432053 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T03:53:27.449192 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75938], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.953897536] seconds [----] I, [2016-09-13T03:53:27.449489 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75938], Delivering... [----] I, [2016-09-13T03:53:27.475749 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T03:53:27.476047 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T03:53:27.482294 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T03:53:27.487141 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T03:53:27.492749 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T03:53:27.498143 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T03:53:27.503696 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T03:53:27.509195 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 835 MB 1.18 GB 41% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T03:53:27.514710 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T03:53:27.520289 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T03:53:27.526109 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T03:53:27.532060 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T03:53:27.537293 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 173 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T03:53:27.540591 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75938], State: [ok], Delivered in [0.091083765] seconds [----] I, [2016-09-13T03:53:27.541279 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T03:53:27.545197 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>2}} [----] I, [2016-09-13T03:53:27.545361 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T03:53:27.545511 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>3, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T03:53:27.550037 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [201981000], Memory % [3.38], CPU Time [146609.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T03:53:27.550390 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [75935], State: [ok], Delivered in [0.128323298] seconds [----] I, [2016-09-13T03:53:27.575008 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75940], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.004546517] seconds [----] I, [2016-09-13T03:53:27.575188 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75940], Delivering... [----] I, [2016-09-13T03:53:27.581885 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003481149673461914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035054683685302734, :pending_vm_jobs=>0.0008504390716552734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006309986114501953} [----] I, [2016-09-13T03:53:27.582247 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75940], State: [ok], Delivered in [0.007048613] seconds [----] I, [2016-09-13T03:53:29.182828 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75937], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.716752511] seconds [----] I, [2016-09-13T03:53:29.183130 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75937], Delivering... [----] I, [2016-09-13T03:53:29.191093 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75937], State: [ok], Delivered in [0.007948303] seconds [----] I, [2016-09-13T03:53:29.209365 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75939], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.681402689] seconds [----] I, [2016-09-13T03:53:29.209601 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75939], Delivering... [----] I, [2016-09-13T03:53:29.213592 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75939], State: [ok], Delivered in [0.003944341] seconds [----] I, [2016-09-13T03:53:33.072236 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T03:53:33.072358 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T03:53:33.077455 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T03:53:33.077556 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T03:53:33.083056 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T03:53:33.083185 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T03:53:33.088806 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T03:53:33.088891 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T03:53:33.094567 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T03:53:33.094661 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T03:53:33.100193 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T03:53:33.100285 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T03:53:33.105941 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T03:53:33.106071 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T03:53:33.111677 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T03:53:33.111802 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T03:53:33.117390 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T03:53:33.117490 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T03:53:33.123080 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T03:53:33.123200 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T03:53:33.128934 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T03:53:33.129027 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T03:53:33.134522 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T03:53:33.134646 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T03:53:33.140503 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T03:53:33.140625 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T03:53:33.146100 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T03:53:33.146200 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T03:53:33.163605 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T03:53:33.163738 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T03:53:33.168212 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:53:33.171502 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004811525344848633, :worker_monitor=>1.0503828525543213, :worker_dequeue=>0.005973100662231445, :total_time=>1.0614728927612305} [----] I, [2016-09-13T03:53:33.383651 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T03:53:33.383804 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T03:53:33.383893 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T03:53:33.479737 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T03:53:33.480335 #684:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T03:53:33.480386 #684:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T03:53:33.480438 #684:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T03:53:33.480477 #684:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T03:53:33.480505 #684:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T03:53:33.480543 #684:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T03:53:33.480573 #684:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T03:53:33.480597 #684:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T03:53:33.480621 #684:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T03:53:33.480644 #684:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T03:53:33.480666 #684:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T03:53:33.480689 #684:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T03:53:33.480711 #684:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T03:53:33.480734 #684:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T03:53:33.480756 #684:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T03:53:33.480778 #684:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T03:53:33.480800 #684:34713c] INFO -- : --- [----] I, [2016-09-13T03:53:33.481046 #684:34713c] INFO -- : :guid: c253e5f6-7924-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T03:53:33.481091 #684:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T03:53:33.481180 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T03:53:33.590339 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T03:53:33.590485 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T03:53:33.590578 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T03:53:33.660991 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75936], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.228085136] seconds [----] I, [2016-09-13T03:53:33.661219 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [75936], Delivering... [----] I, [2016-09-13T03:53:33.672407 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:53:32 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50094.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T03:53:33.673206 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:53:26 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [233239.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T03:53:33.673983 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:53:30 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162415000], Memory % [3.1], CPU Time [36927.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T03:53:33.674652 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:53:32 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [47805.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T03:53:33.675384 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:53:32 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [195487.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T03:53:33.676100 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:53:22 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [102699.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T03:53:33.676872 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:53:32 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [147551.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T03:53:33.677540 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:53:32 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [146620.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T03:53:33.681257 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:53:26 UTC], Process Info: Memory Usage [580935680], Memory Size [939032576], Proportional Set Size: [420258000], Memory % [7.08], CPU Time [828.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T03:53:33.684129 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:53:23 UTC], Process Info: Memory Usage [558489600], Memory Size [930906112], Proportional Set Size: [406133000], Memory % [6.81], CPU Time [4191.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T03:53:33.684903 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:53:32 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [205592.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T03:53:33.685647 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:53:32 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [50146.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T03:53:33.686310 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:53:28 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165800000], Memory % [3.16], CPU Time [37793.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T03:53:33.689471 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [95], PID [22463], GUID [db78f78e-7978-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:53:27 UTC], Process Info: Memory Usage [582770688], Memory Size [925503488], Proportional Set Size: [422154000], Memory % [7.1], CPU Time [989.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T03:53:33.692222 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:53:26 UTC], Process Info: Memory Usage [598118400], Memory Size [1021739008], Proportional Set Size: [435349000], Memory % [7.29], CPU Time [425.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T03:53:33.692669 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [75936], State: [ok], Delivered in [0.03144951] seconds [----] I, [2016-09-13T03:53:33.736185 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T03:53:33.736828 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T03:53:33.736887 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T03:53:33.736917 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T03:53:33.736942 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T03:53:33.736965 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T03:53:33.736990 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T03:53:33.737014 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T03:53:33.737037 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T03:53:33.737060 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T03:53:33.737081 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T03:53:33.737105 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T03:53:33.737128 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T03:53:33.737150 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T03:53:33.737174 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T03:53:33.737195 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T03:53:33.737219 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T03:53:33.737446 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T03:53:33.737595 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T03:53:34.254657 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T03:53:34.254767 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T03:53:34.254816 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T03:53:34.406832 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T03:53:34.407402 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T03:53:34.407488 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T03:53:34.407536 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T03:53:34.407573 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T03:53:34.407601 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T03:53:34.407627 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T03:53:34.407654 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T03:53:34.407679 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T03:53:34.407705 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T03:53:34.407729 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T03:53:34.407753 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T03:53:34.407778 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T03:53:34.407803 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T03:53:34.407826 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T03:53:34.408037 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T03:53:34.408257 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T03:53:35.648644 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T03:53:35.648796 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T03:53:35.648872 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T03:53:35.803720 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T03:53:35.804663 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T03:53:35.804749 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T03:53:35.804794 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T03:53:35.804834 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T03:53:35.804869 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T03:53:35.804904 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T03:53:35.804940 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T03:53:35.804977 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T03:53:35.805013 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T03:53:35.805045 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T03:53:35.805082 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T03:53:35.805118 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T03:53:35.805150 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T03:53:35.805184 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T03:53:35.805218 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T03:53:35.805248 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T03:53:35.805614 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T03:53:35.805783 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T03:53:36.162706 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T03:53:36.162905 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T03:53:36.163031 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T03:53:36.307861 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T03:53:36.308646 #20386:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T03:53:36.308721 #20386:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T03:53:36.308761 #20386:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T03:53:36.308794 #20386:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T03:53:36.308825 #20386:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T03:53:36.308857 #20386:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T03:53:36.308888 #20386:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T03:53:36.308917 #20386:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T03:53:36.308947 #20386:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T03:53:36.308976 #20386:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T03:53:36.309005 #20386:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T03:53:36.309034 #20386:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T03:53:36.309062 #20386:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T03:53:36.309092 #20386:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T03:53:36.309121 #20386:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T03:53:36.309150 #20386:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T03:53:36.309177 #20386:34713c] INFO -- : --- [----] I, [2016-09-13T03:53:36.309484 #20386:34713c] INFO -- : :guid: e5930efc-7974-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T03:53:36.309564 #20386:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T03:53:36.309682 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T03:53:36.696842 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T03:53:36.697012 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T03:53:36.697084 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T03:53:36.718557 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T03:53:36.718676 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T03:53:36.718742 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T03:53:36.835731 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T03:53:36.836544 #28071:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T03:53:36.836622 #28071:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T03:53:36.836666 #28071:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T03:53:36.836712 #28071:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T03:53:36.836747 #28071:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T03:53:36.836777 #28071:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T03:53:36.836809 #28071:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T03:53:36.836840 #28071:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T03:53:36.836869 #28071:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T03:53:36.836901 #28071:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T03:53:36.836931 #28071:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T03:53:36.836961 #28071:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T03:53:36.836991 #28071:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T03:53:36.837022 #28071:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T03:53:36.837061 #28071:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T03:53:36.837091 #28071:34713c] INFO -- : --- [----] I, [2016-09-13T03:53:36.837442 #28071:34713c] INFO -- : :guid: b49c1882-7985-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T03:53:36.837509 #28071:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T03:53:36.837721 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T03:53:36.862731 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T03:53:36.863853 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T03:53:36.863961 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T03:53:36.864032 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T03:53:36.864103 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T03:53:36.864169 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T03:53:36.864237 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T03:53:36.864303 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T03:53:36.864361 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T03:53:36.864450 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T03:53:36.864548 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T03:53:36.864623 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T03:53:36.864693 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T03:53:36.864756 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T03:53:36.864822 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T03:53:36.864895 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T03:53:36.864953 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T03:53:36.865338 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T03:53:36.865604 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T03:53:37.086262 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T03:53:37.086469 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T03:53:37.086614 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T03:53:37.257304 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [95], PID [22463], GUID [db78f78e-7978-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T03:53:37.258199 #22463:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T03:53:37.258286 #22463:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T03:53:37.258333 #22463:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T03:53:37.258371 #22463:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T03:53:37.258409 #22463:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T03:53:37.258492 #22463:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T03:53:37.258556 #22463:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T03:53:37.258596 #22463:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T03:53:37.258635 #22463:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T03:53:37.258668 #22463:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T03:53:37.258703 #22463:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T03:53:37.258738 #22463:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T03:53:37.258770 #22463:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T03:53:37.258804 #22463:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T03:53:37.258839 #22463:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T03:53:37.258872 #22463:34713c] INFO -- : --- [----] I, [2016-09-13T03:53:37.259242 #22463:34713c] INFO -- : :guid: db78f78e-7978-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T03:53:37.259310 #22463:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T03:53:37.259510 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T03:53:38.172041 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:53:38 UTC]... [----] I, [2016-09-13T03:53:38.186399 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:53:38 UTC]...Complete [----] I, [2016-09-13T03:53:39.450719 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T03:53:39.450917 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T03:53:39.451039 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T03:53:39.612584 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T03:53:39.613383 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T03:53:39.613520 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T03:53:39.613601 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T03:53:39.613643 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T03:53:39.613681 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T03:53:39.613718 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T03:53:39.613755 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T03:53:39.613789 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T03:53:39.613825 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T03:53:39.613859 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T03:53:39.613894 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T03:53:39.613928 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T03:53:39.613962 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T03:53:39.613995 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T03:53:39.614029 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T03:53:39.614062 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T03:53:39.614360 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T03:53:39.614565 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T03:53:40.236357 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T03:53:40.236568 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T03:53:40.236671 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T03:53:40.421836 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T03:53:40.422726 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T03:53:40.422818 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T03:53:40.422881 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T03:53:40.422941 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T03:53:40.422998 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T03:53:40.423054 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T03:53:40.423114 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T03:53:40.423173 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T03:53:40.423230 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T03:53:40.423284 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T03:53:40.423340 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T03:53:40.423399 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T03:53:40.423493 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T03:53:40.423571 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T03:53:40.423916 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T03:53:40.424191 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T03:53:41.223385 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T03:53:41.223541 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T03:53:41.223613 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T03:53:41.252352 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T03:53:41.252556 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T03:53:41.252655 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T03:53:41.335265 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T03:53:41.335885 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T03:53:41.335942 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T03:53:41.335974 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T03:53:41.336000 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T03:53:41.336025 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T03:53:41.336051 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T03:53:41.336074 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T03:53:41.336094 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T03:53:41.336118 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T03:53:41.336138 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T03:53:41.336158 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T03:53:41.336178 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T03:53:41.336199 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T03:53:41.336219 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T03:53:41.336240 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T03:53:41.336258 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T03:53:41.336491 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T03:53:41.336650 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T03:53:41.379639 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T03:53:41.379777 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T03:53:41.379846 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T03:53:41.421739 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T03:53:41.422554 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T03:53:41.422636 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T03:53:41.422679 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T03:53:41.422713 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T03:53:41.422746 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T03:53:41.422778 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T03:53:41.422817 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T03:53:41.422848 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T03:53:41.422882 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T03:53:41.422913 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T03:53:41.422946 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T03:53:41.422976 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T03:53:41.423011 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T03:53:41.423045 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T03:53:41.423077 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T03:53:41.423106 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T03:53:41.423385 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T03:53:41.423606 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T03:53:41.548921 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T03:53:41.549646 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T03:53:41.549715 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T03:53:41.549754 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T03:53:41.549785 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T03:53:41.549816 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T03:53:41.549845 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T03:53:41.549873 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T03:53:41.549901 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T03:53:41.549930 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T03:53:41.549959 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T03:53:41.549986 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T03:53:41.550014 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T03:53:41.550042 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T03:53:41.550070 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T03:53:41.550100 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T03:53:41.550127 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T03:53:41.550373 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T03:53:41.550545 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T03:53:41.603498 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T03:53:41.603739 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T03:53:41.603845 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T03:53:41.740318 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T03:53:41.741454 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T03:53:41.741535 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T03:53:41.741586 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T03:53:41.741616 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T03:53:41.741643 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T03:53:41.741669 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T03:53:41.741695 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T03:53:41.741720 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T03:53:41.741745 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T03:53:41.741769 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T03:53:41.741794 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T03:53:41.741818 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T03:53:41.741842 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T03:53:41.741867 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T03:53:41.741892 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T03:53:41.741917 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T03:53:41.741942 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T03:53:41.741966 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T03:53:41.741991 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T03:53:41.742018 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T03:53:41.742044 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T03:53:41.742068 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T03:53:41.742092 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T03:53:41.742116 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T03:53:41.742141 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T03:53:41.742166 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T03:53:41.742190 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T03:53:41.742216 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T03:53:41.742241 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T03:53:41.742266 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T03:53:41.742291 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T03:53:41.742331 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T03:53:41.742359 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T03:53:41.742384 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T03:53:41.742408 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T03:53:41.742466 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T03:53:41.742496 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T03:53:41.742521 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T03:53:41.742564 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T03:53:41.742778 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T03:53:41.742898 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T03:53:41.742956 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:53:41.757977 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75941], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:53:43.219908 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:53:43.820751 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75941], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.073115942] seconds [----] I, [2016-09-13T03:53:43.820968 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75941], Delivering... [----] I, [2016-09-13T03:53:43.827308 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033440589904785156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033631324768066406, :pending_vm_jobs=>0.0007421970367431641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005946159362792969} [----] I, [2016-09-13T03:53:43.827689 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75941], State: [ok], Delivered in [0.006752951] seconds [----] I, [2016-09-13T03:53:44.017316 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T03:53:44.017458 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T03:53:44.017542 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T03:53:44.149452 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T03:53:44.150043 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T03:53:44.150112 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T03:53:44.150150 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T03:53:44.150180 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T03:53:44.150209 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T03:53:44.150237 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T03:53:44.150266 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T03:53:44.150293 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T03:53:44.150320 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T03:53:44.150347 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T03:53:44.150373 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T03:53:44.150401 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T03:53:44.150461 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T03:53:44.150494 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T03:53:44.150730 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T03:53:44.150938 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T03:53:49.445600 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00502324104309082, :worker_monitor=>1.206925392150879, :worker_dequeue=>0.006158590316772461, :total_time=>1.218385934829712} [----] I, [2016-09-13T03:53:56.772183 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:53:56.786403 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75942], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:53:56.798011 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75943], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:53:59.465904 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:53:59.507206 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75943], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.715609594] seconds [----] I, [2016-09-13T03:53:59.507499 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75943], Delivering... [----] I, [2016-09-13T03:53:59.515877 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004070281982421875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004098176956176758, :pending_vm_jobs=>0.0012004375457763672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007894754409790039} [----] I, [2016-09-13T03:53:59.516458 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75943], State: [ok], Delivered in [0.00899694] seconds [----] I, [2016-09-13T03:53:59.541153 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75942], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.764338797] seconds [----] I, [2016-09-13T03:53:59.541385 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75942], Delivering... [----] I, [2016-09-13T03:53:59.547824 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75942], State: [ok], Delivered in [0.006414009] seconds [----] I, [2016-09-13T03:54:05.706209 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006625652313232422, :worker_monitor=>1.2138996124267578, :worker_dequeue=>0.012393951416015625, :total_time=>1.2333545684814453} [----] I, [2016-09-13T03:54:10.706830 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:54:10 UTC]... [----] I, [2016-09-13T03:54:10.723876 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:54:10 UTC]...Complete [----] I, [2016-09-13T03:54:11.811071 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:54:11.826892 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75944], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:54:15.847009 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:54:16.055713 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75944], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.235664276] seconds [----] I, [2016-09-13T03:54:16.055917 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75944], Delivering... [----] I, [2016-09-13T03:54:16.063706 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004172563552856445, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0041942596435546875, :pending_vm_jobs=>0.0010464191436767578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007375955581665039} [----] I, [2016-09-13T03:54:16.064120 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75944], State: [ok], Delivered in [0.008192223] seconds [----] I, [2016-09-13T03:54:22.384926 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003551959991455078, :worker_monitor=>1.5173771381378174, :worker_dequeue=>0.011903762817382812, :total_time=>1.5331833362579346} [----] I, [2016-09-13T03:54:26.839919 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:54:26.855729 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75945], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:54:26.866967 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75946], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:54:26.884406 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75947], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:54:26.901346 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75948], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:54:27.394861 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:54:28.176054 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75946], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.315600387] seconds [----] I, [2016-09-13T03:54:28.176242 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75946], Delivering... [----] I, [2016-09-13T03:54:28.218907 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75948], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.324837446] seconds [----] I, [2016-09-13T03:54:28.219191 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75948], Delivering... [----] I, [2016-09-13T03:54:28.229912 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0053899288177490234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0054264068603515625, :pending_vm_jobs=>0.0015001296997070312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010133504867553711} [----] I, [2016-09-13T03:54:28.230442 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75948], State: [ok], Delivered in [0.011208546] seconds [----] I, [2016-09-13T03:54:28.235327 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75946], State: [ok], Delivered in [0.05903677] seconds [----] I, [2016-09-13T03:54:29.487221 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75945], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.642711568] seconds [----] I, [2016-09-13T03:54:29.487584 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75945], Delivering... [----] I, [2016-09-13T03:54:29.493251 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75945], State: [ok], Delivered in [0.005766206] seconds [----] I, [2016-09-13T03:54:29.515731 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75947], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.642869151] seconds [----] I, [2016-09-13T03:54:29.515925 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75947], Delivering... [----] I, [2016-09-13T03:54:29.519585 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75947], State: [ok], Delivered in [0.003625812] seconds [----] I, [2016-09-13T03:54:39.009250 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00470280647277832, :worker_monitor=>1.5625662803649902, :worker_dequeue=>0.014971733093261719, :total_time=>1.5826444625854492} [----] I, [2016-09-13T03:54:41.917254 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:54:41.938353 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75949], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:54:44.009952 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:54:44 UTC]... [----] I, [2016-09-13T03:54:44.023835 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:54:44 UTC]...Complete [----] I, [2016-09-13T03:54:44.033193 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:54:44.361403 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75949], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.436102672] seconds [----] I, [2016-09-13T03:54:44.361557 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75949], Delivering... [----] I, [2016-09-13T03:54:44.365480 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022172927856445312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022287368774414062, :pending_vm_jobs=>0.00044798851013183594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00368499755859375} [----] I, [2016-09-13T03:54:44.365724 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75949], State: [ok], Delivered in [0.004175075] seconds [----] I, [2016-09-13T03:54:55.562666 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004127025604248047, :worker_monitor=>1.493229866027832, :worker_dequeue=>0.010154962539672852, :total_time=>1.507793664932251} [----] I, [2016-09-13T03:54:56.952859 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:54:56.978742 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75950], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:54:57.001480 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75951], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:55:00.573134 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:55:01.515905 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75951], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.529488503] seconds [----] I, [2016-09-13T03:55:01.516119 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75951], Delivering... [----] I, [2016-09-13T03:55:01.523293 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003532886505126953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035562515258789062, :pending_vm_jobs=>0.0009753704071044922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006753444671630859} [----] I, [2016-09-13T03:55:01.523737 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75951], State: [ok], Delivered in [0.00761144] seconds [----] I, [2016-09-13T03:55:02.687569 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75950], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.728462683] seconds [----] I, [2016-09-13T03:55:02.687779 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75950], Delivering... [----] I, [2016-09-13T03:55:02.692673 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75950], State: [ok], Delivered in [0.004883434] seconds [----] I, [2016-09-13T03:55:11.809461 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.008245229721069336, :worker_monitor=>1.2063043117523193, :worker_dequeue=>0.008031368255615234, :total_time=>1.2230160236358643} [----] I, [2016-09-13T03:55:12.014815 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:55:12.027836 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75952], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:55:16.809909 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:55:16 UTC]... [----] I, [2016-09-13T03:55:16.827672 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:55:16 UTC]...Complete [----] I, [2016-09-13T03:55:16.952453 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:55:17.604819 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75952], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.586322125] seconds [----] I, [2016-09-13T03:55:17.604970 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75952], Delivering... [----] I, [2016-09-13T03:55:17.609651 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024743080139160156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002511262893676758, :pending_vm_jobs=>0.000545501708984375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004375934600830078} [----] I, [2016-09-13T03:55:17.609957 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75952], State: [ok], Delivered in [0.00498367] seconds [----] I, [2016-09-13T03:55:27.037543 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:55:27.050256 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75953], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:55:27.063728 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75954], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:55:27.073109 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75955], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:55:27.084484 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75956], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:55:28.076274 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:55:28.082735 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0026209354400634766, :worker_monitor=>1.088895320892334, :worker_dequeue=>0.011905193328857422, :total_time=>1.103639841079712} [----] I, [2016-09-13T03:55:28.719170 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75954], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.665671098] seconds [----] I, [2016-09-13T03:55:28.719338 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75954], Delivering... [----] I, [2016-09-13T03:55:28.724863 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75956], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.646709114] seconds [----] I, [2016-09-13T03:55:28.724982 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75956], Delivering... [----] I, [2016-09-13T03:55:28.729462 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021216869354248047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002138853073120117, :pending_vm_jobs=>0.0005927085876464844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0042171478271484375} [----] I, [2016-09-13T03:55:28.729711 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75956], State: [ok], Delivered in [0.004721748] seconds [----] I, [2016-09-13T03:55:28.770828 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75954], State: [ok], Delivered in [0.051440996] seconds [----] I, [2016-09-13T03:55:29.799803 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75953], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.758706563] seconds [----] I, [2016-09-13T03:55:29.799967 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75953], Delivering... [----] I, [2016-09-13T03:55:29.803873 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75953], State: [ok], Delivered in [0.003886272] seconds [----] I, [2016-09-13T03:55:29.822464 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75955], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.754715705] seconds [----] I, [2016-09-13T03:55:29.822660 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75955], Delivering... [----] I, [2016-09-13T03:55:29.825728 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75955], State: [ok], Delivered in [0.003056517] seconds [----] I, [2016-09-13T03:55:42.093304 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:55:42.113880 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75957], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:55:44.326283 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:55:44.331587 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0052263736724853516, :worker_monitor=>1.2007813453674316, :worker_dequeue=>0.009352445602416992, :total_time=>1.215714454650879} [----] I, [2016-09-13T03:55:44.845811 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75957], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.74594671] seconds [----] I, [2016-09-13T03:55:44.846078 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75957], Delivering... [----] I, [2016-09-13T03:55:44.856282 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00480341911315918, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004836559295654297, :pending_vm_jobs=>0.0014233589172363281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00967264175415039} [----] I, [2016-09-13T03:55:44.856863 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75957], State: [ok], Delivered in [0.0107711] seconds [----] I, [2016-09-13T03:55:49.332075 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:55:49 UTC]... [----] I, [2016-09-13T03:55:49.360465 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:55:49 UTC]...Complete [----] I, [2016-09-13T03:55:57.131084 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:55:57.165945 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75958], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:55:57.183867 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75959], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:56:00.730238 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:56:00.736894 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004255771636962891, :worker_monitor=>1.3267879486083984, :worker_dequeue=>0.011829853057861328, :total_time=>1.3431689739227295} [----] I, [2016-09-13T03:56:00.996755 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75959], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.823715496] seconds [----] I, [2016-09-13T03:56:00.996893 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75959], Delivering... [----] I, [2016-09-13T03:56:01.000765 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021736621856689453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021882057189941406, :pending_vm_jobs=>0.00047850608825683594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003631591796875} [----] I, [2016-09-13T03:56:01.000997 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75959], State: [ok], Delivered in [0.004105974] seconds [----] I, [2016-09-13T03:56:02.974045 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75958], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.838446935] seconds [----] I, [2016-09-13T03:56:02.974249 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75958], Delivering... [----] I, [2016-09-13T03:56:02.979267 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75958], State: [ok], Delivered in [0.00501038] seconds [----] I, [2016-09-13T03:56:12.199578 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:56:12.226007 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75960], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:56:17.123538 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:56:17.130364 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00410914421081543, :worker_monitor=>1.339827299118042, :worker_dequeue=>0.012089252471923828, :total_time=>1.3563213348388672} [----] I, [2016-09-13T03:56:18.029023 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75960], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.823526019] seconds [----] I, [2016-09-13T03:56:18.029253 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75960], Delivering... [----] I, [2016-09-13T03:56:18.036741 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003901958465576172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00392460823059082, :pending_vm_jobs=>0.0008945465087890625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006931304931640625} [----] I, [2016-09-13T03:56:18.037194 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75960], State: [ok], Delivered in [0.007940037] seconds [----] I, [2016-09-13T03:56:22.131258 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:56:22 UTC]... [----] I, [2016-09-13T03:56:22.148601 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:56:22 UTC]...Complete [----] I, [2016-09-13T03:56:27.243171 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:56:27.263114 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75961], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:56:27.274204 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75962], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:56:27.285745 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75963], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:56:27.297082 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75964], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:56:27.319374 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T03:56:27.324152 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:56:28.166149 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75962], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.898898078] seconds [----] I, [2016-09-13T03:56:28.166354 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75962], Delivering... [----] I, [2016-09-13T03:56:28.183244 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75964], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.889907365] seconds [----] I, [2016-09-13T03:56:28.183578 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75964], Delivering... [----] I, [2016-09-13T03:56:28.193612 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005068063735961914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005160808563232422, :pending_vm_jobs=>0.0013654232025146484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009478330612182617} [----] I, [2016-09-13T03:56:28.194057 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75964], State: [ok], Delivered in [0.010507388] seconds [----] I, [2016-09-13T03:56:28.222870 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75962], State: [ok], Delivered in [0.056503108] seconds [----] I, [2016-09-13T03:56:30.063180 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75961], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.813843365] seconds [----] I, [2016-09-13T03:56:30.063389 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75961], Delivering... [----] I, [2016-09-13T03:56:30.068501 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75961], State: [ok], Delivered in [0.005108609] seconds [----] I, [2016-09-13T03:56:30.091729 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75963], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.813047543] seconds [----] I, [2016-09-13T03:56:30.091943 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75963], Delivering... [----] I, [2016-09-13T03:56:30.094972 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75963], State: [ok], Delivered in [0.003028315] seconds [----] I, [2016-09-13T03:56:33.739696 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00644993782043457, :worker_monitor=>1.396350383758545, :worker_dequeue=>0.006420612335205078, :total_time=>1.4096448421478271} [----] I, [2016-09-13T03:56:42.307907 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:56:42.321531 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75965], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:56:43.763985 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:56:44.322261 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75965], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.007886289] seconds [----] I, [2016-09-13T03:56:44.322459 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75965], Delivering... [----] I, [2016-09-13T03:56:44.330702 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003653287887573242, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036771297454833984, :pending_vm_jobs=>0.0012998580932617188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007830619812011719} [----] I, [2016-09-13T03:56:44.331171 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75965], State: [ok], Delivered in [0.008712998] seconds [----] I, [2016-09-13T03:56:50.309830 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003840923309326172, :worker_monitor=>1.5248301029205322, :worker_dequeue=>0.010570764541625977, :total_time=>1.539536476135254} [----] I, [2016-09-13T03:56:55.310456 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:56:55 UTC]... [----] I, [2016-09-13T03:56:55.329452 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:56:55 UTC]...Complete [----] I, [2016-09-13T03:56:57.333373 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:56:57.352268 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75966], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:56:57.363686 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75967], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:57:00.360787 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:57:00.495627 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75967], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.138721688] seconds [----] I, [2016-09-13T03:57:00.495836 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75967], Delivering... [----] I, [2016-09-13T03:57:00.502594 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035486221313476562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003572702407836914, :pending_vm_jobs=>0.0008747577667236328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006341695785522461} [----] I, [2016-09-13T03:57:00.502982 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75967], State: [ok], Delivered in [0.007141817] seconds [----] I, [2016-09-13T03:57:03.192789 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75966], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.855517003] seconds [----] I, [2016-09-13T03:57:03.192983 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75966], Delivering... [----] I, [2016-09-13T03:57:03.197856 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75966], State: [ok], Delivered in [0.004865607] seconds [----] I, [2016-09-13T03:57:06.669999 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003177642822265625, :worker_monitor=>1.291884183883667, :worker_dequeue=>0.007386445999145508, :total_time=>1.3027610778808594} [----] I, [2016-09-13T03:57:12.373277 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:57:12.418964 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75968], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:57:16.700186 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:57:17.601918 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75968], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.223643741] seconds [----] I, [2016-09-13T03:57:17.602088 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75968], Delivering... [----] I, [2016-09-13T03:57:17.607574 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027985572814941406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028166770935058594, :pending_vm_jobs=>0.0007979869842529297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005098581314086914} [----] I, [2016-09-13T03:57:17.607883 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75968], State: [ok], Delivered in [0.00578408] seconds [----] I, [2016-09-13T03:57:22.924076 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0034575462341308594, :worker_monitor=>1.2005305290222168, :worker_dequeue=>0.009136676788330078, :total_time=>1.2134594917297363} [----] I, [2016-09-13T03:57:27.431532 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:57:27.453746 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75969], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:57:27.477771 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75970], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:57:27.499389 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75971], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:57:27.522098 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75972], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:57:27.924710 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:57:27 UTC]... [----] I, [2016-09-13T03:57:27.944753 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:57:27 UTC]...Complete [----] I, [2016-09-13T03:57:28.059144 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:57:28.716468 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75970], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.258298581] seconds [----] I, [2016-09-13T03:57:28.716707 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75970], Delivering... [----] I, [2016-09-13T03:57:28.727761 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75972], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.218380515] seconds [----] I, [2016-09-13T03:57:28.727956 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75972], Delivering... [----] I, [2016-09-13T03:57:28.734737 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035707950592041016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035905838012695312, :pending_vm_jobs=>0.0008869171142578125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006396055221557617} [----] I, [2016-09-13T03:57:28.735103 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75972], State: [ok], Delivered in [0.007144633] seconds [----] I, [2016-09-13T03:57:28.773393 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75970], State: [ok], Delivered in [0.056657898] seconds [----] I, [2016-09-13T03:57:30.322463 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75969], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.886207254] seconds [----] I, [2016-09-13T03:57:30.322676 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75969], Delivering... [----] I, [2016-09-13T03:57:30.327353 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75969], State: [ok], Delivered in [0.004660833] seconds [----] I, [2016-09-13T03:57:30.328106 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75971], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.844325166] seconds [----] I, [2016-09-13T03:57:30.328300 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75971], Delivering... [----] I, [2016-09-13T03:57:30.331655 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75971], State: [ok], Delivered in [0.003352489] seconds [----] I, [2016-09-13T03:57:39.567636 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0044193267822265625, :worker_monitor=>1.463249683380127, :worker_dequeue=>0.009240865707397461, :total_time=>1.4772229194641113} [----] I, [2016-09-13T03:57:42.534002 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:57:42.550533 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75973], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:57:44.577087 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:57:44.902198 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75973], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.36345567] seconds [----] I, [2016-09-13T03:57:44.902384 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75973], Delivering... [----] I, [2016-09-13T03:57:44.908656 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032377243041992188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00327301025390625, :pending_vm_jobs=>0.0007677078247070312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005883693695068359} [----] I, [2016-09-13T03:57:44.909015 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75973], State: [ok], Delivered in [0.006626344] seconds [----] I, [2016-09-13T03:57:55.770712 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004245758056640625, :worker_monitor=>1.1522867679595947, :worker_dequeue=>0.012166261672973633, :total_time=>1.169081449508667} [----] I, [2016-09-13T03:57:57.559274 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:57:57.574229 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75974], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:57:57.585480 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75975], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:58:00.771288 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:58:00 UTC]... [----] I, [2016-09-13T03:58:00.791401 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:58:00 UTC]...Complete [----] I, [2016-09-13T03:58:00.803149 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:58:01.026321 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75975], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.44854534] seconds [----] I, [2016-09-13T03:58:01.026607 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75975], Delivering... [----] I, [2016-09-13T03:58:01.033659 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037827491760253906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038068294525146484, :pending_vm_jobs=>0.0008673667907714844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006630659103393555} [----] I, [2016-09-13T03:58:01.034043 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75975], State: [ok], Delivered in [0.007442895] seconds [----] I, [2016-09-13T03:58:03.472631 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75974], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.909857003] seconds [----] I, [2016-09-13T03:58:03.472865 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75974], Delivering... [----] I, [2016-09-13T03:58:03.478242 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75974], State: [ok], Delivered in [0.00537568] seconds [----] I, [2016-09-13T03:58:12.087380 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035893917083740234, :worker_monitor=>1.2369799613952637, :worker_dequeue=>0.007966041564941406, :total_time=>1.248809814453125} [----] I, [2016-09-13T03:58:12.594374 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:58:12.608982 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75976], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:58:17.096773 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:58:17.198057 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75976], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.597641506] seconds [----] I, [2016-09-13T03:58:17.198262 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75976], Delivering... [----] I, [2016-09-13T03:58:17.204987 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034456253051757812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003465414047241211, :pending_vm_jobs=>0.0008497238159179688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006297111511230469} [----] I, [2016-09-13T03:58:17.205361 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75976], State: [ok], Delivered in [0.007097075] seconds [----] I, [2016-09-13T03:58:27.629667 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T03:58:27.672217 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75977], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:58:27.704539 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75978], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:58:27.725830 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75979], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:58:27.742908 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75980], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:58:27.759922 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75981], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:58:27.782911 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75982], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:58:28.544437 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:58:28.550232 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004218578338623047, :worker_monitor=>1.419571876525879, :worker_dequeue=>0.009574174880981445, :total_time=>1.4336671829223633} [----] I, [2016-09-13T03:58:29.304137 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75977], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.671086633] seconds [----] I, [2016-09-13T03:58:29.304277 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [75977], Delivering... [----] I, [2016-09-13T03:58:29.304987 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T03:58:29.305132 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5327958016 [----] I, [2016-09-13T03:58:29.305196 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5115236352 [----] I, [2016-09-13T03:58:29.305252 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 212721664 [----] I, [2016-09-13T03:58:29.305302 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1310720000 [----] I, [2016-09-13T03:58:29.305357 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5061533696 [----] I, [2016-09-13T03:58:29.305403 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T03:58:29.305489 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T03:58:29.305559 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 533151744 [----] I, [2016-09-13T03:58:29.305615 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T03:58:29.305668 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7835611136 [----] I, [2016-09-13T03:58:29.305720 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T03:58:29.305801 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T03:58:29.305859 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T03:58:29.305912 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T03:58:29.305963 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T03:58:29.306011 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T03:58:29.306062 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T03:58:29.306111 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T03:58:29.306162 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T03:58:29.306215 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T03:58:29.306265 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272932864 [----] I, [2016-09-13T03:58:29.306315 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56115200 [----] I, [2016-09-13T03:58:29.306365 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216817664 [----] I, [2016-09-13T03:58:29.306412 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T03:58:29.306495 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140275712 [----] I, [2016-09-13T03:58:29.306568 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2607013888 [----] I, [2016-09-13T03:58:29.306626 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2299314176 [----] I, [2016-09-13T03:58:29.306677 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T03:58:29.306724 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T03:58:29.306769 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T03:58:29.306818 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37273600 [----] I, [2016-09-13T03:58:29.306866 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102281216 [----] I, [2016-09-13T03:58:29.306915 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53100544 [----] I, [2016-09-13T03:58:29.306964 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 109834240 [----] I, [2016-09-13T03:58:29.307015 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155381760 [----] I, [2016-09-13T03:58:29.307061 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T03:58:29.307119 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T03:58:29.307171 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T03:58:29.307220 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T03:58:29.307270 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T03:58:29.307320 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T03:58:29.307367 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T03:58:29.307430 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 8192 [----] I, [2016-09-13T03:58:29.307498 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T03:58:29.308625 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75978], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.631289753] seconds [----] I, [2016-09-13T03:58:29.308789 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [75978], Delivering... [----] I, [2016-09-13T03:58:29.316597 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:58:28 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [146691.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T03:58:29.317094 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:58:22 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [102776.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T03:58:29.317646 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:58:27 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50154.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T03:58:29.318086 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:58:20 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [47854.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T03:58:29.318615 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:58:27 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [233366.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T03:58:29.319125 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:58:25 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162415000], Memory % [3.1], CPU Time [36981.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T03:58:29.319731 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:58:27 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [195528.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T03:58:29.320279 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:58:28 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [147632.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T03:58:29.323254 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [95], PID [22463], GUID [db78f78e-7978-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:58:28 UTC], Process Info: Memory Usage [583344128], Memory Size [912166912], Proportional Set Size: [422714000], Memory % [7.11], CPU Time [1066.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T03:58:29.325307 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:58:27 UTC], Process Info: Memory Usage [597655552], Memory Size [940814336], Proportional Set Size: [434924000], Memory % [7.29], CPU Time [489.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T03:58:29.327600 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:58:24 UTC], Process Info: Memory Usage [557891584], Memory Size [896778240], Proportional Set Size: [405389000], Memory % [6.8], CPU Time [4256.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T03:58:29.329683 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:58:26 UTC], Process Info: Memory Usage [580460544], Memory Size [909619200], Proportional Set Size: [419794000], Memory % [7.08], CPU Time [904.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T03:58:29.330212 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:58:27 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [205635.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T03:58:29.330746 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:58:27 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [50175.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T03:58:29.331196 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 07:58:16 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165800000], Memory % [3.16], CPU Time [37849.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T03:58:29.331577 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [75978], State: [ok], Delivered in [0.022747627] seconds [----] I, [2016-09-13T03:58:29.338531 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T03:58:29.338808 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T03:58:29.344636 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T03:58:29.348709 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T03:58:29.353390 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T03:58:29.358146 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T03:58:29.362743 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T03:58:29.367254 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 835 MB 1.17 GB 41% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T03:58:29.371627 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75981], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.621807009] seconds [----] I, [2016-09-13T03:58:29.371752 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75981], Delivering... [----] I, [2016-09-13T03:58:29.371863 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T03:58:29.376251 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T03:58:29.380989 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T03:58:29.385667 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T03:58:29.390174 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 173 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T03:58:29.394601 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T03:58:29.397999 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>2}} [----] I, [2016-09-13T03:58:29.398151 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T03:58:29.398247 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T03:58:29.402138 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [202019000], Memory % [3.36], CPU Time [147618.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T03:58:29.402494 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [75977], State: [ok], Delivered in [0.098168474] seconds [----] I, [2016-09-13T03:58:29.429000 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75981], State: [ok], Delivered in [0.05719086] seconds [----] I, [2016-09-13T03:58:29.463197 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75982], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.699281035] seconds [----] I, [2016-09-13T03:58:29.463379 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75982], Delivering... [----] I, [2016-09-13T03:58:29.469410 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003134012222290039, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031538009643554688, :pending_vm_jobs=>0.0007686614990234375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00565028190612793} [----] I, [2016-09-13T03:58:29.469778 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75982], State: [ok], Delivered in [0.006389539] seconds [----] I, [2016-09-13T03:58:30.577754 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75979], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.869760228] seconds [----] I, [2016-09-13T03:58:30.577957 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75979], Delivering... [----] I, [2016-09-13T03:58:30.584940 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75979], State: [ok], Delivered in [0.006938332] seconds [----] I, [2016-09-13T03:58:30.627118 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75980], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.895909147] seconds [----] I, [2016-09-13T03:58:30.627299 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75980], Delivering... [----] I, [2016-09-13T03:58:30.642775 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75980], State: [ok], Delivered in [0.015428806] seconds [----] I, [2016-09-13T03:58:33.550685 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:58:33 UTC]... [----] I, [2016-09-13T03:58:33.581065 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:58:33 UTC]...Complete [----] I, [2016-09-13T03:58:42.795333 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:58:42.823327 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75983], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:58:45.374951 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:58:45.378711 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035161972045898438, :worker_monitor=>1.4545917510986328, :worker_dequeue=>0.0069332122802734375, :total_time=>1.4653160572052002} [----] I, [2016-09-13T03:58:45.558288 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75983], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.749062944] seconds [----] I, [2016-09-13T03:58:45.558477 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75983], Delivering... [----] I, [2016-09-13T03:58:45.564152 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002854585647583008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028769969940185547, :pending_vm_jobs=>0.0006749629974365234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005318880081176758} [----] I, [2016-09-13T03:58:45.564488 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75983], State: [ok], Delivered in [0.00604124] seconds [----] I, [2016-09-13T03:58:57.837833 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T03:58:57.861740 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75984], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:58:57.896056 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75985], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:59:02.062016 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:59:02.068558 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004418611526489258, :worker_monitor=>1.6388554573059082, :worker_dequeue=>0.011799335479736328, :total_time=>1.6554839611053467} [----] I, [2016-09-13T03:59:02.747600 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75985], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.876858446] seconds [----] I, [2016-09-13T03:59:02.747805 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75985], Delivering... [----] I, [2016-09-13T03:59:02.754208 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003480672836303711, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003498554229736328, :pending_vm_jobs=>0.0007395744323730469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006014108657836914} [----] I, [2016-09-13T03:59:02.754581 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75985], State: [ok], Delivered in [0.006775] seconds [----] I, [2016-09-13T03:59:03.730935 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75984], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.885862612] seconds [----] I, [2016-09-13T03:59:03.731226 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75984], Delivering... [----] I, [2016-09-13T03:59:03.737824 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75984], State: [ok], Delivered in [0.006587906] seconds [----] I, [2016-09-13T03:59:07.069155 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:59:07 UTC]... [----] I, [2016-09-13T03:59:07.095863 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:59:07 UTC]...Complete [----] I, [2016-09-13T03:59:12.913349 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:59:12.947656 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75986], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:59:18.617179 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:59:18.628538 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033228397369384766, :worker_monitor=>1.4652957916259766, :worker_dequeue=>0.019369125366210938, :total_time=>1.4883005619049072} [----] I, [2016-09-13T03:59:18.852598 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75986], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.932110922] seconds [----] I, [2016-09-13T03:59:18.852869 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75986], Delivering... [----] I, [2016-09-13T03:59:18.860342 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0040705204010009766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004095554351806641, :pending_vm_jobs=>0.0008931159973144531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006960868835449219} [----] I, [2016-09-13T03:59:18.860770 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75986], State: [ok], Delivered in [0.007920504] seconds [----] I, [2016-09-13T03:59:28.441171 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:59:28.502083 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75987], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:59:28.524711 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75988], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:59:28.560379 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75989], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:59:28.587492 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75990], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:59:28.659002 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:59:28.913376 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75988], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.403244273] seconds [----] I, [2016-09-13T03:59:28.913672 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75988], Delivering... [----] I, [2016-09-13T03:59:28.971177 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75990], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.39714283] seconds [----] I, [2016-09-13T03:59:28.971455 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75990], Delivering... [----] I, [2016-09-13T03:59:28.980233 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0047838687896728516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00481867790222168, :pending_vm_jobs=>0.0010488033294677734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008292913436889648} [----] I, [2016-09-13T03:59:28.980777 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75990], State: [ok], Delivered in [0.009338211] seconds [----] I, [2016-09-13T03:59:28.982045 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75988], State: [ok], Delivered in [0.068338927] seconds [----] I, [2016-09-13T03:59:30.861764 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75987], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.380449202] seconds [----] I, [2016-09-13T03:59:30.862018 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75987], Delivering... [----] I, [2016-09-13T03:59:30.868365 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75987], State: [ok], Delivered in [0.006318659] seconds [----] I, [2016-09-13T03:59:30.908097 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75989], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.373483131] seconds [----] I, [2016-09-13T03:59:30.908338 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75989], Delivering... [----] I, [2016-09-13T03:59:30.917776 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75989], State: [ok], Delivered in [0.00939663] seconds [----] I, [2016-09-13T03:59:35.275451 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002853870391845703, :server_monitor=>0.1053464412689209, :worker_monitor=>1.4913413524627686, :worker_dequeue=>0.008051156997680664, :total_time=>1.6079094409942627} [----] I, [2016-09-13T03:59:40.275952 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:59:40 UTC]... [----] I, [2016-09-13T03:59:40.295804 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 07:59:40 UTC]...Complete [----] I, [2016-09-13T03:59:43.601399 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T03:59:43.613922 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75991], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:59:45.320844 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T03:59:45.985767 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75991], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.379860931] seconds [----] I, [2016-09-13T03:59:45.985979 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75991], Delivering... [----] I, [2016-09-13T03:59:45.992608 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003507852554321289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003527402877807617, :pending_vm_jobs=>0.0008165836334228516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006215572357177734} [----] I, [2016-09-13T03:59:45.992961 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75991], State: [ok], Delivered in [0.006996682] seconds [----] I, [2016-09-13T03:59:51.537730 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0027425289154052734, :worker_monitor=>1.1955177783966064, :worker_dequeue=>0.011489391326904297, :total_time=>1.209991693496704} [----] I, [2016-09-13T03:59:58.623384 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T03:59:58.637163 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75992], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:59:58.666040 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75993], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:59:58.688784 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75994], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:59:58.706131 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75995], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T03:59:58.723538 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75996], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:00:01.565230 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:00:02.272269 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75993], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.629791454] seconds [----] I, [2016-09-13T04:00:02.272617 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75993], Delivering... [----] I, [2016-09-13T04:00:02.283356 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0058100223541259766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005839109420776367, :pending_vm_jobs=>0.0012674331665039062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010193109512329102} [----] I, [2016-09-13T04:00:02.283868 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75993], State: [ok], Delivered in [0.011257957] seconds [----] I, [2016-09-13T04:00:04.066375 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75992], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.438972586] seconds [----] I, [2016-09-13T04:00:04.066608 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75992], Delivering... [----] I, [2016-09-13T04:00:04.071143 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75992], State: [ok], Delivered in [0.004526922] seconds [----] I, [2016-09-13T04:00:04.261645 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75994], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.588351839] seconds [----] I, [2016-09-13T04:00:04.261936 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75994], Delivering... [----] I, [2016-09-13T04:00:04.265620 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75994], State: [ok], Delivered in [0.003690013] seconds [----] I, [2016-09-13T04:00:04.317490 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75996], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.605973481] seconds [----] I, [2016-09-13T04:00:04.317492 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75995], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.623943182] seconds [----] I, [2016-09-13T04:00:04.317704 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75996], Delivering... [----] I, [2016-09-13T04:00:04.317705 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75995], Delivering... [----] I, [2016-09-13T04:00:04.324852 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75996], State: [ok], Delivered in [0.007121951] seconds [----] I, [2016-09-13T04:00:04.328830 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75995], State: [ok], Delivered in [0.011097187] seconds [----] I, [2016-09-13T04:00:08.176149 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003467082977294922, :worker_monitor=>1.59238862991333, :worker_dequeue=>0.011040687561035156, :total_time=>1.6072306632995605} [----] I, [2016-09-13T04:00:13.176705 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:00:13 UTC]... [----] I, [2016-09-13T04:00:13.208973 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:00:13 UTC]...Complete [----] I, [2016-09-13T04:00:13.732993 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T04:00:13.734440 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget] [----] I, [2016-09-13T04:00:13.745801 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75997], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473757200] [----] I, [2016-09-13T04:00:13.745983 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T04:00:13.747322 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget] [----] I, [2016-09-13T04:00:13.755646 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75998], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473757200] [----] I, [2016-09-13T04:00:13.755770 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T04:00:13.772921 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [75999], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:00:18.237732 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:00:18.361812 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [75999], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.602393814] seconds [----] I, [2016-09-13T04:00:18.361991 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [75999], Delivering... [----] I, [2016-09-13T04:00:18.367360 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028417110443115234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028548240661621094, :pending_vm_jobs=>0.0006518363952636719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005010843276977539} [----] I, [2016-09-13T04:00:18.367701 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [75999], State: [ok], Delivered in [0.005705107] seconds [----] I, [2016-09-13T04:00:19.436276 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75997], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473757200], Dequeued in: [5.700747388] seconds [----] I, [2016-09-13T04:00:19.436488 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75997], Delivering... [----] I, [2016-09-13T04:00:19.450672 #2937:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered VMs] invoking action: [generate_widget] for target: [rss_newest_vms] [----] I, [2016-09-13T04:00:19.482055 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [75998], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473757200], Dequeued in: [5.733651932] seconds [----] I, [2016-09-13T04:00:19.482222 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [75998], Delivering... [----] I, [2016-09-13T04:00:19.491568 #2928:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered Hosts] invoking action: [generate_widget] for target: [rss_newest_hosts] [----] I, [2016-09-13T04:00:19.515905 #2937:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [209], Name: [Generate Widget: 'EVM: Recently Discovered VMs'] for: [1] groups [----] I, [2016-09-13T04:00:19.523028 #2928:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [210], Name: [Generate Widget: 'EVM: Recently Discovered Hosts'] for: [1] groups [----] I, [2016-09-13T04:00:19.534595 #2937:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered VMs] ID: [19] Queueing Content Generation [----] I, [2016-09-13T04:00:19.547131 #2928:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered Hosts] ID: [18] Queueing Content Generation [----] I, [2016-09-13T04:00:19.556214 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76000], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T04:00:19.556476 #2937:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered VMs] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered VMs] [----] I, [2016-09-13T04:00:19.573831 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76001], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T04:00:19.574069 #2928:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered Hosts] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered Hosts] [----] I, [2016-09-13T04:00:19.579038 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75997], State: [ok], Delivered in [0.142515389] seconds [----] I, [2016-09-13T04:00:19.607932 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [75998], State: [ok], Delivered in [0.125672867] seconds [----] I, [2016-09-13T04:00:24.594660 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=reporting, wcount=2, priority=200 [----] I, [2016-09-13T04:00:24.598312 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033960342407226562, :worker_monitor=>1.340423345565796, :worker_dequeue=>0.009940147399902344, :total_time=>1.354015827178955} [----] I, [2016-09-13T04:00:24.923971 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [76000], MiqWorker id: [18], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [5.381913713] seconds [----] I, [2016-09-13T04:00:24.924229 #2978:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76000], Delivering... [----] I, [2016-09-13T04:00:24.928023 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [76001], MiqWorker id: [17], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [5.37358925] seconds [----] I, [2016-09-13T04:00:24.928198 #2967:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76001], Delivering... [----] I, [2016-09-13T04:00:24.940363 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T04:00:24.945610 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T04:00:24.976727 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T04:00:24.977159 #2967:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76001], State: [ok], Delivered in [0.048937046] seconds [----] I, [2016-09-13T04:00:24.980883 #2967:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [76001], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T04:00:24.981079 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [18], MiqTask ID: [210], Status: [ok] [----] I, [2016-09-13T04:00:24.983798 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T04:00:24.984202 #2978:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76000], State: [ok], Delivered in [0.060010581] seconds [----] I, [2016-09-13T04:00:24.986440 #2978:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [76000], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T04:00:24.986624 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [19], MiqTask ID: [209], Status: [ok] [----] I, [2016-09-13T04:00:24.987944 #2967:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [210] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T04:00:24.992696 #2978:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [209] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T04:00:28.782082 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:00:28.812077 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76002], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:00:28.830646 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76003], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:00:28.847946 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76004], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:00:28.881893 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76005], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:00:28.888713 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered Hosts] with id: [18] [----] I, [2016-09-13T04:00:28.888874 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_18 [----] I, [2016-09-13T04:00:28.893002 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T04:00:28.893364 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 09:00:00 UTC [----] I, [2016-09-13T04:00:28.895527 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered Hosts] schedule updated to run at 2016-09-13 09:00:00 UTC with interval 3600 [----] I, [2016-09-13T04:00:28.896052 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered VMs] with id: [19] [----] I, [2016-09-13T04:00:28.896226 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_19 [----] I, [2016-09-13T04:00:28.900571 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T04:00:28.901160 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 09:00:00 UTC [----] I, [2016-09-13T04:00:28.903729 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered VMs] schedule updated to run at 2016-09-13 09:00:00 UTC with interval 3600 [----] I, [2016-09-13T04:00:29.612024 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:00:30.476538 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76003], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.660014955] seconds [----] I, [2016-09-13T04:00:30.476751 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76003], Delivering... [----] I, [2016-09-13T04:00:30.499074 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76005], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.635745841] seconds [----] I, [2016-09-13T04:00:30.499240 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76005], Delivering... [----] I, [2016-09-13T04:00:30.505381 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003227710723876953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032470226287841797, :pending_vm_jobs=>0.0007898807525634766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057446956634521484} [----] I, [2016-09-13T04:00:30.505771 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76005], State: [ok], Delivered in [0.006522744] seconds [----] I, [2016-09-13T04:00:30.527497 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76003], State: [ok], Delivered in [0.050711334] seconds [----] I, [2016-09-13T04:00:31.653949 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76002], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.867282582] seconds [----] I, [2016-09-13T04:00:31.654139 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76002], Delivering... [----] I, [2016-09-13T04:00:31.658914 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76002], State: [ok], Delivered in [0.004760231] seconds [----] I, [2016-09-13T04:00:31.701346 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76004], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.864901894] seconds [----] I, [2016-09-13T04:00:31.701641 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76004], Delivering... [----] I, [2016-09-13T04:00:31.705226 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76004], State: [ok], Delivered in [0.003579178] seconds [----] I, [2016-09-13T04:00:41.231808 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.010111808776855469, :worker_monitor=>1.4422733783721924, :worker_dequeue=>0.009435892105102539, :total_time=>1.4622409343719482} [----] I, [2016-09-13T04:00:43.908557 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:00:43.944957 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76006], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:00:46.232198 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:00:46 UTC]... [----] I, [2016-09-13T04:00:46.247562 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:00:46 UTC]...Complete [----] I, [2016-09-13T04:00:46.256291 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:00:46.620459 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76006], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.705719228] seconds [----] I, [2016-09-13T04:00:46.620616 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76006], Delivering... [----] I, [2016-09-13T04:00:46.624458 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020384788513183594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002050161361694336, :pending_vm_jobs=>0.0004138946533203125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0035903453826904297} [----] I, [2016-09-13T04:00:46.624713 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76006], State: [ok], Delivered in [0.004089757] seconds [----] I, [2016-09-13T04:00:57.531394 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002858400344848633, :worker_monitor=>1.2346043586730957, :worker_dequeue=>0.007467985153198242, :total_time=>1.2451882362365723} [----] I, [2016-09-13T04:00:58.959693 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:00:58.985215 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76007], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:00:59.002338 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76008], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:01:02.542239 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:01:02.773770 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76008], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.783741509] seconds [----] I, [2016-09-13T04:01:02.773983 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76008], Delivering... [----] I, [2016-09-13T04:01:02.779901 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030753612518310547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003092527389526367, :pending_vm_jobs=>0.0007319450378417969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005559444427490234} [----] I, [2016-09-13T04:01:02.780315 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76008], State: [ok], Delivered in [0.00634062] seconds [----] I, [2016-09-13T04:01:04.825620 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76007], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.859788348] seconds [----] I, [2016-09-13T04:01:04.825820 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76007], Delivering... [----] I, [2016-09-13T04:01:04.830406 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76007], State: [ok], Delivered in [0.004570911] seconds [----] I, [2016-09-13T04:01:14.022373 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:01:14.060141 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76009], id: [], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:01:14.094487 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76010], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:01:14.161961 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:01:14.169517 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0042989253997802734, :worker_monitor=>1.5886552333831787, :worker_dequeue=>0.014883041381835938, :total_time=>1.608241319656372} [----] I, [2016-09-13T04:01:14.882999 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76010], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.816912945] seconds [----] I, [2016-09-13T04:01:14.883179 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76010], Delivering... [----] I, [2016-09-13T04:01:14.888669 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029001235961914062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029189586639404297, :pending_vm_jobs=>0.0006971359252929688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005159854888916016} [----] I, [2016-09-13T04:01:14.889041 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76010], State: [ok], Delivered in [0.005848755] seconds [----] I, [2016-09-13T04:01:16.889345 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76009], MiqWorker id: [14], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.848015046] seconds [----] I, [2016-09-13T04:01:16.889545 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76009], Delivering... [----] I, [2016-09-13T04:01:19.170176 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:01:19 UTC]... [----] I, [2016-09-13T04:01:19.196446 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:01:19 UTC]...Complete [----] I, [2016-09-13T04:01:29.111401 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:01:29.225832 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76011], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:01:29.242133 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T04:01:29.277755 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76012], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:01:29.392582 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76013], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:01:29.517652 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76014], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:01:31.181181 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:01:31.186400 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003362417221069336, :log_active_servers=>0.009149789810180664, :worker_monitor=>1.9326069355010986, :worker_dequeue=>0.011329889297485352, :total_time=>1.9567430019378662} [----] I, [2016-09-13T04:01:31.942627 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76012], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.712899198] seconds [----] I, [2016-09-13T04:01:31.942782 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76012], Delivering... [----] I, [2016-09-13T04:01:32.011325 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76012], State: [ok], Delivered in [0.068521487] seconds [----] I, [2016-09-13T04:01:32.011626 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76014], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.609476424] seconds [----] I, [2016-09-13T04:01:32.011777 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76014], Delivering... [----] I, [2016-09-13T04:01:32.017344 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002969026565551758, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00299072265625, :pending_vm_jobs=>0.0007345676422119141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005243778228759766} [----] I, [2016-09-13T04:01:32.017694 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76014], State: [ok], Delivered in [0.005903666] seconds [----] I, [2016-09-13T04:01:32.100717 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76011], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.984986891] seconds [----] I, [2016-09-13T04:01:32.100874 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76011], Delivering... [----] I, [2016-09-13T04:01:32.104726 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76011], State: [ok], Delivered in [0.003841986] seconds [----] I, [2016-09-13T04:01:32.266549 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76013], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.98405356] seconds [----] I, [2016-09-13T04:01:32.266709 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76013], Delivering... [----] I, [2016-09-13T04:01:32.269273 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76013], State: [ok], Delivered in [0.002560322] seconds [----] I, [2016-09-13T04:01:44.529143 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:01:44.554451 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76015], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:01:48.034021 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:01:48.038539 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003766775131225586, :worker_monitor=>1.7360572814941406, :worker_dequeue=>0.008468866348266602, :total_time=>1.7486183643341064} [----] I, [2016-09-13T04:01:48.201102 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76015], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.665622132] seconds [----] I, [2016-09-13T04:01:48.201341 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76015], Delivering... [----] I, [2016-09-13T04:01:48.215666 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.010752201080322266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.010776519775390625, :pending_vm_jobs=>0.0009388923645019531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.013929367065429688} [----] I, [2016-09-13T04:01:48.216122 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76015], State: [ok], Delivered in [0.014791251] seconds [----] I, [2016-09-13T04:01:53.039084 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:01:53 UTC]... [----] I, [2016-09-13T04:01:53.081460 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:01:53 UTC]...Complete [----] I, [2016-09-13T04:01:59.568735 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:01:59.585277 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76016], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:01:59.596610 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76017], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:02:04.723102 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:02:04.728059 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036292076110839844, :worker_monitor=>1.593437910079956, :worker_dequeue=>0.01058506965637207, :total_time=>1.6080067157745361} [----] I, [2016-09-13T04:02:05.285242 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76017], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.696306851] seconds [----] I, [2016-09-13T04:02:05.285487 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76017], Delivering... [----] I, [2016-09-13T04:02:05.292950 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003838777542114258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038640499114990234, :pending_vm_jobs=>0.0009875297546386719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006980419158935547} [----] I, [2016-09-13T04:02:05.293342 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76017], State: [ok], Delivered in [0.007879433] seconds [----] I, [2016-09-13T04:02:05.394045 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76016], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.822313595] seconds [----] I, [2016-09-13T04:02:05.394236 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76016], Delivering... [----] I, [2016-09-13T04:02:05.398601 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76016], State: [ok], Delivered in [0.004326757] seconds [----] I, [2016-09-13T04:02:14.605444 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:02:14.785751 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76018], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:02:21.194288 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:02:21.198037 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004180908203125, :worker_monitor=>1.3646466732025146, :worker_dequeue=>0.0068759918212890625, :total_time=>1.3760004043579102} [----] I, [2016-09-13T04:02:21.436613 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76018], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.821952972] seconds [----] I, [2016-09-13T04:02:21.436731 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76018], Delivering... [----] I, [2016-09-13T04:02:21.440359 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002028942108154297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020399093627929688, :pending_vm_jobs=>0.00041031837463378906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0034003257751464844} [----] I, [2016-09-13T04:02:21.440595 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76018], State: [ok], Delivered in [0.003863557] seconds [----] I, [2016-09-13T04:02:26.198540 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:02:26 UTC]... [----] I, [2016-09-13T04:02:26.265918 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:02:26 UTC]...Complete [----] I, [2016-09-13T04:02:29.796702 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:02:29.853691 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76019], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:02:29.882116 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76020], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:02:29.917141 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76021], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:02:29.957380 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76022], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:02:31.313175 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:02:31.579943 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76020], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.721370367] seconds [----] I, [2016-09-13T04:02:31.580084 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76020], Delivering... [----] I, [2016-09-13T04:02:31.626109 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76022], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.701244191] seconds [----] I, [2016-09-13T04:02:31.626367 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76022], Delivering... [----] I, [2016-09-13T04:02:31.636033 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004873037338256836, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004901409149169922, :pending_vm_jobs=>0.001176595687866211, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009095907211303711} [----] I, [2016-09-13T04:02:31.636535 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76022], State: [ok], Delivered in [0.010105256] seconds [----] I, [2016-09-13T04:02:31.667750 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76020], State: [ok], Delivered in [0.087625334] seconds [----] I, [2016-09-13T04:02:32.588078 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76019], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.7880961] seconds [----] I, [2016-09-13T04:02:32.588309 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76019], Delivering... [----] I, [2016-09-13T04:02:32.592486 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76019], State: [ok], Delivered in [0.004145509] seconds [----] I, [2016-09-13T04:02:32.780121 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76021], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.893951946] seconds [----] I, [2016-09-13T04:02:32.780264 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76021], Delivering... [----] I, [2016-09-13T04:02:32.782720 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76021], State: [ok], Delivered in [0.002442291] seconds [----] I, [2016-09-13T04:02:38.876755 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004155635833740234, :server_monitor=>0.134385347366333, :worker_monitor=>2.399608850479126, :worker_dequeue=>0.00838160514831543, :total_time=>2.546952962875366} [----] I, [2016-09-13T04:02:41.124862 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76009], State: [ok], Delivered in [84.23529593] seconds [----] I, [2016-09-13T04:02:44.969363 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:02:44.996597 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76023], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:02:48.912521 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:02:49.898723 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76023], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.922474791] seconds [----] I, [2016-09-13T04:02:49.898967 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76023], Delivering... [----] I, [2016-09-13T04:02:49.906167 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003734111785888672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037567615509033203, :pending_vm_jobs=>0.0009324550628662109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006802082061767578} [----] I, [2016-09-13T04:02:49.906589 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76023], State: [ok], Delivered in [0.0076202] seconds [----] I, [2016-09-13T04:02:55.283621 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005650758743286133, :worker_monitor=>1.3412537574768066, :worker_dequeue=>0.012524127960205078, :total_time=>1.3597886562347412} [----] I, [2016-09-13T04:03:00.010087 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:03:00.026616 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76024], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:03:00.050844 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76025], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:03:00.284238 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:03:00 UTC]... [----] I, [2016-09-13T04:03:00.335280 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:03:00 UTC]...Complete [----] I, [2016-09-13T04:03:00.348003 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:03:00.976942 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76025], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.943967463] seconds [----] I, [2016-09-13T04:03:00.977181 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76025], Delivering... [----] I, [2016-09-13T04:03:00.984403 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003898143768310547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003921031951904297, :pending_vm_jobs=>0.0008397102355957031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00673985481262207} [----] I, [2016-09-13T04:03:00.984902 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76025], State: [ok], Delivered in [0.007723637] seconds [----] I, [2016-09-13T04:03:02.266928 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76024], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.251726462] seconds [----] I, [2016-09-13T04:03:02.267125 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76024], Delivering... [----] I, [2016-09-13T04:03:02.272086 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76024], State: [ok], Delivered in [0.004963984] seconds [----] I, [2016-09-13T04:03:11.931196 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004089832305908203, :worker_monitor=>1.5437872409820557, :worker_dequeue=>0.011100053787231445, :total_time=>1.5592877864837646} [----] I, [2016-09-13T04:03:15.065611 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:03:15.096902 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76026], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:03:15.120164 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76027], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:03:15.137404 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76028], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:03:16.941583 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:03:17.096980 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76026], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.022388803] seconds [----] I, [2016-09-13T04:03:17.097185 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76026], Delivering... [----] I, [2016-09-13T04:03:17.103312 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003107786178588867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003130674362182617, :pending_vm_jobs=>0.0007634162902832031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005737781524658203} [----] I, [2016-09-13T04:03:17.103700 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76026], State: [ok], Delivered in [0.006518646] seconds [----] I, [2016-09-13T04:03:17.136898 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76027], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.033254135] seconds [----] I, [2016-09-13T04:03:17.137068 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76027], Delivering... [----] I, [2016-09-13T04:03:17.138187 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T04:03:17.138386 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5329063936 [----] I, [2016-09-13T04:03:17.138533 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5116149760 [----] I, [2016-09-13T04:03:17.138619 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 212914176 [----] I, [2016-09-13T04:03:17.138691 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1310720000 [----] I, [2016-09-13T04:03:17.138759 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5062426624 [----] I, [2016-09-13T04:03:17.138825 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T04:03:17.138896 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T04:03:17.138961 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 533917696 [----] I, [2016-09-13T04:03:17.139027 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T04:03:17.139093 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7864430592 [----] I, [2016-09-13T04:03:17.139160 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T04:03:17.139227 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T04:03:17.139303 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T04:03:17.139440 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 1331200 [----] I, [2016-09-13T04:03:17.139570 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T04:03:17.139647 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T04:03:17.139714 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T04:03:17.139782 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T04:03:17.139865 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T04:03:17.139934 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T04:03:17.140036 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273502208 [----] I, [2016-09-13T04:03:17.140111 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56389632 [----] I, [2016-09-13T04:03:17.140175 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217112576 [----] I, [2016-09-13T04:03:17.140242 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T04:03:17.140310 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140558336 [----] I, [2016-09-13T04:03:17.140375 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2605699072 [----] I, [2016-09-13T04:03:17.140469 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2297511936 [----] I, [2016-09-13T04:03:17.140570 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T04:03:17.140640 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T04:03:17.140709 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T04:03:17.140773 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37277696 [----] I, [2016-09-13T04:03:17.140837 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102281216 [----] I, [2016-09-13T04:03:17.140900 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53063680 [----] I, [2016-09-13T04:03:17.140961 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110112768 [----] I, [2016-09-13T04:03:17.141027 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155344896 [----] I, [2016-09-13T04:03:17.141087 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T04:03:17.141149 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T04:03:17.141211 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T04:03:17.141270 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T04:03:17.141332 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T04:03:17.141394 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T04:03:17.141512 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T04:03:17.141596 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T04:03:17.141670 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T04:03:17.148810 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76028], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.023997967] seconds [----] I, [2016-09-13T04:03:17.149089 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76028], Delivering... [----] I, [2016-09-13T04:03:17.156908 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:03:08 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [47862.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T04:03:17.157758 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:03:10 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50178.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:03:17.158534 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:03:11 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162415000], Memory % [3.1], CPU Time [36990.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T04:03:17.159066 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:03:11 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [197010.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T04:03:17.159604 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:03:00 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [233547.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T04:03:17.160041 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:03:11 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [102794.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T04:03:17.160587 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:03:11 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [146756.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:03:17.161060 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:03:11 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [147696.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:03:17.165142 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:03:08 UTC], Process Info: Memory Usage [597655552], Memory Size [940814336], Proportional Set Size: [434952000], Memory % [7.29], CPU Time [506.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:03:17.168192 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [95], PID [22463], GUID [db78f78e-7978-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:03:08 UTC], Process Info: Memory Usage [583344128], Memory Size [912166912], Proportional Set Size: [422714000], Memory % [7.11], CPU Time [1078.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:03:17.171275 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:03:07 UTC], Process Info: Memory Usage [580673536], Memory Size [923250688], Proportional Set Size: [420002000], Memory % [7.08], CPU Time [915.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T04:03:17.174015 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:03:04 UTC], Process Info: Memory Usage [557891584], Memory Size [911458304], Proportional Set Size: [405613000], Memory % [6.8], CPU Time [4267.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T04:03:17.174586 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:03:08 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [205683.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T04:03:17.175082 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:03:10 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [50198.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:03:17.175552 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:03:04 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165800000], Memory % [3.16], CPU Time [37859.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T04:03:17.175901 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76028], State: [ok], Delivered in [0.026849991] seconds [----] I, [2016-09-13T04:03:17.183967 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T04:03:17.184146 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T04:03:17.187635 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T04:03:17.191740 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T04:03:17.195890 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T04:03:17.198886 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T04:03:17.201860 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T04:03:17.204759 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 835 MB 1.17 GB 41% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T04:03:17.207641 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T04:03:17.210625 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T04:03:17.213516 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.6 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T04:03:17.216868 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T04:03:17.219748 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 177 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T04:03:17.222512 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T04:03:17.225133 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:03:17.225271 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:03:17.225366 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T04:03:17.229809 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [146746.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T04:03:17.230195 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76027], State: [ok], Delivered in [0.093106993] seconds [----] I, [2016-09-13T04:03:28.185014 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004319667816162109, :worker_monitor=>1.201280117034912, :worker_dequeue=>0.006511211395263672, :total_time=>1.2124183177947998} [----] I, [2016-09-13T04:03:30.151363 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:03:30.164992 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76029], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:03:30.176325 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76030], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:03:30.193663 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76031], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:03:30.216574 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76032], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:03:33.185653 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:03:33 UTC]... [----] I, [2016-09-13T04:03:33.206170 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:03:33 UTC]...Complete [----] I, [2016-09-13T04:03:33.219199 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:03:33.296574 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76030], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.127288372] seconds [----] I, [2016-09-13T04:03:33.296770 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76030], Delivering... [----] I, [2016-09-13T04:03:33.359404 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76030], State: [ok], Delivered in [0.06260579] seconds [----] I, [2016-09-13T04:03:33.365315 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76032], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.162494314] seconds [----] I, [2016-09-13T04:03:33.365564 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76032], Delivering... [----] I, [2016-09-13T04:03:33.372180 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003423929214477539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003445863723754883, :pending_vm_jobs=>0.0008733272552490234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062062740325927734} [----] I, [2016-09-13T04:03:33.372551 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76032], State: [ok], Delivered in [0.007002135] seconds [----] I, [2016-09-13T04:03:35.371064 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76029], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.214800156] seconds [----] I, [2016-09-13T04:03:35.371273 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76029], Delivering... [----] I, [2016-09-13T04:03:35.376109 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76029], State: [ok], Delivered in [0.004826495] seconds [----] I, [2016-09-13T04:03:35.405548 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76031], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.224060246] seconds [----] I, [2016-09-13T04:03:35.405773 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76031], Delivering... [----] I, [2016-09-13T04:03:35.409584 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76031], State: [ok], Delivered in [0.003795558] seconds [----] I, [2016-09-13T04:03:45.166931 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.011586666107177734, :worker_monitor=>1.8216514587402344, :worker_dequeue=>0.010266542434692383, :total_time=>1.8440001010894775} [----] I, [2016-09-13T04:03:45.227812 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:03:45.246138 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76033], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:03:50.177977 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:03:50.514255 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76033], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.277458649] seconds [----] I, [2016-09-13T04:03:50.514466 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76033], Delivering... [----] I, [2016-09-13T04:03:50.520924 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033121109008789062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033295154571533203, :pending_vm_jobs=>0.0008313655853271484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006024360656738281} [----] I, [2016-09-13T04:03:50.521257 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76033], State: [ok], Delivered in [0.006819468] seconds [----] I, [2016-09-13T04:04:00.257760 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 11. [----] I, [2016-09-13T04:04:00.279619 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76034], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:04:00.290932 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76035], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:04:00.321035 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76036], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:04:01.450980 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:04:01.455263 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004775524139404297, :worker_monitor=>1.237107753753662, :worker_dequeue=>0.0076062679290771484, :total_time=>1.2498462200164795} [----] I, [2016-09-13T04:04:01.576660 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76035], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.291396091] seconds [----] I, [2016-09-13T04:04:01.576853 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76035], Delivering... [----] I, [2016-09-13T04:04:01.582721 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029783248901367188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002995729446411133, :pending_vm_jobs=>0.0007703304290771484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055124759674072266} [----] I, [2016-09-13T04:04:01.583054 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76035], State: [ok], Delivered in [0.006216727] seconds [----] I, [2016-09-13T04:04:02.571348 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76034], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.308780171] seconds [----] I, [2016-09-13T04:04:02.571582 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76034], Delivering... [----] I, [2016-09-13T04:04:02.581748 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76034], State: [ok], Delivered in [0.010126888] seconds [----] I, [2016-09-13T04:04:02.605457 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76036], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.294417555] seconds [----] I, [2016-09-13T04:04:02.605696 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76036], Delivering... [----] I, [2016-09-13T04:04:02.634010 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76037], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T04:04:02.651041 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76038], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T04:04:02.651402 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76036], State: [ok], Delivered in [0.045710931] seconds [----] I, [2016-09-13T04:04:06.455752 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:04:06 UTC]... [----] I, [2016-09-13T04:04:06.473645 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:04:06 UTC]...Complete [----] I, [2016-09-13T04:04:06.489100 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T04:04:06.491440 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T04:04:08.264071 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [76038], MiqWorker id: [96], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [5.624079087] seconds [----] I, [2016-09-13T04:04:08.264292 #28071:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76038], Delivering... [----] I, [2016-09-13T04:04:08.268335 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T04:04:08.268586 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T04:04:08.268741 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T04:04:08.268905 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T04:04:08.269076 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:08.728834 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:08.732481 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [76037], MiqWorker id: [95], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [6.110225893] seconds [----] I, [2016-09-13T04:04:08.732734 #22463:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76037], Delivering... [----] I, [2016-09-13T04:04:08.736855 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T04:04:08.737036 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T04:04:08.737201 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T04:04:08.737370 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T04:04:08.737575 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:09.021406 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:09.034021 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:09.034330 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:09.226523 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:09.226694 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:09.516251 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:09.604083 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:09.697727 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:09.787745 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:09.955389 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:09.955621 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:10.275661 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:10.384752 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:10.471548 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:10.478325 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:10.569948 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:10.661747 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:10.757780 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:10.772875 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:10.773061 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:10.849532 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:10.942744 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:11.034954 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:11.127135 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:11.219038 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:11.240743 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:11.312716 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:11.405045 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:11.497110 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:11.545330 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:11.545557 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:11.588983 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:11.680520 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:11.772054 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:04:11.981235 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T04:04:11.981406 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004083156585693359, :collect_inventory_for_targets=>7.200241088867188e-05, :parse_legacy_inventory=>27.254266262054443, :parse_targeted_inventory=>27.254473447799683, :save_inventory=>1.4829983711242676, :ems_refresh=>28.741682767868042} [----] I, [2016-09-13T04:04:11.994557 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T04:04:11.994932 #22463:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76037], State: [ok], Delivered in [3.262218335] seconds [----] I, [2016-09-13T04:04:13.065793 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:13.384483 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:13.384707 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:13.844056 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:14.170031 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:14.170206 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:14.676852 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:14.963526 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:14.963717 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:15.336687 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:04:15.354865 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76039], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:04:15.444037 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:15.746447 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:15.746690 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:16.222020 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:16.527263 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:16.527544 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:17.019971 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:17.359942 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:17.360148 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:17.849726 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:18.161879 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:18.162097 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:18.105128 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:04:18.176329 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004586458206176758, :worker_monitor=>1.5846052169799805, :worker_dequeue=>0.07723450660705566, :total_time=>1.6668548583984375} [----] I, [2016-09-13T04:04:18.653731 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:18.686286 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76039], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.34322286] seconds [----] I, [2016-09-13T04:04:18.686571 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76039], Delivering... [----] I, [2016-09-13T04:04:18.693307 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003575563430786133, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003660440444946289, :pending_vm_jobs=>0.0007843971252441406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006293058395385742} [----] I, [2016-09-13T04:04:18.693711 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76039], State: [ok], Delivered in [0.007177816] seconds [----] I, [2016-09-13T04:04:18.969123 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:18.969342 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:19.453056 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:19.628452 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:19.763050 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:19.900645 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:20.043361 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:20.180954 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:20.326167 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:20.461296 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:20.600351 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:20.740820 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:20.879039 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:21.017174 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:21.162781 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:21.309569 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:21.639515 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:27.821658 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:27.975852 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:28.117549 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:28.257106 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:28.395536 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:28.535689 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:28.683745 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:28.822925 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:28.968104 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:29.118636 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:29.264683 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:29.403404 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:29.551515 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:29.707631 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:29.856654 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:30.003512 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:30.367784 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:04:30.383153 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76040], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:04:30.394708 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76041], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:04:30.407282 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76042], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:04:30.423220 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76043], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:04:30.511599 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:30.670662 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:30.812838 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:30.963838 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:31.111852 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:31.254064 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:31.391781 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:31.536790 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:31.677663 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:31.815060 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:31.963540 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:32.110755 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:32.249132 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:32.388468 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:32.527182 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:32.679189 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:32.821768 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:33.165455 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:33.318342 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:33.457739 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:33.597802 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:33.745996 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:33.883905 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:34.045483 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:34.191753 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:34.355719 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:34.414082 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:04:34.421274 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00464630126953125, :worker_monitor=>1.1828856468200684, :worker_dequeue=>0.012938261032104492, :total_time=>1.2008635997772217} [----] I, [2016-09-13T04:04:34.524177 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:34.672921 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:34.835150 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76041], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.448806627] seconds [----] I, [2016-09-13T04:04:34.835325 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76041], Delivering... [----] I, [2016-09-13T04:04:34.846754 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76043], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.432075862] seconds [----] I, [2016-09-13T04:04:34.847015 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76043], Delivering... [----] I, [2016-09-13T04:04:34.856853 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00493311882019043, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004962444305419922, :pending_vm_jobs=>0.0012195110321044922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009282350540161133} [----] I, [2016-09-13T04:04:34.857466 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76043], State: [ok], Delivered in [0.01041124] seconds [----] I, [2016-09-13T04:04:34.886889 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:34.887300 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76041], State: [ok], Delivered in [0.051946618] seconds [----] I, [2016-09-13T04:04:35.032716 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:35.182996 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:35.337779 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:35.479975 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:35.614793 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:35.800701 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76040], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.429073049] seconds [----] I, [2016-09-13T04:04:35.800943 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76040], Delivering... [----] I, [2016-09-13T04:04:35.805482 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76040], State: [ok], Delivered in [0.004498208] seconds [----] I, [2016-09-13T04:04:35.829150 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76042], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.429949405] seconds [----] I, [2016-09-13T04:04:35.829322 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76042], Delivering... [----] I, [2016-09-13T04:04:35.836932 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76042], State: [ok], Delivered in [0.007598826] seconds [----] I, [2016-09-13T04:04:35.964165 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:36.126876 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:36.276518 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:36.419944 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:36.566370 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:36.714754 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:36.854169 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:36.997982 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:37.147878 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:37.286446 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:37.437877 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:37.578702 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:37.720128 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:37.863920 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:38.008018 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:38.150321 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:38.291380 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:38.801584 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:39.421901 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:04:39 UTC]... [----] I, [2016-09-13T04:04:39.434649 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:04:39 UTC]...Complete [----] I, [2016-09-13T04:04:44.970517 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:45.113868 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:45.257812 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:45.410363 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:45.434089 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:04:45.453970 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76044], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:04:45.551928 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:45.693634 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:45.840658 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:45.984376 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:46.124786 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:46.272566 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:46.411951 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:46.545504 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:46.693357 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:46.839616 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:46.984302 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:47.130960 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:47.495847 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:47.667243 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:47.816271 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:47.964240 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:48.106950 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:48.273520 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:48.412537 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:48.557680 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:48.706662 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:48.845952 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:48.985993 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:49.128802 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:49.273573 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:49.418904 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:49.576069 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:49.713011 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:49.857081 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:50.253158 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:50.424019 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:50.564340 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:50.705268 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:50.850938 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:50.998777 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:51.159450 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:51.296748 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:04:51.303850 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004708766937255859, :worker_monitor=>1.7106881141662598, :worker_dequeue=>0.013117074966430664, :total_time=>1.7289435863494873} [----] I, [2016-09-13T04:04:51.308960 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:51.463572 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:51.611535 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:51.747036 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:51.894679 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:52.029643 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76044], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.588708175] seconds [----] I, [2016-09-13T04:04:52.029836 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76044], Delivering... [----] I, [2016-09-13T04:04:52.031552 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:52.035987 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033316612243652344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003366708755493164, :pending_vm_jobs=>0.0007221698760986328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005750179290771484} [----] I, [2016-09-13T04:04:52.036335 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76044], State: [ok], Delivered in [0.006496117] seconds [----] I, [2016-09-13T04:04:52.190626 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:52.333677 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:52.477847 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:52.624961 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:53.018382 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:53.184194 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:53.344291 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:53.495255 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:53.642300 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:53.787932 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:53.923987 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:54.064544 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:54.208957 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:04:54.344318 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:00.466996 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:05:00.486584 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76045], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:05:00.501074 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:00.515352 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76046], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:05:00.648164 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:00.810682 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:00.957117 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:01.102972 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:01.260759 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:01.331588 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:05:01.405581 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:01.945180 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:02.127176 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76046], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.63396671] seconds [----] I, [2016-09-13T04:05:02.127394 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76046], Delivering... [----] I, [2016-09-13T04:05:02.130758 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:02.136007 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005185604095458984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005208015441894531, :pending_vm_jobs=>0.001007080078125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008104801177978516} [----] I, [2016-09-13T04:05:02.136374 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76046], State: [ok], Delivered in [0.008977341] seconds [----] I, [2016-09-13T04:05:02.277611 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:02.418462 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:02.573089 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:02.737514 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:02.898736 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:02.961210 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76045], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.489119462] seconds [----] I, [2016-09-13T04:05:02.961456 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76045], Delivering... [----] I, [2016-09-13T04:05:02.968531 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76045], State: [ok], Delivered in [0.00701496] seconds [----] I, [2016-09-13T04:05:03.045404 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:03.186995 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:03.360387 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:03.506064 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:03.646764 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:03.991517 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:04.168322 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:04.316151 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:04.461782 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:04.610400 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:05.004817 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:05.308646 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:05.470211 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:05.645207 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:05.786732 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:05.934306 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:06.081132 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:06.245907 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:06.390942 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:06.533525 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:06.671994 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:06.817284 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:06.959703 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:07.150737 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:07.306754 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:07.465992 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:07.623084 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:07.793354 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004645109176635742, :worker_monitor=>1.437037706375122, :worker_dequeue=>0.012444019317626953, :total_time=>1.4544661045074463} [----] I, [2016-09-13T04:05:08.004012 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:08.177160 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:08.329588 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:08.493289 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:08.657931 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:08.806771 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:08.951183 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:09.095956 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:09.242288 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:09.379981 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:09.531558 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:09.677927 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:09.822059 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:09.969089 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:10.107924 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:10.250138 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:10.396474 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:11.017596 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:12.794088 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:05:12 UTC]... [----] I, [2016-09-13T04:05:12.824047 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:05:12 UTC]...Complete [----] I, [2016-09-13T04:05:15.529686 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:05:15.543829 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76047], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:05:17.176937 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:17.312162 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:17.461528 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:17.612289 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:17.751754 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:17.858665 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:05:17.891302 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:18.031814 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:18.042521 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76047], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.506396061] seconds [----] I, [2016-09-13T04:05:18.042721 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76047], Delivering... [----] I, [2016-09-13T04:05:18.049330 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034248828887939453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003444671630859375, :pending_vm_jobs=>0.0008623600006103516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00619196891784668} [----] I, [2016-09-13T04:05:18.049817 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76047], State: [ok], Delivered in [0.007097095] seconds [----] I, [2016-09-13T04:05:18.166923 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:18.311959 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:18.447266 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:18.586259 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:18.720872 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:18.867269 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:19.018871 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:19.165233 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:05:19.318333 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T04:05:19.529224 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T04:05:19.529841 #28071:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T04:05:19.530459 #28071:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T04:05:19.530727 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T04:05:19.530954 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T04:05:19.578570 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T04:05:19.579128 #28071:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [76038], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T04:05:19.579639 #28071:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T04:05:19.580088 #28071:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T04:05:19.580471 #28071:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76038], State: [error], Delivered in [71.316106531] seconds [----] I, [2016-09-13T04:05:24.095022 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00716090202331543, :worker_monitor=>1.212890863418579, :worker_dequeue=>0.008898258209228516, :total_time=>1.2293059825897217} [----] I, [2016-09-13T04:05:30.556299 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:05:30.578640 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76048], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:05:30.595820 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76049], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:05:30.618969 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76050], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:05:30.647473 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76051], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:05:34.121137 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:05:34.372797 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76049], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.789575601] seconds [----] I, [2016-09-13T04:05:34.372963 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76049], Delivering... [----] I, [2016-09-13T04:05:34.378408 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76051], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.745934303] seconds [----] I, [2016-09-13T04:05:34.378621 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76051], Delivering... [----] I, [2016-09-13T04:05:34.384794 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032694339752197266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032892227172851562, :pending_vm_jobs=>0.000766754150390625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005815744400024414} [----] I, [2016-09-13T04:05:34.385116 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76051], State: [ok], Delivered in [0.006487584] seconds [----] I, [2016-09-13T04:05:34.418239 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76049], State: [ok], Delivered in [0.045256192] seconds [----] I, [2016-09-13T04:05:36.121353 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76048], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.560159029] seconds [----] I, [2016-09-13T04:05:36.121530 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76048], Delivering... [----] I, [2016-09-13T04:05:36.125103 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76048], State: [ok], Delivered in [0.00358453] seconds [----] I, [2016-09-13T04:05:36.161312 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76050], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.559420772] seconds [----] I, [2016-09-13T04:05:36.161483 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76050], Delivering... [----] I, [2016-09-13T04:05:36.163665 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76050], State: [ok], Delivered in [0.002187316] seconds [----] I, [2016-09-13T04:05:40.460614 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003961801528930664, :worker_monitor=>1.3176581859588623, :worker_dequeue=>0.010598897933959961, :total_time=>1.3324909210205078} [----] I, [2016-09-13T04:05:45.461071 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:05:45 UTC]... [----] I, [2016-09-13T04:05:45.481746 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:05:45 UTC]...Complete [----] I, [2016-09-13T04:05:45.660122 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:05:45.681711 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76052], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:05:50.618398 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:05:51.254372 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76052], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.589092829] seconds [----] I, [2016-09-13T04:05:51.254723 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76052], Delivering... [----] I, [2016-09-13T04:05:51.263193 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004999399185180664, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005020856857299805, :pending_vm_jobs=>0.0009701251983642578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007887840270996094} [----] I, [2016-09-13T04:05:51.263586 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76052], State: [ok], Delivered in [0.008885905] seconds [----] I, [2016-09-13T04:05:56.825990 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005946159362792969, :worker_monitor=>1.1909663677215576, :worker_dequeue=>0.006194591522216797, :total_time=>1.2034196853637695} [----] I, [2016-09-13T04:06:00.692503 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:06:00.711341 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76053], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:06:00.727112 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76054], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:06:01.840869 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:06:02.607690 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76054], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.890055543] seconds [----] I, [2016-09-13T04:06:02.607965 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76054], Delivering... [----] I, [2016-09-13T04:06:02.615046 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038971900939941406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003918170928955078, :pending_vm_jobs=>0.0007905960083007812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065653324127197266} [----] I, [2016-09-13T04:06:02.615462 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76054], State: [ok], Delivered in [0.007493517] seconds [----] I, [2016-09-13T04:06:03.316038 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76053], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.61881245] seconds [----] I, [2016-09-13T04:06:03.316212 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76053], Delivering... [----] I, [2016-09-13T04:06:03.320962 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76053], State: [ok], Delivered in [0.004718253] seconds [----] I, [2016-09-13T04:06:13.339818 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004907369613647461, :worker_monitor=>1.4536116123199463, :worker_dequeue=>0.011999845504760742, :total_time=>1.4708302021026611} [----] I, [2016-09-13T04:06:15.738939 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:06:15.763875 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76055], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:06:18.340471 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:06:18 UTC]... [----] I, [2016-09-13T04:06:18.357997 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:06:18 UTC]...Complete [----] I, [2016-09-13T04:06:18.369793 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:06:18.397282 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76055], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.65048449] seconds [----] I, [2016-09-13T04:06:18.397510 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76055], Delivering... [----] I, [2016-09-13T04:06:18.404388 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003480672836303711, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035009384155273438, :pending_vm_jobs=>0.0007915496826171875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063211917877197266} [----] I, [2016-09-13T04:06:18.404879 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76055], State: [ok], Delivered in [0.007372127] seconds [----] I, [2016-09-13T04:06:29.692959 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00474095344543457, :worker_monitor=>1.2804481983184814, :worker_dequeue=>0.012922048568725586, :total_time=>1.2985670566558838} [----] I, [2016-09-13T04:06:30.777550 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:06:30.797563 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76056], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:06:30.814240 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76057], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:06:30.830150 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76058], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:06:30.848520 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76059], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:06:34.711811 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T04:06:34.717676 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:06:34.895316 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76057], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.092834709] seconds [----] I, [2016-09-13T04:06:34.895596 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76057], Delivering... [----] I, [2016-09-13T04:06:34.900444 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76059], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.061136537] seconds [----] I, [2016-09-13T04:06:34.900669 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76059], Delivering... [----] I, [2016-09-13T04:06:34.907447 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036287307739257812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036487579345703125, :pending_vm_jobs=>0.0008196830749511719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063321590423583984} [----] I, [2016-09-13T04:06:34.907866 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76059], State: [ok], Delivered in [0.007187193] seconds [----] I, [2016-09-13T04:06:34.945865 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76057], State: [ok], Delivered in [0.050272923] seconds [----] I, [2016-09-13T04:06:36.489524 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76056], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.706956781] seconds [----] I, [2016-09-13T04:06:36.489805 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76056], Delivering... [----] I, [2016-09-13T04:06:36.496711 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76056], State: [ok], Delivered in [0.006914216] seconds [----] I, [2016-09-13T04:06:36.540501 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76058], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.720346912] seconds [----] I, [2016-09-13T04:06:36.540710 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76058], Delivering... [----] I, [2016-09-13T04:06:36.544307 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76058], State: [ok], Delivered in [0.00356925] seconds [----] I, [2016-09-13T04:06:45.861681 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:06:45.875821 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76060], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:06:45.973086 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:06:45.977745 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004913330078125, :worker_monitor=>1.215672254562378, :worker_dequeue=>0.008240222930908203, :total_time=>1.229301929473877} [----] I, [2016-09-13T04:06:46.007659 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76060], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.140010865] seconds [----] I, [2016-09-13T04:06:46.007839 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76060], Delivering... [----] I, [2016-09-13T04:06:46.014037 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031974315643310547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032165050506591797, :pending_vm_jobs=>0.0008187294006347656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005851030349731445} [----] I, [2016-09-13T04:06:46.014400 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76060], State: [ok], Delivered in [0.0065599] seconds [----] I, [2016-09-13T04:06:50.978242 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:06:50 UTC]... [----] I, [2016-09-13T04:06:51.001778 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:06:50 UTC]...Complete [----] I, [2016-09-13T04:07:00.888248 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:07:00.910740 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76061], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:07:00.921826 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76062], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:07:02.843753 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:07:02.848972 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004279613494873047, :worker_monitor=>1.664034366607666, :worker_dequeue=>0.009407520294189453, :total_time=>1.6780226230621338} [----] I, [2016-09-13T04:07:03.202741 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76062], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.285937579] seconds [----] I, [2016-09-13T04:07:03.202951 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76062], Delivering... [----] I, [2016-09-13T04:07:03.210707 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003639698028564453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036628246307373047, :pending_vm_jobs=>0.0008134841918945312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007289409637451172} [----] I, [2016-09-13T04:07:03.211232 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76062], State: [ok], Delivered in [0.008249281] seconds [----] I, [2016-09-13T04:07:04.026014 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76061], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.132432799] seconds [----] I, [2016-09-13T04:07:04.026359 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76061], Delivering... [----] I, [2016-09-13T04:07:04.035316 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76061], State: [ok], Delivered in [0.008977024] seconds [----] I, [2016-09-13T04:07:15.933987 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:07:15.950830 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76063], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:07:19.315033 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:07:19.322263 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004239082336425781, :worker_monitor=>1.4231557846069336, :worker_dequeue=>0.012755155563354492, :total_time=>1.440427541732788} [----] I, [2016-09-13T04:07:19.763129 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76063], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.823139694] seconds [----] I, [2016-09-13T04:07:19.763354 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76063], Delivering... [----] I, [2016-09-13T04:07:19.770538 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003829479217529297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038518905639648438, :pending_vm_jobs=>0.0008776187896728516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006606578826904297} [----] I, [2016-09-13T04:07:19.770944 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76063], State: [ok], Delivered in [0.007588133] seconds [----] I, [2016-09-13T04:07:24.322814 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:07:24 UTC]... [----] I, [2016-09-13T04:07:24.339411 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:07:24 UTC]...Complete [----] I, [2016-09-13T04:07:30.962055 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:07:30.979767 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76064], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:07:30.992335 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76065], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:07:31.008278 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76066], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:07:31.025213 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76067], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:07:36.022412 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:07:36.028923 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003918647766113281, :worker_monitor=>1.6414265632629395, :worker_dequeue=>0.01179814338684082, :total_time=>1.657470703125} [----] I, [2016-09-13T04:07:36.912101 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76065], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.928300526] seconds [----] I, [2016-09-13T04:07:36.912291 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76065], Delivering... [----] I, [2016-09-13T04:07:36.980327 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76065], State: [ok], Delivered in [0.067997395] seconds [----] I, [2016-09-13T04:07:36.986160 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76067], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.969095313] seconds [----] I, [2016-09-13T04:07:36.986326 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76067], Delivering... [----] I, [2016-09-13T04:07:36.992364 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031507015228271484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003170013427734375, :pending_vm_jobs=>0.0007746219635009766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00564885139465332} [----] I, [2016-09-13T04:07:36.992752 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76067], State: [ok], Delivered in [0.006417746] seconds [----] I, [2016-09-13T04:07:37.146098 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76064], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.17970691] seconds [----] I, [2016-09-13T04:07:37.146295 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76064], Delivering... [----] I, [2016-09-13T04:07:37.151382 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76064], State: [ok], Delivered in [0.005079848] seconds [----] I, [2016-09-13T04:07:37.175620 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76066], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.176858733] seconds [----] I, [2016-09-13T04:07:37.175829 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76066], Delivering... [----] I, [2016-09-13T04:07:37.184279 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76066], State: [ok], Delivered in [0.008435958] seconds [----] I, [2016-09-13T04:07:46.037119 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:07:46.060281 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76068], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:07:46.061594 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:07:46.090217 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76068], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.046700519] seconds [----] I, [2016-09-13T04:07:46.090506 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76068], Delivering... [----] I, [2016-09-13T04:07:46.096787 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003239154815673828, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032749176025390625, :pending_vm_jobs=>0.0008153915405273438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005879640579223633} [----] I, [2016-09-13T04:07:46.097124 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76068], State: [ok], Delivered in [0.006678454] seconds [----] I, [2016-09-13T04:07:52.674581 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003645658493041992, :server_monitor=>0.09487199783325195, :worker_monitor=>1.4890978336334229, :worker_dequeue=>0.015666484832763672, :total_time=>1.6036372184753418} [----] I, [2016-09-13T04:07:57.675277 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:07:57 UTC]... [----] I, [2016-09-13T04:07:57.725637 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:07:57 UTC]...Complete [----] I, [2016-09-13T04:08:01.073160 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:08:01.124760 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76069], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:08:01.140124 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76070], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:08:02.764703 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:08:03.210807 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76070], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.08011709] seconds [----] I, [2016-09-13T04:08:03.211049 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76070], Delivering... [----] I, [2016-09-13T04:08:03.217750 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003641843795776367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00368499755859375, :pending_vm_jobs=>0.0008680820465087891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006270885467529297} [----] I, [2016-09-13T04:08:03.218123 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76070], State: [ok], Delivered in [0.007080586] seconds [----] I, [2016-09-13T04:08:04.319075 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76069], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.240888219] seconds [----] I, [2016-09-13T04:08:04.319308 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76069], Delivering... [----] I, [2016-09-13T04:08:04.325178 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76069], State: [ok], Delivered in [0.005858743] seconds [----] I, [2016-09-13T04:08:09.343614 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004158496856689453, :worker_monitor=>1.5578465461730957, :worker_dequeue=>0.011434555053710938, :total_time=>1.5737690925598145} [----] I, [2016-09-13T04:08:16.154337 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:08:16.174952 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76071], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:08:16.191997 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76072], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:08:16.210120 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76073], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:08:19.379551 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:08:19.490168 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76071], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.327331511] seconds [----] I, [2016-09-13T04:08:19.490606 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76071], Delivering... [----] I, [2016-09-13T04:08:19.503638 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.006694793701171875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.006739377975463867, :pending_vm_jobs=>0.002124309539794922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.012219429016113281} [----] I, [2016-09-13T04:08:19.504180 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76071], State: [ok], Delivered in [0.013621975] seconds [----] I, [2016-09-13T04:08:19.540024 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76072], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.359129756] seconds [----] I, [2016-09-13T04:08:19.540227 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76072], Delivering... [----] I, [2016-09-13T04:08:19.541982 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T04:08:19.542227 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5339955200 [----] I, [2016-09-13T04:08:19.542357 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5126500352 [----] I, [2016-09-13T04:08:19.542516 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 213454848 [----] I, [2016-09-13T04:08:19.542621 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1310720000 [----] I, [2016-09-13T04:08:19.542714 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5072769024 [----] I, [2016-09-13T04:08:19.542802 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T04:08:19.542917 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T04:08:19.543005 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 534183936 [----] I, [2016-09-13T04:08:19.543098 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T04:08:19.543189 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8015474688 [----] I, [2016-09-13T04:08:19.543270 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T04:08:19.543357 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T04:08:19.543500 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T04:08:19.543650 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 20480 [----] I, [2016-09-13T04:08:19.543750 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T04:08:19.543847 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T04:08:19.543930 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T04:08:19.544013 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T04:08:19.544093 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T04:08:19.544179 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T04:08:19.544267 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273211392 [----] I, [2016-09-13T04:08:19.544348 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56373248 [----] I, [2016-09-13T04:08:19.544461 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216838144 [----] I, [2016-09-13T04:08:19.544583 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T04:08:19.544678 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140558336 [----] I, [2016-09-13T04:08:19.544768 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2595569664 [----] I, [2016-09-13T04:08:19.544864 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2287116288 [----] I, [2016-09-13T04:08:19.544960 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T04:08:19.545048 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T04:08:19.545141 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T04:08:19.545233 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37486592 [----] I, [2016-09-13T04:08:19.545318 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102281216 [----] I, [2016-09-13T04:08:19.545399 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53219328 [----] I, [2016-09-13T04:08:19.545536 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110112768 [----] I, [2016-09-13T04:08:19.545631 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155500544 [----] I, [2016-09-13T04:08:19.545725 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T04:08:19.545808 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T04:08:19.545898 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T04:08:19.545995 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T04:08:19.546088 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T04:08:19.546176 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T04:08:19.546270 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T04:08:19.546357 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T04:08:19.546461 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T04:08:19.601554 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T04:08:19.601893 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T04:08:19.608631 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T04:08:19.611883 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T04:08:19.615549 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T04:08:19.619126 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T04:08:19.622859 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T04:08:19.626511 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 835 MB 1.17 GB 41% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T04:08:19.630629 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T04:08:19.634690 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T04:08:19.638451 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T04:08:19.643709 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T04:08:19.649943 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T04:08:19.656047 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T04:08:19.660985 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:08:19.661243 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:08:19.661512 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T04:08:19.668704 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [146858.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:08:19.669191 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76072], State: [ok], Delivered in [0.128929022] seconds [----] I, [2016-09-13T04:08:19.699926 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76073], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.502158625] seconds [----] I, [2016-09-13T04:08:19.700163 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76073], Delivering... [----] I, [2016-09-13T04:08:19.708089 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:07:59 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [102814.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T04:08:19.708897 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:08:08 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [147818.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:08:19.709559 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:08:08 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50195.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:08:19.710158 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:08:01 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [233671.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T04:08:19.710700 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:08:08 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [47871.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T04:08:19.711278 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:08:08 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162415000], Memory % [3.1], CPU Time [37001.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T04:08:19.711932 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:08:07 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [197113.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T04:08:19.712528 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:08:08 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [146869.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:08:19.715452 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:08:07 UTC], Process Info: Memory Usage [580878336], Memory Size [936357888], Proportional Set Size: [420203000], Memory % [7.08], CPU Time [927.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T04:08:19.717760 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:08:04 UTC], Process Info: Memory Usage [558432256], Memory Size [929497088], Proportional Set Size: [406087000], Memory % [6.81], CPU Time [4279.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T04:08:19.718333 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:08:07 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [205755.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T04:08:19.718941 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:08:08 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [50240.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:08:19.719532 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:08:05 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165800000], Memory % [3.16], CPU Time [37870.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T04:08:19.721909 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:07:59 UTC], Process Info: Memory Usage [604663808], Memory Size [1042649088], Proportional Set Size: [441819000], Memory % [7.37], CPU Time [657.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:08:19.724184 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [95], PID [22463], GUID [db78f78e-7978-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:08:02 UTC], Process Info: Memory Usage [583692288], Memory Size [926846976], Proportional Set Size: [423055000], Memory % [7.12], CPU Time [1112.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:08:19.724591 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76073], State: [ok], Delivered in [0.024431233] seconds [----] I, [2016-09-13T04:08:25.595672 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004088640213012695, :worker_monitor=>1.1956815719604492, :worker_dequeue=>0.007555961608886719, :total_time=>1.207568883895874} [----] I, [2016-09-13T04:08:30.596176 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:08:30 UTC]... [----] I, [2016-09-13T04:08:30.614094 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:08:30 UTC]...Complete [----] I, [2016-09-13T04:08:31.222539 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:08:31.238398 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76074], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:08:31.259836 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76075], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:08:31.277260 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76076], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:08:31.306175 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76077], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:08:35.640168 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:08:36.506207 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76075], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.262941339] seconds [----] I, [2016-09-13T04:08:36.506453 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76075], Delivering... [----] I, [2016-09-13T04:08:36.511742 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76077], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.221185014] seconds [----] I, [2016-09-13T04:08:36.511916 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76077], Delivering... [----] I, [2016-09-13T04:08:36.518727 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003581523895263672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003609180450439453, :pending_vm_jobs=>0.0008490085601806641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006432056427001953} [----] I, [2016-09-13T04:08:36.519049 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76077], State: [ok], Delivered in [0.007126466] seconds [----] I, [2016-09-13T04:08:36.585860 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76075], State: [ok], Delivered in [0.079447366] seconds [----] I, [2016-09-13T04:08:37.454781 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76074], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.228530336] seconds [----] I, [2016-09-13T04:08:37.455036 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76074], Delivering... [----] I, [2016-09-13T04:08:37.461948 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76074], State: [ok], Delivered in [0.006918041] seconds [----] I, [2016-09-13T04:08:37.494788 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76076], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.23058901] seconds [----] I, [2016-09-13T04:08:37.495052 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76076], Delivering... [----] I, [2016-09-13T04:08:37.499609 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76076], State: [ok], Delivered in [0.004540027] seconds [----] I, [2016-09-13T04:08:41.933733 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039331912994384766, :worker_monitor=>1.2773759365081787, :worker_dequeue=>0.005151271820068359, :total_time=>1.286787986755371} [----] I, [2016-09-13T04:08:46.323854 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:08:46.344568 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76078], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:08:46.942956 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:08:47.653303 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76078], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.320121329] seconds [----] I, [2016-09-13T04:08:47.653547 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76078], Delivering... [----] I, [2016-09-13T04:08:47.660555 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003741025924682617, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037686824798583984, :pending_vm_jobs=>0.0008370876312255859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006566762924194336} [----] I, [2016-09-13T04:08:47.660910 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76078], State: [ok], Delivered in [0.007365052] seconds [----] I, [2016-09-13T04:08:58.621885 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0063059329986572266, :worker_monitor=>1.4733262062072754, :worker_dequeue=>0.011494874954223633, :total_time=>1.4915087223052979} [----] I, [2016-09-13T04:09:01.357981 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:09:01.381064 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76079], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:09:01.402092 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76080], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:09:03.622461 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:09:03 UTC]... [----] I, [2016-09-13T04:09:03.641380 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:09:03 UTC]...Complete [----] I, [2016-09-13T04:09:03.648271 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:09:03.843899 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76080], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.454693812] seconds [----] I, [2016-09-13T04:09:03.844215 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76080], Delivering... [----] I, [2016-09-13T04:09:03.852251 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004423379898071289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0045435428619384766, :pending_vm_jobs=>0.0008900165557861328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007422208786010742} [----] I, [2016-09-13T04:09:03.852659 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76080], State: [ok], Delivered in [0.008474506] seconds [----] I, [2016-09-13T04:09:04.607847 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76079], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.243728563] seconds [----] I, [2016-09-13T04:09:04.608059 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76079], Delivering... [----] I, [2016-09-13T04:09:04.613803 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76079], State: [ok], Delivered in [0.005732373] seconds [----] I, [2016-09-13T04:09:15.170690 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005425930023193359, :worker_monitor=>1.4815716743469238, :worker_dequeue=>0.014815568923950195, :total_time=>1.5023250579833984} [----] I, [2016-09-13T04:09:16.416215 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:09:16.436372 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76081], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:09:20.180758 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:09:20.928630 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76081], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.508051156] seconds [----] I, [2016-09-13T04:09:20.929002 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76081], Delivering... [----] I, [2016-09-13T04:09:20.941741 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.006521701812744141, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.006562709808349609, :pending_vm_jobs=>0.0017108917236328125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.01194906234741211} [----] I, [2016-09-13T04:09:20.942293 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76081], State: [ok], Delivered in [0.013294306] seconds [----] I, [2016-09-13T04:09:31.448812 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:09:31.493911 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76082], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:09:31.551165 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76083], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:09:31.586872 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76084], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:09:31.632738 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76085], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:09:31.679819 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:09:31.689534 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003913402557373047, :worker_monitor=>1.4665148258209229, :worker_dequeue=>0.013915777206420898, :total_time=>1.4846501350402832} [----] I, [2016-09-13T04:09:31.706824 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76083], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.209042444] seconds [----] I, [2016-09-13T04:09:31.707012 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76083], Delivering... [----] I, [2016-09-13T04:09:31.775264 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76083], State: [ok], Delivered in [0.068227578] seconds [----] I, [2016-09-13T04:09:31.798189 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76085], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.203965712] seconds [----] I, [2016-09-13T04:09:31.798403 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76085], Delivering... [----] I, [2016-09-13T04:09:31.805219 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003420114517211914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034406185150146484, :pending_vm_jobs=>0.0009241104125976562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063555240631103516} [----] I, [2016-09-13T04:09:31.805611 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76085], State: [ok], Delivered in [0.007212416] seconds [----] I, [2016-09-13T04:09:31.832373 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76082], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.379431819] seconds [----] I, [2016-09-13T04:09:31.832638 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76082], Delivering... [----] I, [2016-09-13T04:09:31.837468 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76082], State: [ok], Delivered in [0.004795398] seconds [----] I, [2016-09-13T04:09:31.861025 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76084], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.305465541] seconds [----] I, [2016-09-13T04:09:31.861199 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76084], Delivering... [----] I, [2016-09-13T04:09:31.864299 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76084], State: [ok], Delivered in [0.003086371] seconds [----] I, [2016-09-13T04:09:36.690175 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:09:36 UTC]... [----] I, [2016-09-13T04:09:36.706193 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:09:36 UTC]...Complete [----] I, [2016-09-13T04:09:46.648869 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:09:46.667167 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76086], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:09:48.252513 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:09:48.259699 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0043489933013916016, :worker_monitor=>1.5057716369628906, :worker_dequeue=>0.012675285339355469, :total_time=>1.52315354347229} [----] I, [2016-09-13T04:09:49.159598 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76086], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.503117617] seconds [----] I, [2016-09-13T04:09:49.159808 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76086], Delivering... [----] I, [2016-09-13T04:09:49.167316 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003818988800048828, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003849029541015625, :pending_vm_jobs=>0.0009601116180419922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0070264339447021484} [----] I, [2016-09-13T04:09:49.167769 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76086], State: [ok], Delivered in [0.007953823] seconds [----] I, [2016-09-13T04:10:01.682912 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:10:01.701311 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76087], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:10:01.724363 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76088], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:10:01.741841 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76089], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:10:01.758926 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76090], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:10:01.781872 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76091], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:10:04.704391 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:10:04.711513 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036344528198242188, :worker_monitor=>1.2899565696716309, :worker_dequeue=>0.012583494186401367, :total_time=>1.3064446449279785} [----] I, [2016-09-13T04:10:05.005090 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76088], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.297297037] seconds [----] I, [2016-09-13T04:10:05.005324 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76088], Delivering... [----] I, [2016-09-13T04:10:05.012848 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038824081420898438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003967761993408203, :pending_vm_jobs=>0.0009241104125976562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0070154666900634766} [----] I, [2016-09-13T04:10:05.013314 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76088], State: [ok], Delivered in [0.007993305] seconds [----] I, [2016-09-13T04:10:05.048776 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76089], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.318586364] seconds [----] I, [2016-09-13T04:10:05.048977 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76089], Delivering... [----] I, [2016-09-13T04:10:05.051589 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76089], State: [ok], Delivered in [0.002606449] seconds [----] I, [2016-09-13T04:10:05.072080 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76087], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.384024165] seconds [----] I, [2016-09-13T04:10:05.072375 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76087], Delivering... [----] I, [2016-09-13T04:10:05.079585 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76087], State: [ok], Delivered in [0.007203953] seconds [----] I, [2016-09-13T04:10:05.096074 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76090], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.34615982] seconds [----] I, [2016-09-13T04:10:05.096252 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76090], Delivering... [----] I, [2016-09-13T04:10:05.114214 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76091], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.347998895] seconds [----] I, [2016-09-13T04:10:05.114524 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76091], Delivering... [----] I, [2016-09-13T04:10:05.116876 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76090], State: [ok], Delivered in [0.020555431] seconds [----] I, [2016-09-13T04:10:05.123653 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76091], State: [ok], Delivered in [0.009115187] seconds [----] I, [2016-09-13T04:10:09.712245 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:10:09 UTC]... [----] I, [2016-09-13T04:10:09.736153 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:10:09 UTC]...Complete [----] I, [2016-09-13T04:10:16.794824 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:10:16.817212 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76092], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:10:21.320569 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:10:21.328933 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0046350955963134766, :worker_monitor=>1.5363554954528809, :worker_dequeue=>0.01410365104675293, :total_time=>1.555532693862915} [----] I, [2016-09-13T04:10:21.403492 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76092], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.599168405] seconds [----] I, [2016-09-13T04:10:21.403732 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76092], Delivering... [----] I, [2016-09-13T04:10:21.411371 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0039825439453125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004010200500488281, :pending_vm_jobs=>0.0009720325469970703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007165670394897461} [----] I, [2016-09-13T04:10:21.411846 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76092], State: [ok], Delivered in [0.008116108] seconds [----] I, [2016-09-13T04:10:31.829997 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:10:31.848934 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76093], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:10:31.860163 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76094], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:10:31.877581 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76095], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:10:31.894587 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76096], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:10:37.835863 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:10:37.842508 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0057446956634521484, :worker_monitor=>1.450355052947998, :worker_dequeue=>0.012239217758178711, :total_time=>1.4688422679901123} [----] I, [2016-09-13T04:10:38.243122 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76094], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.389819045] seconds [----] I, [2016-09-13T04:10:38.243262 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76094], Delivering... [----] I, [2016-09-13T04:10:38.248811 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76096], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.361467039] seconds [----] I, [2016-09-13T04:10:38.248934 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76096], Delivering... [----] I, [2016-09-13T04:10:38.253458 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002411365509033203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024302005767822266, :pending_vm_jobs=>0.0005357265472412109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0042133331298828125} [----] I, [2016-09-13T04:10:38.253734 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76096], State: [ok], Delivered in [0.004800246] seconds [----] I, [2016-09-13T04:10:38.294595 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76093], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.457374698] seconds [----] I, [2016-09-13T04:10:38.294734 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76093], Delivering... [----] I, [2016-09-13T04:10:38.298097 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76093], State: [ok], Delivered in [0.00336083] seconds [----] I, [2016-09-13T04:10:38.305764 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76094], State: [ok], Delivered in [0.062481839] seconds [----] I, [2016-09-13T04:10:38.340277 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76095], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.474443384] seconds [----] I, [2016-09-13T04:10:38.340409 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76095], Delivering... [----] I, [2016-09-13T04:10:38.342653 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76095], State: [ok], Delivered in [0.002242039] seconds [----] I, [2016-09-13T04:10:42.843031 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:10:42 UTC]... [----] I, [2016-09-13T04:10:42.861499 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:10:42 UTC]...Complete [----] I, [2016-09-13T04:10:46.907635 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:10:46.929189 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76097], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:10:47.900881 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:10:48.603620 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76097], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.689632101] seconds [----] I, [2016-09-13T04:10:48.603818 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76097], Delivering... [----] I, [2016-09-13T04:10:48.609655 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003083944320678711, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031058788299560547, :pending_vm_jobs=>0.0007178783416748047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005448579788208008} [----] I, [2016-09-13T04:10:48.609994 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76097], State: [ok], Delivered in [0.006179583] seconds [----] I, [2016-09-13T04:10:54.342845 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004088401794433594, :worker_monitor=>1.4152612686157227, :worker_dequeue=>0.011137008666992188, :total_time=>1.4307711124420166} [----] I, [2016-09-13T04:11:01.941436 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:11:01.953557 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76098], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:11:01.969388 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76099], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:11:04.520095 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:11:04.752764 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76099], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.793750472] seconds [----] I, [2016-09-13T04:11:04.752971 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76099], Delivering... [----] I, [2016-09-13T04:11:04.760078 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036907196044921875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037152767181396484, :pending_vm_jobs=>0.0008747577667236328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006689548492431641} [----] I, [2016-09-13T04:11:04.760462 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76099], State: [ok], Delivered in [0.007467814] seconds [----] I, [2016-09-13T04:11:05.426903 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76098], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.480573567] seconds [----] I, [2016-09-13T04:11:05.427125 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76098], Delivering... [----] I, [2016-09-13T04:11:05.432339 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76098], State: [ok], Delivered in [0.005229507] seconds [----] I, [2016-09-13T04:11:10.480603 #2763:34713c] INFO -- : MIQ(MiqServer#validate_worker) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit [----] I, [2016-09-13T04:11:10.491852 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76100], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_uptime_exceeded", {:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T04:11:10.492060 #2763:34713c] INFO -- : MIQ(MiqServer#stop_worker) Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3], status [started]... [----] I, [2016-09-13T04:11:10.503277 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76101], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T04:11:10.513067 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3] is being requested to exit [----] I, [2016-09-13T04:11:10.680755 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:11:10.684958 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006315469741821289, :worker_monitor=>1.1426918506622314, :worker_dequeue=>0.00816798210144043, :total_time=>1.1577157974243164} [----] I, [2016-09-13T04:11:11.476651 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76100], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_uptime_exceeded", {:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [0.994646545] seconds [----] I, [2016-09-13T04:11:11.476930 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76100], Delivering... [----] I, [2016-09-13T04:11:11.481381 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76101], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [0.988394254] seconds [----] I, [2016-09-13T04:11:11.481531 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76101], Delivering... [----] I, [2016-09-13T04:11:11.518666 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_uptime_exceeded"> inputs=<{:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1070, :miq_event_id=>1070, "EventStream::event_stream"=>1070, :event_stream_id=>1070}> [----] I, [2016-09-13T04:11:11.528153 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_stop"> inputs=<{:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1071, :miq_event_id=>1071, "EventStream::event_stream"=>1071, :event_stream_id=>1071}> [----] I, [2016-09-13T04:11:11.551674 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76102], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1070, :miq_event_id=>1070, "EventStream::event_stream"=>1070, :event_stream_id=>1070}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T04:11:11.552048 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76100], State: [ok], Delivered in [0.075143062] seconds [----] I, [2016-09-13T04:11:11.557647 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76103], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1071, :miq_event_id=>1071, "EventStream::event_stream"=>1071, :event_stream_id=>1071}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T04:11:11.558043 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76101], State: [ok], Delivered in [0.076474957] seconds [----] I, [2016-09-13T04:11:12.762232 #22463:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [95], PID [22463], GUID [db78f78e-7978-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:11:02 UTC], Process Info: Memory Usage [583692288], Memory Size [926846976], Proportional Set Size: [423082000], Memory % [7.12], CPU Time [1119.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:11:12.762900 #22463:34713c] INFO -- : EMS [10.16.23.206] as [jdoe] ID [95] PID [22463] GUID [db78f78e-7978-11e6-87c1-fa163e7d01a3] Exit request received. Worker exiting. [----] I, [2016-09-13T04:11:15.685393 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:11:15 UTC]... [----] I, [2016-09-13T04:11:15.699063 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:11:15 UTC]...Complete [----] I, [2016-09-13T04:11:15.705854 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:11:15.821261 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76102], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1070, :miq_event_id=>1070, "EventStream::event_stream"=>1070, :event_stream_id=>1070}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [4.283181174] seconds [----] I, [2016-09-13T04:11:15.821432 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76102], Delivering... [----] I, [2016-09-13T04:11:15.822849 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1070, :miq_event_id=>1070, "EventStream::event_stream"=>1070, :event_stream_id=>1070} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T04:11:15.826941 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1070&MiqEvent%3A%3Amiq_event=1070&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B95%5D%2C%20PID%3A%20%5B22463%5D%2C%20GUID%3A%20%5Bdb78f78e-7978-11e6-87c1-fa163e7d01a3%5D%20uptime%20has%20reached%20the%20interval%20of%207200%20seconds%2C%20requesting%20worker%20to%20exit&event_stream_id=1070&event_type=evm_worker_uptime_exceeded&miq_event_id=1070&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T04:11:15.850125 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1070&MiqEvent%3A%3Amiq_event=1070&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B95%5D%2C%20PID%3A%20%5B22463%5D%2C%20GUID%3A%20%5Bdb78f78e-7978-11e6-87c1-fa163e7d01a3%5D%20uptime%20has%20reached%20the%20interval%20of%207200%20seconds%2C%20requesting%20worker%20to%20exit&event_stream_id=1070&event_type=evm_worker_uptime_exceeded&miq_event_id=1070&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T04:11:15.872321 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76103], MiqWorker id: [16], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1071, :miq_event_id=>1071, "EventStream::event_stream"=>1071, :event_stream_id=>1071}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [4.328867743] seconds [----] I, [2016-09-13T04:11:15.872555 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76103], Delivering... [----] I, [2016-09-13T04:11:15.874700 #2957:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1071, :miq_event_id=>1071, "EventStream::event_stream"=>1071, :event_stream_id=>1071} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T04:11:15.880518 #2957:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1071&MiqEvent%3A%3Amiq_event=1071&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B95%5D%2C%20PID%3A%20%5B22463%5D%2C%20GUID%3A%20%5Bdb78f78e-7978-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1071&event_type=evm_worker_stop&miq_event_id=1071&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T04:11:15.911867 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create] [----] I, [2016-09-13T04:11:15.925902 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T04:11:15.927962 #2957:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1071&MiqEvent%3A%3Amiq_event=1071&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B95%5D%2C%20PID%3A%20%5B22463%5D%2C%20GUID%3A%20%5Bdb78f78e-7978-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1071&event_type=evm_worker_stop&miq_event_id=1071&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T04:11:15.940160 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T04:11:15.953719 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T04:11:15.957310 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T04:11:15.968348 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T04:11:15.974012 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T04:11:15.977280 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 08:11:15", os_priority: 30, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 432046080, memory_size: 729399296, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 357917000, has_active_websocket: true>] [----] I, [2016-09-13T04:11:15.977466 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_uptime_exceeded] [----] I, [2016-09-13T04:11:15.990368 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_uptime_exceeded] [----] I, [2016-09-13T04:11:15.990558 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_uptime_exceeded] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T04:11:15.996159 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T04:11:15.996604 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create] [----] I, [2016-09-13T04:11:15.997191 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76102], State: [ok], Delivered in [0.175774504] seconds [----] I, [2016-09-13T04:11:16.025007 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T04:11:16.047228 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T04:11:16.069262 #2957:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_stop] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T04:11:16.090268 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T04:11:16.096078 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T04:11:16.113406 #2957:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T04:11:16.121938 #2957:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T04:11:16.126911 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 08:11:15", os_priority: 30, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 432046080, memory_size: 729399296, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 357917000, has_active_websocket: true>] [----] I, [2016-09-13T04:11:16.127178 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_stop] [----] I, [2016-09-13T04:11:16.150656 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_stop] [----] I, [2016-09-13T04:11:16.150996 #2957:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_stop] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T04:11:16.160662 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T04:11:16.161245 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T04:11:16.162051 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76103], State: [ok], Delivered in [0.289489157] seconds [----] I, [2016-09-13T04:11:16.981389 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:11:16.996365 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76104], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:11:20.721344 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:11:21.054017 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76104], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.06656122] seconds [----] I, [2016-09-13T04:11:21.054232 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76104], Delivering... [----] I, [2016-09-13T04:11:21.060903 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003510713577270508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035381317138671875, :pending_vm_jobs=>0.0008265972137451172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006238698959350586} [----] I, [2016-09-13T04:11:21.061217 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76104], State: [ok], Delivered in [0.006981515] seconds [----] I, [2016-09-13T04:11:25.845534 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker.sync_workers) Workers are being synchronized: Current: ["ems_16"], Desired: ["ems_15", "ems_16"] [----] I, [2016-09-13T04:11:25.938524 #2763:34713c] INFO -- : :kill_algorithm: [----] I, [2016-09-13T04:11:25.938648 #2763:34713c] INFO -- : :name: :used_swap_percent_gt_value [----] I, [2016-09-13T04:11:25.938695 #2763:34713c] INFO -- : :value: 80 [----] I, [2016-09-13T04:11:25.938732 #2763:34713c] INFO -- : :miq_server_time_threshold: 120 [----] I, [2016-09-13T04:11:25.938766 #2763:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T04:11:25.938800 #2763:34713c] INFO -- : :poll: 2 [----] I, [2016-09-13T04:11:25.938831 #2763:34713c] INFO -- : :start_algorithm: [----] I, [2016-09-13T04:11:25.938865 #2763:34713c] INFO -- : :name: :used_swap_percent_lt_value [----] I, [2016-09-13T04:11:25.938926 #2763:34713c] INFO -- : :value: 60 [----] I, [2016-09-13T04:11:25.938959 #2763:34713c] INFO -- : :sync_interval: 1800 [----] I, [2016-09-13T04:11:25.938990 #2763:34713c] INFO -- : :wait_for_started_timeout: 600 [----] I, [2016-09-13T04:11:26.242601 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker.close_pg_sockets_inherited_from_parent) Closing socket: 21 [----] I, [2016-09-13T04:11:26.409199 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76105], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T04:11:26.409531 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#start) Worker started: ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3] [----] I, [2016-09-13T04:11:26.655074 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:11:26.656314 #30088:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T04:11:26.656444 #30088:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:11:26.656534 #30088:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:11:26.656617 #30088:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:11:26.656692 #30088:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T04:11:26.656755 #30088:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T04:11:26.656815 #30088:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:11:26.656882 #30088:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T04:11:26.656942 #30088:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:11:26.657001 #30088:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:11:26.657064 #30088:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T04:11:26.657122 #30088:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:11:26.657160 #30088:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T04:11:26.657212 #30088:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:11:26.657252 #30088:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T04:11:26.657297 #30088:34713c] INFO -- : --- [----] I, [2016-09-13T04:11:26.657815 #30088:34713c] INFO -- : :guid: aa80abf2-7989-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:11:26.657897 #30088:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T04:11:27.008135 #30088:34713c] INFO -- : MIQ(AuthUseridPassword#validation_successful) [ExtManagementSystem] [15], previously valid/invalid on: [2016-09-13 06:11:07 UTC]/[], previous status: [Valid] [----] I, [2016-09-13T04:11:27.036986 #30088:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76106], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 15], "ems_auth_valid", {}] [----] I, [2016-09-13T04:11:27.358761 #2763:34713c] INFO -- : MIQ(MiqServer#clean_worker_records) SQL Record for Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [95], PID: [22463], GUID: [db78f78e-7978-11e6-87c1-fa163e7d01a3], Status: [stopped] is being deleted [----] I, [2016-09-13T04:11:27.614053 #30088:34713c] INFO -- : ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner started. ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Zone [default], Role [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket] [----] I, [2016-09-13T04:11:27.614517 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_wait_for_worker_monitor) EMS [10.16.23.206] as [jdoe] Checking that worker monitor has started before doing work [----] I, [2016-09-13T04:11:27.618125 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_wait_for_worker_monitor) EMS [10.16.23.206] as [jdoe] Starting work since worker monitor has started [----] I, [2016-09-13T04:11:27.618256 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_before_work_loop) EMS [10.16.23.206] as [jdoe] Queueing initial refresh for EMS. [----] I, [2016-09-13T04:11:27.626412 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:11:27.632183 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040798187255859375, :worker_monitor=>1.886673927307129, :worker_dequeue=>0.010315418243408203, :total_time=>1.90134859085083} [----] I, [2016-09-13T04:11:27.648325 #30088:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76107], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T04:11:27.651314 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#worker_monitor_drb) EMS [10.16.23.206] as [jdoe] Initializing DRb Connection to MiqServer with ID=[1], NAME=[EVM], PID=[2763], GUID=[36647afc-71a3-11e6-838a-fa163e68952f] DRb URI=[druby://127.0.0.1:41718] [----] I, [2016-09-13T04:11:29.631926 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76105], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [3.23819894] seconds [----] I, [2016-09-13T04:11:29.632140 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76105], Delivering... [----] I, [2016-09-13T04:11:29.637339 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76106], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 15], "ems_auth_valid", {}], Dequeued in: [2.611303805] seconds [----] I, [2016-09-13T04:11:29.637582 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76106], Delivering... [----] I, [2016-09-13T04:11:29.649547 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_start"> inputs=<{:event_details=>"Worker started: ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1072, :miq_event_id=>1072, "EventStream::event_stream"=>1072, :event_stream_id=>1072}> [----] I, [2016-09-13T04:11:29.655330 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"ems_auth_valid"> inputs=<{"MiqEvent::miq_event"=>1073, :miq_event_id=>1073, "EventStream::event_stream"=>1073, :event_stream_id=>1073}> [----] I, [2016-09-13T04:11:29.703162 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76108], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1072, :miq_event_id=>1072, "EventStream::event_stream"=>1072, :event_stream_id=>1072}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T04:11:29.703659 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76105], State: [ok], Delivered in [0.071508244] seconds [----] I, [2016-09-13T04:11:29.708552 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76109], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>15, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1073, :miq_event_id=>1073, "EventStream::event_stream"=>1073, :event_stream_id=>1073}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T04:11:29.709107 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76106], State: [ok], Delivered in [0.071508749] seconds [----] I, [2016-09-13T04:11:32.007011 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:11:32.039656 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76110], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:11:32.055538 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76111], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:11:32.066620 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76112], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:11:32.083999 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76113], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:11:32.641269 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:11:32.645383 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T04:11:32.767491 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76108], MiqWorker id: [14], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1072, :miq_event_id=>1072, "EventStream::event_stream"=>1072, :event_stream_id=>1072}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [3.107700487] seconds [----] I, [2016-09-13T04:11:32.767744 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76108], Delivering... [----] I, [2016-09-13T04:11:32.770183 #2937:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1072, :miq_event_id=>1072, "EventStream::event_stream"=>1072, :event_stream_id=>1072} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T04:11:32.771345 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76109], MiqWorker id: [13], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>15, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1073, :miq_event_id=>1073, "EventStream::event_stream"=>1073, :event_stream_id=>1073}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [3.104029514] seconds [----] I, [2016-09-13T04:11:32.771609 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76109], Delivering... [----] I, [2016-09-13T04:11:32.773515 #2928:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1073, :miq_event_id=>1073, "EventStream::event_stream"=>1073, :event_stream_id=>1073} for object [ManageIQ::Providers::Hawkular::MiddlewareManager.15] with state [] to Automate [----] I, [2016-09-13T04:11:32.775832 #2937:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1072&MiqEvent%3A%3Amiq_event=1072&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B97%5D%2C%20PID%20%5B30088%5D%2C%20GUID%20%5Baa80abf2-7989-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1072&event_type=evm_worker_start&miq_event_id=1072&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T04:11:32.778860 #2928:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1073&ExtManagementSystem%3A%3Aext_management_system=15&MiqEvent%3A%3Amiq_event=1073&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1073&event_type=ems_auth_valid&miq_event_id=1073&object_name=Event&vmdb_object_type=ext_management_system] [----] I, [2016-09-13T04:11:32.807141 #2937:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1072&MiqEvent%3A%3Amiq_event=1072&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B97%5D%2C%20PID%20%5B30088%5D%2C%20GUID%20%5Baa80abf2-7989-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1072&event_type=evm_worker_start&miq_event_id=1072&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T04:11:32.809339 #2928:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1073&ExtManagementSystem%3A%3Aext_management_system=15&MiqEvent%3A%3Amiq_event=1073&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1073&event_type=ems_auth_valid&miq_event_id=1073&object_name=Event&vmdb_object_type=ext_management_system ManageIQ/System] [----] I, [2016-09-13T04:11:32.901626 #2937:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T04:11:32.904322 #2928:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T04:11:32.925371 #2937:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T04:11:32.937062 #2928:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T04:11:32.948506 #2937:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_start] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T04:11:32.969701 #2937:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T04:11:32.973327 #2928:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/ems_auth_valid] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T04:11:32.976015 #2937:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T04:11:32.994289 #2937:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T04:11:33.003051 #2937:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T04:11:33.005634 #2928:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T04:11:33.007925 #2937:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 08:11:15", os_priority: 30, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 432046080, memory_size: 729399296, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 357917000, has_active_websocket: true>] [----] I, [2016-09-13T04:11:33.008180 #2937:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_start] [----] I, [2016-09-13T04:11:33.014466 #2928:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T04:11:33.033974 #2937:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_start] [----] I, [2016-09-13T04:11:33.034220 #2937:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_start] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T04:11:33.041662 #2928:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T04:11:33.042554 #2937:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T04:11:33.043042 #2937:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T04:11:33.043760 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76108], State: [ok], Delivered in [0.27602862] seconds [----] I, [2016-09-13T04:11:33.054936 #2928:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T04:11:33.061592 #2928:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#] [----] I, [2016-09-13T04:11:33.062033 #2928:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [ems_auth_valid] [----] I, [2016-09-13T04:11:33.090283 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76111], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.046240722] seconds [----] I, [2016-09-13T04:11:33.090493 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76111], Delivering... [----] I, [2016-09-13T04:11:33.107341 #2928:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [ems_auth_valid] [----] I, [2016-09-13T04:11:33.107759 #2928:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [ems_auth_valid] Target: ManageIQ::Providers::Hawkular::MiddlewareManager Name: [TT], Id: [15] [----] I, [2016-09-13T04:11:33.121803 #2928:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T04:11:33.122698 #2928:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T04:11:33.123810 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76109], State: [ok], Delivered in [0.352179785] seconds [----] I, [2016-09-13T04:11:33.147068 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76111], State: [ok], Delivered in [0.056582631] seconds [----] I, [2016-09-13T04:11:33.164605 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76113], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.088947226] seconds [----] I, [2016-09-13T04:11:33.164839 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76113], Delivering... [----] I, [2016-09-13T04:11:33.170174 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76110], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.157974042] seconds [----] I, [2016-09-13T04:11:33.170382 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76110], Delivering... [----] I, [2016-09-13T04:11:33.174186 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004780292510986328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00481414794921875, :pending_vm_jobs=>0.0011780261993408203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008899688720703125} [----] I, [2016-09-13T04:11:33.174369 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76110], State: [ok], Delivered in [0.003987889] seconds [----] I, [2016-09-13T04:11:33.174592 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76113], State: [ok], Delivered in [0.009745951] seconds [----] I, [2016-09-13T04:11:33.192998 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76112], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.132300338] seconds [----] I, [2016-09-13T04:11:33.193146 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76112], Delivering... [----] I, [2016-09-13T04:11:33.195876 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76112], State: [ok], Delivered in [0.002713835] seconds [----] I, [2016-09-13T04:11:37.663858 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T04:11:37.673611 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T04:11:38.108020 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [76107], MiqWorker id: [97], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [10.477409607] seconds [----] I, [2016-09-13T04:11:38.108324 #30088:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76107], Delivering... [----] I, [2016-09-13T04:11:38.124573 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T04:11:38.124832 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T04:11:38.124999 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T04:11:38.125224 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T04:11:38.131025 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:38.419059 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:38.624865 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:38.625082 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:39.255745 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:39.351121 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:39.442340 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:39.893689 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:39.999320 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:40.093749 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:40.187204 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:40.281106 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:40.374166 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:40.467222 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:40.560288 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:40.652130 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:40.745446 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:40.838944 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:40.932785 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:41.025032 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:41.117244 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:41.208851 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:41.300938 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:41.392686 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:11:41.993797 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T04:11:41.994067 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.0040798187255859375, :collect_inventory_for_targets=>1.0251998901367188e-05, :parse_legacy_inventory=>3.3793141841888428, :parse_targeted_inventory=>3.3793344497680664, :save_inventory=>0.4890131950378418, :ems_refresh=>3.868828773498535} [----] I, [2016-09-13T04:11:42.015779 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T04:11:42.016336 #30088:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76107], State: [ok], Delivered in [3.908040412] seconds [----] I, [2016-09-13T04:11:44.033213 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004254579544067383, :worker_monitor=>1.3438701629638672, :worker_dequeue=>0.008603572845458984, :total_time=>1.3570632934570312} [----] I, [2016-09-13T04:11:47.095841 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:11:47.118886 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76114], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:11:49.033810 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:11:49 UTC]... [----] I, [2016-09-13T04:11:49.073145 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:11:49 UTC]...Complete [----] I, [2016-09-13T04:11:49.084955 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:11:49.377519 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76114], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.274937793] seconds [----] I, [2016-09-13T04:11:49.377730 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76114], Delivering... [----] I, [2016-09-13T04:11:49.384732 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036492347717285156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036725997924804688, :pending_vm_jobs=>0.0009174346923828125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006610393524169922} [----] I, [2016-09-13T04:11:49.385121 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76114], State: [ok], Delivered in [0.007382229] seconds [----] I, [2016-09-13T04:12:00.405673 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002683877944946289, :worker_monitor=>1.2735755443572998, :worker_dequeue=>0.00974130630493164, :total_time=>1.2862896919250488} [----] I, [2016-09-13T04:12:02.132303 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:12:02.148708 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76115], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:12:02.165165 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76116], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:12:05.494161 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:12:05.542973 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76116], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.388312592] seconds [----] I, [2016-09-13T04:12:05.543245 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76116], Delivering... [----] I, [2016-09-13T04:12:05.551804 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004325151443481445, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004359006881713867, :pending_vm_jobs=>0.0010960102081298828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008056640625} [----] I, [2016-09-13T04:12:05.552303 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76116], State: [ok], Delivered in [0.009054097] seconds [----] I, [2016-09-13T04:12:06.302730 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76115], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.165711591] seconds [----] I, [2016-09-13T04:12:06.302967 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76115], Delivering... [----] I, [2016-09-13T04:12:06.308110 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76115], State: [ok], Delivered in [0.005153246] seconds [----] I, [2016-09-13T04:12:16.999617 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002379179000854492, :worker_monitor=>1.4689080715179443, :worker_dequeue=>0.010354280471801758, :total_time=>1.4819047451019287} [----] I, [2016-09-13T04:12:17.176679 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:12:17.207097 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76117], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:12:22.000336 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:12:22 UTC]... [----] I, [2016-09-13T04:12:22.021504 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:12:22 UTC]...Complete [----] I, [2016-09-13T04:12:22.029578 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:12:22.691291 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76117], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.509632261] seconds [----] I, [2016-09-13T04:12:22.691412 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76117], Delivering... [----] I, [2016-09-13T04:12:22.695496 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022268295288085938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022394657135009766, :pending_vm_jobs=>0.0004627704620361328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003789186477661133} [----] I, [2016-09-13T04:12:22.695695 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76117], State: [ok], Delivered in [0.004276661] seconds [----] I, [2016-09-13T04:12:32.220042 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:12:32.249190 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76118], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:12:32.266107 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76119], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:12:32.289746 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76120], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:12:32.312150 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76121], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:12:33.332620 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:12:33.339277 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0032444000244140625, :worker_monitor=>1.2726919651031494, :worker_dequeue=>0.012209653854370117, :total_time=>1.2884304523468018} [----] I, [2016-09-13T04:12:33.369605 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76119], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.117332653] seconds [----] I, [2016-09-13T04:12:33.369809 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76119], Delivering... [----] I, [2016-09-13T04:12:33.386771 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76121], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.088674545] seconds [----] I, [2016-09-13T04:12:33.386972 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76121], Delivering... [----] I, [2016-09-13T04:12:33.395945 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004239320755004883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004266262054443359, :pending_vm_jobs=>0.0011601448059082031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008541584014892578} [----] I, [2016-09-13T04:12:33.396476 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76121], State: [ok], Delivered in [0.009419172] seconds [----] I, [2016-09-13T04:12:33.427691 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76119], State: [ok], Delivered in [0.057799289] seconds [----] I, [2016-09-13T04:12:33.432076 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76118], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.209192882] seconds [----] I, [2016-09-13T04:12:33.432288 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76118], Delivering... [----] I, [2016-09-13T04:12:33.437401 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76118], State: [ok], Delivered in [0.005080803] seconds [----] I, [2016-09-13T04:12:33.472276 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76120], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.202832674] seconds [----] I, [2016-09-13T04:12:33.472500 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76120], Delivering... [----] I, [2016-09-13T04:12:33.476573 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76120], State: [ok], Delivered in [0.00404134] seconds [----] I, [2016-09-13T04:12:47.322477 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:12:47.334744 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76122], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:12:49.703841 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:12:49.708004 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005961894989013672, :worker_monitor=>1.3220164775848389, :worker_dequeue=>0.0077207088470458984, :total_time=>1.336073637008667} [----] I, [2016-09-13T04:12:49.880762 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76122], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.554087279] seconds [----] I, [2016-09-13T04:12:49.880910 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76122], Delivering... [----] I, [2016-09-13T04:12:49.884770 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021550655364990234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021674633026123047, :pending_vm_jobs=>0.00046372413635253906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0036163330078125} [----] I, [2016-09-13T04:12:49.885021 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76122], State: [ok], Delivered in [0.004124169] seconds [----] I, [2016-09-13T04:12:54.708444 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:12:54 UTC]... [----] I, [2016-09-13T04:12:54.726190 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:12:54 UTC]...Complete [----] I, [2016-09-13T04:13:02.345229 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:13:02.360796 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76123], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:13:02.383598 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76124], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:13:06.453334 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:13:06.458874 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041506290435791016, :worker_monitor=>1.6857092380523682, :worker_dequeue=>0.009910345077514648, :total_time=>1.7000727653503418} [----] I, [2016-09-13T04:13:06.572309 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76124], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.205804997] seconds [----] I, [2016-09-13T04:13:06.572512 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76124], Delivering... [----] I, [2016-09-13T04:13:06.578077 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002953767776489258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029697418212890625, :pending_vm_jobs=>0.0006647109985351562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005233287811279297} [----] I, [2016-09-13T04:13:06.578409 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76124], State: [ok], Delivered in [0.005910722] seconds [----] I, [2016-09-13T04:13:06.606841 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76123], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.256952363] seconds [----] I, [2016-09-13T04:13:06.607128 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76123], Delivering... [----] I, [2016-09-13T04:13:06.614311 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76123], State: [ok], Delivered in [0.007183616] seconds [----] I, [2016-09-13T04:13:17.399474 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:13:17.417925 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76125], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:13:17.429252 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76126], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:13:17.440639 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76127], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:13:23.009258 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:13:23.016403 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004391908645629883, :worker_monitor=>1.4330024719238281, :worker_dequeue=>0.012555122375488281, :total_time=>1.4502577781677246} [----] I, [2016-09-13T04:13:23.135963 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76125], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.731647404] seconds [----] I, [2016-09-13T04:13:23.136125 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76125], Delivering... [----] I, [2016-09-13T04:13:23.141529 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028417110443115234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028581619262695312, :pending_vm_jobs=>0.000698089599609375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005057096481323242} [----] I, [2016-09-13T04:13:23.141828 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76125], State: [ok], Delivered in [0.0057042] seconds [----] I, [2016-09-13T04:13:23.144161 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76126], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.722585333] seconds [----] I, [2016-09-13T04:13:23.144352 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76126], Delivering... [----] I, [2016-09-13T04:13:23.145634 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T04:13:23.145839 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5320146944 [----] I, [2016-09-13T04:13:23.145938 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5106413568 [----] I, [2016-09-13T04:13:23.146022 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 213733376 [----] I, [2016-09-13T04:13:23.146097 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1314914304 [----] I, [2016-09-13T04:13:23.146171 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5052661760 [----] I, [2016-09-13T04:13:23.146244 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T04:13:23.146323 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T04:13:23.146397 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 534470656 [----] I, [2016-09-13T04:13:23.146530 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T04:13:23.146615 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7829090304 [----] I, [2016-09-13T04:13:23.146689 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T04:13:23.146809 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T04:13:23.146891 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T04:13:23.146964 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 0 [----] I, [2016-09-13T04:13:23.147032 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T04:13:23.147110 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T04:13:23.147181 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T04:13:23.147254 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T04:13:23.147326 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T04:13:23.147392 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T04:13:23.147521 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273199104 [----] I, [2016-09-13T04:13:23.147613 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56369152 [----] I, [2016-09-13T04:13:23.147691 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216829952 [----] I, [2016-09-13T04:13:23.147763 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T04:13:23.147836 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140587008 [----] I, [2016-09-13T04:13:23.147912 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2616156160 [----] I, [2016-09-13T04:13:23.148009 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2307432448 [----] I, [2016-09-13T04:13:23.148140 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T04:13:23.148250 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T04:13:23.148329 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T04:13:23.148402 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37216256 [----] I, [2016-09-13T04:13:23.148569 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102281216 [----] I, [2016-09-13T04:13:23.148692 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53264384 [----] I, [2016-09-13T04:13:23.148773 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110129152 [----] I, [2016-09-13T04:13:23.148842 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155545600 [----] I, [2016-09-13T04:13:23.148912 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T04:13:23.148998 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T04:13:23.149072 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T04:13:23.149152 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T04:13:23.149222 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T04:13:23.149291 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T04:13:23.149362 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T04:13:23.149472 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 8192 [----] I, [2016-09-13T04:13:23.149568 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T04:13:23.195601 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T04:13:23.195893 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T04:13:23.202197 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T04:13:23.206937 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T04:13:23.211656 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T04:13:23.217520 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T04:13:23.223312 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T04:13:23.229140 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 835 MB 1.17 GB 41% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T04:13:23.234306 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T04:13:23.239758 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T04:13:23.245604 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.6 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T04:13:23.251192 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T04:13:23.256858 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T04:13:23.262576 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T04:13:23.267083 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:13:23.267248 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:13:23.267334 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T04:13:23.271678 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358682000], Memory % [5.28], CPU Time [197197.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T04:13:23.272069 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76126], State: [ok], Delivered in [0.127702793] seconds [----] I, [2016-09-13T04:13:28.017017 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:13:28 UTC]... [----] I, [2016-09-13T04:13:28.056622 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:13:28 UTC]...Complete [----] I, [2016-09-13T04:13:28.070217 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:13:28.212100 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76127], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [10.779305998] seconds [----] I, [2016-09-13T04:13:28.212305 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76127], Delivering... [----] I, [2016-09-13T04:13:28.220143 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:13:17 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [233803.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T04:13:28.220741 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:13:22 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202018000], Memory % [3.38], CPU Time [146945.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:13:28.221201 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:13:11 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [102864.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T04:13:28.221747 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:13:21 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162415000], Memory % [3.1], CPU Time [37040.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T04:13:28.222178 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:13:21 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [47915.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T04:13:28.222696 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:13:22 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [147893.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:13:28.223194 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:13:21 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358682000], Memory % [5.28], CPU Time [197209.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T04:13:28.223733 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:13:21 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50243.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:13:28.224157 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:13:21 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [50257.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:13:28.224609 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:13:17 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165800000], Memory % [3.16], CPU Time [37919.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T04:13:28.227257 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:13:20 UTC], Process Info: Memory Usage [586092544], Memory Size [915906560], Proportional Set Size: [423292000], Memory % [7.15], CPU Time [719.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:13:28.229254 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:13:22 UTC], Process Info: Memory Usage [587448320], Memory Size [930627584], Proportional Set Size: [424341000], Memory % [7.16], CPU Time [244.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:13:28.231310 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:13:14 UTC], Process Info: Memory Usage [557707264], Memory Size [894599168], Proportional Set Size: [405276000], Memory % [6.8], CPU Time [4332.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T04:13:28.233225 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:13:17 UTC], Process Info: Memory Usage [580472832], Memory Size [909279232], Proportional Set Size: [419833000], Memory % [7.08], CPU Time [978.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T04:13:28.233762 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:13:21 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [205850.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T04:13:28.234063 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76127], State: [ok], Delivered in [0.021754959] seconds [----] I, [2016-09-13T04:13:32.451092 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:13:32.473914 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76128], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:13:32.491113 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76129], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:13:32.513949 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76130], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:13:32.536617 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76131], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:13:33.088518 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:13:33.314075 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76129], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.835893488] seconds [----] I, [2016-09-13T04:13:33.314279 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76129], Delivering... [----] I, [2016-09-13T04:13:33.370985 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76129], State: [ok], Delivered in [0.056680324] seconds [----] I, [2016-09-13T04:13:33.389562 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76131], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.86570553] seconds [----] I, [2016-09-13T04:13:33.389750 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76131], Delivering... [----] I, [2016-09-13T04:13:33.396324 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003643035888671875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003664255142211914, :pending_vm_jobs=>0.0007824897766113281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062329769134521484} [----] I, [2016-09-13T04:13:33.396698 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76131], State: [ok], Delivered in [0.006939573] seconds [----] I, [2016-09-13T04:13:33.668213 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76128], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.212574233] seconds [----] I, [2016-09-13T04:13:33.668407 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76128], Delivering... [----] I, [2016-09-13T04:13:33.672808 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76128], State: [ok], Delivered in [0.004403584] seconds [----] I, [2016-09-13T04:13:33.708102 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76130], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.211328056] seconds [----] I, [2016-09-13T04:13:33.708225 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76130], Delivering... [----] I, [2016-09-13T04:13:33.710121 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76130], State: [ok], Delivered in [0.00188174] seconds [----] I, [2016-09-13T04:13:39.408144 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003186464309692383, :worker_monitor=>1.297476053237915, :worker_dequeue=>0.010917186737060547, :total_time=>1.311939001083374} [----] I, [2016-09-13T04:13:47.547500 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:13:47.565059 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76132], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:13:49.439183 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:13:49.548287 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76132], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.994493263] seconds [----] I, [2016-09-13T04:13:49.548560 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76132], Delivering... [----] I, [2016-09-13T04:13:49.556785 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036869049072265625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003711223602294922, :pending_vm_jobs=>0.0009438991546630859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007750511169433594} [----] I, [2016-09-13T04:13:49.557320 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76132], State: [ok], Delivered in [0.008728383] seconds [----] I, [2016-09-13T04:13:55.846606 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038967132568359375, :worker_monitor=>1.3832368850708008, :worker_dequeue=>0.009187698364257812, :total_time=>1.3966875076293945} [----] I, [2016-09-13T04:14:00.846994 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:14:00 UTC]... [----] I, [2016-09-13T04:14:00.862169 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:14:00 UTC]...Complete [----] I, [2016-09-13T04:14:02.576766 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:14:02.588183 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76133], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:14:02.605711 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76134], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:14:05.881627 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:14:06.685766 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76134], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.092050787] seconds [----] I, [2016-09-13T04:14:06.685969 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76134], Delivering... [----] I, [2016-09-13T04:14:06.692500 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035021305084228516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003523588180541992, :pending_vm_jobs=>0.0007870197296142578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060656070709228516} [----] I, [2016-09-13T04:14:06.692870 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76134], State: [ok], Delivered in [0.006890236] seconds [----] I, [2016-09-13T04:14:06.811299 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76133], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.228448145] seconds [----] I, [2016-09-13T04:14:06.811608 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76133], Delivering... [----] I, [2016-09-13T04:14:06.816383 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76133], State: [ok], Delivered in [0.004790403] seconds [----] I, [2016-09-13T04:14:12.534254 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007108211517333984, :worker_monitor=>1.6266462802886963, :worker_dequeue=>0.011530399322509766, :total_time=>1.6458568572998047} [----] I, [2016-09-13T04:14:17.617675 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:14:17.634212 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76135], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:14:22.629523 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:14:22.829025 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76135], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.205631962] seconds [----] I, [2016-09-13T04:14:22.829221 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76135], Delivering... [----] I, [2016-09-13T04:14:22.835689 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034589767456054688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034813880920410156, :pending_vm_jobs=>0.0008025169372558594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060884952545166016} [----] I, [2016-09-13T04:14:22.836122 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76135], State: [ok], Delivered in [0.00688557] seconds [----] I, [2016-09-13T04:14:28.694404 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002798795700073242, :worker_monitor=>1.0496068000793457, :worker_dequeue=>0.006741046905517578, :total_time=>1.0593645572662354} [----] I, [2016-09-13T04:14:32.943146 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:14:32.974068 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76136], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:14:33.011732 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76137], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:14:33.034601 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76138], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:14:33.074590 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76139], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:14:33.694925 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:14:33 UTC]... [----] I, [2016-09-13T04:14:33.725820 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:14:33 UTC]...Complete [----] I, [2016-09-13T04:14:33.736750 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:14:33.898406 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76137], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.915969715] seconds [----] I, [2016-09-13T04:14:33.898631 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76137], Delivering... [----] I, [2016-09-13T04:14:33.943119 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76139], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.894160995] seconds [----] I, [2016-09-13T04:14:33.943267 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76139], Delivering... [----] I, [2016-09-13T04:14:33.947066 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002119779586791992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021305084228515625, :pending_vm_jobs=>0.0004124641418457031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003497600555419922} [----] I, [2016-09-13T04:14:33.947327 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76139], State: [ok], Delivered in [0.004066126] seconds [----] I, [2016-09-13T04:14:33.960233 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76137], State: [ok], Delivered in [0.061531122] seconds [----] I, [2016-09-13T04:14:33.960379 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76136], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.007178681] seconds [----] I, [2016-09-13T04:14:33.960608 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76136], Delivering... [----] I, [2016-09-13T04:14:33.964841 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76136], State: [ok], Delivered in [0.00424606] seconds [----] I, [2016-09-13T04:14:34.000035 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76138], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.980018534] seconds [----] I, [2016-09-13T04:14:34.000176 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76138], Delivering... [----] I, [2016-09-13T04:14:34.002218 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76138], State: [ok], Delivered in [0.002041881] seconds [----] I, [2016-09-13T04:14:44.993381 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00396728515625, :worker_monitor=>1.2267076969146729, :worker_dequeue=>0.008640766143798828, :total_time=>1.239661693572998} [----] I, [2016-09-13T04:14:48.092344 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:14:48.167214 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76140], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:14:50.002988 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:14:50.057484 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76140], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.957124566] seconds [----] I, [2016-09-13T04:14:50.057659 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76140], Delivering... [----] I, [2016-09-13T04:14:50.062392 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025153160095214844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025331974029541016, :pending_vm_jobs=>0.0006232261657714844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004445791244506836} [----] I, [2016-09-13T04:14:50.062688 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76140], State: [ok], Delivered in [0.00502917] seconds [----] I, [2016-09-13T04:15:01.308740 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004216909408569336, :worker_monitor=>1.272167444229126, :worker_dequeue=>0.0068089962005615234, :total_time=>1.2834770679473877} [----] I, [2016-09-13T04:15:03.179092 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:15:03.207921 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76141], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:15:03.224800 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76142], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:15:06.309172 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:15:06 UTC]... [----] I, [2016-09-13T04:15:06.327562 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:15:06 UTC]...Complete [----] I, [2016-09-13T04:15:06.334035 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:15:07.106117 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76142], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.893004563] seconds [----] I, [2016-09-13T04:15:07.106322 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76142], Delivering... [----] I, [2016-09-13T04:15:07.112490 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032393932342529297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003258943557739258, :pending_vm_jobs=>0.0007970333099365234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057811737060546875} [----] I, [2016-09-13T04:15:07.112802 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76142], State: [ok], Delivered in [0.006496794] seconds [----] I, [2016-09-13T04:15:07.133865 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76141], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.950706042] seconds [----] I, [2016-09-13T04:15:07.134040 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76141], Delivering... [----] I, [2016-09-13T04:15:07.139173 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76141], State: [ok], Delivered in [0.005125718] seconds [----] I, [2016-09-13T04:15:17.712992 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0048139095306396484, :worker_monitor=>1.3543407917022705, :worker_dequeue=>0.0059814453125, :total_time=>1.365544319152832} [----] I, [2016-09-13T04:15:18.242213 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:15:18.259740 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76143], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:15:22.874848 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:15:23.259585 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76143], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.011580266] seconds [----] I, [2016-09-13T04:15:23.259727 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76143], Delivering... [----] I, [2016-09-13T04:15:23.264294 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002474546432495117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024871826171875, :pending_vm_jobs=>0.000576019287109375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004315376281738281} [----] I, [2016-09-13T04:15:23.264580 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76143], State: [ok], Delivered in [0.004843447] seconds [----] I, [2016-09-13T04:15:33.275224 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:15:33.300078 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76144], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:15:33.317097 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76145], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:15:33.339826 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76146], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:15:33.374239 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76147], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:15:34.398965 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:15:34.405273 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038776397705078125, :worker_monitor=>1.4907989501953125, :worker_dequeue=>0.011440515518188477, :total_time=>1.5063667297363281} [----] I, [2016-09-13T04:15:34.431369 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76145], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.125144167] seconds [----] I, [2016-09-13T04:15:34.431624 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76145], Delivering... [----] I, [2016-09-13T04:15:34.436527 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76147], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.08219789] seconds [----] I, [2016-09-13T04:15:34.436642 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76147], Delivering... [----] I, [2016-09-13T04:15:34.440363 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020246505737304688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002038240432739258, :pending_vm_jobs=>0.00045228004455566406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0035233497619628906} [----] I, [2016-09-13T04:15:34.440650 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76147], State: [ok], Delivered in [0.004004129] seconds [----] I, [2016-09-13T04:15:34.487969 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76145], State: [ok], Delivered in [0.056318678] seconds [----] I, [2016-09-13T04:15:37.202628 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76144], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.920938459] seconds [----] I, [2016-09-13T04:15:37.202759 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76144], Delivering... [----] I, [2016-09-13T04:15:37.205878 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76144], State: [ok], Delivered in [0.003110467] seconds [----] I, [2016-09-13T04:15:37.226252 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76146], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.897290739] seconds [----] I, [2016-09-13T04:15:37.226470 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76146], Delivering... [----] I, [2016-09-13T04:15:37.229272 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76146], State: [ok], Delivered in [0.002829697] seconds [----] I, [2016-09-13T04:15:39.405730 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:15:39 UTC]... [----] I, [2016-09-13T04:15:39.425317 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:15:39 UTC]...Complete [----] I, [2016-09-13T04:15:48.390267 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:15:48.409197 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76148], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:15:50.825650 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:15:50.830641 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0044825077056884766, :worker_monitor=>1.3653433322906494, :worker_dequeue=>0.008882999420166016, :total_time=>1.3790299892425537} [----] I, [2016-09-13T04:15:51.600626 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76148], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.204935551] seconds [----] I, [2016-09-13T04:15:51.600858 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76148], Delivering... [----] I, [2016-09-13T04:15:51.611649 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004983663558959961, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0050160884857177734, :pending_vm_jobs=>0.0017006397247314453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010268688201904297} [----] I, [2016-09-13T04:15:51.612185 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76148], State: [ok], Delivered in [0.01129566] seconds [----] I, [2016-09-13T04:16:03.422403 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:16:03.437496 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76149], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:16:03.454549 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76150], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:16:07.084281 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:16:07.090085 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0026445388793945312, :worker_monitor=>1.198843240737915, :worker_dequeue=>0.010344982147216797, :total_time=>1.212052345275879} [----] I, [2016-09-13T04:16:07.346005 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76150], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.902311433] seconds [----] I, [2016-09-13T04:16:07.346204 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76150], Delivering... [----] I, [2016-09-13T04:16:07.351858 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76149], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.923829785] seconds [----] I, [2016-09-13T04:16:07.351934 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003062009811401367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003078937530517578, :pending_vm_jobs=>0.0006711483001708984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005338430404663086} [----] I, [2016-09-13T04:16:07.352080 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76149], Delivering... [----] I, [2016-09-13T04:16:07.352252 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76150], State: [ok], Delivered in [0.006065847] seconds [----] I, [2016-09-13T04:16:07.357112 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76149], State: [ok], Delivered in [0.005023405] seconds [----] I, [2016-09-13T04:16:12.090612 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:16:12 UTC]... [----] I, [2016-09-13T04:16:12.104098 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:16:12 UTC]...Complete [----] I, [2016-09-13T04:16:18.474005 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:16:18.493232 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76151], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:16:23.323852 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:16:23.327629 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037279129028320312, :worker_monitor=>1.1860744953155518, :worker_dequeue=>0.006783723831176758, :total_time=>1.1968588829040527} [----] I, [2016-09-13T04:16:23.816650 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76151], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.333587304] seconds [----] I, [2016-09-13T04:16:23.816790 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76151], Delivering... [----] I, [2016-09-13T04:16:23.820851 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002333402633666992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023484230041503906, :pending_vm_jobs=>0.00046706199645996094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038018226623535156} [----] I, [2016-09-13T04:16:23.821090 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76151], State: [ok], Delivered in [0.004296798] seconds [----] I, [2016-09-13T04:16:33.509615 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:16:33.524654 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76152], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:16:33.536115 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76153], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:16:33.553178 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76154], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:16:33.570258 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76155], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:16:38.502656 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T04:16:39.994871 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:16:40.001857 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002892017364501953, :log_active_servers=>0.007517576217651367, :worker_monitor=>1.4860851764678955, :worker_dequeue=>0.01276540756225586, :total_time=>1.5095853805541992} [----] I, [2016-09-13T04:16:40.460510 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76155], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.899381184] seconds [----] I, [2016-09-13T04:16:40.460687 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76155], Delivering... [----] I, [2016-09-13T04:16:40.466772 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031442642211914062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031633377075195312, :pending_vm_jobs=>0.0007920265197753906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057446956634521484} [----] I, [2016-09-13T04:16:40.467146 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76155], State: [ok], Delivered in [0.006442582] seconds [----] I, [2016-09-13T04:16:40.477548 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76153], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.948627616] seconds [----] I, [2016-09-13T04:16:40.477751 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76153], Delivering... [----] I, [2016-09-13T04:16:40.512016 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76152], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.99808399] seconds [----] I, [2016-09-13T04:16:40.512212 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76152], Delivering... [----] I, [2016-09-13T04:16:40.517875 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76152], State: [ok], Delivered in [0.005616361] seconds [----] I, [2016-09-13T04:16:40.551705 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76153], State: [ok], Delivered in [0.073915743] seconds [----] I, [2016-09-13T04:16:40.557300 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76154], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.016001312] seconds [----] I, [2016-09-13T04:16:40.557545 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76154], Delivering... [----] I, [2016-09-13T04:16:40.560660 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76154], State: [ok], Delivered in [0.003103595] seconds [----] I, [2016-09-13T04:16:45.003444 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:16:45 UTC]... [----] I, [2016-09-13T04:16:45.025723 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:16:45 UTC]...Complete [----] I, [2016-09-13T04:16:48.583274 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:16:48.608818 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76156], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:16:50.052622 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:16:51.015026 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76156], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.421856993] seconds [----] I, [2016-09-13T04:16:51.015248 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76156], Delivering... [----] I, [2016-09-13T04:16:51.022177 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003674745559692383, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036957263946533203, :pending_vm_jobs=>0.0008533000946044922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006479501724243164} [----] I, [2016-09-13T04:16:51.022671 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76156], State: [ok], Delivered in [0.007422508] seconds [----] I, [2016-09-13T04:16:56.298148 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0032799243927001953, :worker_monitor=>1.2261064052581787, :worker_dequeue=>0.01034235954284668, :total_time=>1.2399475574493408} [----] I, [2016-09-13T04:17:03.628781 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:17:03.646560 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76157], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:17:03.662508 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76158], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:17:06.326101 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:17:07.125500 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76158], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.472653054] seconds [----] I, [2016-09-13T04:17:07.125676 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76158], Delivering... [----] I, [2016-09-13T04:17:07.131214 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028786659240722656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002897500991821289, :pending_vm_jobs=>0.0006935596466064453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005188941955566406} [----] I, [2016-09-13T04:17:07.131555 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76158], State: [ok], Delivered in [0.005860651] seconds [----] I, [2016-09-13T04:17:07.713725 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76157], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.077752768] seconds [----] I, [2016-09-13T04:17:07.713858 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76157], Delivering... [----] I, [2016-09-13T04:17:07.716855 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76157], State: [ok], Delivered in [0.002988157] seconds [----] I, [2016-09-13T04:17:12.927711 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0052356719970703125, :worker_monitor=>1.5763797760009766, :worker_dequeue=>0.01528477668762207, :total_time=>1.5972974300384521} [----] I, [2016-09-13T04:17:17.929930 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:17:17 UTC]... [----] I, [2016-09-13T04:17:17.949016 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:17:17 UTC]...Complete [----] I, [2016-09-13T04:17:18.681602 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:17:18.702757 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76159], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:17:22.978324 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:17:23.240406 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76159], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.551848403] seconds [----] I, [2016-09-13T04:17:23.240779 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76159], Delivering... [----] I, [2016-09-13T04:17:23.252049 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005681037902832031, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005714893341064453, :pending_vm_jobs=>0.0015833377838134766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010712385177612305} [----] I, [2016-09-13T04:17:23.252626 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76159], State: [ok], Delivered in [0.011852768] seconds [----] I, [2016-09-13T04:17:29.743125 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004747629165649414, :worker_monitor=>1.7392022609710693, :worker_dequeue=>0.009652376174926758, :total_time=>1.7539796829223633} [----] I, [2016-09-13T04:17:33.715798 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:17:33.731035 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76160], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:17:33.748489 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76161], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:17:33.771152 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76162], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:17:33.799646 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76163], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:17:34.875216 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:17:35.337480 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76161], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.602969444] seconds [----] I, [2016-09-13T04:17:35.337685 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76161], Delivering... [----] I, [2016-09-13T04:17:35.365881 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76163], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.586733275] seconds [----] I, [2016-09-13T04:17:35.366083 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76163], Delivering... [----] I, [2016-09-13T04:17:35.372571 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00341796875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003437519073486328, :pending_vm_jobs=>0.0008225440979003906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006117820739746094} [----] I, [2016-09-13T04:17:35.372907 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76163], State: [ok], Delivered in [0.006810531] seconds [----] I, [2016-09-13T04:17:35.401181 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76161], State: [ok], Delivered in [0.063458097] seconds [----] I, [2016-09-13T04:17:37.806359 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76160], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.085790084] seconds [----] I, [2016-09-13T04:17:37.806724 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76160], Delivering... [----] I, [2016-09-13T04:17:37.813643 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76160], State: [ok], Delivered in [0.006911977] seconds [----] I, [2016-09-13T04:17:37.830685 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76162], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.077315728] seconds [----] I, [2016-09-13T04:17:37.831007 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76162], Delivering... [----] I, [2016-09-13T04:17:37.835750 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76162], State: [ok], Delivered in [0.00476751] seconds [----] I, [2016-09-13T04:17:46.440381 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005982160568237305, :worker_monitor=>1.4090354442596436, :worker_dequeue=>0.0063822269439697266, :total_time=>1.4217889308929443} [----] I, [2016-09-13T04:17:48.811386 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:17:48.838517 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76164], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:17:51.440969 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:17:51 UTC]... [----] I, [2016-09-13T04:17:51.461893 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:17:51 UTC]...Complete [----] I, [2016-09-13T04:17:51.473352 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:17:51.512374 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76164], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.694166802] seconds [----] I, [2016-09-13T04:17:51.512635 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76164], Delivering... [----] I, [2016-09-13T04:17:51.519093 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033097267150878906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033299922943115234, :pending_vm_jobs=>0.0008130073547363281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006052494049072266} [----] I, [2016-09-13T04:17:51.519517 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76164], State: [ok], Delivered in [0.006828691] seconds [----] I, [2016-09-13T04:18:03.027084 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003908634185791016, :worker_monitor=>1.507209300994873, :worker_dequeue=>0.017036914825439453, :total_time=>1.5285449028015137} [----] I, [2016-09-13T04:18:03.854740 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T04:18:03.872634 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76165], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:18:03.883769 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76166], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:18:03.901254 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76167], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [3600] [----] I, [2016-09-13T04:18:08.035139 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:18:08.644130 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76166], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.765799457] seconds [----] I, [2016-09-13T04:18:08.644302 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76166], Delivering... [----] I, [2016-09-13T04:18:08.649546 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027837753295898438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028002262115478516, :pending_vm_jobs=>0.0006365776062011719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004853010177612305} [----] I, [2016-09-13T04:18:08.649900 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76166], State: [ok], Delivered in [0.005594609] seconds [----] I, [2016-09-13T04:18:10.958548 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76165], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.096549757] seconds [----] I, [2016-09-13T04:18:10.958716 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76165], Delivering... [----] I, [2016-09-13T04:18:10.962496 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76165], State: [ok], Delivered in [0.003757146] seconds [----] I, [2016-09-13T04:18:10.998521 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76167], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [3600], Dequeued in: [7.109266216] seconds [----] I, [2016-09-13T04:18:10.998667 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76167], Delivering... [----] I, [2016-09-13T04:18:11.008268 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76167], State: [ok], Delivered in [0.009596083] seconds [----] I, [2016-09-13T04:18:18.913981 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:18:18.935572 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76168], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:18:18.959266 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76169], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:18:18.969851 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76170], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:18:19.253608 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:18:19.261661 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0057027339935302734, :worker_monitor=>1.1839256286621094, :worker_dequeue=>0.014577150344848633, :total_time=>1.2046008110046387} [----] I, [2016-09-13T04:18:19.733746 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76168], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.812223978] seconds [----] I, [2016-09-13T04:18:19.734030 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76168], Delivering... [----] I, [2016-09-13T04:18:19.742087 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004468441009521484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004500150680541992, :pending_vm_jobs=>0.0010063648223876953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007520437240600586} [----] I, [2016-09-13T04:18:19.742598 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76168], State: [ok], Delivered in [0.008566242] seconds [----] I, [2016-09-13T04:18:19.744515 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76169], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.803307957] seconds [----] I, [2016-09-13T04:18:19.744681 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76169], Delivering... [----] I, [2016-09-13T04:18:19.745552 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T04:18:19.745695 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5321019392 [----] I, [2016-09-13T04:18:19.745753 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5107101696 [----] I, [2016-09-13T04:18:19.745805 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 213917696 [----] I, [2016-09-13T04:18:19.745850 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1314914304 [----] I, [2016-09-13T04:18:19.745902 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5053255680 [----] I, [2016-09-13T04:18:19.745986 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T04:18:19.746067 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T04:18:19.746151 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 534667264 [----] I, [2016-09-13T04:18:19.746214 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T04:18:19.746266 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7858974720 [----] I, [2016-09-13T04:18:19.746315 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T04:18:19.746358 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T04:18:19.746406 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T04:18:19.746503 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 12288 [----] I, [2016-09-13T04:18:19.746555 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T04:18:19.746601 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T04:18:19.746646 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T04:18:19.746691 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T04:18:19.746736 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T04:18:19.746792 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T04:18:19.746841 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273125376 [----] I, [2016-09-13T04:18:19.746889 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56283136 [----] I, [2016-09-13T04:18:19.746935 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216842240 [----] I, [2016-09-13T04:18:19.746982 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T04:18:19.747031 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140587008 [----] I, [2016-09-13T04:18:19.747076 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2615316480 [----] I, [2016-09-13T04:18:19.747120 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2306396160 [----] I, [2016-09-13T04:18:19.747164 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T04:18:19.747209 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T04:18:19.747252 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T04:18:19.747296 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37220352 [----] I, [2016-09-13T04:18:19.747341 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102281216 [----] I, [2016-09-13T04:18:19.747385 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53227520 [----] I, [2016-09-13T04:18:19.747457 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110129152 [----] I, [2016-09-13T04:18:19.747517 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155508736 [----] I, [2016-09-13T04:18:19.747564 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T04:18:19.747608 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T04:18:19.747654 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T04:18:19.747699 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T04:18:19.747743 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T04:18:19.747790 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T04:18:19.747834 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T04:18:19.747877 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T04:18:19.747920 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T04:18:19.793934 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T04:18:19.794117 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T04:18:19.796718 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T04:18:19.798317 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T04:18:19.800349 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T04:18:19.802305 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T04:18:19.804205 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T04:18:19.806518 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 835 MB 1.17 GB 41% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T04:18:19.808558 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T04:18:19.810461 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T04:18:19.812401 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T04:18:19.814372 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T04:18:19.816268 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T04:18:19.818186 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T04:18:19.820383 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:18:19.820527 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:18:19.820602 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T04:18:19.823952 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358682000], Memory % [5.28], CPU Time [146998.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T04:18:19.824282 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76169], State: [ok], Delivered in [0.079607248] seconds [----] I, [2016-09-13T04:18:24.262253 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:18:24 UTC]... [----] I, [2016-09-13T04:18:24.281368 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:18:24 UTC]...Complete [----] I, [2016-09-13T04:18:24.296771 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:18:24.813253 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76170], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.849547353] seconds [----] I, [2016-09-13T04:18:24.813479 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76170], Delivering... [----] I, [2016-09-13T04:18:24.820646 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:18:11 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [102878.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T04:18:24.821203 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:18:18 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [147955.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:18:24.821679 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:18:09 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [47922.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T04:18:24.822162 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:18:16 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50259.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:18:24.822669 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:18:18 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [233958.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T04:18:24.823171 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:18:16 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162415000], Memory % [3.1], CPU Time [37050.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T04:18:24.823689 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:18:17 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358682000], Memory % [5.28], CPU Time [197243.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T04:18:24.824155 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:18:18 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202018000], Memory % [3.38], CPU Time [147010.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:18:24.826746 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:18:12 UTC], Process Info: Memory Usage [587448320], Memory Size [930627584], Proportional Set Size: [424403000], Memory % [7.16], CPU Time [254.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:18:24.828679 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:18:11 UTC], Process Info: Memory Usage [586092544], Memory Size [915906560], Proportional Set Size: [423292000], Memory % [7.15], CPU Time [732.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:18:24.830641 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:18:15 UTC], Process Info: Memory Usage [557977600], Memory Size [910327808], Proportional Set Size: [405516000], Memory % [6.8], CPU Time [4344.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T04:18:24.832597 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:18:17 UTC], Process Info: Memory Usage [580694016], Memory Size [923435008], Proportional Set Size: [420049000], Memory % [7.08], CPU Time [989.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T04:18:24.833104 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:18:17 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [205882.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T04:18:24.833625 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:18:19 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [50273.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:18:24.834086 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:18:17 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165800000], Memory % [3.16], CPU Time [37929.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T04:18:24.834403 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76170], State: [ok], Delivered in [0.020975974] seconds [----] I, [2016-09-13T04:18:33.983009 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:18:33.995810 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76171], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:18:34.007321 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76172], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:18:34.018696 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76173], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:18:34.042952 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76174], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:18:35.872977 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:18:35.876626 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003984928131103516, :worker_monitor=>1.5530602931976318, :worker_dequeue=>0.0067064762115478516, :total_time=>1.564070224761963} [----] I, [2016-09-13T04:18:35.979288 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76172], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.979745078] seconds [----] I, [2016-09-13T04:18:35.979495 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76172], Delivering... [----] I, [2016-09-13T04:18:35.999271 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76174], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.968743392] seconds [----] I, [2016-09-13T04:18:35.999579 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76174], Delivering... [----] I, [2016-09-13T04:18:36.008393 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004513740539550781, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004547595977783203, :pending_vm_jobs=>0.001104593276977539, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008309364318847656} [----] I, [2016-09-13T04:18:36.008908 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76174], State: [ok], Delivered in [0.00935485] seconds [----] I, [2016-09-13T04:18:36.044867 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76172], State: [ok], Delivered in [0.065383239] seconds [----] I, [2016-09-13T04:18:38.122597 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76171], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.134200303] seconds [----] I, [2016-09-13T04:18:38.122913 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76171], Delivering... [----] I, [2016-09-13T04:18:38.127994 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76171], State: [ok], Delivered in [0.005093958] seconds [----] I, [2016-09-13T04:18:38.130739 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76173], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.117392031] seconds [----] I, [2016-09-13T04:18:38.130958 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76173], Delivering... [----] I, [2016-09-13T04:18:38.134238 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76173], State: [ok], Delivered in [0.003278318] seconds [----] I, [2016-09-13T04:18:49.057390 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:18:49.080901 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76175], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:18:52.206302 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:18:52.218119 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0049326419830322266, :worker_monitor=>1.1153135299682617, :worker_dequeue=>0.029311180114746094, :total_time=>1.149935245513916} [----] I, [2016-09-13T04:18:52.233630 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76175], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.16640512] seconds [----] I, [2016-09-13T04:18:52.233841 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76175], Delivering... [----] I, [2016-09-13T04:18:52.240563 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003883838653564453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0039033889770507812, :pending_vm_jobs=>0.0007648468017578125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00626063346862793} [----] I, [2016-09-13T04:18:52.240927 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76175], State: [ok], Delivered in [0.007089315] seconds [----] I, [2016-09-13T04:18:57.218823 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:18:57 UTC]... [----] I, [2016-09-13T04:18:57.239208 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:18:57 UTC]...Complete [----] I, [2016-09-13T04:19:04.094047 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 11. [----] I, [2016-09-13T04:19:04.107827 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76176], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:19:04.119007 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76177], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:19:04.141868 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76178], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:19:08.733330 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:19:08.740229 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004821300506591797, :worker_monitor=>1.445354700088501, :worker_dequeue=>0.012438058853149414, :total_time=>1.4629738330841064} [----] I, [2016-09-13T04:19:09.262271 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76177], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.148873625] seconds [----] I, [2016-09-13T04:19:09.262523 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76177], Delivering... [----] I, [2016-09-13T04:19:09.269879 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003807544708251953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003837108612060547, :pending_vm_jobs=>0.0010027885437011719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0069200992584228516} [----] I, [2016-09-13T04:19:09.270377 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76177], State: [ok], Delivered in [0.007834395] seconds [----] I, [2016-09-13T04:19:11.262637 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76176], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.163652484] seconds [----] I, [2016-09-13T04:19:11.262829 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76176], Delivering... [----] I, [2016-09-13T04:19:11.267581 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76176], State: [ok], Delivered in [0.004718993] seconds [----] I, [2016-09-13T04:19:11.268086 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76178], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.132320652] seconds [----] I, [2016-09-13T04:19:11.268353 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76178], Delivering... [----] I, [2016-09-13T04:19:11.302634 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76179], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T04:19:11.331395 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76180], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T04:19:11.331858 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76178], State: [ok], Delivered in [0.063500155] seconds [----] I, [2016-09-13T04:19:13.763052 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T04:19:13.765977 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T04:19:18.780705 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T04:19:18.783176 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T04:19:19.157783 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:19:19.176772 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76181], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:19:21.360501 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [76179], MiqWorker id: [96], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [10.072279987] seconds [----] I, [2016-09-13T04:19:21.360762 #28071:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76179], Delivering... [----] I, [2016-09-13T04:19:21.365243 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T04:19:21.365495 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T04:19:21.365672 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T04:19:21.365892 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T04:19:21.366101 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:21.818578 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:22.147360 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:22.147641 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:22.639785 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:22.703254 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [76180], MiqWorker id: [97], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [11.39411811] seconds [----] I, [2016-09-13T04:19:22.703599 #30088:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76180], Delivering... [----] I, [2016-09-13T04:19:22.707722 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T04:19:22.707919 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T04:19:22.708027 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T04:19:22.708184 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T04:19:22.708345 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:22.926077 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:22.926253 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:22.987229 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:23.185499 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:23.185683 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:23.418877 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:23.507991 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:23.601303 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:23.690711 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:23.712316 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:23.712548 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:24.035161 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:24.140681 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:24.184530 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:24.232148 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:24.323054 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:24.415240 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:24.496080 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:24.496315 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:24.507900 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:24.599866 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:24.690915 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:24.783003 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:24.871802 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:19:24.875305 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:24.879648 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002665996551513672, :worker_monitor=>1.0791399478912354, :worker_dequeue=>0.013867855072021484, :total_time=>1.0959248542785645} [----] I, [2016-09-13T04:19:24.963588 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:24.969073 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:25.060340 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:25.152317 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:25.243500 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:25.257739 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:25.258012 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:25.337474 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:25.430725 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:25.445565 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76181], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.281178346] seconds [----] I, [2016-09-13T04:19:25.445757 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76181], Delivering... [----] I, [2016-09-13T04:19:25.452525 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003519296646118164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003543853759765625, :pending_vm_jobs=>0.0009477138519287109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006359577178955078} [----] I, [2016-09-13T04:19:25.452911 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76181], State: [ok], Delivered in [0.007137605] seconds [----] I, [2016-09-13T04:19:25.522512 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:19:25.693314 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T04:19:25.693483 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.0040798187255859375, :collect_inventory_for_targets=>2.8371810913085938e-05, :parse_legacy_inventory=>6.297703742980957, :parse_targeted_inventory=>6.297742128372192, :save_inventory=>0.5555932521820068, :ems_refresh=>6.854131698608398} [----] I, [2016-09-13T04:19:25.713720 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T04:19:25.714024 #30088:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76180], State: [ok], Delivered in [3.010466021] seconds [----] I, [2016-09-13T04:19:25.731935 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:26.047249 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:26.047463 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:26.520225 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:26.830511 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:26.830737 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:27.296385 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:27.657652 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:27.657865 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:28.132906 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:28.429601 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:28.429792 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:28.935221 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:29.233298 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:29.233549 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:29.733103 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:29.880184 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:19:29 UTC]... [----] I, [2016-09-13T04:19:29.902100 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:19:29 UTC]...Complete [----] I, [2016-09-13T04:19:30.038683 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:30.038898 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:30.530182 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:30.839490 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:30.839686 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:31.313537 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:31.459500 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:31.596778 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:31.740107 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:31.870660 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:32.011777 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:32.147159 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:32.286569 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:32.420276 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:32.558897 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:32.696280 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:32.832697 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:32.970836 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:33.109289 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:33.587037 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:33.760114 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:33.900383 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:34.040020 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:34.184862 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:34.188427 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T04:19:34.216975 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76182], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:19:34.233941 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76183], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:19:34.250947 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76184], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:19:34.265185 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76185], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:19:34.282476 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76186], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:19:34.329297 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:34.465366 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:34.602243 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:34.922467 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:19:35.352272 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76184], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.114123148] seconds [----] I, [2016-09-13T04:19:35.352434 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76184], Delivering... [----] I, [2016-09-13T04:19:35.396913 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76184], State: [ok], Delivered in [0.044479583] seconds [----] I, [2016-09-13T04:19:35.419835 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76186], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.145779949] seconds [----] I, [2016-09-13T04:19:35.419980 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76186], Delivering... [----] I, [2016-09-13T04:19:35.424730 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025451183319091797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002562284469604492, :pending_vm_jobs=>0.0005648136138916016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004461526870727539} [----] I, [2016-09-13T04:19:35.425037 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76186], State: [ok], Delivered in [0.005057428] seconds [----] I, [2016-09-13T04:19:35.431387 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76182], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.239908737] seconds [----] I, [2016-09-13T04:19:35.431630 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76182], Delivering... [----] I, [2016-09-13T04:19:35.482838 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76183], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.261655678] seconds [----] I, [2016-09-13T04:19:35.483014 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76183], Delivering... [----] I, [2016-09-13T04:19:35.487169 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76183], State: [ok], Delivered in [0.004130693] seconds [----] I, [2016-09-13T04:19:35.520625 #2937:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 08:19:34 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_16' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 08:19:34.925790') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2927,,2016-09-13 08:19:34 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2936,2016-09-13 08:19:35 UTC,2016-09-13 08:19:35 UTC,COMMIT,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2946,2016-09-13 08:19:35 UTC,2016-09-13 08:19:35 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 08:19:34 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 08:19:34 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 08:19:34 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2986,,2016-09-13 08:19:34 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2997,,2016-09-13 08:19:34 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 08:19:19.184003')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 3011,,2016-09-13 07:53:40 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1555, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,496930, 3030,,2016-09-13 06:53:18 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5176, 3054,,2016-09-13 07:23:30 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3365, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,496928, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,496928, 3160,,2016-09-13 07:53:34 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1561, 703,,2016-09-13 07:53:33 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1562, 27056,,2016-09-13 07:53:44 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1551, 28888,,2016-09-13 07:23:32 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3363, 28079,,2016-09-13 08:19:21 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,14, 20394,,2016-09-13 07:53:36 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1559, 30096,,2016-09-13 08:19:25 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,9, ACTIVITY_STATS_CSV [----] I, [2016-09-13T04:19:35.521017 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76182], State: [ok], Delivered in [0.089399413] seconds [----] I, [2016-09-13T04:19:35.545842 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76185], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.289734238] seconds [----] I, [2016-09-13T04:19:35.546045 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76185], Delivering... [----] I, [2016-09-13T04:19:35.549127 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76185], State: [ok], Delivered in [0.003081105] seconds [----] I, [2016-09-13T04:19:40.760909 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:40.894479 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:41.032515 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:41.126408 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003600597381591797, :worker_monitor=>1.183103322982788, :worker_dequeue=>0.011909008026123047, :total_time=>1.198990821838379} [----] I, [2016-09-13T04:19:41.173526 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:41.317985 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:41.460630 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:41.604075 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:41.744026 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:41.881897 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:42.257858 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:42.411964 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:42.549709 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:42.686369 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:42.824259 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:42.964260 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:43.106928 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:43.246518 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:43.391667 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:43.528801 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:43.693643 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:43.833841 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:43.973045 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:44.118901 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:44.259596 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:44.400411 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:44.536304 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:45.005638 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:45.179162 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:45.319835 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:45.460861 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:45.607985 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:45.748114 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:45.894998 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:46.036092 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:46.173767 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:46.315664 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:46.459816 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:46.641434 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:46.782913 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:46.916883 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:47.064459 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:47.205225 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:47.351549 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:47.848692 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:47.999955 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:48.143143 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:48.283227 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:48.424125 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:48.565682 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:48.710486 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:48.851337 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:48.988084 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:49.127611 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:49.272468 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:49.291888 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:19:49.311233 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76187], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:19:49.408740 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:49.552475 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:49.690458 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:49.832893 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:49.972078 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:50.110882 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:50.509161 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:50.666685 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:50.807015 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:50.953143 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:51.090466 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:51.232400 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:51.308786 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:19:51.378640 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:51.519353 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:51.661245 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76187], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.363175024] seconds [----] I, [2016-09-13T04:19:51.661550 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76187], Delivering... [----] I, [2016-09-13T04:19:51.670465 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004050731658935547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004086494445800781, :pending_vm_jobs=>0.0010914802551269531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008270025253295898} [----] I, [2016-09-13T04:19:51.671129 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76187], State: [ok], Delivered in [0.009566155] seconds [----] I, [2016-09-13T04:19:51.696126 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:57.848206 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:57.914494 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00498199462890625, :worker_monitor=>1.5861148834228516, :worker_dequeue=>0.007244586944580078, :total_time=>1.5986697673797607} [----] I, [2016-09-13T04:19:57.985380 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:58.120577 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:58.266999 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:58.405590 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:58.552129 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:58.697478 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:58.844126 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:59.310918 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:59.463049 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:59.605277 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:59.748274 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:19:59.893398 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:00.033134 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:00.189713 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:00.339176 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:00.478674 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:00.626397 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:00.780371 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:00.922201 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:01.063601 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:01.193974 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:01.338003 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:01.471802 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:01.611953 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:02.024663 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:02.197103 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:02.340963 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:02.483850 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:02.623324 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:02.763630 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:02.903197 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:02.914889 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:20:02 UTC]... [----] I, [2016-09-13T04:20:02.936884 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:20:02 UTC]...Complete [----] I, [2016-09-13T04:20:03.041676 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:03.182645 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:03.324466 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:03.461070 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:03.599515 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:03.743616 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:03.886625 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:04.026965 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:04.165261 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:04.304943 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:04.325768 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:20:04.342713 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76188], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:20:04.394302 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76189], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:20:04.434389 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76190], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:20:04.451959 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76191], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:20:04.468591 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76192], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:20:04.666603 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:04.827081 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:04.973979 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:05.110195 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:05.253762 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:05.404726 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:05.544537 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:06.690086 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:06.824701 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:06.963980 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:07.103675 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:07.243593 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:07.389560 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:07.527341 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:07.682048 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:07.833627 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:07.973291 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:20:07.981528 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:08.364549 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:08.524731 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:08.662059 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:08.674776 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76189], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.326508382] seconds [----] I, [2016-09-13T04:20:08.674935 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76189], Delivering... [----] I, [2016-09-13T04:20:08.679828 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025179386138916016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025339126586914062, :pending_vm_jobs=>0.0006189346313476562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004594326019287109} [----] I, [2016-09-13T04:20:08.680151 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76189], State: [ok], Delivered in [0.005208658] seconds [----] I, [2016-09-13T04:20:08.686011 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76188], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.354538659] seconds [----] I, [2016-09-13T04:20:08.686283 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76188], Delivering... [----] I, [2016-09-13T04:20:08.693052 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76188], State: [ok], Delivered in [0.006754722] seconds [----] I, [2016-09-13T04:20:08.737222 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76190], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.338734003] seconds [----] I, [2016-09-13T04:20:08.737368 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76190], Delivering... [----] I, [2016-09-13T04:20:08.739098 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76190], State: [ok], Delivered in [0.001723038] seconds [----] I, [2016-09-13T04:20:08.743030 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76191], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.304655504] seconds [----] I, [2016-09-13T04:20:08.743199 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76191], Delivering... [----] I, [2016-09-13T04:20:08.752405 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76191], State: [ok], Delivered in [0.009181153] seconds [----] I, [2016-09-13T04:20:08.811668 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76192], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.355641615] seconds [----] I, [2016-09-13T04:20:08.811868 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76192], Delivering... [----] I, [2016-09-13T04:20:08.817480 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76192], State: [ok], Delivered in [0.00556911] seconds [----] I, [2016-09-13T04:20:14.669934 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004034280776977539, :worker_monitor=>1.6735682487487793, :worker_dequeue=>0.011824846267700195, :total_time=>1.6897282600402832} [----] I, [2016-09-13T04:20:14.808731 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:14.940890 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:15.074062 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:15.222475 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:15.368875 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:15.510050 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:15.655762 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:15.801134 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:15.940869 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:16.072720 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:16.213651 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:16.353317 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:16.493573 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:16.640200 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:17.072334 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:17.384672 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:17.523095 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:17.656268 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:17.792292 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:17.935714 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:18.073544 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:18.219815 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:18.357803 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:18.495913 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:18.634172 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:18.767144 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:18.905937 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:19.074736 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:19.219006 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:19.362434 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:19.478624 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:20:19.495693 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:19.496918 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76193], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:20:19.679705 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:20:19.857835 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76193], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.375350699] seconds [----] I, [2016-09-13T04:20:19.858131 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76193], Delivering... [----] I, [2016-09-13T04:20:19.860942 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:19.867371 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004640340805053711, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0046672821044921875, :pending_vm_jobs=>0.0011699199676513672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00858616828918457} [----] I, [2016-09-13T04:20:19.867828 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76193], State: [ok], Delivered in [0.009696123] seconds [----] I, [2016-09-13T04:20:20.012652 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:20.149589 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:20.290355 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:20.436290 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:20.596219 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:20.740048 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:20.884106 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:21.023114 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:21.162641 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:21.301713 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:21.437319 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:21.580237 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:21.721743 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:21.862576 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:22.008897 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:22.151627 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:22.523583 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:22.703402 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:22.839935 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:22.978919 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:23.117691 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:23.259258 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:23.398851 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:23.543174 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:23.679159 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:23.811944 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:23.954903 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:24.091031 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:24.227235 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:24.376521 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:24.511648 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:24.650703 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:20:24.786315 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T04:20:24.979400 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T04:20:24.979861 #28071:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T04:20:24.980186 #28071:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T04:20:24.980289 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T04:20:24.980457 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T04:20:25.006125 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T04:20:25.006821 #28071:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [76179], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T04:20:25.007143 #28071:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T04:20:25.007524 #28071:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T04:20:25.007783 #28071:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76179], State: [error], Delivered in [63.647020674] seconds [----] I, [2016-09-13T04:20:31.040989 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004185199737548828, :worker_monitor=>1.3275878429412842, :worker_dequeue=>0.009727954864501953, :total_time=>1.3418474197387695} [----] I, [2016-09-13T04:20:34.504663 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:20:34.521525 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76194], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:20:34.537306 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76195], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:20:34.554616 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76196], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:20:34.571544 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76197], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:20:36.041435 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:20:36 UTC]... [----] I, [2016-09-13T04:20:36.062884 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:20:36 UTC]...Complete [----] I, [2016-09-13T04:20:36.069850 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:20:36.966019 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76195], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.440087543] seconds [----] I, [2016-09-13T04:20:36.966161 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76195], Delivering... [----] I, [2016-09-13T04:20:36.999924 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76197], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.435056268] seconds [----] I, [2016-09-13T04:20:37.000045 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76197], Delivering... [----] I, [2016-09-13T04:20:37.003981 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002092123031616211, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021059513092041016, :pending_vm_jobs=>0.0005261898040771484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0037071704864501953} [----] I, [2016-09-13T04:20:37.004250 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76197], State: [ok], Delivered in [0.004200179] seconds [----] I, [2016-09-13T04:20:37.017447 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76195], State: [ok], Delivered in [0.051232148] seconds [----] I, [2016-09-13T04:20:38.898214 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76194], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.389438279] seconds [----] I, [2016-09-13T04:20:38.898402 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76194], Delivering... [----] I, [2016-09-13T04:20:38.902611 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76194], State: [ok], Delivered in [0.004189628] seconds [----] I, [2016-09-13T04:20:38.908609 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76196], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.365001506] seconds [----] I, [2016-09-13T04:20:38.908763 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76196], Delivering... [----] I, [2016-09-13T04:20:38.911579 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76196], State: [ok], Delivered in [0.002808248] seconds [----] I, [2016-09-13T04:20:47.827788 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00558781623840332, :worker_monitor=>1.7247803211212158, :worker_dequeue=>0.007239103317260742, :total_time=>1.7378883361816406} [----] I, [2016-09-13T04:20:49.584670 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:20:49.600918 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76198], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:20:52.897305 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:20:53.223939 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76198], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.632519063] seconds [----] I, [2016-09-13T04:20:53.224146 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76198], Delivering... [----] I, [2016-09-13T04:20:53.230274 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032639503479003906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003284931182861328, :pending_vm_jobs=>0.0007405281066894531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005764961242675781} [----] I, [2016-09-13T04:20:53.230645 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76198], State: [ok], Delivered in [0.006493439] seconds [----] I, [2016-09-13T04:21:04.616051 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:21:04.645349 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038864612579345703, :worker_monitor=>1.7126564979553223, :worker_dequeue=>0.011878490447998047, :total_time=>1.7287075519561768} [----] I, [2016-09-13T04:21:04.646616 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76199], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:21:04.666832 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76200], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:21:09.646007 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:21:09 UTC]... [----] I, [2016-09-13T04:21:09.669798 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:21:09 UTC]...Complete [----] I, [2016-09-13T04:21:09.679837 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:21:10.350371 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76200], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.699067045] seconds [----] I, [2016-09-13T04:21:10.350587 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76200], Delivering... [----] I, [2016-09-13T04:21:10.355494 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002769947052001953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027856826782226562, :pending_vm_jobs=>0.0005555152893066406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004561901092529297} [----] I, [2016-09-13T04:21:10.355805 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76200], State: [ok], Delivered in [0.005230981] seconds [----] I, [2016-09-13T04:21:12.026994 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76199], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.40697505] seconds [----] I, [2016-09-13T04:21:12.027159 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76199], Delivering... [----] I, [2016-09-13T04:21:12.031166 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76199], State: [ok], Delivered in [0.003996945] seconds [----] I, [2016-09-13T04:21:19.677561 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:21:19.698473 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76201], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:21:21.072026 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:21:21.078331 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003234386444091797, :worker_monitor=>1.3494904041290283, :worker_dequeue=>0.01427459716796875, :total_time=>1.3672654628753662} [----] I, [2016-09-13T04:21:21.095575 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76201], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.411542746] seconds [----] I, [2016-09-13T04:21:21.095749 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76201], Delivering... [----] I, [2016-09-13T04:21:21.101399 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030977725982666016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003114938735961914, :pending_vm_jobs=>0.0007398128509521484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005322933197021484} [----] I, [2016-09-13T04:21:21.101756 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76201], State: [ok], Delivered in [0.005997733] seconds [----] I, [2016-09-13T04:21:34.708361 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:21:34.724377 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76202], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:21:34.735196 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76203], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:21:34.752523 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76204], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:21:34.769452 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76205], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:21:37.468717 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:21:37.473914 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0032546520233154297, :worker_monitor=>1.3386366367340088, :worker_dequeue=>0.009588956832885742, :total_time=>1.3517801761627197} [----] I, [2016-09-13T04:21:37.518473 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76203], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.789948855] seconds [----] I, [2016-09-13T04:21:37.518607 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76203], Delivering... [----] I, [2016-09-13T04:21:37.552928 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76203], State: [ok], Delivered in [0.034295623] seconds [----] I, [2016-09-13T04:21:37.557951 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76205], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.796621154] seconds [----] I, [2016-09-13T04:21:37.558055 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76205], Delivering... [----] I, [2016-09-13T04:21:37.561482 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00183868408203125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0018510818481445312, :pending_vm_jobs=>0.0004374980926513672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0031900405883789062} [----] I, [2016-09-13T04:21:37.561702 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76205], State: [ok], Delivered in [0.0036443] seconds [----] I, [2016-09-13T04:21:39.221258 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76202], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.508326654] seconds [----] I, [2016-09-13T04:21:39.221385 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76202], Delivering... [----] I, [2016-09-13T04:21:39.224143 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76202], State: [ok], Delivered in [0.002748727] seconds [----] I, [2016-09-13T04:21:39.284310 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76204], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.54403517] seconds [----] I, [2016-09-13T04:21:39.284520 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76204], Delivering... [----] I, [2016-09-13T04:21:39.287354 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76204], State: [ok], Delivered in [0.002829177] seconds [----] I, [2016-09-13T04:21:42.474407 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:21:42 UTC]... [----] I, [2016-09-13T04:21:42.489464 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:21:42 UTC]...Complete [----] I, [2016-09-13T04:21:42.499517 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T04:21:49.780330 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:21:49.809750 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76206], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:21:53.911282 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:21:53.920706 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003036022186279297, :worker_monitor=>1.3732054233551025, :worker_dequeue=>0.013809442520141602, :total_time=>1.3903052806854248} [----] I, [2016-09-13T04:21:54.650395 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76206], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.864510317] seconds [----] I, [2016-09-13T04:21:54.650659 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76206], Delivering... [----] I, [2016-09-13T04:21:54.658051 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038251876831054688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003853321075439453, :pending_vm_jobs=>0.0009000301361083984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006762504577636719} [----] I, [2016-09-13T04:21:54.658460 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76206], State: [ok], Delivered in [0.007791834] seconds [----] I, [2016-09-13T04:22:04.823225 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:22:04.849937 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76207], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:22:04.884155 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76208], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:22:10.424271 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:22:10.428118 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004629373550415039, :worker_monitor=>1.358762502670288, :worker_dequeue=>0.0071451663970947266, :total_time=>1.3709301948547363} [----] I, [2016-09-13T04:22:10.836791 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76208], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.981366004] seconds [----] I, [2016-09-13T04:22:10.837008 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76208], Delivering... [----] I, [2016-09-13T04:22:10.843524 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003554821014404297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035758018493652344, :pending_vm_jobs=>0.0007863044738769531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060577392578125} [----] I, [2016-09-13T04:22:10.843879 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76208], State: [ok], Delivered in [0.006870531] seconds [----] I, [2016-09-13T04:22:12.728076 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76207], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.898590541] seconds [----] I, [2016-09-13T04:22:12.728319 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76207], Delivering... [----] I, [2016-09-13T04:22:12.734010 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76207], State: [ok], Delivered in [0.0056782] seconds [----] I, [2016-09-13T04:22:15.428578 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:22:15 UTC]... [----] I, [2016-09-13T04:22:15.441597 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:22:15 UTC]...Complete [----] I, [2016-09-13T04:22:19.892317 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:22:19.916095 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76209], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:22:20.475260 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:22:21.293521 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76209], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.396618688] seconds [----] I, [2016-09-13T04:22:21.293734 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76209], Delivering... [----] I, [2016-09-13T04:22:21.300639 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035924911499023438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036160945892333984, :pending_vm_jobs=>0.0008475780487060547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00646519660949707} [----] I, [2016-09-13T04:22:21.301052 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76209], State: [ok], Delivered in [0.007314817] seconds [----] I, [2016-09-13T04:22:27.112068 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005244255065917969, :worker_monitor=>1.6092984676361084, :worker_dequeue=>0.010076522827148438, :total_time=>1.6250174045562744} [----] I, [2016-09-13T04:22:34.927197 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:22:34.946010 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76210], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:22:34.962027 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76211], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:22:34.979502 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76212], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:22:35.001990 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76213], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:22:37.140701 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:22:37.426043 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76211], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.47565831] seconds [----] I, [2016-09-13T04:22:37.426225 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76211], Delivering... [----] I, [2016-09-13T04:22:37.470726 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76211], State: [ok], Delivered in [0.044490515] seconds [----] I, [2016-09-13T04:22:37.516880 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76213], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.527018517] seconds [----] I, [2016-09-13T04:22:37.517071 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76213], Delivering... [----] I, [2016-09-13T04:22:37.523971 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035588741302490234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035800933837890625, :pending_vm_jobs=>0.0007903575897216797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006509065628051758} [----] I, [2016-09-13T04:22:37.524388 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76213], State: [ok], Delivered in [0.007288898] seconds [----] I, [2016-09-13T04:22:39.808215 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76210], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.875956468] seconds [----] I, [2016-09-13T04:22:39.808463 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76210], Delivering... [----] I, [2016-09-13T04:22:39.813893 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76210], State: [ok], Delivered in [0.005466909] seconds [----] I, [2016-09-13T04:22:39.842660 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76212], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.874750832] seconds [----] I, [2016-09-13T04:22:39.842876 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76212], Delivering... [----] I, [2016-09-13T04:22:39.846358 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76212], State: [ok], Delivered in [0.003470015] seconds [----] I, [2016-09-13T04:22:43.416592 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00580596923828125, :worker_monitor=>1.2565538883209229, :worker_dequeue=>0.006273031234741211, :total_time=>1.2689907550811768} [----] I, [2016-09-13T04:22:48.417098 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:22:48 UTC]... [----] I, [2016-09-13T04:22:48.508848 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:22:48 UTC]...Complete [----] I, [2016-09-13T04:22:50.017782 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:22:50.065392 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76214], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:22:53.531255 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:22:53.684888 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76214], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.659195478] seconds [----] I, [2016-09-13T04:22:53.685167 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76214], Delivering... [----] I, [2016-09-13T04:22:53.695875 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005406856536865234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005441188812255859, :pending_vm_jobs=>0.0010995864868164062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010103464126586914} [----] I, [2016-09-13T04:22:53.696363 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76214], State: [ok], Delivered in [0.011183838] seconds [----] I, [2016-09-13T04:23:00.073981 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006834268569946289, :worker_monitor=>1.5096166133880615, :worker_dequeue=>0.017899513244628906, :total_time=>1.5348107814788818} [----] I, [2016-09-13T04:23:05.079572 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T04:23:05.091902 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76215], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:23:05.114265 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76216], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:23:05.131729 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76217], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:23:05.162245 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:23:05.794569 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76216], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.695051605] seconds [----] I, [2016-09-13T04:23:05.794715 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76216], Delivering... [----] I, [2016-09-13T04:23:05.800186 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002421140670776367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002462148666381836, :pending_vm_jobs=>0.0008080005645751953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005123138427734375} [----] I, [2016-09-13T04:23:05.800602 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76216], State: [ok], Delivered in [0.005863286] seconds [----] I, [2016-09-13T04:23:06.937493 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76215], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.853323935] seconds [----] I, [2016-09-13T04:23:06.937676 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76215], Delivering... [----] I, [2016-09-13T04:23:06.941669 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76215], State: [ok], Delivered in [0.003995927] seconds [----] I, [2016-09-13T04:23:06.984089 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76217], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.864737349] seconds [----] I, [2016-09-13T04:23:06.984337 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76217], Delivering... [----] I, [2016-09-13T04:23:06.984738 #2928:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Starting [----] I, [2016-09-13T04:23:06.992301 #2928:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Complete [----] I, [2016-09-13T04:23:06.992826 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76217], State: [ok], Delivered in [0.008458628] seconds [----] I, [2016-09-13T04:23:16.442930 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005940437316894531, :worker_monitor=>1.2367935180664062, :worker_dequeue=>0.006349325180053711, :total_time=>1.2495734691619873} [----] I, [2016-09-13T04:23:20.147057 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:23:20.166016 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76218], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:23:20.189263 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76219], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:23:20.205989 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76220], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:23:20.223305 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76221], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:23:21.443516 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:23:21 UTC]... [----] I, [2016-09-13T04:23:21.462927 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:23:21 UTC]...Complete [----] I, [2016-09-13T04:23:21.474609 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:23:21.933613 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76218], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.776703544] seconds [----] I, [2016-09-13T04:23:21.933841 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76218], Delivering... [----] I, [2016-09-13T04:23:21.941769 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004257917404174805, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0042951107025146484, :pending_vm_jobs=>0.0009768009185791016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0074765682220458984} [----] I, [2016-09-13T04:23:21.942159 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76218], State: [ok], Delivered in [0.008309148] seconds [----] I, [2016-09-13T04:23:21.978023 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76219], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.804945931] seconds [----] I, [2016-09-13T04:23:21.978212 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76219], Delivering... [----] I, [2016-09-13T04:23:21.979825 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T04:23:21.980056 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5336068096 [----] I, [2016-09-13T04:23:21.980171 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5121949696 [----] I, [2016-09-13T04:23:21.980263 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 214118400 [----] I, [2016-09-13T04:23:21.980366 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1314914304 [----] I, [2016-09-13T04:23:21.980517 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5068111872 [----] I, [2016-09-13T04:23:21.980624 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T04:23:21.980711 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T04:23:21.980800 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 534843392 [----] I, [2016-09-13T04:23:21.980883 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T04:23:21.980966 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8049029120 [----] I, [2016-09-13T04:23:21.981046 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T04:23:21.981124 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T04:23:21.981203 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T04:23:21.981294 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T04:23:21.981378 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T04:23:21.981507 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T04:23:21.981603 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T04:23:21.981689 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T04:23:21.981779 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T04:23:21.981866 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T04:23:21.981962 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273084416 [----] I, [2016-09-13T04:23:21.982064 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56274944 [----] I, [2016-09-13T04:23:21.982151 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216809472 [----] I, [2016-09-13T04:23:21.982236 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T04:23:21.982321 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140595200 [----] I, [2016-09-13T04:23:21.982407 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2600280064 [----] I, [2016-09-13T04:23:21.982561 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2291191808 [----] I, [2016-09-13T04:23:21.982656 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T04:23:21.982758 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T04:23:21.982849 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T04:23:21.982940 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37507072 [----] I, [2016-09-13T04:23:21.983026 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102281216 [----] I, [2016-09-13T04:23:21.983103 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53194752 [----] I, [2016-09-13T04:23:21.983186 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110137344 [----] I, [2016-09-13T04:23:21.983276 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155475968 [----] I, [2016-09-13T04:23:21.983354 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T04:23:21.983481 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T04:23:21.983596 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T04:23:21.983685 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T04:23:21.983771 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T04:23:21.983852 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T04:23:21.983931 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T04:23:21.984011 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T04:23:21.984093 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T04:23:21.998501 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76220], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.80207942] seconds [----] I, [2016-09-13T04:23:21.998811 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76220], Delivering... [----] I, [2016-09-13T04:23:22.012016 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76221], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.799300901] seconds [----] I, [2016-09-13T04:23:22.012217 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76221], Delivering... [----] I, [2016-09-13T04:23:22.012919 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:23:05 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [234082.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T04:23:22.013857 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:23:12 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [102894.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T04:23:22.014853 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:23:15 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [148064.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:23:22.015809 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:23:15 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202018000], Memory % [3.38], CPU Time [147120.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:23:22.016857 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:23:14 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162415000], Memory % [3.1], CPU Time [37060.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T04:23:22.017387 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76221], State: [ok], Delivered in [0.005154589] seconds [----] I, [2016-09-13T04:23:22.017847 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:23:15 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358682000], Memory % [5.28], CPU Time [197320.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T04:23:22.018742 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:23:09 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [47931.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T04:23:22.019577 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:23:13 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50275.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:23:22.024345 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:23:16 UTC], Process Info: Memory Usage [589398016], Memory Size [958111744], Proportional Set Size: [426335000], Memory % [7.19], CPU Time [284.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:23:22.027102 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T04:23:22.027397 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T04:23:22.028197 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:23:15 UTC], Process Info: Memory Usage [596606976], Memory Size [1042505728], Proportional Set Size: [433603000], Memory % [7.27], CPU Time [863.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:23:22.032021 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:23:15 UTC], Process Info: Memory Usage [558518272], Memory Size [929497088], Proportional Set Size: [406090000], Memory % [6.81], CPU Time [4355.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T04:23:22.034163 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T04:23:22.035972 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:23:08 UTC], Process Info: Memory Usage [580923392], Memory Size [938115072], Proportional Set Size: [420275000], Memory % [7.08], CPU Time [1001.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T04:23:22.036960 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:23:16 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [205970.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T04:23:22.037943 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:23:14 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [50317.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:23:22.038814 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:23:05 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165800000], Memory % [3.16], CPU Time [37939.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T04:23:22.039284 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T04:23:22.039332 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76220], State: [ok], Delivered in [0.040518083] seconds [----] I, [2016-09-13T04:23:22.044875 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T04:23:22.049823 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T04:23:22.054771 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T04:23:22.059527 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 836 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T04:23:22.064495 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T04:23:22.069334 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T04:23:22.074023 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T04:23:22.078597 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T04:23:22.083088 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3241 14127959 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T04:23:22.087533 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T04:23:22.091111 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:23:22.091284 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:23:22.091400 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T04:23:22.096257 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202018000], Memory % [3.38], CPU Time [148053.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:23:22.096651 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76219], State: [ok], Delivered in [0.118422067] seconds [----] I, [2016-09-13T04:23:32.827147 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004086017608642578, :worker_monitor=>1.3096487522125244, :worker_dequeue=>0.00619053840637207, :total_time=>1.3202035427093506} [----] I, [2016-09-13T04:23:35.242585 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T04:23:35.258640 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76222], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:23:35.304651 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76223], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:23:35.327650 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76224], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:23:37.839674 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:23:38.187001 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76222], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.941404834] seconds [----] I, [2016-09-13T04:23:38.187295 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76222], Delivering... [----] I, [2016-09-13T04:23:38.268548 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76224], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.955059369] seconds [----] I, [2016-09-13T04:23:38.268727 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76224], Delivering... [----] I, [2016-09-13T04:23:38.275179 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003307819366455078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033316612243652344, :pending_vm_jobs=>0.0008194446563720703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006080150604248047} [----] I, [2016-09-13T04:23:38.275584 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76224], State: [ok], Delivered in [0.006830706] seconds [----] I, [2016-09-13T04:23:38.290938 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76222], State: [ok], Delivered in [0.103642804] seconds [----] I, [2016-09-13T04:23:40.079735 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76223], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.817793756] seconds [----] I, [2016-09-13T04:23:40.079955 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76223], Delivering... [----] I, [2016-09-13T04:23:40.083629 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76223], State: [ok], Delivered in [0.003656923] seconds [----] I, [2016-09-13T04:23:49.274235 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:23:49.274454 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:23:49.285670 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:23:49.285856 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:23:49.297047 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:23:49.297244 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:23:49.308359 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:23:49.308606 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:23:49.319741 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:23:49.319934 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:23:49.330886 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:23:49.331015 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:23:49.336466 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:23:49.336604 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:23:49.342161 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:23:49.342278 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:23:49.354028 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:23:49.354282 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:23:49.379687 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:23:49.379878 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:23:49.395737 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:23:49.395962 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:23:49.416743 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:23:49.416880 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:23:49.434060 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:23:49.434203 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:23:49.445313 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:23:49.445477 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:23:49.457263 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:23:49.457393 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:23:49.467892 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004961252212524414, :worker_monitor=>1.5818989276885986, :worker_dequeue=>0.0078122615814208984, :total_time=>1.5950343608856201} [----] I, [2016-09-13T04:23:50.336197 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:23:50.336338 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:23:50.336391 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:23:50.468235 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:23:50.469030 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T04:23:50.469078 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:23:50.469105 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:23:50.469125 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:23:50.469145 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T04:23:50.469163 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T04:23:50.469181 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:23:50.469199 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T04:23:50.469217 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:23:50.469235 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:23:50.469252 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:23:50.469269 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:23:50.469287 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T04:23:50.469305 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T04:23:50.469323 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T04:23:50.469341 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T04:23:50.469359 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T04:23:50.469376 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T04:23:50.469394 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T04:23:50.469474 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T04:23:50.469519 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T04:23:50.469542 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T04:23:50.469560 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T04:23:50.469578 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T04:23:50.469595 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T04:23:50.469613 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T04:23:50.469631 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T04:23:50.469649 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T04:23:50.469667 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T04:23:50.469685 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T04:23:50.469702 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T04:23:50.469719 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T04:23:50.469737 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T04:23:50.469754 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T04:23:50.469771 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T04:23:50.469789 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T04:23:50.469807 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T04:23:50.469839 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T04:23:50.469872 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T04:23:50.470114 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:23:50.470251 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:23:50.470325 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:23:50.485044 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76225], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:23:50.496459 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76226], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:23:51.435209 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:23:51.435357 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:23:51.435481 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:23:51.599408 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:23:51.600322 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T04:23:51.600393 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:23:51.600487 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:23:51.600541 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:23:51.600591 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T04:23:51.600639 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T04:23:51.600687 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:23:51.600735 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T04:23:51.600783 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:23:51.600832 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:23:51.600879 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:23:51.600928 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:23:51.600977 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T04:23:51.601024 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:23:51.601069 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T04:23:51.601113 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T04:23:51.601448 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:23:51.601637 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:23:52.107771 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:23:52.107879 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:23:52.107944 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:23:52.206038 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:23:52.206555 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T04:23:52.206604 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:23:52.206629 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:23:52.206651 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:23:52.206673 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T04:23:52.206694 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T04:23:52.206715 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:23:52.206736 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T04:23:52.206756 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:23:52.206776 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:23:52.206795 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:23:52.206815 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:23:52.206835 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T04:23:52.206855 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:23:52.206874 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T04:23:52.206893 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T04:23:52.207063 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:23:52.207170 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:23:53.296629 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:23:53.296740 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:23:53.296800 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:23:53.393171 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:23:53.393698 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T04:23:53.393745 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:23:53.393772 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:23:53.393795 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:23:53.393816 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T04:23:53.393837 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T04:23:53.393857 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:23:53.393876 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T04:23:53.393907 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:23:53.393929 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:23:53.393950 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:23:53.393968 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:23:53.393988 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T04:23:53.394005 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:23:53.394024 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T04:23:53.394042 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T04:23:53.394222 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:23:53.394311 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:23:53.974805 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:23:53.974943 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:23:53.975006 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:23:54.125610 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:23:54.126362 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T04:23:54.126506 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:23:54.126567 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:23:54.126607 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:23:54.126644 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T04:23:54.126678 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T04:23:54.126715 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:23:54.126750 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T04:23:54.126785 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:23:54.126819 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:23:54.126853 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:23:54.126888 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:23:54.126923 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T04:23:54.126956 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T04:23:54.127237 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:23:54.127553 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:23:54.415087 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:23:54.415250 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:23:54.415344 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:23:54.468361 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:23:54 UTC]... [----] I, [2016-09-13T04:23:54.508163 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:23:54 UTC]...Complete [----] I, [2016-09-13T04:23:54.522525 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:23:54.598577 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:23:54.599497 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T04:23:54.599584 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:23:54.599636 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:23:54.599678 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:23:54.599718 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T04:23:54.599754 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T04:23:54.599806 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:23:54.599845 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T04:23:54.599880 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:23:54.599912 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:23:54.599947 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:23:54.599982 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:23:54.600019 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T04:23:54.600057 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:23:54.600091 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T04:23:54.600124 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T04:23:54.600485 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:23:54.600693 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:23:54.622396 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76225], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.148439452] seconds [----] I, [2016-09-13T04:23:54.622629 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76225], Delivering... [----] I, [2016-09-13T04:23:54.627940 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028824806213378906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028998851776123047, :pending_vm_jobs=>0.0006051063537597656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004973649978637695} [----] I, [2016-09-13T04:23:54.628262 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76225], State: [ok], Delivered in [0.005664036] seconds [----] I, [2016-09-13T04:23:55.159659 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76226], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.671693621] seconds [----] I, [2016-09-13T04:23:55.159906 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76226], Delivering... [----] I, [2016-09-13T04:23:55.165632 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76226], State: [ok], Delivered in [0.005741287] seconds [----] I, [2016-09-13T04:23:55.216877 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T04:23:55.217047 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T04:23:55.217184 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T04:23:55.313278 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T04:23:55.313495 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T04:23:55.313632 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T04:23:55.363159 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:23:55.364067 #684:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T04:23:55.364155 #684:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:23:55.364203 #684:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:23:55.364242 #684:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:23:55.364279 #684:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T04:23:55.364315 #684:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T04:23:55.364352 #684:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:23:55.364387 #684:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T04:23:55.364472 #684:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:23:55.364529 #684:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:23:55.364567 #684:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:23:55.364601 #684:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:23:55.364636 #684:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T04:23:55.364670 #684:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T04:23:55.364705 #684:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T04:23:55.364739 #684:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T04:23:55.364770 #684:34713c] INFO -- : --- [----] I, [2016-09-13T04:23:55.365106 #684:34713c] INFO -- : :guid: c253e5f6-7924-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:23:55.365174 #684:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T04:23:55.365299 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T04:23:55.483467 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:23:55.484307 #28071:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T04:23:55.484384 #28071:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:23:55.484488 #28071:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:23:55.484546 #28071:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:23:55.484588 #28071:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T04:23:55.484625 #28071:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T04:23:55.484664 #28071:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:23:55.484698 #28071:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T04:23:55.484735 #28071:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:23:55.484771 #28071:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:23:55.484805 #28071:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T04:23:55.484839 #28071:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:23:55.484872 #28071:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T04:23:55.484903 #28071:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:23:55.484960 #28071:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T04:23:55.484997 #28071:34713c] INFO -- : --- [----] I, [2016-09-13T04:23:55.485376 #28071:34713c] INFO -- : :guid: b49c1882-7985-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:23:55.485495 #28071:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T04:23:55.485685 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T04:23:56.101467 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T04:23:56.101641 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T04:23:56.101720 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T04:23:56.225226 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:23:56.225902 #30088:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T04:23:56.225970 #30088:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:23:56.226007 #30088:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:23:56.226048 #30088:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:23:56.226079 #30088:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T04:23:56.226109 #30088:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T04:23:56.226137 #30088:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:23:56.226162 #30088:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T04:23:56.226188 #30088:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:23:56.226213 #30088:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:23:56.226238 #30088:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T04:23:56.226263 #30088:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:23:56.226288 #30088:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T04:23:56.226313 #30088:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:23:56.226337 #30088:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T04:23:56.226361 #30088:34713c] INFO -- : --- [----] I, [2016-09-13T04:23:56.226688 #30088:34713c] INFO -- : :guid: aa80abf2-7989-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:23:56.226749 #30088:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T04:23:56.226893 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T04:23:56.454086 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:23:56.454217 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:23:56.454283 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:23:56.598024 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:23:56.598816 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T04:23:56.598897 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:23:56.598941 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:23:56.598977 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:23:56.599010 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T04:23:56.599042 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T04:23:56.599076 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:23:56.599108 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T04:23:56.599141 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:23:56.599172 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:23:56.599204 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:23:56.599235 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:23:56.599267 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T04:23:56.599297 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:23:56.599328 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T04:23:56.599359 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T04:23:56.599672 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:23:56.599828 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:23:57.736501 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:23:57.736704 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:23:57.736787 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:23:57.904978 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:23:57.905833 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T04:23:57.905920 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:23:57.905966 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:23:57.906004 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:23:57.906040 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T04:23:57.906077 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T04:23:57.906115 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:23:57.906150 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T04:23:57.906187 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:23:57.906222 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:23:57.906257 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:23:57.906291 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:23:57.906326 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T04:23:57.906359 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T04:23:57.906731 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:23:57.907065 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:23:58.134854 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T04:23:58.135018 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T04:23:58.135104 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T04:23:58.321929 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:23:58.323091 #20386:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T04:23:58.323198 #20386:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:23:58.323250 #20386:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:23:58.323290 #20386:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:23:58.323327 #20386:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T04:23:58.323364 #20386:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T04:23:58.323399 #20386:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:23:58.323512 #20386:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T04:23:58.323563 #20386:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:23:58.323629 #20386:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:23:58.323702 #20386:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:23:58.323771 #20386:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:23:58.323838 #20386:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T04:23:58.323902 #20386:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T04:23:58.323967 #20386:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T04:23:58.324034 #20386:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T04:23:58.324104 #20386:34713c] INFO -- : --- [----] I, [2016-09-13T04:23:58.324719 #20386:34713c] INFO -- : :guid: e5930efc-7974-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:23:58.324839 #20386:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T04:23:58.325035 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T04:23:59.346450 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:23:59.346603 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:23:59.346678 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:23:59.479959 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:23:59.480717 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T04:23:59.480786 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:23:59.480827 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:23:59.480861 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:23:59.480895 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T04:23:59.480926 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T04:23:59.480958 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:23:59.480988 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T04:23:59.481020 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:23:59.481049 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:23:59.481080 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:23:59.481110 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:23:59.481140 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T04:23:59.481168 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:23:59.481212 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T04:23:59.481244 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T04:23:59.481529 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:23:59.481675 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:24:00.145200 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:24:00.145351 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:24:00.145468 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:24:00.308739 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:24:00.309550 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T04:24:00.309639 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:24:00.309689 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:24:00.309729 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:24:00.309766 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T04:24:00.309803 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T04:24:00.309840 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:24:00.309876 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T04:24:00.309911 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:24:00.309945 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:24:00.309979 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:24:00.310013 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:24:00.310047 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T04:24:00.310080 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T04:24:00.310388 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:24:00.310732 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:24:01.191778 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:24:01.191986 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:24:01.192104 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:24:01.392957 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:24:01.393878 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T04:24:01.393976 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:24:01.394029 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:24:01.394069 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:24:01.394106 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T04:24:01.394141 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T04:24:01.394177 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:24:01.394211 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T04:24:01.394242 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:24:01.394275 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:24:01.394311 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:24:01.394344 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:24:01.394379 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T04:24:01.394452 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:24:01.394514 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T04:24:01.394553 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T04:24:01.394854 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:24:01.395047 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:24:05.503876 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:24:05.525402 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76227], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:24:05.808185 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:24:05.815900 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040683746337890625, :worker_monitor=>1.2519381046295166, :worker_dequeue=>0.012710809707641602, :total_time=>1.2691006660461426} [----] I, [2016-09-13T04:24:06.720478 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76227], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.212731498] seconds [----] I, [2016-09-13T04:24:06.720804 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76227], Delivering... [----] I, [2016-09-13T04:24:06.731784 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005631208419799805, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005661725997924805, :pending_vm_jobs=>0.001394510269165039, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010412931442260742} [----] I, [2016-09-13T04:24:06.732307 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76227], State: [ok], Delivered in [0.011521922] seconds [----] I, [2016-09-13T04:24:20.533272 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:24:20.548396 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76228], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:24:20.559844 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76229], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:24:22.497213 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:24:22.501733 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004444122314453125, :worker_monitor=>1.5555756092071533, :worker_dequeue=>0.008087873458862305, :total_time=>1.5684006214141846} [----] I, [2016-09-13T04:24:22.845878 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76228], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.307537327] seconds [----] I, [2016-09-13T04:24:22.846045 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76228], Delivering... [----] I, [2016-09-13T04:24:22.852049 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030188560485839844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030417442321777344, :pending_vm_jobs=>0.0007829666137695312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005659580230712891} [----] I, [2016-09-13T04:24:22.852398 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76228], State: [ok], Delivered in [0.006348179] seconds [----] I, [2016-09-13T04:24:25.315671 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76229], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.763498057] seconds [----] I, [2016-09-13T04:24:25.315899 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76229], Delivering... [----] I, [2016-09-13T04:24:25.321585 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76229], State: [ok], Delivered in [0.005676832] seconds [----] I, [2016-09-13T04:24:27.502348 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:24:27 UTC]... [----] I, [2016-09-13T04:24:27.519828 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:24:27 UTC]...Complete [----] I, [2016-09-13T04:24:35.574369 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T04:24:35.588829 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76230], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:24:35.611677 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76231], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:24:35.635523 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76232], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:24:38.889941 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:24:38.893376 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004134178161621094, :worker_monitor=>1.3230116367340088, :worker_dequeue=>0.006254434585571289, :total_time=>1.333660364151001} [----] I, [2016-09-13T04:24:38.972372 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76230], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.39340481] seconds [----] I, [2016-09-13T04:24:38.972588 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76230], Delivering... [----] I, [2016-09-13T04:24:38.977122 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76232], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.356027195] seconds [----] I, [2016-09-13T04:24:38.977275 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76232], Delivering... [----] I, [2016-09-13T04:24:38.983359 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031273365020751953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031478404998779297, :pending_vm_jobs=>0.0007727146148681641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005703449249267578} [----] I, [2016-09-13T04:24:38.983740 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76232], State: [ok], Delivered in [0.006456671] seconds [----] I, [2016-09-13T04:24:39.031290 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76230], State: [ok], Delivered in [0.058682261] seconds [----] I, [2016-09-13T04:24:40.391952 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76231], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.797160855] seconds [----] I, [2016-09-13T04:24:40.392161 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76231], Delivering... [----] I, [2016-09-13T04:24:40.396120 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76231], State: [ok], Delivered in [0.003943353] seconds [----] I, [2016-09-13T04:24:50.647078 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:24:50.665826 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76233], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:24:50.677102 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76234], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:24:55.372388 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:24:55.379100 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004082441329956055, :worker_monitor=>1.4332818984985352, :worker_dequeue=>0.011797428131103516, :total_time=>1.4494357109069824} [----] I, [2016-09-13T04:24:55.483193 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76233], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.830496113] seconds [----] I, [2016-09-13T04:24:55.483404 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76233], Delivering... [----] I, [2016-09-13T04:24:55.490712 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038433074951171875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038728713989257812, :pending_vm_jobs=>0.0009109973907470703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006827592849731445} [----] I, [2016-09-13T04:24:55.491098 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76233], State: [ok], Delivered in [0.007687265] seconds [----] I, [2016-09-13T04:24:55.517253 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76234], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.847396863] seconds [----] I, [2016-09-13T04:24:55.517502 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76234], Delivering... [----] I, [2016-09-13T04:24:55.522727 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76234], State: [ok], Delivered in [0.005277614] seconds [----] I, [2016-09-13T04:25:00.379686 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:25:00 UTC]... [----] I, [2016-09-13T04:25:00.398202 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:25:00 UTC]...Complete [----] I, [2016-09-13T04:25:05.689017 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:25:05.711739 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76235], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:25:12.028368 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:25:12.034908 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005970001220703125, :worker_monitor=>1.5758535861968994, :worker_dequeue=>0.011562585830688477, :total_time=>1.5938565731048584} [----] I, [2016-09-13T04:25:12.243339 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76235], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.54804078] seconds [----] I, [2016-09-13T04:25:12.243589 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76235], Delivering... [----] I, [2016-09-13T04:25:12.250022 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034236907958984375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003470182418823242, :pending_vm_jobs=>0.0008199214935302734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006013154983520508} [----] I, [2016-09-13T04:25:12.250376 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76235], State: [ok], Delivered in [0.006792995] seconds [----] I, [2016-09-13T04:25:20.723275 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:25:20.740379 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76236], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:25:20.757946 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76237], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:25:22.201010 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:25:22.348296 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76236], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.619497432] seconds [----] I, [2016-09-13T04:25:22.348642 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76236], Delivering... [----] I, [2016-09-13T04:25:22.359632 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005618095397949219, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005652427673339844, :pending_vm_jobs=>0.0014500617980957031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010378837585449219} [----] I, [2016-09-13T04:25:22.360206 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76236], State: [ok], Delivered in [0.011565384] seconds [----] I, [2016-09-13T04:25:22.621022 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76237], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.876718623] seconds [----] I, [2016-09-13T04:25:22.621271 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76237], Delivering... [----] I, [2016-09-13T04:25:22.628093 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76237], State: [ok], Delivered in [0.006810337] seconds [----] I, [2016-09-13T04:25:28.657504 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003946065902709961, :worker_monitor=>1.4287378787994385, :worker_dequeue=>0.016573190689086914, :total_time=>1.4495372772216797} [----] I, [2016-09-13T04:25:33.658129 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:25:33 UTC]... [----] I, [2016-09-13T04:25:33.677332 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:25:33 UTC]...Complete [----] I, [2016-09-13T04:25:35.776352 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T04:25:35.797699 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76238], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:25:35.815061 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76239], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:25:35.835951 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76240], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:25:38.696754 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:25:39.447783 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76238], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.666650675] seconds [----] I, [2016-09-13T04:25:39.447962 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76238], Delivering... [----] I, [2016-09-13T04:25:39.504321 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76238], State: [ok], Delivered in [0.056333186] seconds [----] I, [2016-09-13T04:25:39.510226 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76240], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.683487615] seconds [----] I, [2016-09-13T04:25:39.510394 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76240], Delivering... [----] I, [2016-09-13T04:25:39.516656 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032088756561279297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003228902816772461, :pending_vm_jobs=>0.0008041858673095703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058498382568359375} [----] I, [2016-09-13T04:25:39.517038 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76240], State: [ok], Delivered in [0.006633799] seconds [----] I, [2016-09-13T04:25:40.676412 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76239], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.873174492] seconds [----] I, [2016-09-13T04:25:40.676663 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76239], Delivering... [----] I, [2016-09-13T04:25:40.680048 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76239], State: [ok], Delivered in [0.00337074] seconds [----] I, [2016-09-13T04:25:45.140990 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006135225296020508, :worker_monitor=>1.4154374599456787, :worker_dequeue=>0.015796422958374023, :total_time=>1.4377024173736572} [----] I, [2016-09-13T04:25:50.851344 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:25:50.864623 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76241], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:25:50.875940 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76242], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:25:55.169867 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:25:55.653707 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76241], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.797139093] seconds [----] I, [2016-09-13T04:25:55.653925 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76241], Delivering... [----] I, [2016-09-13T04:25:55.660839 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003683328628540039, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037069320678710938, :pending_vm_jobs=>0.0008428096771240234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006527900695800781} [----] I, [2016-09-13T04:25:55.661353 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76241], State: [ok], Delivered in [0.00740388] seconds [----] I, [2016-09-13T04:25:55.756646 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76242], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.888539678] seconds [----] I, [2016-09-13T04:25:55.756883 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76242], Delivering... [----] I, [2016-09-13T04:25:55.762341 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76242], State: [ok], Delivered in [0.005475442] seconds [----] I, [2016-09-13T04:26:01.570818 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00413203239440918, :worker_monitor=>1.3786463737487793, :worker_dequeue=>0.010361909866333008, :total_time=>1.3934924602508545} [----] I, [2016-09-13T04:26:05.885853 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:26:05.904879 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76243], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:26:06.571407 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:26:06 UTC]... [----] I, [2016-09-13T04:26:06.584612 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:26:06 UTC]...Complete [----] I, [2016-09-13T04:26:06.595750 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:26:06.751150 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76243], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.859561618] seconds [----] I, [2016-09-13T04:26:06.751361 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76243], Delivering... [----] I, [2016-09-13T04:26:06.758405 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003609895706176758, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003629446029663086, :pending_vm_jobs=>0.0009169578552246094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006555080413818359} [----] I, [2016-09-13T04:26:06.758893 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76243], State: [ok], Delivered in [0.007512389] seconds [----] I, [2016-09-13T04:26:18.356549 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004330873489379883, :worker_monitor=>1.710737943649292, :worker_dequeue=>0.01947498321533203, :total_time=>1.7350444793701172} [----] I, [2016-09-13T04:26:20.918008 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:26:20.960248 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76244], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:26:21.000285 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76245], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:26:23.479665 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:26:23.884663 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76244], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.95899667] seconds [----] I, [2016-09-13T04:26:23.884882 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76244], Delivering... [----] I, [2016-09-13T04:26:23.891847 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036656856536865234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036907196044921875, :pending_vm_jobs=>0.0009360313415527344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006582975387573242} [----] I, [2016-09-13T04:26:23.892258 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76244], State: [ok], Delivered in [0.007366327] seconds [----] I, [2016-09-13T04:26:25.832780 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76245], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.867743293] seconds [----] I, [2016-09-13T04:26:25.832945 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76245], Delivering... [----] I, [2016-09-13T04:26:25.836751 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76245], State: [ok], Delivered in [0.003806323] seconds [----] I, [2016-09-13T04:26:34.662739 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005151987075805664, :worker_monitor=>1.141991138458252, :worker_dequeue=>0.009759187698364258, :total_time=>1.157280683517456} [----] I, [2016-09-13T04:26:36.012307 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T04:26:36.027390 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76246], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:26:36.038306 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76247], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:26:36.055802 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76248], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:26:39.663323 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:26:39 UTC]... [----] I, [2016-09-13T04:26:39.684513 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:26:39 UTC]...Complete [----] I, [2016-09-13T04:26:39.696598 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:26:40.010836 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76246], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.995062446] seconds [----] I, [2016-09-13T04:26:40.011055 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76246], Delivering... [----] I, [2016-09-13T04:26:40.032747 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76248], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.989024112] seconds [----] I, [2016-09-13T04:26:40.032968 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76248], Delivering... [----] I, [2016-09-13T04:26:40.039761 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003658294677734375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036780834197998047, :pending_vm_jobs=>0.0008542537689208984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006413936614990234} [----] I, [2016-09-13T04:26:40.040143 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76248], State: [ok], Delivered in [0.007163852] seconds [----] I, [2016-09-13T04:26:40.084058 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76246], State: [ok], Delivered in [0.072986198] seconds [----] I, [2016-09-13T04:26:40.901726 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76247], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.870881877] seconds [----] I, [2016-09-13T04:26:40.901950 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76247], Delivering... [----] I, [2016-09-13T04:26:40.905242 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76247], State: [ok], Delivered in [0.003291478] seconds [----] I, [2016-09-13T04:26:44.719807 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T04:26:51.071625 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:26:51.103668 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76249], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:26:51.114826 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76250], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:26:51.214810 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:26:51.221861 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002977609634399414, :worker_monitor=>1.4740209579467773, :worker_dequeue=>0.012561559677124023, :total_time=>1.489844560623169} [----] I, [2016-09-13T04:26:52.166223 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76249], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.083726395] seconds [----] I, [2016-09-13T04:26:52.166483 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76249], Delivering... [----] I, [2016-09-13T04:26:52.173008 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033349990844726562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033562183380126953, :pending_vm_jobs=>0.0008378028869628906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006115913391113281} [----] I, [2016-09-13T04:26:52.173359 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76249], State: [ok], Delivered in [0.006936076] seconds [----] I, [2016-09-13T04:26:52.960855 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76250], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.852921555] seconds [----] I, [2016-09-13T04:26:52.961099 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76250], Delivering... [----] I, [2016-09-13T04:26:52.966223 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76250], State: [ok], Delivered in [0.005121844] seconds [----] I, [2016-09-13T04:27:06.126893 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:27:06.143278 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76251], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:27:07.738864 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:27:07.744884 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041086673736572266, :worker_monitor=>1.4612131118774414, :worker_dequeue=>0.009789705276489258, :total_time=>1.4754555225372314} [----] I, [2016-09-13T04:27:08.017485 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76251], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.884309597] seconds [----] I, [2016-09-13T04:27:08.017657 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76251], Delivering... [----] I, [2016-09-13T04:27:08.022894 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002775430679321289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028145313262939453, :pending_vm_jobs=>0.0006072521209716797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004912853240966797} [----] I, [2016-09-13T04:27:08.023159 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76251], State: [ok], Delivered in [0.005503783] seconds [----] I, [2016-09-13T04:27:12.745307 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:27:12 UTC]... [----] I, [2016-09-13T04:27:12.760149 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:27:12 UTC]...Complete [----] I, [2016-09-13T04:27:21.155596 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:27:21.171871 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76252], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:27:21.189152 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76253], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:27:24.043042 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:27:24.047544 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004044294357299805, :worker_monitor=>1.253610372543335, :worker_dequeue=>0.00913691520690918, :total_time=>1.2672019004821777} [----] I, [2016-09-13T04:27:24.412697 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76252], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.25082675] seconds [----] I, [2016-09-13T04:27:24.412954 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76252], Delivering... [----] I, [2016-09-13T04:27:24.421125 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004145383834838867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00417327880859375, :pending_vm_jobs=>0.0011243820190429688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007674694061279297} [----] I, [2016-09-13T04:27:24.421584 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76252], State: [ok], Delivered in [0.008626101] seconds [----] I, [2016-09-13T04:27:26.053700 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76253], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.877941677] seconds [----] I, [2016-09-13T04:27:26.053858 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76253], Delivering... [----] I, [2016-09-13T04:27:26.057855 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76253], State: [ok], Delivered in [0.003987117] seconds [----] I, [2016-09-13T04:27:36.203372 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T04:27:36.219389 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76254], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:27:36.241076 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76255], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:27:36.263836 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76256], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:27:40.723133 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:27:40.734163 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005832672119140625, :worker_monitor=>1.481722116470337, :worker_dequeue=>0.019942283630371094, :total_time=>1.507948875427246} [----] I, [2016-09-13T04:27:41.127005 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76254], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.918633788] seconds [----] I, [2016-09-13T04:27:41.127292 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76254], Delivering... [----] I, [2016-09-13T04:27:41.139245 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76256], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.887904604] seconds [----] I, [2016-09-13T04:27:41.139464 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76256], Delivering... [----] I, [2016-09-13T04:27:41.145727 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034465789794921875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00348663330078125, :pending_vm_jobs=>0.0007977485656738281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005918741226196289} [----] I, [2016-09-13T04:27:41.146025 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76256], State: [ok], Delivered in [0.006602812] seconds [----] I, [2016-09-13T04:27:41.206751 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76255], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.980533347] seconds [----] I, [2016-09-13T04:27:41.206928 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76255], Delivering... [----] I, [2016-09-13T04:27:41.209762 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76255], State: [ok], Delivered in [0.00283194] seconds [----] I, [2016-09-13T04:27:41.212058 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76254], State: [ok], Delivered in [0.084781422] seconds [----] I, [2016-09-13T04:27:45.734832 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:27:45 UTC]... [----] I, [2016-09-13T04:27:45.749204 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:27:45 UTC]...Complete [----] I, [2016-09-13T04:27:51.277054 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:27:51.304686 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76257], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:27:51.319526 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76258], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:27:57.152664 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:27:57.156198 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005522966384887695, :worker_monitor=>1.3602054119110107, :worker_dequeue=>0.006515026092529297, :total_time=>1.3725793361663818} [----] I, [2016-09-13T04:27:57.668734 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76257], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.384443288] seconds [----] I, [2016-09-13T04:27:57.668991 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76257], Delivering... [----] I, [2016-09-13T04:27:57.675329 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035490989685058594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035676956176757812, :pending_vm_jobs=>0.0007622241973876953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005949258804321289} [----] I, [2016-09-13T04:27:57.675753 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76257], State: [ok], Delivered in [0.006746153] seconds [----] I, [2016-09-13T04:27:59.331804 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76258], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.022356396] seconds [----] I, [2016-09-13T04:27:59.332016 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76258], Delivering... [----] I, [2016-09-13T04:27:59.337155 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76258], State: [ok], Delivered in [0.005136547] seconds [----] I, [2016-09-13T04:28:06.334144 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:28:06.354224 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76259], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:28:07.184223 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:28:07.760135 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76259], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.419767334] seconds [----] I, [2016-09-13T04:28:07.760348 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76259], Delivering... [----] I, [2016-09-13T04:28:07.767218 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036454200744628906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036640167236328125, :pending_vm_jobs=>0.0008318424224853516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006380796432495117} [----] I, [2016-09-13T04:28:07.767636 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76259], State: [ok], Delivered in [0.007283667] seconds [----] I, [2016-09-13T04:28:13.456554 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036842823028564453, :worker_monitor=>1.2483928203582764, :worker_dequeue=>0.011837482452392578, :total_time=>1.2642300128936768} [----] I, [2016-09-13T04:28:18.457266 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:28:18 UTC]... [----] I, [2016-09-13T04:28:18.480244 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:28:18 UTC]...Complete [----] I, [2016-09-13T04:28:21.373268 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T04:28:21.388745 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76260], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:28:21.413191 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76261], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:28:21.427070 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76262], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:28:21.440665 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76263], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:28:21.451994 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76264], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:28:21.467192 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76265], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:28:23.515584 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:28:23.890498 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76260], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.507971116] seconds [----] I, [2016-09-13T04:28:23.890694 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76260], Delivering... [----] I, [2016-09-13T04:28:23.897105 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003409147262573242, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034317970275878906, :pending_vm_jobs=>0.0008535385131835938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006071329116821289} [----] I, [2016-09-13T04:28:23.897542 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76260], State: [ok], Delivered in [0.00684539] seconds [----] I, [2016-09-13T04:28:23.908209 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76261], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.515321471] seconds [----] I, [2016-09-13T04:28:23.908404 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76261], Delivering... [----] I, [2016-09-13T04:28:23.909404 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T04:28:23.909683 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5327208448 [----] I, [2016-09-13T04:28:23.909780 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5112856576 [----] I, [2016-09-13T04:28:23.909860 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 214351872 [----] I, [2016-09-13T04:28:23.909939 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1314914304 [----] I, [2016-09-13T04:28:23.910018 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5058932736 [----] I, [2016-09-13T04:28:23.910098 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T04:28:23.910172 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T04:28:23.910268 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 535195648 [----] I, [2016-09-13T04:28:23.910341 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T04:28:23.910409 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7846084608 [----] I, [2016-09-13T04:28:23.910539 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T04:28:23.910620 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T04:28:23.910694 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T04:28:23.910764 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 16384 [----] I, [2016-09-13T04:28:23.910837 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T04:28:23.910914 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T04:28:23.910984 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T04:28:23.911054 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T04:28:23.911130 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T04:28:23.911195 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T04:28:23.911266 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273133568 [----] I, [2016-09-13T04:28:23.911338 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56205312 [----] I, [2016-09-13T04:28:23.911405 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216928256 [----] I, [2016-09-13T04:28:23.911531 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T04:28:23.911618 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140595200 [----] I, [2016-09-13T04:28:23.911691 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2608656384 [----] I, [2016-09-13T04:28:23.911767 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2299215872 [----] I, [2016-09-13T04:28:23.911834 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T04:28:23.911905 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T04:28:23.911972 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T04:28:23.912038 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37285888 [----] I, [2016-09-13T04:28:23.912109 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102281216 [----] I, [2016-09-13T04:28:23.912181 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53014528 [----] I, [2016-09-13T04:28:23.912246 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110137344 [----] I, [2016-09-13T04:28:23.912314 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155295744 [----] I, [2016-09-13T04:28:23.912380 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T04:28:23.912497 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T04:28:23.912582 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T04:28:23.912656 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T04:28:23.912728 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T04:28:23.912799 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T04:28:23.912867 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T04:28:23.912932 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T04:28:23.913001 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T04:28:23.941939 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76264], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.497186546] seconds [----] I, [2016-09-13T04:28:23.942126 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76264], Delivering... [----] I, [2016-09-13T04:28:23.956547 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T04:28:23.956808 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T04:28:23.960573 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T04:28:23.963178 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T04:28:23.966320 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T04:28:23.969376 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T04:28:23.972394 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T04:28:23.975477 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 836 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T04:28:23.978473 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T04:28:23.981528 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T04:28:23.984515 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T04:28:23.987636 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T04:28:23.990677 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T04:28:23.993135 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76264], State: [ok], Delivered in [0.05097325] seconds [----] I, [2016-09-13T04:28:23.993732 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T04:28:23.996328 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>2}} [----] I, [2016-09-13T04:28:23.996572 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:28:23.996745 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>3, "ems_inventory"=>1}} [----] I, [2016-09-13T04:28:24.001035 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [200185000], Memory % [5.28], CPU Time [148155.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T04:28:24.001410 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76261], State: [ok], Delivered in [0.092990595] seconds [----] I, [2016-09-13T04:28:26.400611 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76263], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.969406644] seconds [----] I, [2016-09-13T04:28:26.400815 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76263], Delivering... [----] I, [2016-09-13T04:28:26.405821 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76263], State: [ok], Delivered in [0.004993765] seconds [----] I, [2016-09-13T04:28:26.457033 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76265], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.999405953] seconds [----] I, [2016-09-13T04:28:26.457275 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76265], Delivering... [----] I, [2016-09-13T04:28:26.461944 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76265], State: [ok], Delivered in [0.004643306] seconds [----] I, [2016-09-13T04:28:30.022811 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:28:30.033241 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038671493530273438, :worker_monitor=>1.4887421131134033, :worker_dequeue=>0.014609098434448242, :total_time=>1.5075287818908691} [----] I, [2016-09-13T04:28:30.062337 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76262], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.644878779] seconds [----] I, [2016-09-13T04:28:30.062564 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76262], Delivering... [----] I, [2016-09-13T04:28:30.070170 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:28:21 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [234224.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T04:28:30.070756 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:28:29 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [148160.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:28:30.071232 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:28:29 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [147219.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:28:30.071728 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:28:24 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [102965.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T04:28:30.072193 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:28:22 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [47995.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T04:28:30.072741 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:28:27 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162415000], Memory % [3.1], CPU Time [37109.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T04:28:30.073224 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:28:29 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358682000], Memory % [5.28], CPU Time [197374.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T04:28:30.073733 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:28:27 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50334.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:28:30.076565 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:28:26 UTC], Process Info: Memory Usage [588431360], Memory Size [930414592], Proportional Set Size: [425830000], Memory % [7.17], CPU Time [945.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:28:30.078578 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:28:27 UTC], Process Info: Memory Usage [589737984], Memory Size [930242560], Proportional Set Size: [426717000], Memory % [7.19], CPU Time [377.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:28:30.080608 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:28:28 UTC], Process Info: Memory Usage [580452352], Memory Size [909570048], Proportional Set Size: [419828000], Memory % [7.08], CPU Time [1077.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T04:28:30.082708 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:28:25 UTC], Process Info: Memory Usage [557649920], Memory Size [896253952], Proportional Set Size: [405400000], Memory % [6.8], CPU Time [4426.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T04:28:30.083240 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:28:29 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [206016.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T04:28:30.083765 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:28:27 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [50343.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:28:30.084191 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:28:18 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165801000], Memory % [3.16], CPU Time [37994.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T04:28:30.084559 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76262], State: [ok], Delivered in [0.021983727] seconds [----] I, [2016-09-13T04:28:36.481060 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:28:36.496218 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76266], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:28:40.201526 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:28:41.141931 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76266], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.654934747] seconds [----] I, [2016-09-13T04:28:41.142112 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76266], Delivering... [----] I, [2016-09-13T04:28:41.148493 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003322124481201172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003409862518310547, :pending_vm_jobs=>0.0007927417755126953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059931278228759766} [----] I, [2016-09-13T04:28:41.148824 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76266], State: [ok], Delivered in [0.006704261] seconds [----] I, [2016-09-13T04:28:46.543072 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002727031707763672, :worker_monitor=>1.3165431022644043, :worker_dequeue=>0.014244318008422852, :total_time=>1.3337678909301758} [----] I, [2016-09-13T04:28:51.506022 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:28:51.518883 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76267], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:28:51.524621 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76268], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:28:51.543730 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:28:51 UTC]... [----] I, [2016-09-13T04:28:51.558918 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:28:51 UTC]...Complete [----] I, [2016-09-13T04:28:51.569789 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:28:52.251050 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76267], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.739621139] seconds [----] I, [2016-09-13T04:28:52.251367 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76267], Delivering... [----] I, [2016-09-13T04:28:52.262028 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005350351333618164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005438566207885742, :pending_vm_jobs=>0.001489877700805664, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009995222091674805} [----] I, [2016-09-13T04:28:52.262460 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76267], State: [ok], Delivered in [0.011082637] seconds [----] I, [2016-09-13T04:28:53.530758 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76268], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.009859612] seconds [----] I, [2016-09-13T04:28:53.530945 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76268], Delivering... [----] I, [2016-09-13T04:28:53.535639 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76268], State: [ok], Delivered in [0.004690447] seconds [----] I, [2016-09-13T04:29:03.161347 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038862228393554688, :worker_monitor=>1.5498380661010742, :worker_dequeue=>0.015114307403564453, :total_time=>1.5691509246826172} [----] I, [2016-09-13T04:29:06.531616 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:29:06.547879 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76269], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:29:08.170726 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:29:08.411049 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76269], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.875764783] seconds [----] I, [2016-09-13T04:29:08.411247 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76269], Delivering... [----] I, [2016-09-13T04:29:08.417345 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003189563751220703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003206491470336914, :pending_vm_jobs=>0.0007624626159667969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005697011947631836} [----] I, [2016-09-13T04:29:08.417734 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76269], State: [ok], Delivered in [0.006482251] seconds [----] I, [2016-09-13T04:29:19.613915 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004571437835693359, :worker_monitor=>1.4035029411315918, :worker_dequeue=>0.011022090911865234, :total_time=>1.4195334911346436} [----] I, [2016-09-13T04:29:21.559678 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:29:21.582546 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76270], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:29:21.599860 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76271], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:29:21.611953 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76272], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:29:21.628213 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76273], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:29:24.614552 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:29:24 UTC]... [----] I, [2016-09-13T04:29:24.639738 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:29:24 UTC]...Complete [----] I, [2016-09-13T04:29:24.651626 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:29:25.498891 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76270], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.931049568] seconds [----] I, [2016-09-13T04:29:25.499094 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76270], Delivering... [----] I, [2016-09-13T04:29:25.505885 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035729408264160156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036301612854003906, :pending_vm_jobs=>0.0008640289306640625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006377458572387695} [----] I, [2016-09-13T04:29:25.506275 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76270], State: [ok], Delivered in [0.007172933] seconds [----] I, [2016-09-13T04:29:25.533041 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76272], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.928894895] seconds [----] I, [2016-09-13T04:29:25.533225 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76272], Delivering... [----] I, [2016-09-13T04:29:25.584594 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76272], State: [ok], Delivered in [0.051333937] seconds [----] I, [2016-09-13T04:29:26.664507 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76271], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.077103689] seconds [----] I, [2016-09-13T04:29:26.664707 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76271], Delivering... [----] I, [2016-09-13T04:29:26.669634 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76271], State: [ok], Delivered in [0.004914589] seconds [----] I, [2016-09-13T04:29:26.710569 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76273], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.092710391] seconds [----] I, [2016-09-13T04:29:26.710809 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76273], Delivering... [----] I, [2016-09-13T04:29:26.719393 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76273], State: [ok], Delivered in [0.008580848] seconds [----] I, [2016-09-13T04:29:35.947032 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004567146301269531, :worker_monitor=>1.2555861473083496, :worker_dequeue=>0.012107372283935547, :total_time=>1.2728018760681152} [----] I, [2016-09-13T04:29:37.064692 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:29:37.091607 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76274], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:29:41.097682 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:29:41.634522 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76274], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.560274708] seconds [----] I, [2016-09-13T04:29:41.634719 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76274], Delivering... [----] I, [2016-09-13T04:29:41.640562 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003123044967651367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031397342681884766, :pending_vm_jobs=>0.0007331371307373047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005523681640625} [----] I, [2016-09-13T04:29:41.640893 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76274], State: [ok], Delivered in [0.006162501] seconds [----] I, [2016-09-13T04:29:52.106220 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:29:52.154728 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76275], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:29:52.189041 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76276], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:29:53.398758 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:29:53.405860 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004765748977661133, :worker_monitor=>2.254194974899292, :worker_dequeue=>0.01278233528137207, :total_time=>2.272120714187622} [----] I, [2016-09-13T04:29:53.789517 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76275], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.674846516] seconds [----] I, [2016-09-13T04:29:53.789756 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76275], Delivering... [----] I, [2016-09-13T04:29:53.796976 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003810882568359375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003834962844848633, :pending_vm_jobs=>0.0009083747863769531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006774187088012695} [----] I, [2016-09-13T04:29:53.797406 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76275], State: [ok], Delivered in [0.007631901] seconds [----] I, [2016-09-13T04:29:53.812209 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76276], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.652376736] seconds [----] I, [2016-09-13T04:29:53.812498 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76276], Delivering... [----] I, [2016-09-13T04:29:53.818262 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76276], State: [ok], Delivered in [0.005798279] seconds [----] I, [2016-09-13T04:29:58.406542 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:29:58 UTC]... [----] I, [2016-09-13T04:29:58.423178 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:29:58 UTC]...Complete [----] I, [2016-09-13T04:30:07.207701 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T04:30:07.235380 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76277], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:30:07.251976 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76278], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:30:07.269343 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76279], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:30:07.297916 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76280], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:30:10.169710 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:30:10.175499 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0044100284576416016, :worker_monitor=>1.7012460231781006, :worker_dequeue=>0.010410547256469727, :total_time=>1.7163851261138916} [----] I, [2016-09-13T04:30:10.939502 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76280], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.663595] seconds [----] I, [2016-09-13T04:30:10.939716 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76280], Delivering... [----] I, [2016-09-13T04:30:10.946334 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034360885620117188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034575462341308594, :pending_vm_jobs=>0.0007975101470947266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006168365478515625} [----] I, [2016-09-13T04:30:10.946781 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76280], State: [ok], Delivered in [0.007048933] seconds [----] I, [2016-09-13T04:30:12.014236 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76277], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.799963194] seconds [----] I, [2016-09-13T04:30:12.014490 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76277], Delivering... [----] I, [2016-09-13T04:30:12.017114 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76277], State: [ok], Delivered in [0.002668327] seconds [----] I, [2016-09-13T04:30:12.060532 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76278], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.818570892] seconds [----] I, [2016-09-13T04:30:12.060782 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76278], Delivering... [----] I, [2016-09-13T04:30:12.072339 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76278], State: [ok], Delivered in [0.011532397] seconds [----] I, [2016-09-13T04:30:12.179848 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76279], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.921188945] seconds [----] I, [2016-09-13T04:30:12.180063 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76279], Delivering... [----] I, [2016-09-13T04:30:12.190804 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76279], State: [ok], Delivered in [0.010737678] seconds [----] I, [2016-09-13T04:30:22.311678 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:30:22.339562 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76281], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:30:22.373632 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76282], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:30:22.402277 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76283], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:30:22.424963 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76284], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:30:26.679347 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:30:26.686065 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004588603973388672, :worker_monitor=>1.455559492111206, :worker_dequeue=>0.01197671890258789, :total_time=>1.4724366664886475} [----] I, [2016-09-13T04:30:27.111501 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76282], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.767587236] seconds [----] I, [2016-09-13T04:30:27.111736 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76282], Delivering... [----] I, [2016-09-13T04:30:27.116894 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76284], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.70481034] seconds [----] I, [2016-09-13T04:30:27.117132 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76284], Delivering... [----] I, [2016-09-13T04:30:27.124907 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0042972564697265625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004328250885009766, :pending_vm_jobs=>0.000949859619140625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007310628890991211} [----] I, [2016-09-13T04:30:27.125321 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76284], State: [ok], Delivered in [0.008178563] seconds [----] I, [2016-09-13T04:30:27.184359 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76282], State: [ok], Delivered in [0.072594204] seconds [----] I, [2016-09-13T04:30:27.201631 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76281], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.885364879] seconds [----] I, [2016-09-13T04:30:27.201835 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76281], Delivering... [----] I, [2016-09-13T04:30:27.207039 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76281], State: [ok], Delivered in [0.005213382] seconds [----] I, [2016-09-13T04:30:27.229683 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76283], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.850605301] seconds [----] I, [2016-09-13T04:30:27.229860 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76283], Delivering... [----] I, [2016-09-13T04:30:27.232854 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76283], State: [ok], Delivered in [0.00297888] seconds [----] I, [2016-09-13T04:30:31.686721 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:30:31 UTC]... [----] I, [2016-09-13T04:30:31.709554 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:30:31 UTC]...Complete [----] I, [2016-09-13T04:30:37.438947 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:30:37.458354 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76285], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:30:44.098108 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:30:44.106245 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004202365875244141, :server_monitor=>0.10294270515441895, :worker_monitor=>2.2439959049224854, :worker_dequeue=>0.015204668045043945, :total_time=>2.3667962551116943} [----] I, [2016-09-13T04:30:44.281907 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76285], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.833773996] seconds [----] I, [2016-09-13T04:30:44.282163 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76285], Delivering... [----] I, [2016-09-13T04:30:44.289235 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003693819046020508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003715038299560547, :pending_vm_jobs=>0.0008311271667480469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006648540496826172} [----] I, [2016-09-13T04:30:44.289642 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76285], State: [ok], Delivered in [0.007470731] seconds [----] I, [2016-09-13T04:30:52.475626 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:30:52.498669 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76286], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:30:52.567331 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76287], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:30:54.135566 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:30:54.344501 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76287], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.839974239] seconds [----] I, [2016-09-13T04:30:54.344696 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76287], Delivering... [----] I, [2016-09-13T04:30:54.350366 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002938985824584961, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002955198287963867, :pending_vm_jobs=>0.0007033348083496094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005268573760986328} [----] I, [2016-09-13T04:30:54.350738 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76287], State: [ok], Delivered in [0.006039728] seconds [----] I, [2016-09-13T04:30:54.464451 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76286], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.98397646] seconds [----] I, [2016-09-13T04:30:54.464616 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76286], Delivering... [----] I, [2016-09-13T04:30:54.469011 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76286], State: [ok], Delivered in [0.004366755] seconds [----] I, [2016-09-13T04:31:00.847002 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041713714599609375, :worker_monitor=>1.6905841827392578, :worker_dequeue=>0.009748458862304688, :total_time=>1.7049334049224854} [----] I, [2016-09-13T04:31:05.847765 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:31:05 UTC]... [----] I, [2016-09-13T04:31:05.874915 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:31:05 UTC]...Complete [----] I, [2016-09-13T04:31:07.579273 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:31:07.607247 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76288], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:31:10.904782 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:31:11.497613 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76288], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.912469558] seconds [----] I, [2016-09-13T04:31:11.497765 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76288], Delivering... [----] I, [2016-09-13T04:31:11.501627 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021109580993652344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002123117446899414, :pending_vm_jobs=>0.00046896934509277344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003616809844970703} [----] I, [2016-09-13T04:31:11.502627 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76288], State: [ok], Delivered in [0.004875087] seconds [----] I, [2016-09-13T04:31:17.994797 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0046787261962890625, :worker_monitor=>2.0640616416931152, :worker_dequeue=>0.012732267379760742, :total_time=>2.081861734390259} [----] I, [2016-09-13T04:31:22.622677 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:31:22.652700 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76289], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:31:22.674912 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76290], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:31:22.697648 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76291], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:31:22.720211 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76292], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:31:23.002125 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:31:23.608747 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76290], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.951053154] seconds [----] I, [2016-09-13T04:31:23.609063 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76290], Delivering... [----] I, [2016-09-13T04:31:23.646770 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76292], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.938701504] seconds [----] I, [2016-09-13T04:31:23.647023 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76292], Delivering... [----] I, [2016-09-13T04:31:23.656949 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0047855377197265625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004818916320800781, :pending_vm_jobs=>0.0013079643249511719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009435653686523438} [----] I, [2016-09-13T04:31:23.657459 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76292], State: [ok], Delivered in [0.010379921] seconds [----] I, [2016-09-13T04:31:23.710495 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76290], State: [ok], Delivered in [0.101338283] seconds [----] I, [2016-09-13T04:31:24.600699 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76289], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.972165103] seconds [----] I, [2016-09-13T04:31:24.600882 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76289], Delivering... [----] I, [2016-09-13T04:31:24.606526 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76289], State: [ok], Delivered in [0.005614924] seconds [----] I, [2016-09-13T04:31:24.634532 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76291], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.953844703] seconds [----] I, [2016-09-13T04:31:24.634683 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76291], Delivering... [----] I, [2016-09-13T04:31:24.636859 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76291], State: [ok], Delivered in [0.002160249] seconds [----] I, [2016-09-13T04:31:36.114107 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035011768341064453, :worker_monitor=>3.0773661136627197, :worker_dequeue=>0.012019634246826172, :total_time=>3.0931882858276367} [----] I, [2016-09-13T04:31:37.738216 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:31:37.785318 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76293], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:31:41.114766 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:31:41 UTC]... [----] I, [2016-09-13T04:31:41.169010 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:31:41 UTC]...Complete [----] I, [2016-09-13T04:31:41.180118 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:31:41.830991 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76293], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.082834008] seconds [----] I, [2016-09-13T04:31:41.831176 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76293], Delivering... [----] I, [2016-09-13T04:31:41.837545 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003415346145629883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034368038177490234, :pending_vm_jobs=>0.00078582763671875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005996227264404297} [----] I, [2016-09-13T04:31:41.837885 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76293], State: [ok], Delivered in [0.006706013] seconds [----] I, [2016-09-13T04:31:46.316971 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T04:31:52.798153 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:31:52.833282 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76294], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:31:52.867709 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76295], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:31:53.011361 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:31:53.015582 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006102085113525391, :worker_monitor=>1.6725554466247559, :worker_dequeue=>0.007760524749755859, :total_time=>1.6868321895599365} [----] I, [2016-09-13T04:31:53.976841 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76295], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.137081262] seconds [----] I, [2016-09-13T04:31:53.977131 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76295], Delivering... [----] I, [2016-09-13T04:31:53.984865 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004071712493896484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004097938537597656, :pending_vm_jobs=>0.0009322166442871094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007008552551269531} [----] I, [2016-09-13T04:31:53.985281 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76295], State: [ok], Delivered in [0.008121] seconds [----] I, [2016-09-13T04:31:54.754913 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76294], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.951911899] seconds [----] I, [2016-09-13T04:31:54.755068 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76294], Delivering... [----] I, [2016-09-13T04:31:54.758640 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76294], State: [ok], Delivered in [0.003564775] seconds [----] I, [2016-09-13T04:32:07.883464 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:32:07.918293 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76296], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:32:09.696185 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:32:09.711172 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003954172134399414, :worker_monitor=>1.6287150382995605, :worker_dequeue=>0.021197080612182617, :total_time=>1.6541953086853027} [----] I, [2016-09-13T04:32:09.810160 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76296], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.919889183] seconds [----] I, [2016-09-13T04:32:09.810460 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76296], Delivering... [----] I, [2016-09-13T04:32:09.817804 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0039179325103759766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003939390182495117, :pending_vm_jobs=>0.0009205341339111328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068514347076416016} [----] I, [2016-09-13T04:32:09.818264 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76296], State: [ok], Delivered in [0.007858413] seconds [----] I, [2016-09-13T04:32:14.712134 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:32:14 UTC]... [----] I, [2016-09-13T04:32:14.741589 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:32:14 UTC]...Complete [----] I, [2016-09-13T04:32:22.938259 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:32:22.965400 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76297], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:32:22.998099 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76298], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:32:23.022801 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76299], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:32:23.069068 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76300], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:32:26.576006 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:32:26.582738 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.011381387710571289, :worker_monitor=>1.776136875152588, :worker_dequeue=>0.012330055236816406, :total_time=>1.8002824783325195} [----] I, [2016-09-13T04:32:27.269181 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76298], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.299364206] seconds [----] I, [2016-09-13T04:32:27.269361 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76298], Delivering... [----] I, [2016-09-13T04:32:27.320459 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76300], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.287184061] seconds [----] I, [2016-09-13T04:32:27.320693 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76300], Delivering... [----] I, [2016-09-13T04:32:27.326989 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003317117691040039, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033354759216308594, :pending_vm_jobs=>0.0007867813110351562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005900859832763672} [----] I, [2016-09-13T04:32:27.327396 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76300], State: [ok], Delivered in [0.006711756] seconds [----] I, [2016-09-13T04:32:27.337357 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76298], State: [ok], Delivered in [0.067957632] seconds [----] I, [2016-09-13T04:32:27.876525 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76297], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.933459011] seconds [----] I, [2016-09-13T04:32:27.876835 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76297], Delivering... [----] I, [2016-09-13T04:32:27.884031 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76297], State: [ok], Delivered in [0.00718244] seconds [----] I, [2016-09-13T04:32:27.932121 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76299], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.929388574] seconds [----] I, [2016-09-13T04:32:27.932344 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76299], Delivering... [----] I, [2016-09-13T04:32:27.935959 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76299], State: [ok], Delivered in [0.003604677] seconds [----] I, [2016-09-13T04:32:38.086914 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:32:38.135702 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76301], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:32:43.524371 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:32:43.532569 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004567861557006836, :worker_monitor=>1.9012277126312256, :worker_dequeue=>0.01635909080505371, :total_time=>1.9224634170532227} [----] I, [2016-09-13T04:32:44.482513 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76301], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.389058128] seconds [----] I, [2016-09-13T04:32:44.482817 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76301], Delivering... [----] I, [2016-09-13T04:32:44.492982 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005411386489868164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005437612533569336, :pending_vm_jobs=>0.0012717247009277344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00964808464050293} [----] I, [2016-09-13T04:32:44.493507 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76301], State: [ok], Delivered in [0.010634305] seconds [----] I, [2016-09-13T04:32:48.532956 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:32:48 UTC]... [----] I, [2016-09-13T04:32:48.556510 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:32:48 UTC]...Complete [----] I, [2016-09-13T04:32:53.147590 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:32:53.169156 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76302], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:32:53.180607 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76303], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:32:53.780238 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:32:54.609552 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76303], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.43683626] seconds [----] I, [2016-09-13T04:32:54.609838 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76303], Delivering... [----] I, [2016-09-13T04:32:54.618692 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005126476287841797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0051479339599609375, :pending_vm_jobs=>0.0007615089416503906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008202552795410156} [----] I, [2016-09-13T04:32:54.619221 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76303], State: [ok], Delivered in [0.009377994] seconds [----] I, [2016-09-13T04:32:55.055135 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76302], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.903013132] seconds [----] I, [2016-09-13T04:32:55.055344 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76302], Delivering... [----] I, [2016-09-13T04:32:55.060218 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76302], State: [ok], Delivered in [0.004875545] seconds [----] I, [2016-09-13T04:33:00.479343 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005341768264770508, :worker_monitor=>1.677377462387085, :worker_dequeue=>0.008070945739746094, :total_time=>1.6910912990570068} [----] I, [2016-09-13T04:33:08.193698 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:33:08.211655 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76304], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:33:10.509760 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:33:10.686911 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76304], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.486564206] seconds [----] I, [2016-09-13T04:33:10.687147 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76304], Delivering... [----] I, [2016-09-13T04:33:10.694451 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037412643432617188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037641525268554688, :pending_vm_jobs=>0.0010116100311279297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0067746639251708984} [----] I, [2016-09-13T04:33:10.694908 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76304], State: [ok], Delivered in [0.007746066] seconds [----] I, [2016-09-13T04:33:16.970795 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006036281585693359, :worker_monitor=>1.43560791015625, :worker_dequeue=>0.010156631469726562, :total_time=>1.4521958827972412} [----] I, [2016-09-13T04:33:21.971292 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:33:21 UTC]... [----] I, [2016-09-13T04:33:21.990656 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:33:21 UTC]...Complete [----] I, [2016-09-13T04:33:23.225390 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T04:33:23.248482 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76305], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:33:23.270781 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76306], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:33:23.293904 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76307], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:33:23.316930 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76308], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:33:23.345670 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76309], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:33:23.368477 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76310], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:33:27.020779 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:33:27.854169 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76305], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.622559437] seconds [----] I, [2016-09-13T04:33:27.854335 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76305], Delivering... [----] I, [2016-09-13T04:33:27.855082 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T04:33:27.855204 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5329334272 [----] I, [2016-09-13T04:33:27.855263 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5114667008 [----] I, [2016-09-13T04:33:27.855328 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 214667264 [----] I, [2016-09-13T04:33:27.855377 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1314914304 [----] I, [2016-09-13T04:33:27.855463 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5060743168 [----] I, [2016-09-13T04:33:27.855519 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T04:33:27.855565 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T04:33:27.855609 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 535429120 [----] I, [2016-09-13T04:33:27.855653 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T04:33:27.855696 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7880421376 [----] I, [2016-09-13T04:33:27.855739 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T04:33:27.855785 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T04:33:27.855831 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T04:33:27.855876 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T04:33:27.855918 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T04:33:27.855962 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T04:33:27.856006 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T04:33:27.856049 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T04:33:27.856092 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T04:33:27.856147 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T04:33:27.856197 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273031168 [----] I, [2016-09-13T04:33:27.856242 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56217600 [----] I, [2016-09-13T04:33:27.856285 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216813568 [----] I, [2016-09-13T04:33:27.856331 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6225920 [----] I, [2016-09-13T04:33:27.856374 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140607488 [----] I, [2016-09-13T04:33:27.856443 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2607681536 [----] I, [2016-09-13T04:33:27.856499 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2298040320 [----] I, [2016-09-13T04:33:27.856554 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T04:33:27.856600 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T04:33:27.856645 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T04:33:27.856688 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37584896 [----] I, [2016-09-13T04:33:27.856730 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102281216 [----] I, [2016-09-13T04:33:27.856774 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53063680 [----] I, [2016-09-13T04:33:27.856817 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110170112 [----] I, [2016-09-13T04:33:27.856860 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155344896 [----] I, [2016-09-13T04:33:27.856900 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T04:33:27.856955 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T04:33:27.857001 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T04:33:27.857042 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T04:33:27.857084 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T04:33:27.857132 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T04:33:27.857177 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T04:33:27.857221 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T04:33:27.857266 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T04:33:27.899067 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T04:33:27.899265 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T04:33:27.902751 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T04:33:27.905193 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T04:33:27.908062 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T04:33:27.911036 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T04:33:27.913821 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T04:33:27.916803 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 836 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T04:33:27.916985 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76308], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.619398802] seconds [----] I, [2016-09-13T04:33:27.917146 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76308], Delivering... [----] I, [2016-09-13T04:33:27.919614 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T04:33:27.922374 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T04:33:27.925173 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.6 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T04:33:27.928073 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T04:33:27.930922 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T04:33:27.933637 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T04:33:27.936340 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>2}} [----] I, [2016-09-13T04:33:27.936527 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:33:27.936634 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>3, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T04:33:27.940941 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [148210.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:33:27.941332 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76305], State: [ok], Delivered in [0.086966542] seconds [----] I, [2016-09-13T04:33:27.968129 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76308], State: [ok], Delivered in [0.050959552] seconds [----] I, [2016-09-13T04:33:27.974071 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76310], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.61865001] seconds [----] I, [2016-09-13T04:33:27.974223 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76310], Delivering... [----] I, [2016-09-13T04:33:27.978284 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023429393768310547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023584365844726562, :pending_vm_jobs=>0.0004379749298095703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003769397735595703} [----] I, [2016-09-13T04:33:27.978546 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76310], State: [ok], Delivered in [0.004324665] seconds [----] I, [2016-09-13T04:33:28.140230 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76307], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.865671499] seconds [----] I, [2016-09-13T04:33:28.140584 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76307], Delivering... [----] I, [2016-09-13T04:33:28.147083 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76307], State: [ok], Delivered in [0.006477425] seconds [----] I, [2016-09-13T04:33:28.180060 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76309], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.857682851] seconds [----] I, [2016-09-13T04:33:28.180269 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76309], Delivering... [----] I, [2016-09-13T04:33:28.184160 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76309], State: [ok], Delivered in [0.00390348] seconds [----] I, [2016-09-13T04:33:33.620937 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:33:33.627294 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005795478820800781, :worker_monitor=>1.5824618339538574, :worker_dequeue=>0.011733770370483398, :total_time=>1.600407361984253} [----] I, [2016-09-13T04:33:34.042851 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76306], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [10.788547844] seconds [----] I, [2016-09-13T04:33:34.043075 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76306], Delivering... [----] I, [2016-09-13T04:33:34.050573 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:33:24 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347147000], Memory % [5.04], CPU Time [102982.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T04:33:34.050981 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:33:22 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212538000], Memory % [3.5], CPU Time [48003.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T04:33:34.051480 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:33:33 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [147296.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:33:34.051898 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:33:30 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50349.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:33:34.052312 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:33:31 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162415000], Memory % [3.1], CPU Time [37119.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T04:33:34.052754 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:33:23 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [234399.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T04:33:34.053158 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:33:31 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358680000], Memory % [5.28], CPU Time [197406.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T04:33:34.053595 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:33:33 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [148231.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:33:34.056096 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:33:29 UTC], Process Info: Memory Usage [580681728], Memory Size [923725824], Proportional Set Size: [420043000], Memory % [7.08], CPU Time [1090.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T04:33:34.058051 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:33:26 UTC], Process Info: Memory Usage [557920256], Memory Size [911982592], Proportional Set Size: [405640000], Memory % [6.8], CPU Time [4439.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T04:33:34.058562 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:33:31 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [206048.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T04:33:34.058983 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:33:31 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [50360.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:33:34.059347 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:33:30 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165800000], Memory % [3.16], CPU Time [38006.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T04:33:34.061508 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:33:27 UTC], Process Info: Memory Usage [589737984], Memory Size [930242560], Proportional Set Size: [426729000], Memory % [7.19], CPU Time [388.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:33:34.063386 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:33:26 UTC], Process Info: Memory Usage [588431360], Memory Size [930414592], Proportional Set Size: [425829000], Memory % [7.17], CPU Time [958.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:33:34.063819 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76306], State: [ok], Delivered in [0.02075006] seconds [----] I, [2016-09-13T04:33:38.383017 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:33:38.412883 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76311], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:33:38.636584 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:33:39.087852 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76311], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.696424288] seconds [----] I, [2016-09-13T04:33:39.088130 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76311], Delivering... [----] I, [2016-09-13T04:33:39.095081 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035219192504882812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035431385040283203, :pending_vm_jobs=>0.0007979869842529297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006420612335205078} [----] I, [2016-09-13T04:33:39.095511 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76311], State: [ok], Delivered in [0.007396408] seconds [----] I, [2016-09-13T04:33:50.229535 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004751443862915039, :server_monitor=>0.09815001487731934, :worker_monitor=>1.4556710720062256, :worker_dequeue=>0.012315988540649414, :total_time=>1.5713074207305908} [----] I, [2016-09-13T04:33:53.425800 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:33:53.453236 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76312], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:33:53.476357 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76313], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:33:55.230274 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:33:55 UTC]... [----] I, [2016-09-13T04:33:55.253098 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:33:55 UTC]...Complete [----] I, [2016-09-13T04:33:55.268348 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:33:55.310452 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76313], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.849388222] seconds [----] I, [2016-09-13T04:33:55.310686 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76313], Delivering... [----] I, [2016-09-13T04:33:55.317297 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003339529037475586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003364086151123047, :pending_vm_jobs=>0.0008170604705810547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062255859375} [----] I, [2016-09-13T04:33:55.317372 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76312], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.880173609] seconds [----] I, [2016-09-13T04:33:55.317613 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76312], Delivering... [----] I, [2016-09-13T04:33:55.317663 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76313], State: [ok], Delivered in [0.006988379] seconds [----] I, [2016-09-13T04:33:55.322554 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76312], State: [ok], Delivered in [0.00492355] seconds [----] I, [2016-09-13T04:34:06.669657 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002997159957885742, :worker_monitor=>1.3667807579040527, :worker_dequeue=>0.00859212875366211, :total_time=>1.3785960674285889} [----] I, [2016-09-13T04:34:08.492224 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T04:34:08.528115 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76314], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:34:08.550666 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76315], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:34:11.679689 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:34:12.391130 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76315], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.851236201] seconds [----] I, [2016-09-13T04:34:12.391329 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76315], Delivering... [----] I, [2016-09-13T04:34:12.397682 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003389596939086914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034096240997314453, :pending_vm_jobs=>0.0007698535919189453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005929470062255859} [----] I, [2016-09-13T04:34:12.398022 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76315], State: [ok], Delivered in [0.006684481] seconds [----] I, [2016-09-13T04:34:13.386750 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76314], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.872806734] seconds [----] I, [2016-09-13T04:34:13.386908 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76314], Delivering... [----] I, [2016-09-13T04:34:13.431705 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76316], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T04:34:13.448112 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76317], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T04:34:13.448494 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76314], State: [ok], Delivered in [0.061573555] seconds [----] I, [2016-09-13T04:34:16.695440 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T04:34:16.696926 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T04:34:16.968786 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [76317], MiqWorker id: [96], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [3.528699468] seconds [----] I, [2016-09-13T04:34:16.968996 #28071:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76317], Delivering... [----] I, [2016-09-13T04:34:16.972441 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T04:34:16.972592 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T04:34:16.972714 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T04:34:16.972849 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T04:34:16.972998 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:17.401032 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:17.709672 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:17.709966 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:17.878176 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [76316], MiqWorker id: [97], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [4.472098993] seconds [----] I, [2016-09-13T04:34:17.878593 #30088:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76316], Delivering... [----] I, [2016-09-13T04:34:17.885945 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T04:34:17.886235 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T04:34:17.886631 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T04:34:17.886968 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T04:34:17.887251 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:18.173847 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:18.213617 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:18.373648 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:18.373842 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:18.527390 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:18.527587 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:18.704089 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:18.798827 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:18.889038 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:19.024309 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:19.181246 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:19.283008 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:19.331770 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:19.331896 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:19.375175 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:19.467811 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:19.560388 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:19.651923 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:19.748475 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:19.840638 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:19.840717 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:19.933862 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:20.026605 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:20.118207 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:20.161626 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:20.161804 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:20.210980 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:20.303978 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:20.397356 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:20.490949 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:20.584537 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:20.624552 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:20.676694 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:34:20.872034 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T04:34:20.872206 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.0040798187255859375, :collect_inventory_for_targets=>5.6743621826171875e-05, :parse_legacy_inventory=>9.189136981964111, :parse_targeted_inventory=>9.189200639724731, :save_inventory=>0.6489613056182861, :ems_refresh=>9.839478015899658} [----] I, [2016-09-13T04:34:20.910590 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T04:34:20.910946 #30088:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76316], State: [ok], Delivered in [3.032431444] seconds [----] I, [2016-09-13T04:34:20.922092 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:20.922357 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:21.430354 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:21.721334 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:21.721542 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:22.201232 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:22.528291 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:22.528515 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:22.998225 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003757953643798828, :worker_monitor=>1.2895359992980957, :worker_dequeue=>0.007250308990478516, :total_time=>1.300873041152954} [----] I, [2016-09-13T04:34:23.004487 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:23.305373 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:23.305613 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:23.564440 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:34:23.596888 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76318], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:34:23.619485 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76319], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:34:23.642567 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76320], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:34:23.659569 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76321], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:34:23.801694 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:24.116220 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:24.116474 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:24.613141 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:26.431670 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:26.431841 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:26.910043 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:27.998825 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:34:27 UTC]... [----] I, [2016-09-13T04:34:28.019756 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:34:27 UTC]...Complete [----] I, [2016-09-13T04:34:28.030522 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:34:28.212341 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:28.212674 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:28.431132 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76319], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.829359295] seconds [----] I, [2016-09-13T04:34:28.431335 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76319], Delivering... [----] I, [2016-09-13T04:34:28.482585 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76321], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.83224133] seconds [----] I, [2016-09-13T04:34:28.482822 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76321], Delivering... [----] I, [2016-09-13T04:34:28.489772 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036826133728027344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037050247192382812, :pending_vm_jobs=>0.0007622241973876953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065441131591796875} [----] I, [2016-09-13T04:34:28.490778 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76321], State: [ok], Delivered in [0.007911618] seconds [----] I, [2016-09-13T04:34:28.511028 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76319], State: [ok], Delivered in [0.079654176] seconds [----] I, [2016-09-13T04:34:28.511187 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76318], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.941590207] seconds [----] I, [2016-09-13T04:34:28.511355 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76318], Delivering... [----] I, [2016-09-13T04:34:28.516457 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76318], State: [ok], Delivered in [0.00504705] seconds [----] I, [2016-09-13T04:34:28.539521 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76320], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.914291295] seconds [----] I, [2016-09-13T04:34:28.539646 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76320], Delivering... [----] I, [2016-09-13T04:34:28.543156 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76320], State: [ok], Delivered in [0.003501531] seconds [----] I, [2016-09-13T04:34:28.682932 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:28.993265 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:28.993524 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:29.532297 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:29.677497 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:29.819928 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:29.958165 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:30.100506 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:30.242033 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:30.378489 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:30.521132 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:30.666619 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:30.809478 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:30.958974 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:31.098319 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:31.233798 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:31.381731 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:31.860110 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:32.008480 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:32.152661 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:32.298599 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:32.437304 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:32.595282 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:32.738380 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:32.878676 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:33.020995 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:33.164520 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:33.301621 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:33.445647 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:33.586572 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:33.732716 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:33.906237 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:34.043461 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:34.190605 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:34.565134 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:34.727927 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:34.880353 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:35.022029 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:35.167009 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:35.305723 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:35.445305 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:35.589695 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:35.733062 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:35.881946 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:36.033935 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:36.182168 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:36.325639 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:36.474322 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:36.618159 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:38.681819 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:34:38.693693 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76322], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:34:39.349728 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:34:39.354617 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003431558609008789, :worker_monitor=>1.2896199226379395, :worker_dequeue=>0.009176015853881836, :total_time=>1.302520990371704} [----] I, [2016-09-13T04:34:39.614831 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76322], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.928330199] seconds [----] I, [2016-09-13T04:34:39.614961 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76322], Delivering... [----] I, [2016-09-13T04:34:39.619255 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021686553955078125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002183675765991211, :pending_vm_jobs=>0.0005292892456054688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004015445709228516} [----] I, [2016-09-13T04:34:39.619836 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76322], State: [ok], Delivered in [0.004850004] seconds [----] I, [2016-09-13T04:34:42.771063 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:42.921338 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:43.345954 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:43.509784 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:43.664275 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:43.798784 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:43.934637 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:44.086105 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:44.223906 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:44.362525 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:44.522798 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:44.668563 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:44.807459 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:44.947946 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:45.094730 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:45.237250 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:45.373751 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:45.514528 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:45.657687 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:46.007247 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:46.157555 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:46.300076 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:46.443684 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:46.584606 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:46.728921 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:46.873839 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:47.016850 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:47.155774 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:47.292760 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:47.427190 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:47.566438 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:47.706390 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:47.843266 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:47.987856 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:48.127962 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:48.268845 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:48.621791 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:48.795537 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:48.944051 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:49.079310 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:49.229481 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:49.382875 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:49.519722 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:49.661232 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:49.804110 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:49.945220 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:50.098658 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:50.237738 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:50.380961 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:50.525159 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:50.662832 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:50.804203 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:50.940943 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:51.384442 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:51.533964 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:51.668200 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:51.820843 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:51.959733 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:52.097834 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:52.239281 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:52.384070 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:52.525382 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:52.694077 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:52.833513 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:52.990687 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:53.134512 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:53.275946 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:53.417885 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:53.556535 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:53.696773 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:34:53.706345 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:34:53.731101 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76323], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:34:53.751219 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76324], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:34:56.213741 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:34:56.220080 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006391763687133789, :worker_monitor=>1.712846279144287, :worker_dequeue=>0.011524438858032227, :total_time=>1.731116771697998} [----] I, [2016-09-13T04:34:56.758027 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76324], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.018875257] seconds [----] I, [2016-09-13T04:34:56.758162 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76324], Delivering... [----] I, [2016-09-13T04:34:56.762084 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002156972885131836, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021708011627197266, :pending_vm_jobs=>0.0004425048828125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003665924072265625} [----] I, [2016-09-13T04:34:56.762346 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76324], State: [ok], Delivered in [0.004179166] seconds [----] I, [2016-09-13T04:34:58.648720 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76323], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.936100186] seconds [----] I, [2016-09-13T04:34:58.648923 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76323], Delivering... [----] I, [2016-09-13T04:34:58.653846 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76323], State: [ok], Delivered in [0.004909434] seconds [----] I, [2016-09-13T04:35:00.162153 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:00.327954 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:00.470861 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:00.612079 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:00.757230 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:00.908702 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:01.055193 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:01.198963 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:01.220650 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:35:01 UTC]... [----] I, [2016-09-13T04:35:01.233149 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:35:01 UTC]...Complete [----] I, [2016-09-13T04:35:01.342249 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:01.491599 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:01.636507 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:01.770767 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:01.920489 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:02.263868 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:02.403288 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:02.548550 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:02.687375 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:03.124329 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:03.296061 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:03.436113 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:03.578698 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:03.720554 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:03.866684 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:04.009664 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:04.158616 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:04.302788 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:04.442039 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:04.585797 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:04.720155 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:04.856846 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:05.001390 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:05.151312 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:05.291016 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:05.435379 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:05.790256 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:05.958226 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:06.097826 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:06.237673 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:06.378343 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:06.519307 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:06.662472 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:06.807773 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:06.951828 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:07.094830 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:07.230178 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:07.371844 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:07.514068 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:07.659102 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:07.798067 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:07.939668 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:08.081953 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:08.445140 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:08.686846 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:08.767933 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:35:08.780923 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76325], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:35:08.830497 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:08.976517 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:09.115257 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:09.259289 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:09.407809 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:09.554701 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:09.691073 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:09.841562 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:09.986049 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:10.128511 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:10.272750 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:10.467143 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:10.617183 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:12.829745 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:35:12.836977 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006090879440307617, :worker_monitor=>1.551396131515503, :worker_dequeue=>0.013476133346557617, :total_time=>1.5714912414550781} [----] I, [2016-09-13T04:35:12.883741 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76325], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.109631547] seconds [----] I, [2016-09-13T04:35:12.883940 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76325], Delivering... [----] I, [2016-09-13T04:35:12.890811 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035681724548339844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035924911499023438, :pending_vm_jobs=>0.0008480548858642578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006468534469604492} [----] I, [2016-09-13T04:35:12.891218 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76325], State: [ok], Delivered in [0.007275857] seconds [----] I, [2016-09-13T04:35:16.774386 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:16.910764 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:17.397093 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:17.555179 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:17.699172 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:17.839790 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:17.978066 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:18.126983 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:18.270861 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:18.413287 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:18.552320 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:18.694598 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:18.831877 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:18.976232 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:19.110152 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:19.245755 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:19.391049 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:19.524552 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:19.675841 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:20.100300 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:20.247236 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:20.391060 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:20.532677 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:20.673543 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:20.813092 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:20.955373 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:21.095221 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:21.239753 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:21.377606 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:21.520268 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:21.662055 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:21.797037 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:21.930302 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:22.081092 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:22.224451 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:35:22.361444 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T04:35:22.566069 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T04:35:22.566360 #28071:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T04:35:22.566659 #28071:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T04:35:22.566753 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T04:35:22.566852 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T04:35:22.592467 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T04:35:22.592868 #28071:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [76317], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T04:35:22.593130 #28071:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T04:35:22.593381 #28071:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T04:35:22.593620 #28071:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76317], State: [error], Delivered in [65.624633273] seconds [----] I, [2016-09-13T04:35:23.794619 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:35:23.809459 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76326], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:35:23.832507 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76327], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:35:23.849607 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76328], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:35:23.884209 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76329], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:35:29.003183 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:35:29.007216 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0062558650970458984, :worker_monitor=>1.118727445602417, :worker_dequeue=>0.01154637336730957, :total_time=>1.1369564533233643} [----] I, [2016-09-13T04:35:29.021738 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76327], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.207915137] seconds [----] I, [2016-09-13T04:35:29.021885 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76327], Delivering... [----] I, [2016-09-13T04:35:29.043753 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76329], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.186620842] seconds [----] I, [2016-09-13T04:35:29.043918 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76329], Delivering... [----] I, [2016-09-13T04:35:29.049578 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002929210662841797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029494762420654297, :pending_vm_jobs=>0.0007519721984863281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005369663238525391} [----] I, [2016-09-13T04:35:29.049897 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76329], State: [ok], Delivered in [0.005968811] seconds [----] I, [2016-09-13T04:35:29.060599 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76327], State: [ok], Delivered in [0.038698585] seconds [----] I, [2016-09-13T04:35:31.747028 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76326], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.94599579] seconds [----] I, [2016-09-13T04:35:31.747215 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76326], Delivering... [----] I, [2016-09-13T04:35:31.752116 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76326], State: [ok], Delivered in [0.00489453] seconds [----] I, [2016-09-13T04:35:31.781249 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76328], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.942835665] seconds [----] I, [2016-09-13T04:35:31.781487 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76328], Delivering... [----] I, [2016-09-13T04:35:31.788717 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76328], State: [ok], Delivered in [0.007247713] seconds [----] I, [2016-09-13T04:35:34.007828 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:35:34 UTC]... [----] I, [2016-09-13T04:35:34.026584 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:35:34 UTC]...Complete [----] I, [2016-09-13T04:35:38.896067 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:35:38.912470 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76330], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:35:39.053847 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:35:39.136149 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76330], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.234429937] seconds [----] I, [2016-09-13T04:35:39.136357 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76330], Delivering... [----] I, [2016-09-13T04:35:39.143200 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036101341247558594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036339759826660156, :pending_vm_jobs=>0.0008504390716552734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006377696990966797} [----] I, [2016-09-13T04:35:39.143643 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76330], State: [ok], Delivered in [0.007274601] seconds [----] I, [2016-09-13T04:35:45.738516 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004446506500244141, :worker_monitor=>1.664400339126587, :worker_dequeue=>0.011142969131469727, :total_time=>1.6803185939788818} [----] I, [2016-09-13T04:35:53.926597 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:35:53.946875 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76331], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:35:53.958227 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76332], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:35:55.859678 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:35:55.959125 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76332], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.006904275] seconds [----] I, [2016-09-13T04:35:55.959335 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76332], Delivering... [----] I, [2016-09-13T04:35:55.966248 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037674903869628906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003787994384765625, :pending_vm_jobs=>0.0007874965667724609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0064432621002197266} [----] I, [2016-09-13T04:35:55.966623 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76332], State: [ok], Delivered in [0.007281753] seconds [----] I, [2016-09-13T04:35:55.970607 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76331], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.037136748] seconds [----] I, [2016-09-13T04:35:55.970917 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76331], Delivering... [----] I, [2016-09-13T04:35:55.978647 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76331], State: [ok], Delivered in [0.007728229] seconds [----] I, [2016-09-13T04:36:02.385125 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0043904781341552734, :worker_monitor=>1.4910016059875488, :worker_dequeue=>0.011775493621826172, :total_time=>1.5075485706329346} [----] I, [2016-09-13T04:36:07.385734 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:36:07 UTC]... [----] I, [2016-09-13T04:36:07.403931 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:36:07 UTC]...Complete [----] I, [2016-09-13T04:36:08.969994 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:36:08.992927 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76333], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:36:12.427533 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:36:13.394149 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76333], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.418174911] seconds [----] I, [2016-09-13T04:36:13.394354 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76333], Delivering... [----] I, [2016-09-13T04:36:13.400855 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034542083740234375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034720897674560547, :pending_vm_jobs=>0.0007944107055664062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006070137023925781} [----] I, [2016-09-13T04:36:13.401224 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76333], State: [ok], Delivered in [0.006868727] seconds [----] I, [2016-09-13T04:36:18.862753 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033206939697265625, :worker_monitor=>1.409876823425293, :worker_dequeue=>0.016766786575317383, :total_time=>1.4302968978881836} [----] I, [2016-09-13T04:36:24.004813 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:36:24.046708 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76334], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:36:24.059036 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76335], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:36:24.069249 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76336], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:36:24.086502 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76337], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:36:28.887748 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:36:29.075620 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76335], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.025013242] seconds [----] I, [2016-09-13T04:36:29.075878 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76335], Delivering... [----] I, [2016-09-13T04:36:29.143911 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76335], State: [ok], Delivered in [0.068034054] seconds [----] I, [2016-09-13T04:36:29.172552 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76337], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.094454234] seconds [----] I, [2016-09-13T04:36:29.172718 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76337], Delivering... [----] I, [2016-09-13T04:36:29.178628 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003014802932739258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030317306518554688, :pending_vm_jobs=>0.0007867813110351562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005562305450439453} [----] I, [2016-09-13T04:36:29.178978 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76337], State: [ok], Delivered in [0.006255925] seconds [----] I, [2016-09-13T04:36:29.224164 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76334], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.214994199] seconds [----] I, [2016-09-13T04:36:29.224347 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76334], Delivering... [----] I, [2016-09-13T04:36:29.228844 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76334], State: [ok], Delivered in [0.00448864] seconds [----] I, [2016-09-13T04:36:29.268245 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76336], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.204427708] seconds [----] I, [2016-09-13T04:36:29.268468 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76336], Delivering... [----] I, [2016-09-13T04:36:29.271478 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76336], State: [ok], Delivered in [0.003006732] seconds [----] I, [2016-09-13T04:36:35.561303 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005016326904296875, :worker_monitor=>1.6494755744934082, :worker_dequeue=>0.01172018051147461, :total_time=>1.666651964187622} [----] I, [2016-09-13T04:36:39.100565 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:36:39.122881 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76338], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:36:40.562051 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:36:40 UTC]... [----] I, [2016-09-13T04:36:40.585562 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:36:40 UTC]...Complete [----] I, [2016-09-13T04:36:40.597099 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:36:40.638273 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76338], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.527917867] seconds [----] I, [2016-09-13T04:36:40.638502 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76338], Delivering... [----] I, [2016-09-13T04:36:40.644585 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002552509307861328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00257110595703125, :pending_vm_jobs=>0.0008821487426757812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057103633880615234} [----] I, [2016-09-13T04:36:40.644968 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76338], State: [ok], Delivered in [0.006450828] seconds [----] I, [2016-09-13T04:36:50.638327 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T04:36:52.069541 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004683256149291992, :log_active_servers=>0.012238025665283203, :worker_monitor=>1.4191856384277344, :worker_dequeue=>0.011552810668945312, :total_time=>1.4480934143066406} [----] I, [2016-09-13T04:36:54.140448 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:36:54.180448 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76339], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:36:54.197325 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76340], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:36:57.198153 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:36:57.763153 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76340], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.576351318] seconds [----] I, [2016-09-13T04:36:57.763356 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76340], Delivering... [----] I, [2016-09-13T04:36:57.769788 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003377676010131836, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003398418426513672, :pending_vm_jobs=>0.0007944107055664062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00598597526550293} [----] I, [2016-09-13T04:36:57.770118 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76340], State: [ok], Delivered in [0.006761744] seconds [----] I, [2016-09-13T04:36:59.581515 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76339], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.435799827] seconds [----] I, [2016-09-13T04:36:59.581778 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76339], Delivering... [----] I, [2016-09-13T04:36:59.588675 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76339], State: [ok], Delivered in [0.006901015] seconds [----] I, [2016-09-13T04:37:08.908138 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004953622817993164, :worker_monitor=>1.6656742095947266, :worker_dequeue=>0.010703325271606445, :total_time=>1.6817998886108398} [----] I, [2016-09-13T04:37:09.211837 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:37:09.237651 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76341], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:37:13.908751 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:37:13 UTC]... [----] I, [2016-09-13T04:37:13.929172 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:37:13 UTC]...Complete [----] I, [2016-09-13T04:37:13.940802 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:37:14.391874 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76341], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.170109772] seconds [----] I, [2016-09-13T04:37:14.392086 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76341], Delivering... [----] I, [2016-09-13T04:37:14.398639 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033822059631347656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034036636352539062, :pending_vm_jobs=>0.0008454322814941406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006087303161621094} [----] I, [2016-09-13T04:37:14.399038 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76341], State: [ok], Delivered in [0.006967292] seconds [----] I, [2016-09-13T04:37:24.251765 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:37:24.271940 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76342], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:37:24.284303 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76343], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:37:24.295723 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76344], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:37:24.313032 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76345], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:37:25.397378 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:37:25.404088 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0065152645111083984, :worker_monitor=>1.419853925704956, :worker_dequeue=>0.011813163757324219, :total_time=>1.4386563301086426} [----] I, [2016-09-13T04:37:25.481563 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76343], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.205196846] seconds [----] I, [2016-09-13T04:37:25.481738 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76343], Delivering... [----] I, [2016-09-13T04:37:25.512196 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76345], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.207192663] seconds [----] I, [2016-09-13T04:37:25.512504 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76345], Delivering... [----] I, [2016-09-13T04:37:25.521852 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0049359798431396484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0049626827239990234, :pending_vm_jobs=>0.0011112689971923828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00886678695678711} [----] I, [2016-09-13T04:37:25.522263 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76345], State: [ok], Delivered in [0.009821554] seconds [----] I, [2016-09-13T04:37:25.527870 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76343], State: [ok], Delivered in [0.046096945] seconds [----] I, [2016-09-13T04:37:26.676796 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76342], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.420078776] seconds [----] I, [2016-09-13T04:37:26.677005 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76342], Delivering... [----] I, [2016-09-13T04:37:26.682874 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76342], State: [ok], Delivered in [0.005856567] seconds [----] I, [2016-09-13T04:37:26.711719 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76344], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.421659716] seconds [----] I, [2016-09-13T04:37:26.712052 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76344], Delivering... [----] I, [2016-09-13T04:37:26.717065 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76344], State: [ok], Delivered in [0.005036858] seconds [----] I, [2016-09-13T04:37:39.325691 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:37:39.368207 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76346], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:37:41.805777 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:37:41.815772 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004805326461791992, :worker_monitor=>1.35383939743042, :worker_dequeue=>0.017961978912353516, :total_time=>1.3770415782928467} [----] I, [2016-09-13T04:37:41.906907 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76346], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.575324431] seconds [----] I, [2016-09-13T04:37:41.907112 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76346], Delivering... [----] I, [2016-09-13T04:37:41.914482 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003931999206542969, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003958702087402344, :pending_vm_jobs=>0.0008318424224853516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00680994987487793} [----] I, [2016-09-13T04:37:41.914858 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76346], State: [ok], Delivered in [0.007739101] seconds [----] I, [2016-09-13T04:37:46.816341 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:37:46 UTC]... [----] I, [2016-09-13T04:37:46.843944 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:37:46 UTC]...Complete [----] I, [2016-09-13T04:37:54.380252 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:37:54.404587 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76347], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:37:54.442908 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76348], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:37:58.432893 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:37:58.438906 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004614353179931641, :worker_monitor=>1.5425899028778076, :worker_dequeue=>0.010724782943725586, :total_time=>1.558290719985962} [----] I, [2016-09-13T04:37:58.799014 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76348], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.388633428] seconds [----] I, [2016-09-13T04:37:58.799262 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76348], Delivering... [----] I, [2016-09-13T04:37:58.806509 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037882328033447266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038170814514160156, :pending_vm_jobs=>0.0008358955383300781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006701231002807617} [----] I, [2016-09-13T04:37:58.806965 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76348], State: [ok], Delivered in [0.007716466] seconds [----] I, [2016-09-13T04:37:59.844702 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76347], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.459922376] seconds [----] I, [2016-09-13T04:37:59.844907 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76347], Delivering... [----] I, [2016-09-13T04:37:59.850377 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76347], State: [ok], Delivered in [0.005471318] seconds [----] I, [2016-09-13T04:38:09.456866 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:38:09.480173 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76349], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:38:15.154594 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:38:15.161045 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004154205322265625, :worker_monitor=>1.5575695037841797, :worker_dequeue=>0.011152982711791992, :total_time=>1.5731632709503174} [----] I, [2016-09-13T04:38:15.896234 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76349], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.430221552] seconds [----] I, [2016-09-13T04:38:15.896491 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76349], Delivering... [----] I, [2016-09-13T04:38:15.903577 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035860538482666016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003612995147705078, :pending_vm_jobs=>0.0008714199066162109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006617307662963867} [----] I, [2016-09-13T04:38:15.903944 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76349], State: [ok], Delivered in [0.007503843] seconds [----] I, [2016-09-13T04:38:20.161604 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:38:20 UTC]... [----] I, [2016-09-13T04:38:20.181659 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:38:20 UTC]...Complete [----] I, [2016-09-13T04:38:24.493352 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T04:38:24.513472 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76350], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:38:24.524707 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76351], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:38:24.536072 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76352], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:38:24.547544 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76353], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:38:24.560075 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76354], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:38:24.588729 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76355], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:38:25.208256 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:38:25.989689 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76350], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.489533565] seconds [----] I, [2016-09-13T04:38:25.989871 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76350], Delivering... [----] I, [2016-09-13T04:38:25.991174 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T04:38:25.991443 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5340696576 [----] I, [2016-09-13T04:38:25.991559 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5125750784 [----] I, [2016-09-13T04:38:25.991663 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 214945792 [----] I, [2016-09-13T04:38:25.991747 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1314914304 [----] I, [2016-09-13T04:38:25.991826 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5071798272 [----] I, [2016-09-13T04:38:25.991902 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T04:38:25.992002 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T04:38:25.992091 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 535711744 [----] I, [2016-09-13T04:38:25.992181 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T04:38:25.992267 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8040374272 [----] I, [2016-09-13T04:38:25.992343 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T04:38:25.992490 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T04:38:25.992578 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T04:38:25.992661 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 16384 [----] I, [2016-09-13T04:38:25.992741 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T04:38:25.992834 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T04:38:25.992905 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T04:38:25.992976 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T04:38:25.993050 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T04:38:25.993129 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T04:38:25.993203 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273035264 [----] I, [2016-09-13T04:38:25.993280 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56217600 [----] I, [2016-09-13T04:38:25.993364 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216817664 [----] I, [2016-09-13T04:38:25.993484 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6242304 [----] I, [2016-09-13T04:38:25.993572 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140615680 [----] I, [2016-09-13T04:38:25.993648 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2595647488 [----] I, [2016-09-13T04:38:25.993723 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2285723648 [----] I, [2016-09-13T04:38:25.993796 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T04:38:25.993871 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T04:38:25.993942 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T04:38:25.994015 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37810176 [----] I, [2016-09-13T04:38:25.994104 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102285312 [----] I, [2016-09-13T04:38:25.994190 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53252096 [----] I, [2016-09-13T04:38:25.994263 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110170112 [----] I, [2016-09-13T04:38:25.994283 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76351], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.476749596] seconds [----] I, [2016-09-13T04:38:25.994332 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155537408 [----] I, [2016-09-13T04:38:25.994447 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T04:38:25.994503 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76351], Delivering... [----] I, [2016-09-13T04:38:25.994544 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T04:38:25.994623 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T04:38:25.994700 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T04:38:25.994777 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T04:38:25.994853 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T04:38:25.994929 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T04:38:25.995005 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T04:38:25.995084 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T04:38:26.002783 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:38:14 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [147395.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:38:26.003353 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:38:14 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [148327.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:38:26.003956 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:38:09 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [234518.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T04:38:26.004697 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:38:13 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347147000], Memory % [5.04], CPU Time [102998.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T04:38:26.005341 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:38:10 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [48012.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T04:38:26.006165 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:38:13 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162416000], Memory % [3.1], CPU Time [37129.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T04:38:26.006994 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:38:12 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358680000], Memory % [5.28], CPU Time [197491.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T04:38:26.007769 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:38:13 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50365.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:38:26.011821 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:38:11 UTC], Process Info: Memory Usage [589967360], Memory Size [944922624], Proportional Set Size: [426986000], Memory % [7.19], CPU Time [426.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:38:26.015056 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:38:12 UTC], Process Info: Memory Usage [597696512], Memory Size [1042010112], Proportional Set Size: [434881000], Memory % [7.29], CPU Time [1097.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:38:26.018519 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:38:09 UTC], Process Info: Memory Usage [580894720], Memory Size [937881600], Proportional Set Size: [420260000], Memory % [7.08], CPU Time [1102.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T04:38:26.021741 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:38:06 UTC], Process Info: Memory Usage [558460928], Memory Size [929497088], Proportional Set Size: [406105000], Memory % [6.81], CPU Time [4449.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T04:38:26.022604 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:38:14 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [206125.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T04:38:26.023462 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:38:14 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [50407.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:38:26.024116 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:38:06 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165800000], Memory % [3.16], CPU Time [38017.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T04:38:26.024528 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76351], State: [ok], Delivered in [0.030040012] seconds [----] I, [2016-09-13T04:38:26.042491 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T04:38:26.042699 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T04:38:26.047293 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T04:38:26.050672 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T04:38:26.054704 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T04:38:26.058373 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T04:38:26.062150 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T04:38:26.065666 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 836 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T04:38:26.069271 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T04:38:26.072917 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T04:38:26.076434 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.6 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T04:38:26.080090 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76353], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.54022976] seconds [----] I, [2016-09-13T04:38:26.080263 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76353], Delivering... [----] I, [2016-09-13T04:38:26.080302 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T04:38:26.084436 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T04:38:26.087797 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T04:38:26.090812 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>2}} [----] I, [2016-09-13T04:38:26.090977 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:38:26.091087 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T04:38:26.095811 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358679000], Memory % [5.28], CPU Time [148315.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T04:38:26.096145 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76350], State: [ok], Delivered in [0.106263045] seconds [----] I, [2016-09-13T04:38:26.131060 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76353], State: [ok], Delivered in [0.050788844] seconds [----] I, [2016-09-13T04:38:26.154196 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76355], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.585197803] seconds [----] I, [2016-09-13T04:38:26.154434 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76355], Delivering... [----] I, [2016-09-13T04:38:26.161618 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003703594207763672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003731966018676758, :pending_vm_jobs=>0.0009877681732177734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0067293643951416016} [----] I, [2016-09-13T04:38:26.161986 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76355], State: [ok], Delivered in [0.007580444] seconds [----] I, [2016-09-13T04:38:26.938008 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76352], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.409179256] seconds [----] I, [2016-09-13T04:38:26.938205 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76352], Delivering... [----] I, [2016-09-13T04:38:26.943238 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76352], State: [ok], Delivered in [0.00502384] seconds [----] I, [2016-09-13T04:38:26.965557 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76354], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.412966229] seconds [----] I, [2016-09-13T04:38:26.965735 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76354], Delivering... [----] I, [2016-09-13T04:38:26.969033 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76354], State: [ok], Delivered in [0.003293053] seconds [----] I, [2016-09-13T04:38:31.407325 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004196882247924805, :worker_monitor=>1.181485652923584, :worker_dequeue=>0.006188631057739258, :total_time=>1.192105770111084} [----] I, [2016-09-13T04:38:39.602347 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:38:39.645781 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76356], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:38:41.433471 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:38:42.034854 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76356], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.425836629] seconds [----] I, [2016-09-13T04:38:42.035085 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76356], Delivering... [----] I, [2016-09-13T04:38:42.047753 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.006406068801879883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0064427852630615234, :pending_vm_jobs=>0.0014314651489257812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.012054443359375} [----] I, [2016-09-13T04:38:42.048358 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76356], State: [ok], Delivered in [0.013255268] seconds [----] I, [2016-09-13T04:38:47.798165 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004034757614135742, :worker_monitor=>1.3418669700622559, :worker_dequeue=>0.01123809814453125, :total_time=>1.3574576377868652} [----] I, [2016-09-13T04:38:52.798707 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:38:52 UTC]... [----] I, [2016-09-13T04:38:52.818039 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:38:52 UTC]...Complete [----] I, [2016-09-13T04:38:54.659114 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:38:54.680116 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76357], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:38:54.706851 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76358], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:38:57.846065 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:38:58.421376 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76358], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.73263635] seconds [----] I, [2016-09-13T04:38:58.421699 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76358], Delivering... [----] I, [2016-09-13T04:38:58.429780 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004187583923339844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004319667816162109, :pending_vm_jobs=>0.0009257793426513672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0075609683990478516} [----] I, [2016-09-13T04:38:58.430232 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76358], State: [ok], Delivered in [0.008547891] seconds [----] I, [2016-09-13T04:39:00.158147 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76357], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.490010711] seconds [----] I, [2016-09-13T04:39:00.158374 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76357], Delivering... [----] I, [2016-09-13T04:39:00.164471 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76357], State: [ok], Delivered in [0.006064758] seconds [----] I, [2016-09-13T04:39:04.472255 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005010128021240234, :worker_monitor=>1.599050760269165, :worker_dequeue=>0.014485359191894531, :total_time=>1.6189777851104736} [----] I, [2016-09-13T04:39:09.720083 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:39:09.747058 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76359], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:39:14.621936 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:39:15.221166 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76359], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.49441472] seconds [----] I, [2016-09-13T04:39:15.221329 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76359], Delivering... [----] I, [2016-09-13T04:39:15.225933 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024399757385253906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002460002899169922, :pending_vm_jobs=>0.0005786418914794922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004267215728759766} [----] I, [2016-09-13T04:39:15.226207 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76359], State: [ok], Delivered in [0.004881483] seconds [----] I, [2016-09-13T04:39:20.960462 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003780841827392578, :worker_monitor=>1.3130059242248535, :worker_dequeue=>0.010928153991699219, :total_time=>1.328042984008789} [----] I, [2016-09-13T04:39:24.761449 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:39:24.786738 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76360], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:39:24.803796 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76361], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:39:24.821044 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76362], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:39:24.832242 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76363], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:39:25.961031 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:39:25 UTC]... [----] I, [2016-09-13T04:39:25.975194 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:39:25 UTC]...Complete [----] I, [2016-09-13T04:39:25.986687 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:39:26.632662 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76361], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.842406576] seconds [----] I, [2016-09-13T04:39:26.632861 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76361], Delivering... [----] I, [2016-09-13T04:39:26.695289 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76361], State: [ok], Delivered in [0.062406723] seconds [----] I, [2016-09-13T04:39:26.701543 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76363], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.873144056] seconds [----] I, [2016-09-13T04:39:26.701801 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76363], Delivering... [----] I, [2016-09-13T04:39:26.711662 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005393266677856445, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0054247379302978516, :pending_vm_jobs=>0.0013632774353027344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009395837783813477} [----] I, [2016-09-13T04:39:26.712028 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76363], State: [ok], Delivered in [0.010242548] seconds [----] I, [2016-09-13T04:39:27.262226 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76360], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.495892295] seconds [----] I, [2016-09-13T04:39:27.262527 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76360], Delivering... [----] I, [2016-09-13T04:39:27.268787 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76360], State: [ok], Delivered in [0.006254831] seconds [----] I, [2016-09-13T04:39:27.318841 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76362], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.510152851] seconds [----] I, [2016-09-13T04:39:27.319154 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76362], Delivering... [----] I, [2016-09-13T04:39:27.324611 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76362], State: [ok], Delivered in [0.005445821] seconds [----] I, [2016-09-13T04:39:37.178663 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0034449100494384766, :worker_monitor=>1.158370018005371, :worker_dequeue=>0.006567955017089844, :total_time=>1.168682336807251} [----] I, [2016-09-13T04:39:39.846317 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:39:39.867848 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76364], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:39:42.188557 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:39:42.399339 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76364], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.546026339] seconds [----] I, [2016-09-13T04:39:42.399579 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76364], Delivering... [----] I, [2016-09-13T04:39:42.406805 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037221908569335938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038106441497802734, :pending_vm_jobs=>0.0009291172027587891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006802558898925781} [----] I, [2016-09-13T04:39:42.407183 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76364], State: [ok], Delivered in [0.007604162] seconds [----] I, [2016-09-13T04:39:53.407471 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00419306755065918, :worker_monitor=>1.1898531913757324, :worker_dequeue=>0.006861686706542969, :total_time=>1.2011609077453613} [----] I, [2016-09-13T04:39:54.880063 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:39:54.897274 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76365], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:39:54.913326 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76366], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:39:58.407922 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:39:58 UTC]... [----] I, [2016-09-13T04:39:58.450492 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:39:58 UTC]...Complete [----] I, [2016-09-13T04:39:58.461580 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:39:58.948029 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76366], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.044442065] seconds [----] I, [2016-09-13T04:39:58.948241 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76366], Delivering... [----] I, [2016-09-13T04:39:58.955707 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004041910171508789, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004066944122314453, :pending_vm_jobs=>0.0008788108825683594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0069959163665771484} [----] I, [2016-09-13T04:39:58.956103 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76366], State: [ok], Delivered in [0.007861186] seconds [----] I, [2016-09-13T04:40:00.479293 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76365], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.594835037] seconds [----] I, [2016-09-13T04:40:00.479582 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76365], Delivering... [----] I, [2016-09-13T04:40:00.485269 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76365], State: [ok], Delivered in [0.005691432] seconds [----] I, [2016-09-13T04:40:09.929651 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T04:40:09.949299 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76367], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:40:09.960808 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76368], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:40:09.972168 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76369], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:40:09.974438 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:40:09.980755 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004936933517456055, :worker_monitor=>1.48091721534729, :worker_dequeue=>0.011306285858154297, :total_time=>1.4975736141204834} [----] I, [2016-09-13T04:40:09.983660 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76370], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:40:12.532938 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76367], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.59801709] seconds [----] I, [2016-09-13T04:40:12.533180 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76367], Delivering... [----] I, [2016-09-13T04:40:12.535908 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76367], State: [ok], Delivered in [0.00273164] seconds [----] I, [2016-09-13T04:40:12.561403 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76368], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.607558861] seconds [----] I, [2016-09-13T04:40:12.561627 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76368], Delivering... [----] I, [2016-09-13T04:40:12.566916 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76369], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.601094586] seconds [----] I, [2016-09-13T04:40:12.567109 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76369], Delivering... [----] I, [2016-09-13T04:40:12.573445 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76368], State: [ok], Delivered in [0.011758412] seconds [----] I, [2016-09-13T04:40:12.574506 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76369], State: [ok], Delivered in [0.007386997] seconds [----] I, [2016-09-13T04:40:15.109566 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:40:15.612970 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76370], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.635729902] seconds [----] I, [2016-09-13T04:40:15.613153 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76370], Delivering... [----] I, [2016-09-13T04:40:15.620127 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035431385040283203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035691261291503906, :pending_vm_jobs=>0.0008785724639892578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065157413482666016} [----] I, [2016-09-13T04:40:15.620530 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76370], State: [ok], Delivered in [0.00737167] seconds [----] I, [2016-09-13T04:40:24.995717 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:40:25.012694 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76371], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:40:25.030126 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76372], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:40:25.046852 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76373], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:40:25.063992 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76374], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:40:26.815048 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:40:26.821872 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004584789276123047, :worker_monitor=>1.6676826477050781, :worker_dequeue=>0.012121200561523438, :total_time=>1.6846671104431152} [----] I, [2016-09-13T04:40:27.191175 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76372], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.174482599] seconds [----] I, [2016-09-13T04:40:27.191369 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76372], Delivering... [----] I, [2016-09-13T04:40:27.201453 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76374], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.145239649] seconds [----] I, [2016-09-13T04:40:27.201692 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76374], Delivering... [----] I, [2016-09-13T04:40:27.208893 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037517547607421875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037772655487060547, :pending_vm_jobs=>0.0009081363677978516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006781578063964844} [----] I, [2016-09-13T04:40:27.209288 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76374], State: [ok], Delivered in [0.00759949] seconds [----] I, [2016-09-13T04:40:27.264302 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76372], State: [ok], Delivered in [0.072900015] seconds [----] I, [2016-09-13T04:40:27.641510 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76371], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.640189448] seconds [----] I, [2016-09-13T04:40:27.641715 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76371], Delivering... [----] I, [2016-09-13T04:40:27.647170 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76371], State: [ok], Delivered in [0.005453366] seconds [----] I, [2016-09-13T04:40:27.676041 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76373], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.640758487] seconds [----] I, [2016-09-13T04:40:27.676243 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76373], Delivering... [----] I, [2016-09-13T04:40:27.679894 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76373], State: [ok], Delivered in [0.003645178] seconds [----] I, [2016-09-13T04:40:31.822616 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:40:31 UTC]... [----] I, [2016-09-13T04:40:31.841195 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:40:31 UTC]...Complete [----] I, [2016-09-13T04:40:40.076847 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:40:40.092893 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76375], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:40:43.513296 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:40:43.520198 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005235433578491211, :worker_monitor=>1.618816614151001, :worker_dequeue=>0.01249384880065918, :total_time=>1.6369438171386719} [----] I, [2016-09-13T04:40:44.344481 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76375], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.260956882] seconds [----] I, [2016-09-13T04:40:44.344700 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76375], Delivering... [----] I, [2016-09-13T04:40:44.351756 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036163330078125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036439895629882812, :pending_vm_jobs=>0.0008945465087890625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00665736198425293} [----] I, [2016-09-13T04:40:44.352165 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76375], State: [ok], Delivered in [0.007453635] seconds [----] I, [2016-09-13T04:40:55.105911 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:40:55.123115 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76376], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:40:55.138644 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76377], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:40:59.930855 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:40:59.939022 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005192995071411133, :worker_monitor=>1.363976240158081, :worker_dequeue=>0.014557361602783203, :total_time=>1.384157657623291} [----] I, [2016-09-13T04:41:00.532078 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76377], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.403300673] seconds [----] I, [2016-09-13T04:41:00.532314 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76377], Delivering... [----] I, [2016-09-13T04:41:00.540575 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004118680953979492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00414276123046875, :pending_vm_jobs=>0.0008883476257324219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007680654525756836} [----] I, [2016-09-13T04:41:00.541011 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76377], State: [ok], Delivered in [0.00869837] seconds [----] I, [2016-09-13T04:41:00.783360 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76376], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.672396305] seconds [----] I, [2016-09-13T04:41:00.783636 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76376], Delivering... [----] I, [2016-09-13T04:41:00.789717 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76376], State: [ok], Delivered in [0.006076611] seconds [----] I, [2016-09-13T04:41:04.939648 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:41:04 UTC]... [----] I, [2016-09-13T04:41:04.961365 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:41:04 UTC]...Complete [----] I, [2016-09-13T04:41:10.150435 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:41:10.162470 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76378], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:41:16.403864 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:41:16.410872 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004221200942993164, :server_monitor=>0.10350203514099121, :worker_monitor=>1.29274320602417, :worker_dequeue=>0.012502193450927734, :total_time=>1.4134430885314941} [----] I, [2016-09-13T04:41:16.606581 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76378], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.449785836] seconds [----] I, [2016-09-13T04:41:16.606806 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76378], Delivering... [----] I, [2016-09-13T04:41:16.614647 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0039865970611572266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004056215286254883, :pending_vm_jobs=>0.0009365081787109375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007378339767456055} [----] I, [2016-09-13T04:41:16.615051 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76378], State: [ok], Delivered in [0.008232606] seconds [----] I, [2016-09-13T04:41:25.173920 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:41:25.195131 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76379], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:41:25.206285 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76380], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:41:25.217659 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76381], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:41:25.234875 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76382], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:41:26.436917 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:41:26.726642 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76380], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.527356502] seconds [----] I, [2016-09-13T04:41:26.726819 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76380], Delivering... [----] I, [2016-09-13T04:41:26.732490 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76382], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.505783383] seconds [----] I, [2016-09-13T04:41:26.732670 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76382], Delivering... [----] I, [2016-09-13T04:41:26.739502 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003486156463623047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003512144088745117, :pending_vm_jobs=>0.0008153915405273438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006413459777832031} [----] I, [2016-09-13T04:41:26.739918 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76382], State: [ok], Delivered in [0.007224669] seconds [----] I, [2016-09-13T04:41:26.858243 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76380], State: [ok], Delivered in [0.131370804] seconds [----] I, [2016-09-13T04:41:27.921990 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76379], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.74307819] seconds [----] I, [2016-09-13T04:41:27.922199 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76379], Delivering... [----] I, [2016-09-13T04:41:27.927749 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76379], State: [ok], Delivered in [0.005552685] seconds [----] I, [2016-09-13T04:41:27.932541 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76381], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.720820405] seconds [----] I, [2016-09-13T04:41:27.932697 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76381], Delivering... [----] I, [2016-09-13T04:41:27.935810 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76381], State: [ok], Delivered in [0.003106122] seconds [----] I, [2016-09-13T04:41:32.748146 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00656437873840332, :worker_monitor=>1.2848706245422363, :worker_dequeue=>0.011948823928833008, :total_time=>1.3040032386779785} [----] I, [2016-09-13T04:41:37.748736 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:41:37 UTC]... [----] I, [2016-09-13T04:41:37.766562 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:41:37 UTC]...Complete [----] I, [2016-09-13T04:41:40.246052 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:41:40.286674 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76383], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:41:42.804257 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:41:42.859367 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76383], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.607651111] seconds [----] I, [2016-09-13T04:41:42.859577 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76383], Delivering... [----] I, [2016-09-13T04:41:42.865725 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031533241271972656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003171205520629883, :pending_vm_jobs=>0.0007758140563964844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005808830261230469} [----] I, [2016-09-13T04:41:42.866056 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76383], State: [ok], Delivered in [0.006475056] seconds [----] I, [2016-09-13T04:41:49.293464 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00404810905456543, :worker_monitor=>1.4679598808288574, :worker_dequeue=>0.01007986068725586, :total_time=>1.4823477268218994} [----] I, [2016-09-13T04:41:54.316568 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T04:41:55.298254 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:41:55.309708 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76384], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:41:55.320803 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76385], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:41:59.345826 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:42:00.041043 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76385], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.726121466] seconds [----] I, [2016-09-13T04:42:00.041234 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76385], Delivering... [----] I, [2016-09-13T04:42:00.047691 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003293752670288086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003313779830932617, :pending_vm_jobs=>0.0008347034454345703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006045341491699219} [----] I, [2016-09-13T04:42:00.048080 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76385], State: [ok], Delivered in [0.00684467] seconds [----] I, [2016-09-13T04:42:01.064102 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76384], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.761291716] seconds [----] I, [2016-09-13T04:42:01.064332 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76384], Delivering... [----] I, [2016-09-13T04:42:01.070204 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76384], State: [ok], Delivered in [0.005876466] seconds [----] I, [2016-09-13T04:42:05.634928 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006545066833496094, :worker_monitor=>1.269174337387085, :worker_dequeue=>0.0062792301177978516, :total_time=>1.2823963165283203} [----] I, [2016-09-13T04:42:10.332784 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:42:10.357828 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76386], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:42:10.635783 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:42:10 UTC]... [----] I, [2016-09-13T04:42:10.666484 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:42:10 UTC]...Complete [----] I, [2016-09-13T04:42:10.679389 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:42:11.164097 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76386], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.823630195] seconds [----] I, [2016-09-13T04:42:11.164475 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76386], Delivering... [----] I, [2016-09-13T04:42:11.175873 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0059854984283447266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.006157636642456055, :pending_vm_jobs=>0.0017070770263671875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010858535766601562} [----] I, [2016-09-13T04:42:11.176335 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76386], State: [ok], Delivered in [0.011939909] seconds [----] I, [2016-09-13T04:42:22.240587 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0071735382080078125, :worker_monitor=>1.4122028350830078, :worker_dequeue=>0.016844511032104492, :total_time=>1.4365496635437012} [----] I, [2016-09-13T04:42:25.371730 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:42:25.392214 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76387], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:42:25.403285 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76388], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:42:25.414737 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76389], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:42:25.431967 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76390], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:42:27.249364 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:42:27.277876 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76388], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.881696886] seconds [----] I, [2016-09-13T04:42:27.278049 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76388], Delivering... [----] I, [2016-09-13T04:42:27.323619 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76390], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.901058768] seconds [----] I, [2016-09-13T04:42:27.323806 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76390], Delivering... [----] I, [2016-09-13T04:42:27.329066 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76388], State: [ok], Delivered in [0.050996674] seconds [----] I, [2016-09-13T04:42:27.330698 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003493785858154297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035161972045898438, :pending_vm_jobs=>0.0009071826934814453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065419673919677734} [----] I, [2016-09-13T04:42:27.331068 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76390], State: [ok], Delivered in [0.007250446] seconds [----] I, [2016-09-13T04:42:28.129634 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76387], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.752815334] seconds [----] I, [2016-09-13T04:42:28.129860 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76387], Delivering... [----] I, [2016-09-13T04:42:28.136048 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76387], State: [ok], Delivered in [0.006156413] seconds [----] I, [2016-09-13T04:42:28.157905 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76389], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.749869992] seconds [----] I, [2016-09-13T04:42:28.158076 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76389], Delivering... [----] I, [2016-09-13T04:42:28.165158 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76389], State: [ok], Delivered in [0.007075244] seconds [----] I, [2016-09-13T04:42:38.722542 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037980079650878906, :worker_monitor=>1.4342291355133057, :worker_dequeue=>0.011661052703857422, :total_time=>1.450071096420288} [----] I, [2016-09-13T04:42:40.443081 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:42:40.455187 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76391], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:42:43.723126 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:42:43 UTC]... [----] I, [2016-09-13T04:42:43.746811 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:42:43 UTC]...Complete [----] I, [2016-09-13T04:42:43.764888 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:42:44.464518 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76391], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.016254395] seconds [----] I, [2016-09-13T04:42:44.464675 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76391], Delivering... [----] I, [2016-09-13T04:42:44.471828 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031974315643310547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033609867095947266, :pending_vm_jobs=>0.001119852066040039, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0067901611328125} [----] I, [2016-09-13T04:42:44.472303 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76391], State: [ok], Delivered in [0.007600278] seconds [----] I, [2016-09-13T04:42:55.406824 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004140615463256836, :worker_monitor=>1.6069939136505127, :worker_dequeue=>0.008894205093383789, :total_time=>1.6203393936157227} [----] I, [2016-09-13T04:42:55.469322 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:42:55.487286 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76392], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:42:55.501065 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76393], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:43:00.416761 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:43:00.592900 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76393], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.100842126] seconds [----] I, [2016-09-13T04:43:00.593101 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76393], Delivering... [----] I, [2016-09-13T04:43:00.601277 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003866434097290039, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003890514373779297, :pending_vm_jobs=>0.0009126663208007812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007651329040527344} [----] I, [2016-09-13T04:43:00.601799 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76393], State: [ok], Delivered in [0.008670062] seconds [----] I, [2016-09-13T04:43:01.318828 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76392], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.842514479] seconds [----] I, [2016-09-13T04:43:01.318971 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76392], Delivering... [----] I, [2016-09-13T04:43:01.323137 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76392], State: [ok], Delivered in [0.004142833] seconds [----] I, [2016-09-13T04:43:10.515338 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:43:10.529792 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76394], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:43:11.780011 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:43:11.786753 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003952980041503906, :worker_monitor=>1.3311941623687744, :worker_dequeue=>0.01272273063659668, :total_time=>1.3482434749603271} [----] I, [2016-09-13T04:43:12.678799 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76394], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.15775683] seconds [----] I, [2016-09-13T04:43:12.678990 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76394], Delivering... [----] I, [2016-09-13T04:43:12.685480 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003264904022216797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032858848571777344, :pending_vm_jobs=>0.0008571147918701172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060787200927734375} [----] I, [2016-09-13T04:43:12.685896 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76394], State: [ok], Delivered in [0.006898766] seconds [----] I, [2016-09-13T04:43:16.787344 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:43:16 UTC]... [----] I, [2016-09-13T04:43:16.832972 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:43:16 UTC]...Complete [----] I, [2016-09-13T04:43:25.541785 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T04:43:25.558667 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76395], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:43:25.569990 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76396], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:43:25.581618 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76397], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:43:25.592775 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76398], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:43:25.604130 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76399], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:43:25.621343 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76400], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:43:28.228429 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:43:28.233646 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004006385803222656, :worker_monitor=>1.1929306983947754, :worker_dequeue=>0.009502410888671875, :total_time=>1.2067615985870361} [----] I, [2016-09-13T04:43:28.370390 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76395], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.823518206] seconds [----] I, [2016-09-13T04:43:28.370596 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76395], Delivering... [----] I, [2016-09-13T04:43:28.371903 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T04:43:28.372141 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5324996608 [----] I, [2016-09-13T04:43:28.372270 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5109866496 [----] I, [2016-09-13T04:43:28.372398 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 215130112 [----] I, [2016-09-13T04:43:28.372523 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1317011456 [----] I, [2016-09-13T04:43:28.372608 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5055913984 [----] I, [2016-09-13T04:43:28.372702 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T04:43:28.372812 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T04:43:28.372917 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 535896064 [----] I, [2016-09-13T04:43:28.373018 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T04:43:28.373126 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7820091392 [----] I, [2016-09-13T04:43:28.373211 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T04:43:28.373290 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T04:43:28.373377 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T04:43:28.373483 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 0 [----] I, [2016-09-13T04:43:28.373568 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T04:43:28.373647 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T04:43:28.373720 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T04:43:28.373796 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T04:43:28.373870 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T04:43:28.373944 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T04:43:28.374018 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273035264 [----] I, [2016-09-13T04:43:28.374094 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56217600 [----] I, [2016-09-13T04:43:28.374171 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216817664 [----] I, [2016-09-13T04:43:28.374253 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T04:43:28.374328 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140615680 [----] I, [2016-09-13T04:43:28.374439 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2612068352 [----] I, [2016-09-13T04:43:28.374530 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2301960192 [----] I, [2016-09-13T04:43:28.374610 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T04:43:28.374687 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T04:43:28.374763 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T04:43:28.374842 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37511168 [----] I, [2016-09-13T04:43:28.374919 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102285312 [----] I, [2016-09-13T04:43:28.374995 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53190656 [----] I, [2016-09-13T04:43:28.375073 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110170112 [----] I, [2016-09-13T04:43:28.375149 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155475968 [----] I, [2016-09-13T04:43:28.375222 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T04:43:28.375308 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T04:43:28.375458 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T04:43:28.375582 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T04:43:28.375687 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T04:43:28.375790 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T04:43:28.375873 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T04:43:28.375951 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T04:43:28.376028 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T04:43:28.410176 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76398], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.824144736] seconds [----] I, [2016-09-13T04:43:28.410332 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76398], Delivering... [----] I, [2016-09-13T04:43:28.428604 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T04:43:28.428817 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T04:43:28.432922 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T04:43:28.436153 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T04:43:28.439938 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T04:43:28.443630 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T04:43:28.447161 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T04:43:28.450831 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 837 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T04:43:28.454773 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T04:43:28.460824 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T04:43:28.464434 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T04:43:28.467997 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T04:43:28.471594 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T04:43:28.472914 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76398], State: [ok], Delivered in [0.06255987] seconds [----] I, [2016-09-13T04:43:28.474870 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T04:43:28.477753 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>2}} [----] I, [2016-09-13T04:43:28.477873 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:43:28.477994 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>3, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T04:43:28.481998 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357639000], Memory % [5.27], CPU Time [206167.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T04:43:28.482313 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76395], State: [ok], Delivered in [0.111705363] seconds [----] I, [2016-09-13T04:43:28.501609 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76400], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.888354453] seconds [----] I, [2016-09-13T04:43:28.501784 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76400], Delivering... [----] I, [2016-09-13T04:43:28.507165 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76397], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.933359369] seconds [----] I, [2016-09-13T04:43:28.507308 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76397], Delivering... [----] I, [2016-09-13T04:43:28.508386 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032927989959716797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033125877380371094, :pending_vm_jobs=>0.0009655952453613281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006242275238037109} [----] I, [2016-09-13T04:43:28.508750 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76400], State: [ok], Delivered in [0.006964392] seconds [----] I, [2016-09-13T04:43:28.510969 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76397], State: [ok], Delivered in [0.003659978] seconds [----] I, [2016-09-13T04:43:28.535774 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76399], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.937276654] seconds [----] I, [2016-09-13T04:43:28.535939 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76399], Delivering... [----] I, [2016-09-13T04:43:28.538830 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76399], State: [ok], Delivered in [0.00287524] seconds [----] I, [2016-09-13T04:43:33.240161 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:43:33.867599 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76396], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.304832765] seconds [----] I, [2016-09-13T04:43:33.867766 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76396], Delivering... [----] I, [2016-09-13T04:43:33.874687 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:43:25 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [234651.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T04:43:33.875224 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:43:26 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162416000], Memory % [3.1], CPU Time [37166.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T04:43:33.875666 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:43:25 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347147000], Memory % [5.04], CPU Time [103060.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T04:43:33.876122 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:43:25 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358680000], Memory % [5.28], CPU Time [197524.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T04:43:33.876630 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:43:27 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [148400.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:43:33.877035 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:43:27 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [147473.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:43:33.877511 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:43:26 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50404.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:43:33.877895 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:43:23 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [48061.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T04:43:33.880355 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:43:19 UTC], Process Info: Memory Usage [580009984], Memory Size [908509184], Proportional Set Size: [419396000], Memory % [7.07], CPU Time [1159.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T04:43:33.880855 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:43:25 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [206166.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T04:43:33.881289 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:43:26 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [50423.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:43:33.881721 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:43:19 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165800000], Memory % [3.16], CPU Time [38059.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T04:43:33.883624 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:43:22 UTC], Process Info: Memory Usage [587247616], Memory Size [915996672], Proportional Set Size: [424330000], Memory % [7.16], CPU Time [486.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:43:33.885523 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:43:23 UTC], Process Info: Memory Usage [586276864], Memory Size [915906560], Proportional Set Size: [423729000], Memory % [7.15], CPU Time [1164.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:43:33.887461 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:43:26 UTC], Process Info: Memory Usage [557740032], Memory Size [894844928], Proportional Set Size: [405281000], Memory % [6.8], CPU Time [4514.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T04:43:33.887772 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76396], State: [ok], Delivered in [0.01998124] seconds [----] I, [2016-09-13T04:43:40.632943 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:43:40.644451 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76401], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:43:44.354663 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:43:44.359253 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004331827163696289, :worker_monitor=>1.0805652141571045, :worker_dequeue=>0.008965730667114258, :total_time=>1.0941667556762695} [----] I, [2016-09-13T04:43:44.930769 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76401], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.292050151] seconds [----] I, [2016-09-13T04:43:44.930952 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76401], Delivering... [----] I, [2016-09-13T04:43:44.936261 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002797365188598633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002815723419189453, :pending_vm_jobs=>0.0007262229919433594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004989147186279297} [----] I, [2016-09-13T04:43:44.936577 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76401], State: [ok], Delivered in [0.005632896] seconds [----] I, [2016-09-13T04:43:49.359994 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:43:49 UTC]... [----] I, [2016-09-13T04:43:49.382297 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:43:49 UTC]...Complete [----] I, [2016-09-13T04:43:55.655717 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:43:55.679777 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76402], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:43:55.690814 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76403], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:44:00.822243 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:44:00.827010 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004645824432373047, :worker_monitor=>1.3955535888671875, :worker_dequeue=>0.008388519287109375, :total_time=>1.408928394317627} [----] I, [2016-09-13T04:44:01.068212 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76403], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.382976209] seconds [----] I, [2016-09-13T04:44:01.068392 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76403], Delivering... [----] I, [2016-09-13T04:44:01.073555 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027556419372558594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027725696563720703, :pending_vm_jobs=>0.0006356239318847656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0048024654388427734} [----] I, [2016-09-13T04:44:01.073865 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76403], State: [ok], Delivered in [0.005486563] seconds [----] I, [2016-09-13T04:44:01.670107 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76402], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.005516371] seconds [----] I, [2016-09-13T04:44:01.670338 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76402], Delivering... [----] I, [2016-09-13T04:44:01.676187 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76402], State: [ok], Delivered in [0.005845897] seconds [----] I, [2016-09-13T04:44:10.702710 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:44:10.719869 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76404], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:44:10.853828 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:44:11.150660 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76404], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.441503639] seconds [----] I, [2016-09-13T04:44:11.150859 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76404], Delivering... [----] I, [2016-09-13T04:44:11.157334 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033545494079589844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003374338150024414, :pending_vm_jobs=>0.0007696151733398438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006061553955078125} [----] I, [2016-09-13T04:44:11.157733 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76404], State: [ok], Delivered in [0.006871324] seconds [----] I, [2016-09-13T04:44:17.312042 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004640340805053711, :worker_monitor=>1.4350228309631348, :worker_dequeue=>0.011075258255004883, :total_time=>1.451096534729004} [----] I, [2016-09-13T04:44:22.312730 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:44:22 UTC]... [----] I, [2016-09-13T04:44:22.342855 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:44:22 UTC]...Complete [----] I, [2016-09-13T04:44:25.733008 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:44:25.824276 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76405], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:44:25.886072 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76406], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:44:25.902999 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76407], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:44:25.919807 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76408], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:44:27.497307 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:44:28.281141 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76406], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.451658926] seconds [----] I, [2016-09-13T04:44:28.281337 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76406], Delivering... [----] I, [2016-09-13T04:44:28.303351 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76408], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.389747564] seconds [----] I, [2016-09-13T04:44:28.303709 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76408], Delivering... [----] I, [2016-09-13T04:44:28.310908 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038270950317382812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003851652145385742, :pending_vm_jobs=>0.0009019374847412109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006696224212646484} [----] I, [2016-09-13T04:44:28.311300 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76408], State: [ok], Delivered in [0.007616733] seconds [----] I, [2016-09-13T04:44:28.339889 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76406], State: [ok], Delivered in [0.058515414] seconds [----] I, [2016-09-13T04:44:28.723141 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76405], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.984902092] seconds [----] I, [2016-09-13T04:44:28.723435 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76405], Delivering... [----] I, [2016-09-13T04:44:28.729472 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76405], State: [ok], Delivered in [0.006031416] seconds [----] I, [2016-09-13T04:44:28.762761 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76407], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.870454598] seconds [----] I, [2016-09-13T04:44:28.762957 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76407], Delivering... [----] I, [2016-09-13T04:44:28.766250 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76407], State: [ok], Delivered in [0.003288955] seconds [----] I, [2016-09-13T04:44:34.035143 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005635499954223633, :worker_monitor=>1.5174901485443115, :worker_dequeue=>0.0071125030517578125, :total_time=>1.530867099761963} [----] I, [2016-09-13T04:44:41.316964 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:44:41.374010 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76409], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:44:44.056247 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:44:44.437112 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76409], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.072688448] seconds [----] I, [2016-09-13T04:44:44.437288 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76409], Delivering... [----] I, [2016-09-13T04:44:44.443649 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032699108123779297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003288745880126953, :pending_vm_jobs=>0.0008294582366943359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059397220611572266} [----] I, [2016-09-13T04:44:44.444006 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76409], State: [ok], Delivered in [0.006709503] seconds [----] I, [2016-09-13T04:44:50.356720 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003007650375366211, :worker_monitor=>1.2830746173858643, :worker_dequeue=>0.007509708404541016, :total_time=>1.293813943862915} [----] I, [2016-09-13T04:44:55.357466 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:44:55 UTC]... [----] I, [2016-09-13T04:44:55.380049 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:44:55 UTC]...Complete [----] I, [2016-09-13T04:44:56.384904 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:44:56.398178 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76410], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:44:56.414410 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76411], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:45:00.404701 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:45:00.614631 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76411], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.21036348] seconds [----] I, [2016-09-13T04:45:00.614829 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76411], Delivering... [----] I, [2016-09-13T04:45:00.621913 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035660266876220703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003589153289794922, :pending_vm_jobs=>0.001058340072631836, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006701231002807617} [----] I, [2016-09-13T04:45:00.622382 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76411], State: [ok], Delivered in [0.007519761] seconds [----] I, [2016-09-13T04:45:01.872125 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76410], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.482525105] seconds [----] I, [2016-09-13T04:45:01.872342 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76410], Delivering... [----] I, [2016-09-13T04:45:01.877943 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76410], State: [ok], Delivered in [0.005593672] seconds [----] I, [2016-09-13T04:45:06.868764 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004801034927368164, :worker_monitor=>1.4451451301574707, :worker_dequeue=>0.006880521774291992, :total_time=>1.4571559429168701} [----] I, [2016-09-13T04:45:11.427555 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:45:11.449842 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76412], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:45:11.880545 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:45:12.692837 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76412], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.258553553] seconds [----] I, [2016-09-13T04:45:12.693060 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76412], Delivering... [----] I, [2016-09-13T04:45:12.701917 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004114866256713867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00413823127746582, :pending_vm_jobs=>0.0013327598571777344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00833272933959961} [----] I, [2016-09-13T04:45:12.702396 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76412], State: [ok], Delivered in [0.009285371] seconds [----] I, [2016-09-13T04:45:23.547895 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00610661506652832, :worker_monitor=>1.6257824897766113, :worker_dequeue=>0.011087894439697266, :total_time=>1.643354892730713} [----] I, [2016-09-13T04:45:26.462728 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:45:26.475145 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76413], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:45:26.486597 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76414], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:45:26.498978 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76415], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:45:26.515143 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76416], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:45:28.548514 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:45:28 UTC]... [----] I, [2016-09-13T04:45:28.560723 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:45:28 UTC]...Complete [----] I, [2016-09-13T04:45:28.669462 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:45:28.824410 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76414], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.346071248] seconds [----] I, [2016-09-13T04:45:28.824630 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76414], Delivering... [----] I, [2016-09-13T04:45:28.881212 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76414], State: [ok], Delivered in [0.056570932] seconds [----] I, [2016-09-13T04:45:28.892701 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76416], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.385702002] seconds [----] I, [2016-09-13T04:45:28.892857 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76416], Delivering... [----] I, [2016-09-13T04:45:28.897273 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025932788848876953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026078224182128906, :pending_vm_jobs=>0.00047588348388671875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004135847091674805} [----] I, [2016-09-13T04:45:28.897535 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76416], State: [ok], Delivered in [0.004686259] seconds [----] I, [2016-09-13T04:45:28.966926 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76413], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.500393778] seconds [----] I, [2016-09-13T04:45:28.967042 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76413], Delivering... [----] I, [2016-09-13T04:45:28.970247 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76413], State: [ok], Delivered in [0.003183659] seconds [----] I, [2016-09-13T04:45:28.972520 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76415], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.48152328] seconds [----] I, [2016-09-13T04:45:28.972703 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76415], Delivering... [----] I, [2016-09-13T04:45:28.980220 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76415], State: [ok], Delivered in [0.007499799] seconds [----] I, [2016-09-13T04:45:40.324984 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00560307502746582, :worker_monitor=>1.6081490516662598, :worker_dequeue=>0.011862754821777344, :total_time=>1.625955581665039} [----] I, [2016-09-13T04:45:41.525638 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:45:41.544168 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76417], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:45:45.335134 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:45:46.006945 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76417], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.475339539] seconds [----] I, [2016-09-13T04:45:46.007075 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76417], Delivering... [----] I, [2016-09-13T04:45:46.010915 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002165555953979492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002191781997680664, :pending_vm_jobs=>0.0004432201385498047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0036203861236572266} [----] I, [2016-09-13T04:45:46.011162 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76417], State: [ok], Delivered in [0.00409402] seconds [----] I, [2016-09-13T04:45:56.555102 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:45:56.563545 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76418], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:45:56.574978 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76419], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:46:01.349183 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:46:01 UTC]... [----] I, [2016-09-13T04:46:01.363886 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:46:01 UTC]...Complete [----] I, [2016-09-13T04:46:01.374185 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:46:02.112785 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76419], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.545608377] seconds [----] I, [2016-09-13T04:46:02.113005 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76419], Delivering... [----] I, [2016-09-13T04:46:02.120104 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76418], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.561951249] seconds [----] I, [2016-09-13T04:46:02.120312 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76418], Delivering... [----] I, [2016-09-13T04:46:02.120867 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003818035125732422, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038421154022216797, :pending_vm_jobs=>0.001154184341430664, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007441997528076172} [----] I, [2016-09-13T04:46:02.121272 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76419], State: [ok], Delivered in [0.008267199] seconds [----] I, [2016-09-13T04:46:02.125272 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76418], State: [ok], Delivered in [0.004952132] seconds [----] I, [2016-09-13T04:46:11.584315 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:46:11.596619 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76420], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:46:12.531225 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:46:12.541789 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0032351016998291016, :worker_monitor=>1.1222138404846191, :worker_dequeue=>0.019430160522460938, :total_time=>1.1451585292816162} [----] I, [2016-09-13T04:46:13.248842 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76420], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.658584601] seconds [----] I, [2016-09-13T04:46:13.249047 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76420], Delivering... [----] I, [2016-09-13T04:46:13.255720 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035805702209472656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003599882125854492, :pending_vm_jobs=>0.0008237361907958984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006296634674072266} [----] I, [2016-09-13T04:46:13.256072 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76420], State: [ok], Delivered in [0.007019756] seconds [----] I, [2016-09-13T04:46:26.608825 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:46:26.625487 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76421], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:46:26.642856 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76422], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:46:26.659862 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76423], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:46:26.688731 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76424], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:46:28.872859 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:46:28.882328 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038971900939941406, :worker_monitor=>1.2922282218933105, :worker_dequeue=>0.016344547271728516, :total_time=>1.3128588199615479} [----] I, [2016-09-13T04:46:29.222744 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76422], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.594024858] seconds [----] I, [2016-09-13T04:46:29.222933 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76422], Delivering... [----] I, [2016-09-13T04:46:29.229717 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76424], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.560014959] seconds [----] I, [2016-09-13T04:46:29.229928 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76424], Delivering... [----] I, [2016-09-13T04:46:29.237081 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037817955017089844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003803730010986328, :pending_vm_jobs=>0.0008709430694580078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006744384765625} [----] I, [2016-09-13T04:46:29.237516 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76424], State: [ok], Delivered in [0.007578619] seconds [----] I, [2016-09-13T04:46:29.279600 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76421], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.666035414] seconds [----] I, [2016-09-13T04:46:29.279774 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76421], Delivering... [----] I, [2016-09-13T04:46:29.284342 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76421], State: [ok], Delivered in [0.004553145] seconds [----] I, [2016-09-13T04:46:29.296631 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76422], State: [ok], Delivered in [0.073674691] seconds [----] I, [2016-09-13T04:46:29.342489 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76423], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.693860015] seconds [----] I, [2016-09-13T04:46:29.342675 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76423], Delivering... [----] I, [2016-09-13T04:46:29.345823 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76423], State: [ok], Delivered in [0.003143377] seconds [----] I, [2016-09-13T04:46:33.883011 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:46:33 UTC]... [----] I, [2016-09-13T04:46:33.902344 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:46:33 UTC]...Complete [----] I, [2016-09-13T04:46:41.701209 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:46:41.719343 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76425], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:46:45.360609 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:46:45.367123 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037550926208496094, :worker_monitor=>1.2651398181915283, :worker_dequeue=>0.010933399200439453, :total_time=>1.280118465423584} [----] I, [2016-09-13T04:46:45.439806 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76425], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.732643901] seconds [----] I, [2016-09-13T04:46:45.440081 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76425], Delivering... [----] I, [2016-09-13T04:46:45.449547 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004820108413696289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004854440689086914, :pending_vm_jobs=>0.0012292861938476562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008850336074829102} [----] I, [2016-09-13T04:46:45.450005 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76425], State: [ok], Delivered in [0.009929527] seconds [----] I, [2016-09-13T04:46:55.396149 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T04:46:56.732843 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:46:56.748562 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76426], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:46:56.771383 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76427], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:47:02.032530 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:47:02.039841 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005974292755126953, :worker_monitor=>1.616506576538086, :worker_dequeue=>0.011526823043823242, :total_time=>1.6344399452209473} [----] I, [2016-09-13T04:47:02.468326 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76427], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.71293436] seconds [----] I, [2016-09-13T04:47:02.468568 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76427], Delivering... [----] I, [2016-09-13T04:47:02.474575 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029785633087158203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029993057250976562, :pending_vm_jobs=>0.0008425712585449219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005627870559692383} [----] I, [2016-09-13T04:47:02.474914 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76427], State: [ok], Delivered in [0.00634742] seconds [----] I, [2016-09-13T04:47:02.479752 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76426], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.741394104] seconds [----] I, [2016-09-13T04:47:02.479979 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76426], Delivering... [----] I, [2016-09-13T04:47:02.484987 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76426], State: [ok], Delivered in [0.005021382] seconds [----] I, [2016-09-13T04:47:07.040519 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:47:07 UTC]... [----] I, [2016-09-13T04:47:07.056668 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:47:07 UTC]...Complete [----] I, [2016-09-13T04:47:11.786290 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:47:11.823274 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76428], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:47:12.087822 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:47:12.668135 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76428], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.874265841] seconds [----] I, [2016-09-13T04:47:12.668281 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76428], Delivering... [----] I, [2016-09-13T04:47:12.672174 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002093791961669922, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021076202392578125, :pending_vm_jobs=>0.0004413127899169922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003592967987060547} [----] I, [2016-09-13T04:47:12.672442 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76428], State: [ok], Delivered in [0.004144853] seconds [----] I, [2016-09-13T04:47:18.917692 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005785226821899414, :worker_monitor=>1.8026361465454102, :worker_dequeue=>0.011648178100585938, :total_time=>1.82051420211792} [----] I, [2016-09-13T04:47:26.842688 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:47:26.857018 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76429], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:47:26.873994 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76430], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:47:26.885210 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76431], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:47:26.902385 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76432], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:47:28.940916 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:47:29.565533 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76430], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.704742646] seconds [----] I, [2016-09-13T04:47:29.565676 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76430], Delivering... [----] I, [2016-09-13T04:47:29.578017 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76432], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.684110813] seconds [----] I, [2016-09-13T04:47:29.578267 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76432], Delivering... [----] I, [2016-09-13T04:47:29.586740 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004351139068603516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004374980926513672, :pending_vm_jobs=>0.0010709762573242188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007989645004272461} [----] I, [2016-09-13T04:47:29.587120 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76432], State: [ok], Delivered in [0.008870752] seconds [----] I, [2016-09-13T04:47:29.605282 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76429], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.758124965] seconds [----] I, [2016-09-13T04:47:29.605466 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76429], Delivering... [----] I, [2016-09-13T04:47:29.609130 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76429], State: [ok], Delivered in [0.003680957] seconds [----] I, [2016-09-13T04:47:29.622483 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76430], State: [ok], Delivered in [0.056757735] seconds [----] I, [2016-09-13T04:47:29.634272 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76431], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.755028857] seconds [----] I, [2016-09-13T04:47:29.634496 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76431], Delivering... [----] I, [2016-09-13T04:47:29.637616 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76431], State: [ok], Delivered in [0.003097167] seconds [----] I, [2016-09-13T04:47:35.400799 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0043070316314697266, :server_monitor=>0.09986042976379395, :worker_monitor=>1.3386712074279785, :worker_dequeue=>0.010746955871582031, :total_time=>1.4539530277252197} [----] I, [2016-09-13T04:47:40.401487 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:47:40 UTC]... [----] I, [2016-09-13T04:47:40.440672 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:47:40 UTC]...Complete [----] I, [2016-09-13T04:47:41.916394 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:47:41.960114 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76433], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:47:45.482591 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:47:45.919488 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76433], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.99538404] seconds [----] I, [2016-09-13T04:47:45.919667 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76433], Delivering... [----] I, [2016-09-13T04:47:45.924824 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002986907958984375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030045509338378906, :pending_vm_jobs=>0.0006029605865478516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004857063293457031} [----] I, [2016-09-13T04:47:45.925188 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76433], State: [ok], Delivered in [0.005513361] seconds [----] I, [2016-09-13T04:47:51.945329 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037970542907714844, :worker_monitor=>1.442983627319336, :worker_dequeue=>0.008525848388671875, :total_time=>1.4557039737701416} [----] I, [2016-09-13T04:47:56.972743 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:47:57.021197 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76434], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:47:57.038210 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76435], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:48:01.972442 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:48:02.067740 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76435], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.0397988] seconds [----] I, [2016-09-13T04:48:02.068002 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76435], Delivering... [----] I, [2016-09-13T04:48:02.074870 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003658771514892578, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036783218383789062, :pending_vm_jobs=>0.0008795261383056641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006455898284912109} [----] I, [2016-09-13T04:48:02.075241 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76435], State: [ok], Delivered in [0.00726514] seconds [----] I, [2016-09-13T04:48:02.754539 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76434], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.776821068] seconds [----] I, [2016-09-13T04:48:02.754775 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76434], Delivering... [----] I, [2016-09-13T04:48:02.760128 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76434], State: [ok], Delivered in [0.005345359] seconds [----] I, [2016-09-13T04:48:08.138296 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003874540328979492, :worker_monitor=>1.139467716217041, :worker_dequeue=>0.015080690383911133, :total_time=>1.1588096618652344} [----] I, [2016-09-13T04:48:12.052110 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:48:12.101939 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76436], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:48:13.139071 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:48:13 UTC]... [----] I, [2016-09-13T04:48:13.158339 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:48:13 UTC]...Complete [----] I, [2016-09-13T04:48:13.172618 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:48:14.141584 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76436], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.082574727] seconds [----] I, [2016-09-13T04:48:14.141778 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76436], Delivering... [----] I, [2016-09-13T04:48:14.148344 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003554105758666992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003572702407836914, :pending_vm_jobs=>0.0008008480072021484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0061604976654052734} [----] I, [2016-09-13T04:48:14.148724 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76436], State: [ok], Delivered in [0.006940801] seconds [----] I, [2016-09-13T04:48:24.939987 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00468897819519043, :worker_monitor=>1.7177581787109375, :worker_dequeue=>0.012212038040161133, :total_time=>1.7350523471832275} [----] I, [2016-09-13T04:48:27.116576 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T04:48:27.135900 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76437], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:48:27.158030 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76438], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:48:27.170187 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76439], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:48:27.204620 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76440], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:48:27.227479 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76441], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:48:27.238409 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76442], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:48:29.950317 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:48:30.307277 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76438], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.167673091] seconds [----] I, [2016-09-13T04:48:30.307462 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76438], Delivering... [----] I, [2016-09-13T04:48:30.312035 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:48:24 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50420.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:48:30.312326 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:48:23 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [48069.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T04:48:30.312687 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:48:12 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [234816.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T04:48:30.312971 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:48:13 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347147000], Memory % [5.04], CPU Time [103076.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T04:48:30.313285 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:48:23 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358680000], Memory % [5.28], CPU Time [197574.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T04:48:30.313637 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:48:21 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162416000], Memory % [3.1], CPU Time [37177.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T04:48:30.313959 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:48:24 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [147529.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:48:30.314248 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:48:24 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [148450.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:48:30.315852 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:48:24 UTC], Process Info: Memory Usage [586276864], Memory Size [915906560], Proportional Set Size: [423729000], Memory % [7.15], CPU Time [1177.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:48:30.317054 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:48:22 UTC], Process Info: Memory Usage [587247616], Memory Size [915996672], Proportional Set Size: [424330000], Memory % [7.16], CPU Time [498.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:48:30.318262 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:48:17 UTC], Process Info: Memory Usage [557740032], Memory Size [910049280], Proportional Set Size: [405513000], Memory % [6.8], CPU Time [4527.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T04:48:30.319464 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:48:19 UTC], Process Info: Memory Usage [580239360], Memory Size [922664960], Proportional Set Size: [419612000], Memory % [7.07], CPU Time [1170.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T04:48:30.319777 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:48:23 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [206209.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T04:48:30.320066 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:48:24 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [50439.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:48:30.320336 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:48:19 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165800000], Memory % [3.16], CPU Time [38070.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T04:48:30.320559 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76438], State: [ok], Delivered in [0.013124336] seconds [----] I, [2016-09-13T04:48:30.330515 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76437], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.208842388] seconds [----] I, [2016-09-13T04:48:30.330645 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76437], Delivering... [----] I, [2016-09-13T04:48:30.331457 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T04:48:30.331585 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5325651968 [----] I, [2016-09-13T04:48:30.331645 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5110337536 [----] I, [2016-09-13T04:48:30.331695 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 215314432 [----] I, [2016-09-13T04:48:30.331743 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1317011456 [----] I, [2016-09-13T04:48:30.331789 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5056389120 [----] I, [2016-09-13T04:48:30.331833 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T04:48:30.331875 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T04:48:30.331918 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 536080384 [----] I, [2016-09-13T04:48:30.331962 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T04:48:30.332006 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7850500096 [----] I, [2016-09-13T04:48:30.332049 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T04:48:30.332093 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T04:48:30.332137 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T04:48:30.332180 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 12288 [----] I, [2016-09-13T04:48:30.332227 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T04:48:30.332269 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T04:48:30.332312 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T04:48:30.332377 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T04:48:30.332447 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T04:48:30.332505 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T04:48:30.332550 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273022976 [----] I, [2016-09-13T04:48:30.332606 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56205312 [----] I, [2016-09-13T04:48:30.332655 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216817664 [----] I, [2016-09-13T04:48:30.332699 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T04:48:30.332742 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140615680 [----] I, [2016-09-13T04:48:30.332785 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2611695616 [----] I, [2016-09-13T04:48:30.332830 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2301403136 [----] I, [2016-09-13T04:48:30.332872 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T04:48:30.332915 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T04:48:30.332958 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T04:48:30.333001 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37515264 [----] I, [2016-09-13T04:48:30.333046 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102285312 [----] I, [2016-09-13T04:48:30.333088 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53108736 [----] I, [2016-09-13T04:48:30.333130 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110170112 [----] I, [2016-09-13T04:48:30.333171 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155394048 [----] I, [2016-09-13T04:48:30.333212 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T04:48:30.333255 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T04:48:30.333296 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T04:48:30.333338 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T04:48:30.333395 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T04:48:30.333465 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T04:48:30.333516 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T04:48:30.333563 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T04:48:30.333608 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T04:48:30.368582 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T04:48:30.368792 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T04:48:30.373206 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T04:48:30.376662 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76440], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.202329447] seconds [----] I, [2016-09-13T04:48:30.376940 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76440], Delivering... [----] I, [2016-09-13T04:48:30.377164 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T04:48:30.382172 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T04:48:30.386543 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T04:48:30.391319 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T04:48:30.396067 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 837 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T04:48:30.400913 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T04:48:30.405783 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T04:48:30.410915 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T04:48:30.415796 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T04:48:30.420579 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T04:48:30.424503 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T04:48:30.427473 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>2}} [----] I, [2016-09-13T04:48:30.427629 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:48:30.427743 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T04:48:30.432107 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358680000], Memory % [5.28], CPU Time [197564.0], CPU % [0.4], Priority [21] [----] I, [2016-09-13T04:48:30.432619 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76437], State: [ok], Delivered in [0.101935235] seconds [----] I, [2016-09-13T04:48:30.450554 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76440], State: [ok], Delivered in [0.073652133] seconds [----] I, [2016-09-13T04:48:30.490616 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76442], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.257401251] seconds [----] I, [2016-09-13T04:48:30.490797 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76442], Delivering... [----] I, [2016-09-13T04:48:30.496204 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003040790557861328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030579566955566406, :pending_vm_jobs=>0.0006682872772216797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0051004886627197266} [----] I, [2016-09-13T04:48:30.496578 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76442], State: [ok], Delivered in [0.005779856] seconds [----] I, [2016-09-13T04:48:32.907819 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76439], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.746433295] seconds [----] I, [2016-09-13T04:48:32.908044 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76439], Delivering... [----] I, [2016-09-13T04:48:32.912938 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76439], State: [ok], Delivered in [0.004896132] seconds [----] I, [2016-09-13T04:48:32.914329 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76441], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.70364887] seconds [----] I, [2016-09-13T04:48:32.914585 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76441], Delivering... [----] I, [2016-09-13T04:48:32.922182 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76441], State: [ok], Delivered in [0.007546572] seconds [----] I, [2016-09-13T04:48:41.586723 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0059239864349365234, :worker_monitor=>1.466829538345337, :worker_dequeue=>0.011675357818603516, :total_time=>1.4847326278686523} [----] I, [2016-09-13T04:48:42.247625 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:48:42.263720 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76443], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:48:46.587299 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:48:46 UTC]... [----] I, [2016-09-13T04:48:46.606727 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:48:46 UTC]...Complete [----] I, [2016-09-13T04:48:46.622383 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:48:46.665459 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76443], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.411017459] seconds [----] I, [2016-09-13T04:48:46.665701 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76443], Delivering... [----] I, [2016-09-13T04:48:46.676025 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0055217742919921875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00555872917175293, :pending_vm_jobs=>0.0013616085052490234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009872913360595703} [----] I, [2016-09-13T04:48:46.676628 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76443], State: [ok], Delivered in [0.010893845] seconds [----] I, [2016-09-13T04:48:57.276828 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:48:57.297891 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76444], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:48:57.309210 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76445], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:48:58.100538 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:48:58.107328 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003911733627319336, :worker_monitor=>1.4439427852630615, :worker_dequeue=>0.012077093124389648, :total_time=>1.460315227508545} [----] I, [2016-09-13T04:48:58.727227 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76445], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.423580554] seconds [----] I, [2016-09-13T04:48:58.727559 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76445], Delivering... [----] I, [2016-09-13T04:48:58.737852 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005259513854980469, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0052890777587890625, :pending_vm_jobs=>0.0013608932495117188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009661674499511719} [----] I, [2016-09-13T04:48:58.738292 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76445], State: [ok], Delivered in [0.010733914] seconds [----] I, [2016-09-13T04:49:00.064140 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76444], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.778173597] seconds [----] I, [2016-09-13T04:49:00.064385 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76444], Delivering... [----] I, [2016-09-13T04:49:00.069788 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76444], State: [ok], Delivered in [0.005424913] seconds [----] I, [2016-09-13T04:49:12.322328 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T04:49:12.349613 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76446], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:49:12.366557 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76447], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:49:14.469620 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:49:14.478680 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004110097885131836, :worker_monitor=>1.3158583641052246, :worker_dequeue=>0.01702737808227539, :total_time=>1.3373277187347412} [----] I, [2016-09-13T04:49:14.886878 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76447], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.528203354] seconds [----] I, [2016-09-13T04:49:14.887056 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76447], Delivering... [----] I, [2016-09-13T04:49:14.893168 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003262758255004883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032815933227539062, :pending_vm_jobs=>0.00067901611328125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005759716033935547} [----] I, [2016-09-13T04:49:14.893599 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76447], State: [ok], Delivered in [0.006519887] seconds [----] I, [2016-09-13T04:49:15.104045 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76446], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.76479537] seconds [----] I, [2016-09-13T04:49:15.104264 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76446], Delivering... [----] I, [2016-09-13T04:49:15.139723 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76448], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T04:49:15.162072 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76449], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T04:49:15.162503 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76446], State: [ok], Delivered in [0.058239087] seconds [----] I, [2016-09-13T04:49:19.479260 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:49:19 UTC]... [----] I, [2016-09-13T04:49:19.500128 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:49:19 UTC]...Complete [----] I, [2016-09-13T04:49:19.518012 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T04:49:19.520688 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T04:49:22.791371 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [76448], MiqWorker id: [97], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [7.670548245] seconds [----] I, [2016-09-13T04:49:22.791674 #30088:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76448], Delivering... [----] I, [2016-09-13T04:49:22.795994 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T04:49:22.796182 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T04:49:22.796327 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T04:49:22.796588 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T04:49:22.796795 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:23.082679 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:23.286243 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:23.286516 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:23.623687 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:23.718846 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:23.810967 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:24.116603 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:24.222396 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:24.316943 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:24.411602 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:24.505579 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [76449], MiqWorker id: [96], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [9.359332376] seconds [----] I, [2016-09-13T04:49:24.505807 #28071:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76449], Delivering... [----] I, [2016-09-13T04:49:24.506975 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:24.509798 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T04:49:24.509991 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T04:49:24.510152 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T04:49:24.510345 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T04:49:24.510605 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:24.600190 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:24.694321 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:24.789071 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:24.882815 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:24.955885 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:24.977083 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:25.070202 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:25.163142 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:25.247765 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:25.247991 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:25.254840 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:25.347393 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:25.440759 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:25.532919 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:25.625086 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T04:49:25.730222 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:25.888996 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T04:49:25.889244 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.0040798187255859375, :collect_inventory_for_targets=>7.653236389160156e-05, :parse_legacy_inventory=>12.14708685874939, :parse_targeted_inventory=>12.14717411994934, :save_inventory=>0.7831683158874512, :ems_refresh=>12.932157278060913} [----] I, [2016-09-13T04:49:25.910485 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T04:49:25.911002 #30088:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76448], State: [ok], Delivered in [3.11931673] seconds [----] I, [2016-09-13T04:49:26.048793 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:26.049007 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:26.569165 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:26.882389 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:26.882651 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:27.374782 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:27.379169 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T04:49:27.390407 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76450], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:49:27.401816 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76451], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:49:27.413225 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76452], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:49:27.424577 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76453], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:49:27.443650 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76454], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:49:27.668930 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:27.669113 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:28.187276 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:28.504310 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:28.504561 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:28.967756 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:29.281616 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:29.281813 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:29.788687 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:30.114813 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:30.115095 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:30.613279 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:30.914563 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:30.914760 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:31.076811 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:49:31.083942 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00603795051574707, :worker_monitor=>1.520707607269287, :worker_dequeue=>0.013120412826538086, :total_time=>1.5403621196746826} [----] I, [2016-09-13T04:49:31.387274 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:31.698514 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:31.698712 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:32.031135 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76452], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.62502052] seconds [----] I, [2016-09-13T04:49:32.031534 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76452], Delivering... [----] I, [2016-09-13T04:49:32.036293 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76454], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.602248907] seconds [----] I, [2016-09-13T04:49:32.036543 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76454], Delivering... [----] I, [2016-09-13T04:49:32.043270 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003453969955444336, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003475189208984375, :pending_vm_jobs=>0.0008931159973144531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006335735321044922} [----] I, [2016-09-13T04:49:32.043740 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76454], State: [ok], Delivered in [0.007189208] seconds [----] I, [2016-09-13T04:49:32.099091 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76452], State: [ok], Delivered in [0.067601404] seconds [----] I, [2016-09-13T04:49:32.209204 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:32.518725 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:32.518929 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:32.975068 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:33.174132 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76450], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.789795551] seconds [----] I, [2016-09-13T04:49:33.174409 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76450], Delivering... [----] I, [2016-09-13T04:49:33.254101 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76451], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.859033025] seconds [----] I, [2016-09-13T04:49:33.254318 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76451], Delivering... [----] I, [2016-09-13T04:49:33.259801 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76451], State: [ok], Delivered in [0.005477669] seconds [----] I, [2016-09-13T04:49:33.272043 #2937:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 08:49:31 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_16' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 08:49:31.081703') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2927,,2016-09-13 08:49:30 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2936,,2016-09-13 08:49:30 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2946,2016-09-13 08:49:33 UTC,2016-09-13 08:49:33 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 08:49:33 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 08:49:33 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 08:49:30 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2986,,2016-09-13 08:49:30 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2997,,2016-09-13 08:49:27 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 08:49:12.373015')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5, 3011,,2016-09-13 08:23:54 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1539, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,498728, 3030,,2016-09-13 08:24:00 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1532, 3054,,2016-09-13 08:23:57 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1535, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,498726, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,498726, 3160,,2016-09-13 07:53:34 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3358, 703,,2016-09-13 08:23:55 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1537, 27056,,2016-09-13 07:53:44 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3349, 28888,,2016-09-13 07:23:32 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5160, 28079,,2016-09-13 08:49:24 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,8, 20394,,2016-09-13 08:23:58 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1534, 30096,,2016-09-13 08:49:25 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,7, ACTIVITY_STATS_CSV [----] I, [2016-09-13T04:49:33.272641 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76450], State: [ok], Delivered in [0.098266352] seconds [----] I, [2016-09-13T04:49:33.294275 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:33.294510 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:33.294662 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76453], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.875750714] seconds [----] I, [2016-09-13T04:49:33.294889 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76453], Delivering... [----] I, [2016-09-13T04:49:33.299141 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76453], State: [ok], Delivered in [0.004218698] seconds [----] I, [2016-09-13T04:49:33.799496 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:34.108787 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:34.109005 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:34.635455 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:40.811152 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:40.946259 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:41.082289 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:41.223979 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:41.368826 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:41.509014 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:41.645616 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:41.780521 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:41.916185 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:42.052591 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:42.197188 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:42.341967 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:42.456808 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:49:42.476294 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76455], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:49:42.481657 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:43.003735 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:43.164683 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:43.308013 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:43.489210 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:43.631989 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:43.779316 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:43.947907 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:44.090586 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:44.235578 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:44.375666 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:44.512000 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:44.666340 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:44.802597 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:44.946878 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:45.092750 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:45.226771 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:45.366476 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:45.745186 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:45.892606 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:46.030524 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:46.182236 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:46.323762 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:46.463170 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:46.609170 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:46.754069 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:46.892729 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:47.034080 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:47.175792 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:47.317919 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:47.459651 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:47.597337 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:47.741562 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:47.851759 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:49:47.858765 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00474858283996582, :worker_monitor=>1.596379280090332, :worker_dequeue=>0.01255488395690918, :total_time=>1.6140050888061523} [----] I, [2016-09-13T04:49:47.881050 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:48.025613 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:48.188747 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76455], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.726006559] seconds [----] I, [2016-09-13T04:49:48.188949 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76455], Delivering... [----] I, [2016-09-13T04:49:48.195183 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032806396484375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032994747161865234, :pending_vm_jobs=>0.0007855892181396484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005894184112548828} [----] I, [2016-09-13T04:49:48.195558 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76455], State: [ok], Delivered in [0.006607052] seconds [----] I, [2016-09-13T04:49:48.317212 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:48.486171 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:48.644683 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:48.787821 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:48.930141 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:49.072973 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:49.217934 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:49.360212 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:49.508808 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:49.658855 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:49.809007 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:49.998130 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:50.153843 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:50.298862 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:50.446334 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:50.585964 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:50.724728 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:51.237684 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:51.387217 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:51.538461 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:51.687734 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:52.859380 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:49:52 UTC]... [----] I, [2016-09-13T04:49:52.880451 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:49:52 UTC]...Complete [----] I, [2016-09-13T04:49:57.488557 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:49:57.505831 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76456], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:49:57.525901 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76457], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:49:57.542908 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76458], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:49:57.554230 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76459], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:49:57.565657 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76460], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:49:57.844632 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:57.909203 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:49:58.008671 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:58.167390 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:58.313670 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:58.325832 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76457], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.814289847] seconds [----] I, [2016-09-13T04:49:58.326005 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76457], Delivering... [----] I, [2016-09-13T04:49:58.331907 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003031015396118164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030508041381835938, :pending_vm_jobs=>0.0007512569427490234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005548954010009766} [----] I, [2016-09-13T04:49:58.332263 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76457], State: [ok], Delivered in [0.006258889] seconds [----] I, [2016-09-13T04:49:58.452984 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:58.610511 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:58.758019 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:58.912657 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:59.056741 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:59.216220 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:59.378176 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:59.542397 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:49:59.696266 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:00.165980 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:00.329267 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:00.394572 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76456], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.901244135] seconds [----] I, [2016-09-13T04:50:00.394782 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76456], Delivering... [----] I, [2016-09-13T04:50:00.399992 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76456], State: [ok], Delivered in [0.005214237] seconds [----] I, [2016-09-13T04:50:00.423320 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76458], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.891375699] seconds [----] I, [2016-09-13T04:50:00.423669 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76458], Delivering... [----] I, [2016-09-13T04:50:00.427069 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76458], State: [ok], Delivered in [0.003403956] seconds [----] I, [2016-09-13T04:50:00.428853 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76459], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.880311555] seconds [----] I, [2016-09-13T04:50:00.429104 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76459], Delivering... [----] I, [2016-09-13T04:50:00.440181 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76459], State: [ok], Delivered in [0.011095605] seconds [----] I, [2016-09-13T04:50:00.457242 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76460], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.897720767] seconds [----] I, [2016-09-13T04:50:00.457480 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76460], Delivering... [----] I, [2016-09-13T04:50:00.463316 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76460], State: [ok], Delivered in [0.005860752] seconds [----] I, [2016-09-13T04:50:00.468210 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:00.608106 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:00.753126 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:00.892057 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:01.030479 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:01.166916 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:01.306191 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:01.448258 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:01.594073 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:01.741833 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:01.888953 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:02.024166 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:02.442020 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:02.580300 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:02.730690 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:03.191807 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:03.360293 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:03.501149 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:03.666757 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:03.817965 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:03.955163 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:04.108543 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:04.249854 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004576444625854492, :worker_monitor=>1.320772647857666, :worker_dequeue=>0.006645679473876953, :total_time=>1.3323087692260742} [----] I, [2016-09-13T04:50:04.253049 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:04.404302 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:04.546792 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:04.687624 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:04.823874 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:04.967520 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:05.113395 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:05.270272 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:05.421114 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:05.573147 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:06.005070 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:06.171889 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:06.314562 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:06.456879 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:06.593157 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:06.734042 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:06.870444 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:07.003716 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:07.144922 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:07.286025 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:07.425153 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:07.562793 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:07.701737 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:07.839075 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:07.985389 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:08.123207 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:08.258471 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:08.661874 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:12.578439 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:50:12.600241 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76461], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:50:12.611688 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76462], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:50:12.623042 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76463], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:50:14.278299 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:50:14.430380 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76463], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.812640124] seconds [----] I, [2016-09-13T04:50:14.430633 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76463], Delivering... [----] I, [2016-09-13T04:50:14.437582 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036649703979492188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003686189651489258, :pending_vm_jobs=>0.0008823871612548828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006503582000732422} [----] I, [2016-09-13T04:50:14.437952 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76463], State: [ok], Delivered in [0.007321919] seconds [----] I, [2016-09-13T04:50:14.829777 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:14.969243 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:15.129535 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:15.266022 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:15.418513 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:15.498155 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76461], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.915000512] seconds [----] I, [2016-09-13T04:50:15.498330 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76461], Delivering... [----] I, [2016-09-13T04:50:15.515180 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76464], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 08:50:15 UTC] [----] I, [2016-09-13T04:50:15.520530 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76462], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.916433162] seconds [----] I, [2016-09-13T04:50:15.520709 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76462], Delivering... [----] I, [2016-09-13T04:50:15.532026 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76465], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 08:50:15 UTC] [----] I, [2016-09-13T04:50:15.532381 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76461], State: [ok], Delivered in [0.034020401] seconds [----] I, [2016-09-13T04:50:15.537650 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76466], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 08:50:15 UTC] [----] I, [2016-09-13T04:50:15.555013 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76467], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 08:50:15 UTC] [----] I, [2016-09-13T04:50:15.555395 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76462], State: [ok], Delivered in [0.034657314] seconds [----] I, [2016-09-13T04:50:15.560470 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:15.701558 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:15.847110 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:15.994197 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:16.147195 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:16.305800 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:16.454936 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:16.610525 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:16.753095 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:16.903066 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:17.052656 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:17.492754 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:17.673106 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:17.826194 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:17.963340 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:18.098872 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:18.243366 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:18.390360 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:18.531303 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:18.672470 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:18.816545 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:18.968760 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:19.124594 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:19.286223 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:19.439213 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:19.586124 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:19.755477 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:19.898053 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:20.289076 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:20.448108 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:20.632991 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:20.740619 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:50:20.749135 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004338502883911133, :worker_monitor=>1.44368577003479, :worker_dequeue=>0.015199422836303711, :total_time=>1.4635436534881592} [----] I, [2016-09-13T04:50:20.769057 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:20.926440 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:21.093211 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:21.235314 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:21.394695 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:21.534517 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:21.583824 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76464], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 08:50:15 UTC], Dequeued in: [6.078891324] seconds [----] I, [2016-09-13T04:50:21.583993 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76464], Delivering... [----] I, [2016-09-13T04:50:21.584280 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 08:50:15 UTC]... [----] I, [2016-09-13T04:50:21.587166 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T04:50:21.589564 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 08:50:15 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T04:50:21.589898 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76464], State: [ok], Delivered in [0.00589694] seconds [----] I, [2016-09-13T04:50:21.590332 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76465], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 08:50:15 UTC], Dequeued in: [6.068297898] seconds [----] I, [2016-09-13T04:50:21.590550 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76465], Delivering... [----] I, [2016-09-13T04:50:21.590916 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 08:50:15 UTC]... [----] I, [2016-09-13T04:50:21.593591 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T04:50:21.595770 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 08:50:15 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T04:50:21.596109 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76465], State: [ok], Delivered in [0.005558912] seconds [----] I, [2016-09-13T04:50:21.612279 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76466], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 08:50:15 UTC], Dequeued in: [6.084634233] seconds [----] I, [2016-09-13T04:50:21.612481 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76466], Delivering... [----] I, [2016-09-13T04:50:21.612767 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 08:50:15 UTC]... [----] I, [2016-09-13T04:50:21.615777 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T04:50:21.618058 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76467], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 08:50:15 UTC], Dequeued in: [6.074358884] seconds [----] I, [2016-09-13T04:50:21.618213 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76467], Delivering... [----] I, [2016-09-13T04:50:21.618525 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 08:50:15 UTC]... [----] I, [2016-09-13T04:50:21.621080 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T04:50:21.693898 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 08:50:15 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T04:50:21.694457 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76466], State: [ok], Delivered in [0.081930306] seconds [----] I, [2016-09-13T04:50:21.695055 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 08:50:15 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T04:50:21.695511 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76467], State: [ok], Delivered in [0.077272761] seconds [----] I, [2016-09-13T04:50:21.711901 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:21.876112 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:22.014748 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:22.184610 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:22.381730 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:22.527323 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:22.677765 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:22.831975 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:23.225062 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:23.383596 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:23.531460 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:23.672614 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:23.811713 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:23.951651 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:24.095480 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:24.231062 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:24.378663 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:24.524599 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:24.666178 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:24.805815 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:24.956808 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:25.097949 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:25.241112 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:25.387584 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:25.546270 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:25.749732 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:50:25 UTC]... [----] I, [2016-09-13T04:50:25.768666 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:50:25 UTC]...Complete [----] I, [2016-09-13T04:50:26.037090 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:27.637454 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:50:27.654604 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76468], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:50:27.671753 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76469], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:50:27.683103 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76470], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:50:27.705852 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76471], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:50:30.797151 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:50:31.570136 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76469], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.911526665] seconds [----] I, [2016-09-13T04:50:31.570287 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76469], Delivering... [----] I, [2016-09-13T04:50:31.603101 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76471], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.91028055] seconds [----] I, [2016-09-13T04:50:31.603237 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76471], Delivering... [----] I, [2016-09-13T04:50:31.607768 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023505687713623047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002369403839111328, :pending_vm_jobs=>0.0005867481231689453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004172325134277344} [----] I, [2016-09-13T04:50:31.607985 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76471], State: [ok], Delivered in [0.004744531] seconds [----] I, [2016-09-13T04:50:31.608950 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76469], State: [ok], Delivered in [0.038626088] seconds [----] I, [2016-09-13T04:50:32.220733 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:32.366170 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:32.511624 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:32.653705 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:32.796876 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:32.937327 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:33.076608 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:33.222001 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:33.364762 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:33.513969 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:33.656381 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:33.786593 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76468], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.144038654] seconds [----] I, [2016-09-13T04:50:33.786793 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76468], Delivering... [----] I, [2016-09-13T04:50:33.792061 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76470], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.114370314] seconds [----] I, [2016-09-13T04:50:33.792252 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76470], Delivering... [----] I, [2016-09-13T04:50:33.793466 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76468], State: [ok], Delivered in [0.006631103] seconds [----] I, [2016-09-13T04:50:33.795875 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76470], State: [ok], Delivered in [0.003607181] seconds [----] I, [2016-09-13T04:50:33.807821 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:33.944200 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:34.087181 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:34.228745 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T04:50:34.367170 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T04:50:34.574157 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T04:50:34.574733 #28071:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T04:50:34.575247 #28071:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T04:50:34.575479 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T04:50:34.575709 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T04:50:34.603687 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T04:50:34.604071 #28071:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [76449], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T04:50:34.604289 #28071:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T04:50:34.604517 #28071:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T04:50:34.604689 #28071:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76449], State: [error], Delivered in [70.098902514] seconds [----] I, [2016-09-13T04:50:36.919888 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030469894409179688, :worker_monitor=>1.105820655822754, :worker_dequeue=>0.006509065628051758, :total_time=>1.115694522857666} [----] I, [2016-09-13T04:50:42.717577 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:50:42.730057 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76472], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:50:47.108458 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:50:47.740768 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76472], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.016909663] seconds [----] I, [2016-09-13T04:50:47.740947 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76472], Delivering... [----] I, [2016-09-13T04:50:47.747132 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032727718353271484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033245086669921875, :pending_vm_jobs=>0.0007107257843017578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005824089050292969} [----] I, [2016-09-13T04:50:47.747559 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76472], State: [ok], Delivered in [0.006594911] seconds [----] I, [2016-09-13T04:50:53.349603 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004573345184326172, :worker_monitor=>1.2218809127807617, :worker_dequeue=>0.007016181945800781, :total_time=>1.2338404655456543} [----] I, [2016-09-13T04:50:57.742288 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:50:57.757706 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76473], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:50:57.775936 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76474], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:50:58.350125 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:50:58 UTC]... [----] I, [2016-09-13T04:50:58.370213 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:50:58 UTC]...Complete [----] I, [2016-09-13T04:50:58.381532 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:50:58.838156 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76474], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.07528433] seconds [----] I, [2016-09-13T04:50:58.838373 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76474], Delivering... [----] I, [2016-09-13T04:50:58.844549 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003211498260498047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003230571746826172, :pending_vm_jobs=>0.0007679462432861328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057108402252197266} [----] I, [2016-09-13T04:50:58.844899 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76474], State: [ok], Delivered in [0.006538062] seconds [----] I, [2016-09-13T04:51:00.923810 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76473], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.177121432] seconds [----] I, [2016-09-13T04:51:00.924016 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76473], Delivering... [----] I, [2016-09-13T04:51:00.928767 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76473], State: [ok], Delivered in [0.004737398] seconds [----] I, [2016-09-13T04:51:09.773753 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004761695861816406, :worker_monitor=>1.325773000717163, :worker_dequeue=>0.006947755813598633, :total_time=>1.3379185199737549} [----] I, [2016-09-13T04:51:12.791231 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:51:12.816484 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76475], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:51:14.785265 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:51:14.988252 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76475], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.186752188] seconds [----] I, [2016-09-13T04:51:14.988517 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76475], Delivering... [----] I, [2016-09-13T04:51:14.995698 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038614273071289062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003886699676513672, :pending_vm_jobs=>0.0008366107940673828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006685495376586914} [----] I, [2016-09-13T04:51:14.996101 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76475], State: [ok], Delivered in [0.007579687] seconds [----] I, [2016-09-13T04:51:26.150086 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005090475082397461, :worker_monitor=>1.3168506622314453, :worker_dequeue=>0.01462554931640625, :total_time=>1.3369619846343994} [----] I, [2016-09-13T04:51:27.830369 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:51:27.845483 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76476], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:51:27.856903 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76477], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:51:27.874178 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76478], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:51:27.902815 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76479], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:51:31.150779 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:51:31 UTC]... [----] I, [2016-09-13T04:51:31.176948 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:51:31 UTC]...Complete [----] I, [2016-09-13T04:51:31.187863 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:51:31.474242 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76477], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.624472477] seconds [----] I, [2016-09-13T04:51:31.474474 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76477], Delivering... [----] I, [2016-09-13T04:51:31.537001 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76477], State: [ok], Delivered in [0.062541862] seconds [----] I, [2016-09-13T04:51:31.559478 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76479], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.674614538] seconds [----] I, [2016-09-13T04:51:31.559607 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76479], Delivering... [----] I, [2016-09-13T04:51:31.563824 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002263307571411133, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002276897430419922, :pending_vm_jobs=>0.0005426406860351562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003954887390136719} [----] I, [2016-09-13T04:51:31.564094 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76479], State: [ok], Delivered in [0.004479822] seconds [----] I, [2016-09-13T04:51:31.582232 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76476], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.747362713] seconds [----] I, [2016-09-13T04:51:31.582394 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76476], Delivering... [----] I, [2016-09-13T04:51:31.587003 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76476], State: [ok], Delivered in [0.004591995] seconds [----] I, [2016-09-13T04:51:31.605275 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76478], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.74209588] seconds [----] I, [2016-09-13T04:51:31.605508 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76478], Delivering... [----] I, [2016-09-13T04:51:31.608318 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76478], State: [ok], Delivered in [0.002824828] seconds [----] I, [2016-09-13T04:51:42.625843 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005202770233154297, :worker_monitor=>1.4037349224090576, :worker_dequeue=>0.0066144466400146484, :total_time=>1.4159348011016846} [----] I, [2016-09-13T04:51:42.915678 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:51:42.932676 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76480], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:51:47.743070 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:51:48.222133 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76480], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.300552315] seconds [----] I, [2016-09-13T04:51:48.222319 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76480], Delivering... [----] I, [2016-09-13T04:51:48.228791 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034449100494384766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003467082977294922, :pending_vm_jobs=>0.000804901123046875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006082773208618164} [----] I, [2016-09-13T04:51:48.229133 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76480], State: [ok], Delivered in [0.006811892] seconds [----] I, [2016-09-13T04:51:57.795901 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T04:51:57.946336 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:51:57.966272 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76481], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:51:57.993677 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76482], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:51:59.397719 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:51:59.405794 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004057168960571289, :log_active_servers=>0.010994911193847656, :worker_monitor=>1.5960748195648193, :worker_dequeue=>0.013394594192504883, :total_time=>1.6248674392700195} [----] I, [2016-09-13T04:52:00.326764 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76482], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.354794495] seconds [----] I, [2016-09-13T04:52:00.326966 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76482], Delivering... [----] I, [2016-09-13T04:52:00.333539 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034770965576171875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003497600555419922, :pending_vm_jobs=>0.0008463859558105469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006142854690551758} [----] I, [2016-09-13T04:52:00.333948 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76482], State: [ok], Delivered in [0.00697764] seconds [----] I, [2016-09-13T04:52:01.481265 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76481], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.53026461] seconds [----] I, [2016-09-13T04:52:01.481512 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76481], Delivering... [----] I, [2016-09-13T04:52:01.486852 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76481], State: [ok], Delivered in [0.005342188] seconds [----] I, [2016-09-13T04:52:04.406474 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:52:04 UTC]... [----] I, [2016-09-13T04:52:04.423609 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:52:04 UTC]...Complete [----] I, [2016-09-13T04:52:13.006478 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:52:13.023802 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76483], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:52:16.214912 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:52:16.221837 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005216121673583984, :worker_monitor=>1.748702049255371, :worker_dequeue=>0.012211322784423828, :total_time=>1.7665915489196777} [----] I, [2016-09-13T04:52:16.555605 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76483], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.54239338] seconds [----] I, [2016-09-13T04:52:16.555815 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76483], Delivering... [----] I, [2016-09-13T04:52:16.563377 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003930330276489258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00395965576171875, :pending_vm_jobs=>0.0009603500366210938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00709986686706543} [----] I, [2016-09-13T04:52:16.563846 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76483], State: [ok], Delivered in [0.008023211] seconds [----] I, [2016-09-13T04:52:28.035734 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:52:28.046733 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76484], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:52:28.058078 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76485], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:52:28.069604 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76486], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:52:28.092529 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76487], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:52:32.383702 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:52:32.388108 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004004240036010742, :worker_monitor=>1.1228621006011963, :worker_dequeue=>0.008130550384521484, :total_time=>1.1352720260620117} [----] I, [2016-09-13T04:52:32.988324 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76485], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.937709625] seconds [----] I, [2016-09-13T04:52:32.988672 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76485], Delivering... [----] I, [2016-09-13T04:52:33.022493 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76487], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.943026219] seconds [----] I, [2016-09-13T04:52:33.022689 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76487], Delivering... [----] I, [2016-09-13T04:52:33.029224 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003293752670288086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003314971923828125, :pending_vm_jobs=>0.0009887218475341797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006147861480712891} [----] I, [2016-09-13T04:52:33.029611 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76487], State: [ok], Delivered in [0.006913423] seconds [----] I, [2016-09-13T04:52:33.046679 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76485], State: [ok], Delivered in [0.0580045] seconds [----] I, [2016-09-13T04:52:34.628212 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76484], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.587972357] seconds [----] I, [2016-09-13T04:52:34.628436 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76484], Delivering... [----] I, [2016-09-13T04:52:34.633299 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76484], State: [ok], Delivered in [0.004885315] seconds [----] I, [2016-09-13T04:52:34.668226 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76486], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.604586144] seconds [----] I, [2016-09-13T04:52:34.668439 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76486], Delivering... [----] I, [2016-09-13T04:52:34.671167 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76486], State: [ok], Delivered in [0.002754305] seconds [----] I, [2016-09-13T04:52:37.388565 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:52:37 UTC]... [----] I, [2016-09-13T04:52:37.422548 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:52:37 UTC]...Complete [----] I, [2016-09-13T04:52:43.103749 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:52:43.119633 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76488], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:52:49.257070 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:52:49.261691 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004094600677490234, :worker_monitor=>1.7921273708343506, :worker_dequeue=>0.008383035659790039, :total_time=>1.8048768043518066} [----] I, [2016-09-13T04:52:49.770806 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76488], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.660451319] seconds [----] I, [2016-09-13T04:52:49.771100 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76488], Delivering... [----] I, [2016-09-13T04:52:49.779371 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004496335983276367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004522085189819336, :pending_vm_jobs=>0.000965118408203125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007662296295166016} [----] I, [2016-09-13T04:52:49.779804 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76488], State: [ok], Delivered in [0.008712844] seconds [----] I, [2016-09-13T04:52:58.132008 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:52:58.159047 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76489], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:52:58.187658 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76490], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:52:59.398790 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:53:00.235217 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76490], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.070613955] seconds [----] I, [2016-09-13T04:53:00.235514 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76490], Delivering... [----] I, [2016-09-13T04:53:00.243254 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004109859466552734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004138469696044922, :pending_vm_jobs=>0.0009236335754394531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007233381271362305} [----] I, [2016-09-13T04:53:00.243635 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76490], State: [ok], Delivered in [0.00812968] seconds [----] I, [2016-09-13T04:53:01.840662 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76489], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.704135017] seconds [----] I, [2016-09-13T04:53:01.840860 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76489], Delivering... [----] I, [2016-09-13T04:53:01.846602 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76489], State: [ok], Delivered in [0.005737412] seconds [----] I, [2016-09-13T04:53:05.855786 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004606962203979492, :worker_monitor=>1.4334425926208496, :worker_dequeue=>0.011967658996582031, :total_time=>1.4503965377807617} [----] I, [2016-09-13T04:53:10.856395 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:53:10 UTC]... [----] I, [2016-09-13T04:53:10.880702 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:53:10 UTC]...Complete [----] I, [2016-09-13T04:53:13.199844 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:53:13.217725 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76491], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:53:15.910141 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:53:16.377913 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76491], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.171530345] seconds [----] I, [2016-09-13T04:53:16.378115 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76491], Delivering... [----] I, [2016-09-13T04:53:16.385254 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035567283630371094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035843849182128906, :pending_vm_jobs=>0.0009706020355224609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006682872772216797} [----] I, [2016-09-13T04:53:16.385673 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76491], State: [ok], Delivered in [0.007551862] seconds [----] I, [2016-09-13T04:53:22.441875 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006460428237915039, :worker_monitor=>1.5024440288543701, :worker_dequeue=>0.015105485916137695, :total_time=>1.5244519710540771} [----] I, [2016-09-13T04:53:28.230182 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T04:53:28.246828 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76492], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:53:28.263679 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76493], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:53:28.280739 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76494], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:53:28.297957 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76495], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:53:28.315509 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76496], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:53:28.338410 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76497], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:53:32.477596 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:53:32.509970 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76492], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.274475072] seconds [----] I, [2016-09-13T04:53:32.510155 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76492], Delivering... [----] I, [2016-09-13T04:53:32.511764 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T04:53:32.511995 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5338546176 [----] I, [2016-09-13T04:53:32.512098 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5122953216 [----] I, [2016-09-13T04:53:32.512183 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 215592960 [----] I, [2016-09-13T04:53:32.512270 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1317011456 [----] I, [2016-09-13T04:53:32.512372 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5068988416 [----] I, [2016-09-13T04:53:32.512506 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T04:53:32.512601 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T04:53:32.512679 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 536371200 [----] I, [2016-09-13T04:53:32.512767 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T04:53:32.512848 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8021958656 [----] I, [2016-09-13T04:53:32.512926 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T04:53:32.513007 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T04:53:32.513090 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T04:53:32.513187 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T04:53:32.513270 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T04:53:32.513376 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T04:53:32.513506 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T04:53:32.513600 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T04:53:32.513685 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T04:53:32.513769 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T04:53:32.513853 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273035264 [----] I, [2016-09-13T04:53:32.513931 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56205312 [----] I, [2016-09-13T04:53:32.514020 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216829952 [----] I, [2016-09-13T04:53:32.514099 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T04:53:32.514182 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140615680 [----] I, [2016-09-13T04:53:32.514259 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2598526976 [----] I, [2016-09-13T04:53:32.514352 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2287943680 [----] I, [2016-09-13T04:53:32.514476 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T04:53:32.514582 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T04:53:32.514667 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T04:53:32.514750 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37765120 [----] I, [2016-09-13T04:53:32.514829 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102285312 [----] I, [2016-09-13T04:53:32.514910 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53366784 [----] I, [2016-09-13T04:53:32.514991 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110170112 [----] I, [2016-09-13T04:53:32.515069 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155652096 [----] I, [2016-09-13T04:53:32.515143 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T04:53:32.515223 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T04:53:32.515305 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T04:53:32.515450 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T04:53:32.515557 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T04:53:32.515647 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T04:53:32.515725 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T04:53:32.515799 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T04:53:32.515888 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T04:53:32.550977 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T04:53:32.551201 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T04:53:32.555687 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T04:53:32.558970 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T04:53:32.562756 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T04:53:32.566435 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T04:53:32.569972 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T04:53:32.573506 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 837 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T04:53:32.577119 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T04:53:32.580678 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T04:53:32.584376 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T04:53:32.588118 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T04:53:32.591742 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T04:53:32.595210 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T04:53:32.598399 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:53:32.598590 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:53:32.598717 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>4, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T04:53:32.603493 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [148548.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T04:53:32.603889 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76492], State: [ok], Delivered in [0.093717352] seconds [----] I, [2016-09-13T04:53:32.635769 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76493], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.385086881] seconds [----] I, [2016-09-13T04:53:32.635945 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76493], Delivering... [----] I, [2016-09-13T04:53:32.643530 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:53:11 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [48078.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T04:53:32.644153 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:53:22 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50437.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:53:32.644773 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:53:19 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358680000], Memory % [5.28], CPU Time [197660.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T04:53:32.645353 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:53:13 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [234949.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T04:53:32.645879 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:53:14 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347147000], Memory % [5.04], CPU Time [103093.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T04:53:32.646474 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:53:19 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162417000], Memory % [3.1], CPU Time [37188.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T04:53:32.647045 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:53:21 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [148560.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:53:32.647616 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:53:21 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [147640.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:53:32.650378 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:53:16 UTC], Process Info: Memory Usage [587476992], Memory Size [930676736], Proportional Set Size: [424571000], Memory % [7.16], CPU Time [539.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:53:32.652608 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:53:14 UTC], Process Info: Memory Usage [596905984], Memory Size [1042513920], Proportional Set Size: [434110000], Memory % [7.28], CPU Time [1323.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:53:32.654861 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:53:17 UTC], Process Info: Memory Usage [558551040], Memory Size [930201600], Proportional Set Size: [406129000], Memory % [6.81], CPU Time [4541.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T04:53:32.657051 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:53:20 UTC], Process Info: Memory Usage [580386816], Memory Size [932102144], Proportional Set Size: [419764000], Memory % [7.08], CPU Time [1180.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T04:53:32.657659 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:53:19 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [206298.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T04:53:32.658214 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:53:19 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [50488.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:53:32.658733 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:53:19 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165801000], Memory % [3.16], CPU Time [38081.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T04:53:32.659063 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76493], State: [ok], Delivered in [0.023123032] seconds [----] I, [2016-09-13T04:53:32.681383 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76495], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.396614988] seconds [----] I, [2016-09-13T04:53:32.681568 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76495], Delivering... [----] I, [2016-09-13T04:53:32.744164 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76495], State: [ok], Delivered in [0.062577578] seconds [----] I, [2016-09-13T04:53:32.778719 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76497], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.453622243] seconds [----] I, [2016-09-13T04:53:32.778872 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76497], Delivering... [----] I, [2016-09-13T04:53:32.784977 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030465126037597656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003066539764404297, :pending_vm_jobs=>0.0007760524749755859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005681753158569336} [----] I, [2016-09-13T04:53:32.785293 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76497], State: [ok], Delivered in [0.006406669] seconds [----] I, [2016-09-13T04:53:34.990176 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76494], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.722817172] seconds [----] I, [2016-09-13T04:53:34.990384 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76494], Delivering... [----] I, [2016-09-13T04:53:34.995518 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76494], State: [ok], Delivered in [0.005144413] seconds [----] I, [2016-09-13T04:53:35.018557 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76496], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.715446287] seconds [----] I, [2016-09-13T04:53:35.018743 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76496], Delivering... [----] I, [2016-09-13T04:53:35.026504 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76496], State: [ok], Delivered in [0.00774099] seconds [----] I, [2016-09-13T04:53:38.887367 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0068359375, :worker_monitor=>1.3875491619110107, :worker_dequeue=>0.0077021121978759766, :total_time=>1.4024567604064941} [----] I, [2016-09-13T04:53:43.352680 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:53:43.367146 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76498], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:53:43.888865 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:53:43 UTC]... [----] I, [2016-09-13T04:53:43.904191 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:53:43 UTC]...Complete [----] I, [2016-09-13T04:53:43.916773 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:53:44.071606 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76498], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.712239797] seconds [----] I, [2016-09-13T04:53:44.071857 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76498], Delivering... [----] I, [2016-09-13T04:53:44.079574 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003953218460083008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003984928131103516, :pending_vm_jobs=>0.0008985996246337891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007227420806884766} [----] I, [2016-09-13T04:53:44.079975 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76498], State: [ok], Delivered in [0.008105899] seconds [----] I, [2016-09-13T04:53:55.340153 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:53:55.340461 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:53:55.357102 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:53:55.357371 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:53:55.374266 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:53:55.374553 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:53:55.396960 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:53:55.397186 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:53:55.413868 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:53:55.414069 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:53:55.431125 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:53:55.431325 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:53:55.448215 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:53:55.448452 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:53:55.465401 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:53:55.465624 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:53:55.482462 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:53:55.482659 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:53:55.499700 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:53:55.499897 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:53:55.522398 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:53:55.522631 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:53:55.539880 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:53:55.540069 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:53:55.556980 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:53:55.557188 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:53:55.573902 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:53:55.574097 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:53:55.591184 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T04:53:55.591466 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T04:53:55.609977 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004648923873901367, :worker_monitor=>1.648371696472168, :worker_dequeue=>0.015632152557373047, :total_time=>1.6689352989196777} [----] I, [2016-09-13T04:53:55.640451 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:53:55.640637 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:53:55.640714 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:53:55.785798 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:53:55.786507 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T04:53:55.786590 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:53:55.786636 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:53:55.786675 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:53:55.786711 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T04:53:55.786746 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T04:53:55.786782 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:53:55.786816 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T04:53:55.786864 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:53:55.786901 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:53:55.786935 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:53:55.786968 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:53:55.787001 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T04:53:55.787032 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T04:53:55.787296 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:53:55.787598 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:53:56.298590 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T04:53:56.298756 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T04:53:56.298847 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T04:53:56.468715 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:53:56.469638 #30088:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T04:53:56.469725 #30088:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:53:56.469773 #30088:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:53:56.469812 #30088:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:53:56.469848 #30088:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T04:53:56.469886 #30088:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T04:53:56.469921 #30088:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:53:56.469955 #30088:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T04:53:56.469990 #30088:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:53:56.470022 #30088:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:53:56.470053 #30088:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T04:53:56.470088 #30088:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:53:56.470119 #30088:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T04:53:56.470153 #30088:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:53:56.470183 #30088:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T04:53:56.470217 #30088:34713c] INFO -- : --- [----] I, [2016-09-13T04:53:56.470623 #30088:34713c] INFO -- : :guid: aa80abf2-7989-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:53:56.470702 #30088:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T04:53:56.470871 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T04:53:57.262383 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T04:53:57.262646 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T04:53:57.262735 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T04:53:57.436139 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:53:57.437037 #684:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T04:53:57.437131 #684:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:53:57.437183 #684:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:53:57.437224 #684:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:53:57.437262 #684:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T04:53:57.437299 #684:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T04:53:57.437352 #684:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:53:57.437399 #684:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T04:53:57.437483 #684:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:53:57.437532 #684:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:53:57.437570 #684:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:53:57.437605 #684:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:53:57.437640 #684:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T04:53:57.437676 #684:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T04:53:57.437712 #684:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T04:53:57.437747 #684:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T04:53:57.437781 #684:34713c] INFO -- : --- [----] I, [2016-09-13T04:53:57.438133 #684:34713c] INFO -- : :guid: c253e5f6-7924-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:53:57.438206 #684:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T04:53:57.438359 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T04:53:58.379757 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:53:58.379957 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:53:58.380037 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:53:58.517097 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:53:58.518615 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T04:53:58.518729 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:53:58.518784 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:53:58.518825 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:53:58.518862 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T04:53:58.518897 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T04:53:58.518932 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:53:58.518966 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T04:53:58.519001 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:53:58.519036 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:53:58.519070 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:53:58.519103 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:53:58.519136 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T04:53:58.519169 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T04:53:58.519202 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T04:53:58.519235 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T04:53:58.519269 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T04:53:58.519303 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T04:53:58.519354 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T04:53:58.519402 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T04:53:58.519483 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T04:53:58.519527 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T04:53:58.519562 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T04:53:58.519597 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T04:53:58.519631 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T04:53:58.519665 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T04:53:58.519698 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T04:53:58.519733 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T04:53:58.519766 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T04:53:58.519800 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T04:53:58.519833 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T04:53:58.519867 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T04:53:58.519900 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T04:53:58.519933 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T04:53:58.519966 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T04:53:58.519999 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T04:53:58.520032 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T04:53:58.520066 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T04:53:58.520097 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T04:53:58.520408 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:53:58.520607 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:53:58.520695 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:53:58.539630 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76499], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:53:58.551710 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76500], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:53:58.661249 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:53:58.661480 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:53:58.661605 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:53:58.847949 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:53:58.848940 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T04:53:58.849071 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:53:58.849174 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:53:58.849233 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:53:58.849276 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T04:53:58.849313 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T04:53:58.849378 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:53:58.849457 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T04:53:58.849521 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:53:58.849561 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:53:58.849601 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:53:58.849639 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:53:58.849675 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T04:53:58.849713 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:53:58.849749 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T04:53:58.849784 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T04:53:58.850126 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:53:58.850303 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:53:58.937515 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:53:58.937708 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:53:58.937808 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:53:59.127260 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:53:59.127509 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:53:59.127636 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:53:59.154380 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:53:59.155441 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T04:53:59.155546 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:53:59.155598 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:53:59.155643 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:53:59.155687 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T04:53:59.155726 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T04:53:59.155767 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:53:59.155806 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T04:53:59.155845 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:53:59.155885 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:53:59.155923 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:53:59.155961 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:53:59.156001 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T04:53:59.156039 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:53:59.156077 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T04:53:59.156112 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T04:53:59.156497 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:53:59.156691 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:53:59.312101 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:53:59.313001 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T04:53:59.313094 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:53:59.313143 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:53:59.313186 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:53:59.313223 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T04:53:59.313267 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T04:53:59.313306 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:53:59.313367 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T04:53:59.313436 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:53:59.313516 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:53:59.313563 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:53:59.313618 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:53:59.313657 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T04:53:59.313692 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:53:59.313725 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T04:53:59.313760 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T04:53:59.314094 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:53:59.314292 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:53:59.585629 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:53:59.585793 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:53:59.585873 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:53:59.746668 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:53:59.747463 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T04:53:59.747557 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:53:59.747609 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:53:59.747649 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:53:59.747688 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T04:53:59.747726 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T04:53:59.747765 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:53:59.747801 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T04:53:59.747837 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:53:59.747872 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:53:59.747907 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:53:59.747942 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:53:59.747977 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T04:53:59.748010 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T04:53:59.748306 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:53:59.748640 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:54:00.182130 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T04:54:00.182302 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T04:54:00.182447 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T04:54:00.329816 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:54:00.330774 #20386:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T04:54:00.330869 #20386:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:54:00.330919 #20386:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:54:00.330960 #20386:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:54:00.331000 #20386:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T04:54:00.331038 #20386:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T04:54:00.331077 #20386:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:54:00.331114 #20386:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T04:54:00.331151 #20386:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:54:00.331187 #20386:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:54:00.331224 #20386:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:54:00.331259 #20386:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:54:00.331295 #20386:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T04:54:00.331331 #20386:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T04:54:00.331399 #20386:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T04:54:00.331485 #20386:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T04:54:00.331530 #20386:34713c] INFO -- : --- [----] I, [2016-09-13T04:54:00.331907 #20386:34713c] INFO -- : :guid: e5930efc-7974-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:54:00.331982 #20386:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T04:54:00.332127 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T04:54:00.820458 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:54:00.888369 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76500], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.343164856] seconds [----] I, [2016-09-13T04:54:00.888679 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76500], Delivering... [----] I, [2016-09-13T04:54:00.895824 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00377655029296875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003799915313720703, :pending_vm_jobs=>0.0008924007415771484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00662541389465332} [----] I, [2016-09-13T04:54:00.896182 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76500], State: [ok], Delivered in [0.007538556] seconds [----] I, [2016-09-13T04:54:01.397232 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:54:01.397518 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:54:01.397696 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:54:01.547329 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:54:01.548247 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T04:54:01.548329 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:54:01.548403 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:54:01.548495 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:54:01.548542 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T04:54:01.548577 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T04:54:01.548613 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:54:01.548649 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T04:54:01.548684 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:54:01.548718 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:54:01.548752 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:54:01.548785 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:54:01.548819 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T04:54:01.548852 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:54:01.548885 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T04:54:01.548917 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T04:54:01.549216 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:54:01.549398 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:54:02.003882 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:54:02.004074 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:54:02.004175 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:54:02.122672 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:54:02.122849 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:54:02.122931 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:54:02.161320 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:54:02.161614 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:54:02.161786 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:54:02.188309 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:54:02.189197 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T04:54:02.189277 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:54:02.189321 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:54:02.189383 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:54:02.189455 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T04:54:02.189514 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T04:54:02.189553 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:54:02.189587 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T04:54:02.189620 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:54:02.189653 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:54:02.189685 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:54:02.189718 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:54:02.189750 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T04:54:02.189781 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:54:02.189819 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T04:54:02.189849 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T04:54:02.190187 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:54:02.190372 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:54:02.294366 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:54:02.295152 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T04:54:02.295234 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:54:02.295280 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:54:02.295318 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:54:02.295384 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T04:54:02.295464 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T04:54:02.295515 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:54:02.295551 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T04:54:02.295586 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:54:02.295621 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:54:02.295655 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:54:02.295688 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:54:02.295722 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T04:54:02.295753 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T04:54:02.296032 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:54:02.296300 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:54:02.334449 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76499], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.809324705] seconds [----] I, [2016-09-13T04:54:02.334668 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76499], Delivering... [----] I, [2016-09-13T04:54:02.339202 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76499], State: [ok], Delivered in [0.004550742] seconds [----] I, [2016-09-13T04:54:02.342828 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:54:02.343688 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T04:54:02.343774 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:54:02.343819 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:54:02.343859 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:54:02.343895 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T04:54:02.343931 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T04:54:02.343966 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:54:02.344001 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T04:54:02.344039 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:54:02.344073 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:54:02.344108 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:54:02.344141 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:54:02.344174 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T04:54:02.344209 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:54:02.344240 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T04:54:02.344271 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T04:54:02.344635 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:54:02.344856 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:54:04.637235 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T04:54:04.637486 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T04:54:04.637595 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T04:54:04.799000 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:54:04.799949 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T04:54:04.800041 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:54:04.800110 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:54:04.800158 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:54:04.800199 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T04:54:04.800238 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T04:54:04.800278 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:54:04.800317 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T04:54:04.800383 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:54:04.800469 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:54:04.800524 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T04:54:04.800564 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:54:04.800599 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T04:54:04.800633 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:54:04.800668 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T04:54:04.800705 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T04:54:04.801036 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:54:04.801202 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T04:54:04.992894 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T04:54:04.993093 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T04:54:04.993212 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T04:54:05.175964 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T04:54:05.176872 #28071:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T04:54:05.176965 #28071:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T04:54:05.177014 #28071:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T04:54:05.177055 #28071:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T04:54:05.177095 #28071:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T04:54:05.177130 #28071:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T04:54:05.177167 #28071:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T04:54:05.177204 #28071:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T04:54:05.177238 #28071:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T04:54:05.177272 #28071:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T04:54:05.177307 #28071:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T04:54:05.177359 #28071:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T04:54:05.177404 #28071:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T04:54:05.177483 #28071:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T04:54:05.177525 #28071:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T04:54:05.177578 #28071:34713c] INFO -- : --- [----] I, [2016-09-13T04:54:05.177955 #28071:34713c] INFO -- : :guid: b49c1882-7985-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T04:54:05.178023 #28071:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T04:54:05.178190 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T04:54:12.423742 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003923177719116211, :worker_monitor=>1.5606658458709717, :worker_dequeue=>0.011991500854492188, :total_time=>1.576857328414917} [----] I, [2016-09-13T04:54:13.564384 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:54:13.585510 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76501], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:54:17.424289 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:54:17 UTC]... [----] I, [2016-09-13T04:54:17.465668 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:54:17 UTC]...Complete [----] I, [2016-09-13T04:54:17.481187 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:54:18.060013 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76501], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.489078523] seconds [----] I, [2016-09-13T04:54:18.060203 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76501], Delivering... [----] I, [2016-09-13T04:54:18.066937 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035622119903564453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036153793334960938, :pending_vm_jobs=>0.0008273124694824219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006321430206298828} [----] I, [2016-09-13T04:54:18.067312 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76501], State: [ok], Delivered in [0.007099885] seconds [----] I, [2016-09-13T04:54:28.620828 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:54:28.642555 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76502], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:54:28.653874 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76503], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:54:28.665601 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76504], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:54:28.682786 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76505], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:54:29.065376 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:54:29.069077 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003919124603271484, :worker_monitor=>1.5523388385772705, :worker_dequeue=>0.006979465484619141, :total_time=>1.5635263919830322} [----] I, [2016-09-13T04:54:29.169046 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76503], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.522196823] seconds [----] I, [2016-09-13T04:54:29.169250 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76503], Delivering... [----] I, [2016-09-13T04:54:29.219963 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76503], State: [ok], Delivered in [0.05069076] seconds [----] I, [2016-09-13T04:54:29.254923 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76505], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.580225375] seconds [----] I, [2016-09-13T04:54:29.255103 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76505], Delivering... [----] I, [2016-09-13T04:54:29.260990 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00321197509765625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032291412353515625, :pending_vm_jobs=>0.0006659030914306641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005574941635131836} [----] I, [2016-09-13T04:54:29.261499 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76505], State: [ok], Delivered in [0.006324376] seconds [----] I, [2016-09-13T04:54:29.456825 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76504], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.79761353] seconds [----] I, [2016-09-13T04:54:29.456981 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76504], Delivering... [----] I, [2016-09-13T04:54:29.459612 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76504], State: [ok], Delivered in [0.002627271] seconds [----] I, [2016-09-13T04:54:29.461525 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76502], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.83460524] seconds [----] I, [2016-09-13T04:54:29.461785 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76502], Delivering... [----] I, [2016-09-13T04:54:29.467695 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76502], State: [ok], Delivered in [0.00589959] seconds [----] I, [2016-09-13T04:54:43.695019 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:54:43.712459 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76506], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:54:45.552247 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:54:45.561453 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0047800540924072266, :worker_monitor=>1.4288208484649658, :worker_dequeue=>0.016327857971191406, :total_time=>1.4503436088562012} [----] I, [2016-09-13T04:54:46.394763 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76506], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.693301289] seconds [----] I, [2016-09-13T04:54:46.394954 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76506], Delivering... [----] I, [2016-09-13T04:54:46.401438 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003514528274536133, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003534078598022461, :pending_vm_jobs=>0.0008099079132080078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006105184555053711} [----] I, [2016-09-13T04:54:46.401764 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76506], State: [ok], Delivered in [0.006803499] seconds [----] I, [2016-09-13T04:54:50.562052 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:54:50 UTC]... [----] I, [2016-09-13T04:54:50.588118 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:54:50 UTC]...Complete [----] I, [2016-09-13T04:54:58.724388 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:54:58.735436 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76507], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:54:58.752678 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76508], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:55:02.387826 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:55:02.396978 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004667043685913086, :server_monitor=>0.11451268196105957, :worker_monitor=>1.6275086402893066, :worker_dequeue=>0.01654648780822754, :total_time=>1.7636868953704834} [----] I, [2016-09-13T04:55:02.564781 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76508], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.824532223] seconds [----] I, [2016-09-13T04:55:02.565063 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76508], Delivering... [----] I, [2016-09-13T04:55:02.573675 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004393339157104492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004418611526489258, :pending_vm_jobs=>0.0010793209075927734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008014678955078125} [----] I, [2016-09-13T04:55:02.574060 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76508], State: [ok], Delivered in [0.009009815] seconds [----] I, [2016-09-13T04:55:02.587174 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76507], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.858400743] seconds [----] I, [2016-09-13T04:55:02.587372 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76507], Delivering... [----] I, [2016-09-13T04:55:02.592068 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76507], State: [ok], Delivered in [0.004703149] seconds [----] I, [2016-09-13T04:55:13.769698 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:55:13.788036 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76509], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:55:18.758877 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:55:18.762803 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005952119827270508, :worker_monitor=>1.3039326667785645, :worker_dequeue=>0.006953716278076172, :total_time=>1.317209243774414} [----] I, [2016-09-13T04:55:19.725373 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76509], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.947361921] seconds [----] I, [2016-09-13T04:55:19.725592 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76509], Delivering... [----] I, [2016-09-13T04:55:19.731992 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003367900848388672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033864974975585938, :pending_vm_jobs=>0.0008182525634765625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060634613037109375} [----] I, [2016-09-13T04:55:19.732355 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76509], State: [ok], Delivered in [0.006747] seconds [----] I, [2016-09-13T04:55:23.763922 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:55:23 UTC]... [----] I, [2016-09-13T04:55:23.782253 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:55:23 UTC]...Complete [----] I, [2016-09-13T04:55:28.806506 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:55:28.820261 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76510], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:55:28.827871 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76511], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:55:28.850954 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76512], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:55:28.868085 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76513], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:55:35.225282 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:55:35.232817 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00603032112121582, :worker_monitor=>1.3937032222747803, :worker_dequeue=>0.013022661209106445, :total_time=>1.4130899906158447} [----] I, [2016-09-13T04:55:35.692795 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76511], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.869474697] seconds [----] I, [2016-09-13T04:55:35.693105 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76511], Delivering... [----] I, [2016-09-13T04:55:35.708665 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76513], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.848492666] seconds [----] I, [2016-09-13T04:55:35.708857 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76513], Delivering... [----] I, [2016-09-13T04:55:35.715801 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003765583038330078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037860870361328125, :pending_vm_jobs=>0.0008687973022460938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006535768508911133} [----] I, [2016-09-13T04:55:35.716139 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76513], State: [ok], Delivered in [0.007275681] seconds [----] I, [2016-09-13T04:55:35.754196 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76510], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.943053883] seconds [----] I, [2016-09-13T04:55:35.754407 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76510], Delivering... [----] I, [2016-09-13T04:55:35.758687 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76510], State: [ok], Delivered in [0.004271502] seconds [----] I, [2016-09-13T04:55:35.759711 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76511], State: [ok], Delivered in [0.066604804] seconds [----] I, [2016-09-13T04:55:35.805468 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76512], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.97333148] seconds [----] I, [2016-09-13T04:55:35.805630 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76512], Delivering... [----] I, [2016-09-13T04:55:35.808367 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76512], State: [ok], Delivered in [0.002715519] seconds [----] I, [2016-09-13T04:55:43.878082 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:55:43.902736 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76514], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:55:45.265148 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:55:45.851471 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76514], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.965142494] seconds [----] I, [2016-09-13T04:55:45.851644 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76514], Delivering... [----] I, [2016-09-13T04:55:45.856914 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028290748596191406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00284576416015625, :pending_vm_jobs=>0.0006747245788574219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004914283752441406} [----] I, [2016-09-13T04:55:45.857217 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76514], State: [ok], Delivered in [0.005574182] seconds [----] I, [2016-09-13T04:55:51.601883 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006121158599853516, :worker_monitor=>1.3138940334320068, :worker_dequeue=>0.009416341781616211, :total_time=>1.3298685550689697} [----] I, [2016-09-13T04:55:56.602375 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:55:56 UTC]... [----] I, [2016-09-13T04:55:56.617137 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:55:56 UTC]...Complete [----] I, [2016-09-13T04:55:58.915561 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:55:58.937304 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76515], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:55:58.959934 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76516], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:56:01.747549 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:56:02.021178 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76516], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.073750597] seconds [----] I, [2016-09-13T04:56:02.021513 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76516], Delivering... [----] I, [2016-09-13T04:56:02.029373 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004159450531005859, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004183769226074219, :pending_vm_jobs=>0.0010099411010742188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0073699951171875} [----] I, [2016-09-13T04:56:02.033949 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76516], State: [ok], Delivered in [0.012443717] seconds [----] I, [2016-09-13T04:56:02.879562 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76515], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.958980781] seconds [----] I, [2016-09-13T04:56:02.879689 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76515], Delivering... [----] I, [2016-09-13T04:56:02.882687 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76515], State: [ok], Delivered in [0.002994418] seconds [----] I, [2016-09-13T04:56:07.818029 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041790008544921875, :worker_monitor=>1.0503487586975098, :worker_dequeue=>0.010267972946166992, :total_time=>1.0650148391723633} [----] I, [2016-09-13T04:56:13.972465 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:56:13.989310 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76517], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:56:17.845950 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:56:17.950974 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76517], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.97270822] seconds [----] I, [2016-09-13T04:56:17.951255 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76517], Delivering... [----] I, [2016-09-13T04:56:17.959079 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004332542419433594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004359722137451172, :pending_vm_jobs=>0.0008909702301025391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007278919219970703} [----] I, [2016-09-13T04:56:17.959542 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76517], State: [ok], Delivered in [0.008305587] seconds [----] I, [2016-09-13T04:56:24.309598 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00410771369934082, :worker_monitor=>1.4403722286224365, :worker_dequeue=>0.008264303207397461, :total_time=>1.4531984329223633} [----] I, [2016-09-13T04:56:29.001171 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:56:29.023614 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76518], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:56:29.046582 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76519], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:56:29.059065 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76520], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:56:29.080718 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76521], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:56:29.310074 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:56:29 UTC]... [----] I, [2016-09-13T04:56:29.326236 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:56:29 UTC]...Complete [----] I, [2016-09-13T04:56:29.335274 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:56:29.995261 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76519], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.967514939] seconds [----] I, [2016-09-13T04:56:29.995527 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76519], Delivering... [----] I, [2016-09-13T04:56:30.017856 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76521], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.949784354] seconds [----] I, [2016-09-13T04:56:30.017986 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76521], Delivering... [----] I, [2016-09-13T04:56:30.022985 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002698183059692383, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027124881744384766, :pending_vm_jobs=>0.0006539821624755859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004728078842163086} [----] I, [2016-09-13T04:56:30.023310 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76521], State: [ok], Delivered in [0.005291145] seconds [----] I, [2016-09-13T04:56:30.046588 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76518], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.040908362] seconds [----] I, [2016-09-13T04:56:30.046798 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76518], Delivering... [----] I, [2016-09-13T04:56:30.051976 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76518], State: [ok], Delivered in [0.005155175] seconds [----] I, [2016-09-13T04:56:30.058071 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76519], State: [ok], Delivered in [0.062502627] seconds [----] I, [2016-09-13T04:56:30.074804 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76520], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.022927165] seconds [----] I, [2016-09-13T04:56:30.074928 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76520], Delivering... [----] I, [2016-09-13T04:56:30.077052 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76520], State: [ok], Delivered in [0.0021196] seconds [----] I, [2016-09-13T04:56:40.833096 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00502324104309082, :worker_monitor=>1.450549840927124, :worker_dequeue=>0.011530637741088867, :total_time=>1.4675934314727783} [----] I, [2016-09-13T04:56:44.093184 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:56:44.115281 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76522], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:56:45.844461 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:56:46.315830 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76522], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.216372633] seconds [----] I, [2016-09-13T04:56:46.316039 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76522], Delivering... [----] I, [2016-09-13T04:56:46.321785 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030982494354248047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031385421752929688, :pending_vm_jobs=>0.0006630420684814453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00538182258605957} [----] I, [2016-09-13T04:56:46.322126 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76522], State: [ok], Delivered in [0.006099405] seconds [----] I, [2016-09-13T04:56:57.407104 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004293918609619141, :worker_monitor=>1.5276024341583252, :worker_dequeue=>0.008822202682495117, :total_time=>1.5410306453704834} [----] I, [2016-09-13T04:56:59.127625 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:56:59.143374 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76523], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:56:59.162000 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76524], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:57:02.407774 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:57:02 UTC]... [----] I, [2016-09-13T04:57:02.442063 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:57:02 UTC]...Complete [----] I, [2016-09-13T04:57:02.589303 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T04:57:02.595450 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:57:03.178230 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76524], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.029247997] seconds [----] I, [2016-09-13T04:57:03.178435 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76524], Delivering... [----] I, [2016-09-13T04:57:03.183625 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002780914306640625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027992725372314453, :pending_vm_jobs=>0.0005695819854736328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0048525333404541016} [----] I, [2016-09-13T04:57:03.183925 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76524], State: [ok], Delivered in [0.005506097] seconds [----] I, [2016-09-13T04:57:03.195450 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76523], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.062889047] seconds [----] I, [2016-09-13T04:57:03.195733 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76523], Delivering... [----] I, [2016-09-13T04:57:03.201694 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76523], State: [ok], Delivered in [0.005976924] seconds [----] I, [2016-09-13T04:57:14.135543 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007324934005737305, :worker_monitor=>1.5008394718170166, :worker_dequeue=>0.011718511581420898, :total_time=>1.5205144882202148} [----] I, [2016-09-13T04:57:14.173184 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:57:14.189114 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76525], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:57:19.145316 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:57:19.543965 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76525], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.363809711] seconds [----] I, [2016-09-13T04:57:19.544149 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76525], Delivering... [----] I, [2016-09-13T04:57:19.550537 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003229856491088867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032510757446289062, :pending_vm_jobs=>0.0008215904235839844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005900144577026367} [----] I, [2016-09-13T04:57:19.550899 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76525], State: [ok], Delivered in [0.006744538] seconds [----] I, [2016-09-13T04:57:29.203174 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:57:29.218040 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76526], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:57:29.229308 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76527], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:57:29.252270 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76528], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:57:29.269556 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76529], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:57:30.495529 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:57:30.506021 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040836334228515625, :worker_monitor=>1.3066120147705078, :worker_dequeue=>0.018998146057128906, :total_time=>1.330045223236084} [----] I, [2016-09-13T04:57:30.641490 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76528], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.405148233] seconds [----] I, [2016-09-13T04:57:30.641732 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76528], Delivering... [----] I, [2016-09-13T04:57:30.647147 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76529], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.389673198] seconds [----] I, [2016-09-13T04:57:30.647363 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76529], Delivering... [----] I, [2016-09-13T04:57:30.654289 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003609180450439453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003632068634033203, :pending_vm_jobs=>0.0009207725524902344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006513118743896484} [----] I, [2016-09-13T04:57:30.654748 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76529], State: [ok], Delivered in [0.007392894] seconds [----] I, [2016-09-13T04:57:30.698473 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76528], State: [ok], Delivered in [0.056673056] seconds [----] I, [2016-09-13T04:57:33.281087 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76526], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.073248587] seconds [----] I, [2016-09-13T04:57:33.281269 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76526], Delivering... [----] I, [2016-09-13T04:57:33.286143 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76526], State: [ok], Delivered in [0.004864346] seconds [----] I, [2016-09-13T04:57:33.286766 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76527], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.063794901] seconds [----] I, [2016-09-13T04:57:33.286931 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76527], Delivering... [----] I, [2016-09-13T04:57:33.290042 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76527], State: [ok], Delivered in [0.003100491] seconds [----] I, [2016-09-13T04:57:35.506763 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:57:35 UTC]... [----] I, [2016-09-13T04:57:35.532702 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:57:35 UTC]...Complete [----] I, [2016-09-13T04:57:44.280597 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:57:44.298592 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76530], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:57:46.831564 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:57:46.837843 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006092071533203125, :worker_monitor=>1.253056287765503, :worker_dequeue=>0.011120080947875977, :total_time=>1.270674705505371} [----] I, [2016-09-13T04:57:47.816919 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76530], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.530936722] seconds [----] I, [2016-09-13T04:57:47.817129 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76530], Delivering... [----] I, [2016-09-13T04:57:47.824005 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036530494689941406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003673076629638672, :pending_vm_jobs=>0.0008738040924072266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006435394287109375} [----] I, [2016-09-13T04:57:47.824405 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76530], State: [ok], Delivered in [0.00726823] seconds [----] I, [2016-09-13T04:57:59.309541 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:57:59.327898 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76531], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:57:59.339217 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76532], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:58:03.478842 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:58:03.485272 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005564451217651367, :worker_monitor=>1.5199472904205322, :worker_dequeue=>0.01134634017944336, :total_time=>1.5372505187988281} [----] I, [2016-09-13T04:58:04.054743 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76532], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.721399972] seconds [----] I, [2016-09-13T04:58:04.054979 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76532], Delivering... [----] I, [2016-09-13T04:58:04.062155 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003869295120239258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038907527923583984, :pending_vm_jobs=>0.00087738037109375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0067598819732666016} [----] I, [2016-09-13T04:58:04.062588 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76532], State: [ok], Delivered in [0.007601296] seconds [----] I, [2016-09-13T04:58:06.425738 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76531], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.11172395] seconds [----] I, [2016-09-13T04:58:06.425956 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76531], Delivering... [----] I, [2016-09-13T04:58:06.430831 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76531], State: [ok], Delivered in [0.004855799] seconds [----] I, [2016-09-13T04:58:08.485926 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:58:08 UTC]... [----] I, [2016-09-13T04:58:08.505217 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:58:08 UTC]...Complete [----] I, [2016-09-13T04:58:14.349379 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:58:14.368008 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76533], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:58:20.044107 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:58:20.050389 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004100322723388672, :worker_monitor=>1.3892967700958252, :worker_dequeue=>0.011090278625488281, :total_time=>1.4047834873199463} [----] I, [2016-09-13T04:58:20.129053 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76533], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.775465451] seconds [----] I, [2016-09-13T04:58:20.129230 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76533], Delivering... [----] I, [2016-09-13T04:58:20.135041 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00298309326171875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003000020980834961, :pending_vm_jobs=>0.0007061958312988281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005407571792602539} [----] I, [2016-09-13T04:58:20.135387 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76533], State: [ok], Delivered in [0.006157164] seconds [----] I, [2016-09-13T04:58:29.378178 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T04:58:29.396997 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76534], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:58:29.408392 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76535], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:58:29.419706 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76536], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:58:29.432396 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76537], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:58:29.442704 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76538], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:58:29.459767 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76539], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:58:30.077533 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:58:30.225797 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76534], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.842481935] seconds [----] I, [2016-09-13T04:58:30.225977 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76534], Delivering... [----] I, [2016-09-13T04:58:30.227139 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T04:58:30.227371 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5329412096 [----] I, [2016-09-13T04:58:30.227574 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5113589760 [----] I, [2016-09-13T04:58:30.227684 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 215822336 [----] I, [2016-09-13T04:58:30.227771 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1317011456 [----] I, [2016-09-13T04:58:30.227848 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5059653632 [----] I, [2016-09-13T04:58:30.227929 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T04:58:30.228006 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T04:58:30.228082 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 536576000 [----] I, [2016-09-13T04:58:30.228272 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T04:58:30.228654 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7835164672 [----] I, [2016-09-13T04:58:30.228799 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T04:58:30.228895 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T04:58:30.229007 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T04:58:30.229100 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T04:58:30.229179 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T04:58:30.229261 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T04:58:30.229354 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T04:58:30.229468 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T04:58:30.229570 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T04:58:30.229655 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T04:58:30.229734 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273031168 [----] I, [2016-09-13T04:58:30.229816 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56193024 [----] I, [2016-09-13T04:58:30.229901 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216838144 [----] I, [2016-09-13T04:58:30.229975 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T04:58:30.230057 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140611584 [----] I, [2016-09-13T04:58:30.230137 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2609192960 [----] I, [2016-09-13T04:58:30.230211 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2298372096 [----] I, [2016-09-13T04:58:30.230288 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T04:58:30.230386 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T04:58:30.230504 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T04:58:30.230592 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37257216 [----] I, [2016-09-13T04:58:30.230672 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102285312 [----] I, [2016-09-13T04:58:30.230749 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53092352 [----] I, [2016-09-13T04:58:30.230822 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110137344 [----] I, [2016-09-13T04:58:30.230900 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155377664 [----] I, [2016-09-13T04:58:30.230975 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T04:58:30.231052 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T04:58:30.231129 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T04:58:30.231238 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T04:58:30.231343 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T04:58:30.231460 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T04:58:30.231560 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T04:58:30.231640 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T04:58:30.231720 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T04:58:30.254804 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76537], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.831288174] seconds [----] I, [2016-09-13T04:58:30.255080 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76537], Delivering... [----] I, [2016-09-13T04:58:30.276970 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T04:58:30.277291 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T04:58:30.283482 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T04:58:30.287916 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T04:58:30.293219 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T04:58:30.298599 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T04:58:30.303875 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T04:58:30.309208 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 837 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T04:58:30.314512 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T04:58:30.319758 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T04:58:30.325345 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T04:58:30.331012 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T04:58:30.335172 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T04:58:30.338553 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T04:58:30.341683 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>2}} [----] I, [2016-09-13T04:58:30.341833 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T04:58:30.341940 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>3, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T04:58:30.345907 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76537], State: [ok], Delivered in [0.090792181] seconds [----] I, [2016-09-13T04:58:30.347477 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358681000], Memory % [5.28], CPU Time [148626.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T04:58:30.348037 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76534], State: [ok], Delivered in [0.122004065] seconds [----] I, [2016-09-13T04:58:30.391549 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76539], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.939663282] seconds [----] I, [2016-09-13T04:58:30.391773 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76539], Delivering... [----] I, [2016-09-13T04:58:30.399143 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038526058197021484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038771629333496094, :pending_vm_jobs=>0.000946044921875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00693964958190918} [----] I, [2016-09-13T04:58:30.399591 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76539], State: [ok], Delivered in [0.007801857] seconds [----] I, [2016-09-13T04:58:30.484465 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76536], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.072273797] seconds [----] I, [2016-09-13T04:58:30.484973 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76536], Delivering... [----] I, [2016-09-13T04:58:30.491315 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76536], State: [ok], Delivered in [0.00638942] seconds [----] I, [2016-09-13T04:58:30.511528 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76538], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.073740962] seconds [----] I, [2016-09-13T04:58:30.511731 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76538], Delivering... [----] I, [2016-09-13T04:58:30.515289 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76538], State: [ok], Delivered in [0.003549708] seconds [----] I, [2016-09-13T04:58:36.704684 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:58:36.711870 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0046083927154541016, :worker_monitor=>1.6091322898864746, :worker_dequeue=>0.012887954711914062, :total_time=>1.6269679069519043} [----] I, [2016-09-13T04:58:37.454813 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76535], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.053978016] seconds [----] I, [2016-09-13T04:58:37.455028 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76535], Delivering... [----] I, [2016-09-13T04:58:37.463256 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:58:26 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [103156.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T04:58:37.463980 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:58:36 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [147736.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:58:37.464566 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:58:35 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [50498.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:58:37.465044 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:58:36 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48133.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T04:58:37.465623 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:58:29 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [235099.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T04:58:37.466203 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:58:35 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162419000], Memory % [3.1], CPU Time [37240.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T04:58:37.466777 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:58:33 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [197719.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T04:58:37.467299 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:58:36 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [148652.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T04:58:37.470227 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:58:27 UTC], Process Info: Memory Usage [588021760], Memory Size [917340160], Proportional Set Size: [425104000], Memory % [7.17], CPU Time [624.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:58:37.472444 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:58:36 UTC], Process Info: Memory Usage [588775424], Memory Size [930500608], Proportional Set Size: [426171000], Memory % [7.18], CPU Time [1411.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T04:58:37.474655 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:58:28 UTC], Process Info: Memory Usage [557682688], Memory Size [896778240], Proportional Set Size: [405410000], Memory % [6.8], CPU Time [4619.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T04:58:37.476804 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:58:30 UTC], Process Info: Memory Usage [580538368], Memory Size [909770752], Proportional Set Size: [419996000], Memory % [7.08], CPU Time [1248.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T04:58:37.477350 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:58:36 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [206355.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T04:58:37.477907 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:58:35 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [50526.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T04:58:37.478386 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 08:58:32 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165804000], Memory % [3.16], CPU Time [38141.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T04:58:37.478792 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76535], State: [ok], Delivered in [0.023763453] seconds [----] I, [2016-09-13T04:58:41.712523 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:58:41 UTC]... [----] I, [2016-09-13T04:58:41.734511 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:58:41 UTC]...Complete [----] I, [2016-09-13T04:58:44.472163 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:58:44.489051 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76540], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:58:46.763010 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:58:47.540832 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76540], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.062043404] seconds [----] I, [2016-09-13T04:58:47.541046 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76540], Delivering... [----] I, [2016-09-13T04:58:47.547921 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003551006317138672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035729408264160156, :pending_vm_jobs=>0.0008881092071533203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00645756721496582} [----] I, [2016-09-13T04:58:47.548348 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76540], State: [ok], Delivered in [0.00729415] seconds [----] I, [2016-09-13T04:58:53.189207 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004361629486083984, :worker_monitor=>1.4069890975952148, :worker_dequeue=>0.007150888442993164, :total_time=>1.41890287399292} [----] I, [2016-09-13T04:58:59.501202 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T04:58:59.522950 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76541], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:58:59.534530 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76542], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:59:03.214698 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:59:03.631859 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76542], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.104146974] seconds [----] I, [2016-09-13T04:59:03.632035 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76542], Delivering... [----] I, [2016-09-13T04:59:03.637856 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002933025360107422, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029554367065429688, :pending_vm_jobs=>0.0007574558258056641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00546717643737793} [----] I, [2016-09-13T04:59:03.638171 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76542], State: [ok], Delivered in [0.006135059] seconds [----] I, [2016-09-13T04:59:03.654833 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76541], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.142749059] seconds [----] I, [2016-09-13T04:59:03.655004 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76541], Delivering... [----] I, [2016-09-13T04:59:03.659312 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76541], State: [ok], Delivered in [0.004304577] seconds [----] I, [2016-09-13T04:59:09.742080 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004636526107788086, :worker_monitor=>1.5051348209381104, :worker_dequeue=>0.010365962982177734, :total_time=>1.5205121040344238} [----] I, [2016-09-13T04:59:14.545931 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:59:14.563006 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76543], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:59:14.742609 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:59:14 UTC]... [----] I, [2016-09-13T04:59:14.768761 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:59:14 UTC]...Complete [----] I, [2016-09-13T04:59:14.889633 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:59:15.717939 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76543], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.165463521] seconds [----] I, [2016-09-13T04:59:15.718175 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76543], Delivering... [----] I, [2016-09-13T04:59:15.725545 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003930091857910156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003952980041503906, :pending_vm_jobs=>0.0008685588836669922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068988800048828125} [----] I, [2016-09-13T04:59:15.725974 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76543], State: [ok], Delivered in [0.007810661] seconds [----] I, [2016-09-13T04:59:26.408985 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006644725799560547, :worker_monitor=>1.4755394458770752, :worker_dequeue=>0.009006977081298828, :total_time=>1.4916489124298096} [----] I, [2016-09-13T04:59:29.576168 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T04:59:29.591745 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76544], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:59:29.604519 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76545], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:59:29.620371 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76546], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:59:29.706505 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76547], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:59:31.420179 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:59:31.849116 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76545], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.253049007] seconds [----] I, [2016-09-13T04:59:31.849360 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76545], Delivering... [----] I, [2016-09-13T04:59:31.894922 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76547], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.265409503] seconds [----] I, [2016-09-13T04:59:31.895142 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76547], Delivering... [----] I, [2016-09-13T04:59:31.901933 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003467082977294922, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034880638122558594, :pending_vm_jobs=>0.0008833408355712891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006310224533081055} [----] I, [2016-09-13T04:59:31.902312 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76547], State: [ok], Delivered in [0.007162551] seconds [----] I, [2016-09-13T04:59:31.907767 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76545], State: [ok], Delivered in [0.058335042] seconds [----] I, [2016-09-13T04:59:33.753792 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76544], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.172591675] seconds [----] I, [2016-09-13T04:59:33.754024 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76544], Delivering... [----] I, [2016-09-13T04:59:33.759381 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76544], State: [ok], Delivered in [0.005342375] seconds [----] I, [2016-09-13T04:59:33.803964 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76546], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.193850841] seconds [----] I, [2016-09-13T04:59:33.804212 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76546], Delivering... [----] I, [2016-09-13T04:59:33.808498 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76546], State: [ok], Delivered in [0.004254286] seconds [----] I, [2016-09-13T04:59:42.844088 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0045337677001953125, :worker_monitor=>1.3861660957336426, :worker_dequeue=>0.008384227752685547, :total_time=>1.3994238376617432} [----] I, [2016-09-13T04:59:45.117762 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T04:59:45.188005 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76548], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T04:59:47.844599 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:59:47 UTC]... [----] I, [2016-09-13T04:59:47.867626 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 08:59:47 UTC]...Complete [----] I, [2016-09-13T04:59:47.878242 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T04:59:48.119471 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76548], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.959590457] seconds [----] I, [2016-09-13T04:59:48.119650 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76548], Delivering... [----] I, [2016-09-13T04:59:48.125950 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003357410430908203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033752918243408203, :pending_vm_jobs=>0.0007863044738769531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005946636199951172} [----] I, [2016-09-13T04:59:48.126307 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76548], State: [ok], Delivered in [0.006652447] seconds [----] I, [2016-09-13T04:59:59.408648 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00480341911315918, :worker_monitor=>1.4900050163269043, :worker_dequeue=>0.011302947998046875, :total_time=>1.5065422058105469} [----] I, [2016-09-13T05:00:00.206086 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 7. [----] I, [2016-09-13T05:00:00.222173 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76549], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:00:00.233517 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76550], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:00:00.244850 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76551], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:00:00.256519 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76552], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:00:00.269641 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76553], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:00:00.271211 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget] [----] I, [2016-09-13T05:00:00.279583 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76554], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473760800] [----] I, [2016-09-13T05:00:00.279709 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T05:00:00.281048 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget] [----] I, [2016-09-13T05:00:00.295711 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76555], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473760800] [----] I, [2016-09-13T05:00:00.295842 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T05:00:04.420125 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 7 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:00:05.252290 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76550], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.024597297] seconds [----] I, [2016-09-13T05:00:05.252574 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76550], Delivering... [----] I, [2016-09-13T05:00:05.259052 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034525394439697266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003473520278930664, :pending_vm_jobs=>0.0007758140563964844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00606083869934082} [----] I, [2016-09-13T05:00:05.259387 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76550], State: [ok], Delivered in [0.006813908] seconds [----] I, [2016-09-13T05:00:06.914477 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76549], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.703832234] seconds [----] I, [2016-09-13T05:00:06.914659 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76549], Delivering... [----] I, [2016-09-13T05:00:06.918856 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76549], State: [ok], Delivered in [0.004166047] seconds [----] I, [2016-09-13T05:00:06.959505 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76551], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.721203081] seconds [----] I, [2016-09-13T05:00:06.959682 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76551], Delivering... [----] I, [2016-09-13T05:00:06.961874 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76551], State: [ok], Delivered in [0.002186413] seconds [----] I, [2016-09-13T05:00:06.971115 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76552], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.721392205] seconds [----] I, [2016-09-13T05:00:06.971311 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76552], Delivering... [----] I, [2016-09-13T05:00:06.985276 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76552], State: [ok], Delivered in [0.013934033] seconds [----] I, [2016-09-13T05:00:06.999651 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76553], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.737903065] seconds [----] I, [2016-09-13T05:00:06.999908 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76553], Delivering... [----] I, [2016-09-13T05:00:07.010207 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76553], State: [ok], Delivered in [0.010315108] seconds [----] I, [2016-09-13T05:00:07.011052 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76554], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473760800], Dequeued in: [6.738387455] seconds [----] I, [2016-09-13T05:00:07.011199 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76554], Delivering... [----] I, [2016-09-13T05:00:07.018479 #2928:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered Hosts] invoking action: [generate_widget] for target: [rss_newest_hosts] [----] I, [2016-09-13T05:00:07.034173 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76555], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473760800], Dequeued in: [6.751736738] seconds [----] I, [2016-09-13T05:00:07.034370 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76555], Delivering... [----] I, [2016-09-13T05:00:07.043877 #2937:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered VMs] invoking action: [generate_widget] for target: [rss_newest_vms] [----] I, [2016-09-13T05:00:07.050721 #2928:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [211], Name: [Generate Widget: 'EVM: Recently Discovered Hosts'] for: [1] groups [----] I, [2016-09-13T05:00:07.062377 #2928:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered Hosts] ID: [18] Queueing Content Generation [----] I, [2016-09-13T05:00:07.079860 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76556], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T05:00:07.080037 #2928:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered Hosts] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered Hosts] [----] I, [2016-09-13T05:00:07.085033 #2937:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [212], Name: [Generate Widget: 'EVM: Recently Discovered VMs'] for: [1] groups [----] I, [2016-09-13T05:00:07.102650 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76554], State: [ok], Delivered in [0.091416127] seconds [----] I, [2016-09-13T05:00:07.107921 #2937:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered VMs] ID: [19] Queueing Content Generation [----] I, [2016-09-13T05:00:07.131285 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76557], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T05:00:07.131585 #2937:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered VMs] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered VMs] [----] I, [2016-09-13T05:00:07.154070 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76555], State: [ok], Delivered in [0.11968047] seconds [----] I, [2016-09-13T05:00:09.438251 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=reporting, wcount=2, priority=200 [----] I, [2016-09-13T05:00:11.771682 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [76556], MiqWorker id: [18], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [4.703492167] seconds [----] I, [2016-09-13T05:00:11.771930 #2978:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76556], Delivering... [----] I, [2016-09-13T05:00:11.795027 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T05:00:11.829510 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T05:00:11.830020 #2978:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76556], State: [ok], Delivered in [0.058076836] seconds [----] I, [2016-09-13T05:00:11.832701 #2978:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [76556], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T05:00:11.832898 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [18], MiqTask ID: [211], Status: [ok] [----] I, [2016-09-13T05:00:11.838566 #2978:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [211] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T05:00:11.885847 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [76557], MiqWorker id: [18], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [4.770270742] seconds [----] I, [2016-09-13T05:00:11.886031 #2978:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76557], Delivering... [----] I, [2016-09-13T05:00:11.903778 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T05:00:11.936666 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T05:00:11.937091 #2978:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76557], State: [ok], Delivered in [0.051052999] seconds [----] I, [2016-09-13T05:00:11.939516 #2978:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [76557], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T05:00:11.939689 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [19], MiqTask ID: [212], Status: [ok] [----] I, [2016-09-13T05:00:11.944761 #2978:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [212] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T05:00:15.310954 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:00:15.325026 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76558], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:00:15.329813 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered Hosts] with id: [18] [----] I, [2016-09-13T05:00:15.329932 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_18 [----] I, [2016-09-13T05:00:15.332042 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T05:00:15.332286 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 10:00:00 UTC [----] I, [2016-09-13T05:00:15.333325 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered Hosts] schedule updated to run at 2016-09-13 10:00:00 UTC with interval 3600 [----] I, [2016-09-13T05:00:15.333587 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered VMs] with id: [19] [----] I, [2016-09-13T05:00:15.333673 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_19 [----] I, [2016-09-13T05:00:15.335369 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T05:00:15.335626 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 10:00:00 UTC [----] I, [2016-09-13T05:00:15.336687 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered VMs] schedule updated to run at 2016-09-13 10:00:00 UTC with interval 3600 [----] I, [2016-09-13T05:00:16.014872 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:00:16.022461 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0046787261962890625, :worker_monitor=>1.5613305568695068, :worker_dequeue=>0.013178825378417969, :total_time=>1.5794997215270996} [----] I, [2016-09-13T05:00:16.155087 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76558], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.835367911] seconds [----] I, [2016-09-13T05:00:16.155272 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76558], Delivering... [----] I, [2016-09-13T05:00:16.161732 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035076141357421875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035314559936523438, :pending_vm_jobs=>0.0007860660552978516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060770511627197266} [----] I, [2016-09-13T05:00:16.162054 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76558], State: [ok], Delivered in [0.006780308] seconds [----] I, [2016-09-13T05:00:21.022961 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:00:21 UTC]... [----] I, [2016-09-13T05:00:21.074062 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:00:21 UTC]...Complete [----] I, [2016-09-13T05:00:30.343892 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:00:30.365843 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76559], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:00:30.389198 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76560], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:00:30.406214 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76561], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:00:30.428775 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76562], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:00:32.865355 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:00:32.871870 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004527568817138672, :worker_monitor=>1.5480668544769287, :worker_dequeue=>0.011701583862304688, :total_time=>1.5645897388458252} [----] I, [2016-09-13T05:00:33.477008 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76560], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.104716291] seconds [----] I, [2016-09-13T05:00:33.477205 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76560], Delivering... [----] I, [2016-09-13T05:00:33.531822 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76560], State: [ok], Delivered in [0.054592045] seconds [----] I, [2016-09-13T05:00:33.554949 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76562], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.13523462] seconds [----] I, [2016-09-13T05:00:33.555139 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76562], Delivering... [----] I, [2016-09-13T05:00:33.561568 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003377199172973633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033957958221435547, :pending_vm_jobs=>0.0007987022399902344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006006717681884766} [----] I, [2016-09-13T05:00:33.561941 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76562], State: [ok], Delivered in [0.006780646] seconds [----] I, [2016-09-13T05:00:34.234629 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76559], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.88336264] seconds [----] I, [2016-09-13T05:00:34.234786 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76559], Delivering... [----] I, [2016-09-13T05:00:34.238815 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76559], State: [ok], Delivered in [0.004005915] seconds [----] I, [2016-09-13T05:00:34.268922 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76561], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.871424817] seconds [----] I, [2016-09-13T05:00:34.269095 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76561], Delivering... [----] I, [2016-09-13T05:00:34.271678 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76561], State: [ok], Delivered in [0.002556848] seconds [----] I, [2016-09-13T05:00:45.440851 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:00:45.463403 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76563], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:00:49.169486 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:00:49.177968 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004053831100463867, :worker_monitor=>1.2551147937774658, :worker_dequeue=>0.013665437698364258, :total_time=>1.2731211185455322} [----] I, [2016-09-13T05:00:49.326260 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76563], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.879702268] seconds [----] I, [2016-09-13T05:00:49.326466 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76563], Delivering... [----] I, [2016-09-13T05:00:49.332097 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002979755401611328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002996206283569336, :pending_vm_jobs=>0.0006532669067382812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00528717041015625} [----] I, [2016-09-13T05:00:49.332459 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76563], State: [ok], Delivered in [0.005987208] seconds [----] I, [2016-09-13T05:00:54.178669 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:00:54 UTC]... [----] I, [2016-09-13T05:00:54.194759 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:00:54 UTC]...Complete [----] I, [2016-09-13T05:01:00.476346 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T05:01:00.498261 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76564], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:01:00.526553 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76565], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:01:00.560848 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76566], id: [], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:01:05.822901 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:01:05.833517 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0046234130859375, :worker_monitor=>1.5764732360839844, :worker_dequeue=>0.022301673889160156, :total_time=>1.6038222312927246} [----] I, [2016-09-13T05:01:05.955692 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76565], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.451616885] seconds [----] I, [2016-09-13T05:01:05.955921 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76565], Delivering... [----] I, [2016-09-13T05:01:05.962981 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038590431213378906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038788318634033203, :pending_vm_jobs=>0.0008513927459716797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00664067268371582} [----] I, [2016-09-13T05:01:05.963399 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76565], State: [ok], Delivered in [0.007474669] seconds [----] I, [2016-09-13T05:01:07.429970 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76564], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.948416264] seconds [----] I, [2016-09-13T05:01:07.430213 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76564], Delivering... [----] I, [2016-09-13T05:01:07.436163 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76564], State: [ok], Delivered in [0.0059257] seconds [----] I, [2016-09-13T05:01:07.464106 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76566], MiqWorker id: [14], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.924643971] seconds [----] I, [2016-09-13T05:01:07.464356 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76566], Delivering... [----] I, [2016-09-13T05:01:15.575894 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:01:15.599700 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76567], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:01:15.863665 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:01:16.096641 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76567], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.512676509] seconds [----] I, [2016-09-13T05:01:16.096874 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76567], Delivering... [----] I, [2016-09-13T05:01:16.106051 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004675149917602539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004702091217041016, :pending_vm_jobs=>0.0011632442474365234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008745431900024414} [----] I, [2016-09-13T05:01:16.106516 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76567], State: [ok], Delivered in [0.009649251] seconds [----] I, [2016-09-13T05:01:23.515475 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033423900604248047, :worker_monitor=>2.631272554397583, :worker_dequeue=>0.006139516830444336, :total_time=>2.641019821166992} [----] I, [2016-09-13T05:01:28.515969 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:01:28 UTC]... [----] I, [2016-09-13T05:01:28.554544 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:01:28 UTC]...Complete [----] I, [2016-09-13T05:01:30.616394 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:01:30.808096 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76568], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:01:30.836549 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76569], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:01:30.908275 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76570], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:01:30.951792 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76571], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:01:33.851185 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:01:33.943527 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76569], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.131649915] seconds [----] I, [2016-09-13T05:01:33.943666 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76569], Delivering... [----] I, [2016-09-13T05:01:33.989433 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76569], State: [ok], Delivered in [0.045724056] seconds [----] I, [2016-09-13T05:01:34.042625 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76571], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.119906433] seconds [----] I, [2016-09-13T05:01:34.042756 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76571], Delivering... [----] I, [2016-09-13T05:01:34.046901 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002248048782348633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022668838500976562, :pending_vm_jobs=>0.0005314350128173828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0039021968841552734} [----] I, [2016-09-13T05:01:34.047148 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76571], State: [ok], Delivered in [0.004368237] seconds [----] I, [2016-09-13T05:01:34.603080 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76568], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.982047787] seconds [----] I, [2016-09-13T05:01:34.603261 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76568], Delivering... [----] I, [2016-09-13T05:01:34.609162 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76568], State: [ok], Delivered in [0.005865643] seconds [----] I, [2016-09-13T05:01:34.668900 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76570], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.827817266] seconds [----] I, [2016-09-13T05:01:34.669059 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76570], Delivering... [----] I, [2016-09-13T05:01:34.671841 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76570], State: [ok], Delivered in [0.002773357] seconds [----] I, [2016-09-13T05:01:41.438716 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004067420959472656, :worker_monitor=>2.5675477981567383, :worker_dequeue=>0.010018110275268555, :total_time=>2.581939220428467} [----] I, [2016-09-13T05:01:45.969743 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:01:46.011597 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76572], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:01:46.453966 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:01:46.803382 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76572], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.828511163] seconds [----] I, [2016-09-13T05:01:46.803564 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76572], Delivering... [----] I, [2016-09-13T05:01:46.808890 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028715133666992188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002888202667236328, :pending_vm_jobs=>0.0006568431854248047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004981040954589844} [----] I, [2016-09-13T05:01:46.809222 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76572], State: [ok], Delivered in [0.005658788] seconds [----] I, [2016-09-13T05:01:59.001390 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025141239166259766, :worker_monitor=>2.5116770267486572, :worker_dequeue=>0.009421825408935547, :total_time=>2.5238189697265625} [----] I, [2016-09-13T05:02:01.023222 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:02:01.079254 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76573], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:02:01.115333 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76574], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:02:04.001915 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:02:04 UTC]... [----] I, [2016-09-13T05:02:04.088616 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:02:04 UTC]...Complete [----] I, [2016-09-13T05:02:04.100518 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T05:02:04.104218 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:02:04.272087 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76574], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.187158911] seconds [----] I, [2016-09-13T05:02:04.272276 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76574], Delivering... [----] I, [2016-09-13T05:02:04.278994 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003320932388305664, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033435821533203125, :pending_vm_jobs=>0.0009829998016357422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006254673004150391} [----] I, [2016-09-13T05:02:04.279395 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76574], State: [ok], Delivered in [0.00711266] seconds [----] I, [2016-09-13T05:02:04.995329 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76573], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.967498749] seconds [----] I, [2016-09-13T05:02:04.995602 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76573], Delivering... [----] I, [2016-09-13T05:02:05.011633 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76573], State: [ok], Delivered in [0.015960767] seconds [----] I, [2016-09-13T05:02:16.128603 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:02:16.206762 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76575], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:02:16.677965 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:02:16.689103 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005197286605834961, :worker_monitor=>2.5402307510375977, :worker_dequeue=>0.018500566482543945, :total_time=>2.564354658126831} [----] I, [2016-09-13T05:02:17.130304 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76575], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.997049503] seconds [----] I, [2016-09-13T05:02:17.130543 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76575], Delivering... [----] I, [2016-09-13T05:02:17.137687 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035469532012939453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035669803619384766, :pending_vm_jobs=>0.0010089874267578125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006650686264038086} [----] I, [2016-09-13T05:02:17.138039 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76575], State: [ok], Delivered in [0.007491402] seconds [----] I, [2016-09-13T05:02:31.222281 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:02:31.270299 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76576], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:02:31.308006 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76577], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:02:31.330040 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76578], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:02:31.343084 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76579], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:02:34.053833 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:02:34.057982 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004218578338623047, :server_monitor=>0.12405967712402344, :worker_monitor=>2.205822706222534, :worker_dequeue=>0.0077288150787353516, :total_time=>2.3421614170074463} [----] I, [2016-09-13T05:02:34.584412 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76577], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.306310549] seconds [----] I, [2016-09-13T05:02:34.584716 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76577], Delivering... [----] I, [2016-09-13T05:02:34.613737 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76579], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.278152418] seconds [----] I, [2016-09-13T05:02:34.614130 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76579], Delivering... [----] I, [2016-09-13T05:02:34.625139 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.006022214889526367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.006173372268676758, :pending_vm_jobs=>0.0015287399291992188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010374784469604492} [----] I, [2016-09-13T05:02:34.625592 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76579], State: [ok], Delivered in [0.011491717] seconds [----] I, [2016-09-13T05:02:34.675620 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76577], State: [ok], Delivered in [0.09086787] seconds [----] I, [2016-09-13T05:02:35.272784 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76576], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.04282365] seconds [----] I, [2016-09-13T05:02:35.272917 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76576], Delivering... [----] I, [2016-09-13T05:02:35.276120 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76576], State: [ok], Delivered in [0.003191592] seconds [----] I, [2016-09-13T05:02:35.306359 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76578], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.995079615] seconds [----] I, [2016-09-13T05:02:35.306524 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76578], Delivering... [----] I, [2016-09-13T05:02:35.308744 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76578], State: [ok], Delivered in [0.002219254] seconds [----] I, [2016-09-13T05:02:39.058473 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:02:39 UTC]... [----] I, [2016-09-13T05:02:39.077815 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:02:39 UTC]...Complete [----] I, [2016-09-13T05:02:43.964860 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76566], State: [ok], Delivered in [96.500494017] seconds [----] I, [2016-09-13T05:02:46.353079 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:02:46.394168 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76580], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:02:50.786135 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:02:50.794818 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025320053100585938, :worker_monitor=>1.6719744205474854, :worker_dequeue=>0.015161514282226562, :total_time=>1.6900255680084229} [----] I, [2016-09-13T05:02:50.877815 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76580], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.518849799] seconds [----] I, [2016-09-13T05:02:50.878030 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76580], Delivering... [----] I, [2016-09-13T05:02:50.884718 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003592252731323242, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036127567291259766, :pending_vm_jobs=>0.0008282661437988281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062677860260009766} [----] I, [2016-09-13T05:02:50.885093 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76580], State: [ok], Delivered in [0.007063052] seconds [----] I, [2016-09-13T05:03:01.406547 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:03:01.429510 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76581], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:03:01.459449 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76582], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:03:07.352692 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:03:07.359829 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0043261051177978516, :worker_monitor=>1.5134634971618652, :worker_dequeue=>0.012589454650878906, :total_time=>1.5307402610778809} [----] I, [2016-09-13T05:03:07.885290 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76582], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.449923931] seconds [----] I, [2016-09-13T05:03:07.885522 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76582], Delivering... [----] I, [2016-09-13T05:03:07.891525 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031435489654541016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031614303588867188, :pending_vm_jobs=>0.0007522106170654297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005613803863525391} [----] I, [2016-09-13T05:03:07.891889 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76582], State: [ok], Delivered in [0.006371082] seconds [----] I, [2016-09-13T05:03:08.114121 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76581], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.702882934] seconds [----] I, [2016-09-13T05:03:08.114363 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76581], Delivering... [----] I, [2016-09-13T05:03:08.119031 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76581], State: [ok], Delivered in [0.004696728] seconds [----] I, [2016-09-13T05:03:12.362199 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:03:12 UTC]... [----] I, [2016-09-13T05:03:12.394011 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:03:12 UTC]...Complete [----] I, [2016-09-13T05:03:16.471749 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:03:16.497216 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76583], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:03:17.422243 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:03:17.491570 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76583], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.013257266] seconds [----] I, [2016-09-13T05:03:17.491799 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76583], Delivering... [----] I, [2016-09-13T05:03:17.498160 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004008054733276367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004027366638183594, :pending_vm_jobs=>0.00063323974609375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005999088287353516} [----] I, [2016-09-13T05:03:17.498620 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76583], State: [ok], Delivered in [0.006824903] seconds [----] I, [2016-09-13T05:03:24.128069 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005025148391723633, :worker_monitor=>1.6808857917785645, :worker_dequeue=>0.012181520462036133, :total_time=>1.6985642910003662} [----] I, [2016-09-13T05:03:31.509706 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T05:03:31.531775 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76584], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:03:31.548829 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76585], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:03:31.565646 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76586], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:03:31.576967 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76587], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:03:31.600410 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76588], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:03:31.622757 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76589], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:03:34.262766 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:03:35.120145 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76584], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.605499676] seconds [----] I, [2016-09-13T05:03:35.120354 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76584], Delivering... [----] I, [2016-09-13T05:03:35.121289 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T05:03:35.121521 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5331447808 [----] I, [2016-09-13T05:03:35.121623 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5115408384 [----] I, [2016-09-13T05:03:35.121707 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 216039424 [----] I, [2016-09-13T05:03:35.121779 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1317011456 [----] I, [2016-09-13T05:03:35.121848 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5061443584 [----] I, [2016-09-13T05:03:35.121918 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T05:03:35.121993 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T05:03:35.122059 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 537317376 [----] I, [2016-09-13T05:03:35.122126 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T05:03:35.122210 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7870025728 [----] I, [2016-09-13T05:03:35.122280 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T05:03:35.122400 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T05:03:35.122516 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T05:03:35.122591 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 1540096 [----] I, [2016-09-13T05:03:35.122659 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T05:03:35.122733 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T05:03:35.122800 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T05:03:35.122866 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T05:03:35.122930 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T05:03:35.122997 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T05:03:35.123059 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273534976 [----] I, [2016-09-13T05:03:35.123121 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56451072 [----] I, [2016-09-13T05:03:35.123185 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217083904 [----] I, [2016-09-13T05:03:35.123254 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6242304 [----] I, [2016-09-13T05:03:35.123345 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140873728 [----] I, [2016-09-13T05:03:35.123448 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2607001600 [----] I, [2016-09-13T05:03:35.123536 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2295713792 [----] I, [2016-09-13T05:03:35.123607 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T05:03:35.123672 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T05:03:35.123736 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T05:03:35.123797 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37556224 [----] I, [2016-09-13T05:03:35.123863 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102289408 [----] I, [2016-09-13T05:03:35.123927 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 52940800 [----] I, [2016-09-13T05:03:35.123989 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110415872 [----] I, [2016-09-13T05:03:35.124066 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155230208 [----] I, [2016-09-13T05:03:35.124139 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T05:03:35.124205 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T05:03:35.124265 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T05:03:35.124345 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T05:03:35.124439 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T05:03:35.124526 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T05:03:35.124598 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T05:03:35.124661 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T05:03:35.124722 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T05:03:35.165230 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T05:03:35.165478 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T05:03:35.168935 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T05:03:35.171485 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T05:03:35.174501 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T05:03:35.177508 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T05:03:35.180506 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T05:03:35.183537 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 838 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T05:03:35.186501 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T05:03:35.189484 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T05:03:35.192352 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.6 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T05:03:35.195219 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T05:03:35.198256 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 182 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T05:03:35.201164 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T05:03:35.203724 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:03:35.203865 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:03:35.203967 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>4, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T05:03:35.208089 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [147783.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:03:35.208463 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76584], State: [ok], Delivered in [0.088084] seconds [----] I, [2016-09-13T05:03:35.212173 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76587], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.642793974] seconds [----] I, [2016-09-13T05:03:35.212368 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76587], Delivering... [----] I, [2016-09-13T05:03:35.234461 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76589], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.624038108] seconds [----] I, [2016-09-13T05:03:35.234708 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76589], Delivering... [----] I, [2016-09-13T05:03:35.244759 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005261421203613281, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00528717041015625, :pending_vm_jobs=>0.0012993812561035156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009545564651489258} [----] I, [2016-09-13T05:03:35.245237 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76589], State: [ok], Delivered in [0.010542742] seconds [----] I, [2016-09-13T05:03:35.280509 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76586], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.727039466] seconds [----] I, [2016-09-13T05:03:35.280744 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76586], Delivering... [----] I, [2016-09-13T05:03:35.285334 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76586], State: [ok], Delivered in [0.004571397] seconds [----] I, [2016-09-13T05:03:35.285729 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76587], State: [ok], Delivered in [0.073359543] seconds [----] I, [2016-09-13T05:03:35.331832 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76588], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.74957382] seconds [----] I, [2016-09-13T05:03:35.332006 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76588], Delivering... [----] I, [2016-09-13T05:03:35.335190 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76588], State: [ok], Delivered in [0.003160768] seconds [----] I, [2016-09-13T05:03:41.005882 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:03:41.013356 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007390499114990234, :worker_monitor=>1.722177267074585, :worker_dequeue=>0.013825416564941406, :total_time=>1.7437541484832764} [----] I, [2016-09-13T05:03:41.293031 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76585], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [9.756706798] seconds [----] I, [2016-09-13T05:03:41.293266 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76585], Delivering... [----] I, [2016-09-13T05:03:41.302794 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:03:31 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [235278.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T05:03:41.303508 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:03:40 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [148715.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:03:41.304014 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:03:40 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [147806.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:03:41.304630 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:03:38 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347147000], Memory % [5.04], CPU Time [103174.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T05:03:41.305121 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:03:36 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [48141.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T05:03:41.305735 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:03:39 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162419000], Memory % [3.1], CPU Time [37250.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T05:03:41.306321 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:03:38 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358681000], Memory % [5.28], CPU Time [199200.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T05:03:41.306900 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:03:39 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [50528.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:03:41.310247 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:03:37 UTC], Process Info: Memory Usage [588021760], Memory Size [917340160], Proportional Set Size: [425108000], Memory % [7.17], CPU Time [637.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:03:41.312729 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:03:36 UTC], Process Info: Memory Usage [588775424], Memory Size [930500608], Proportional Set Size: [426170000], Memory % [7.18], CPU Time [1425.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:03:41.315072 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:03:38 UTC], Process Info: Memory Usage [557953024], Memory Size [912506880], Proportional Set Size: [405650000], Memory % [6.8], CPU Time [4632.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T05:03:41.317256 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:03:31 UTC], Process Info: Memory Usage [580767744], Memory Size [924450816], Proportional Set Size: [420219000], Memory % [7.08], CPU Time [1260.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T05:03:41.317933 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:03:38 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [206404.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T05:03:41.318509 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:03:39 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [50542.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:03:41.318999 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:03:32 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38152.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T05:03:41.319482 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76585], State: [ok], Delivered in [0.026164101] seconds [----] I, [2016-09-13T05:03:46.013913 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:03:46 UTC]... [----] I, [2016-09-13T05:03:46.035320 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:03:46 UTC]...Complete [----] I, [2016-09-13T05:03:46.636230 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:03:46.659358 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76590], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:03:51.059715 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:03:51.435580 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76590], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.793596643] seconds [----] I, [2016-09-13T05:03:51.435755 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76590], Delivering... [----] I, [2016-09-13T05:03:51.440116 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002411365509033203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002482891082763672, :pending_vm_jobs=>0.0004973411560058594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004049777984619141} [----] I, [2016-09-13T05:03:51.440381 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76590], State: [ok], Delivered in [0.00464075] seconds [----] I, [2016-09-13T05:03:57.320265 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0026671886444091797, :worker_monitor=>1.2396903038024902, :worker_dequeue=>0.011158227920532227, :total_time=>1.2537732124328613} [----] I, [2016-09-13T05:04:01.672142 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 11. [----] I, [2016-09-13T05:04:01.692713 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76591], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:04:01.727403 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76592], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:04:01.761470 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76593], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:04:02.330609 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:04:02.515825 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76592], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.817244386] seconds [----] I, [2016-09-13T05:04:02.516046 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76592], Delivering... [----] I, [2016-09-13T05:04:02.522745 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003572702407836914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035910606384277344, :pending_vm_jobs=>0.0007536411285400391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006215810775756836} [----] I, [2016-09-13T05:04:02.523089 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76592], State: [ok], Delivered in [0.00704371] seconds [----] I, [2016-09-13T05:04:02.561187 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76591], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.880239703] seconds [----] I, [2016-09-13T05:04:02.561359 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76591], Delivering... [----] I, [2016-09-13T05:04:02.566012 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76591], State: [ok], Delivered in [0.0046635] seconds [----] I, [2016-09-13T05:04:02.590224 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76593], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.845263256] seconds [----] I, [2016-09-13T05:04:02.590518 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76593], Delivering... [----] I, [2016-09-13T05:04:02.624354 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76594], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T05:04:02.641329 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76595], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T05:04:02.641887 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76593], State: [ok], Delivered in [0.051374068] seconds [----] I, [2016-09-13T05:04:07.351546 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T05:04:07.353996 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T05:04:08.025241 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [76594], MiqWorker id: [97], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [5.4113228] seconds [----] I, [2016-09-13T05:04:08.025580 #30088:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76594], Delivering... [----] I, [2016-09-13T05:04:08.031041 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T05:04:08.031258 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T05:04:08.031454 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T05:04:08.031660 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T05:04:08.031845 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:08.318155 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:08.518700 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:08.518897 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:08.859707 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:08.952949 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:09.042902 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:09.410172 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:09.515985 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:09.608854 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:09.700206 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:09.795099 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:09.888009 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:09.980222 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:10.074704 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:10.168776 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:10.260991 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:10.353060 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:10.445203 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:10.538331 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:10.631492 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:10.723481 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:10.815219 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:10.907289 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:04:11.135625 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T05:04:11.135858 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.0040798187255859375, :collect_inventory_for_targets=>8.511543273925781e-05, :parse_legacy_inventory=>15.127525091171265, :parse_targeted_inventory=>15.127633810043335, :save_inventory=>0.9064853191375732, :ems_refresh=>16.036357402801514} [----] I, [2016-09-13T05:04:11.168205 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T05:04:11.168706 #30088:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76594], State: [ok], Delivered in [3.1431591] seconds [----] I, [2016-09-13T05:04:13.759376 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T05:04:13.759628 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037288665771484375, :worker_monitor=>1.3893697261810303, :worker_dequeue=>0.011808633804321289, :total_time=>1.4052042961120605} [----] I, [2016-09-13T05:04:16.778206 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:04:16.801223 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76596], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:04:16.807700 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [76595], MiqWorker id: [96], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [14.176803888] seconds [----] I, [2016-09-13T05:04:16.807940 #28071:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76595], Delivering... [----] I, [2016-09-13T05:04:16.811992 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T05:04:16.812188 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T05:04:16.812353 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T05:04:16.812567 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T05:04:16.812778 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:18.760025 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:04:18 UTC]... [----] I, [2016-09-13T05:04:18.783964 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:04:18 UTC]...Complete [----] I, [2016-09-13T05:04:18.792336 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:04:19.635960 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76596], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.849515353] seconds [----] I, [2016-09-13T05:04:19.636167 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76596], Delivering... [----] I, [2016-09-13T05:04:19.642584 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034017562866210938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034253597259521484, :pending_vm_jobs=>0.0008549690246582031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060422420501708984} [----] I, [2016-09-13T05:04:19.642928 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76596], State: [ok], Delivered in [0.006756978] seconds [----] I, [2016-09-13T05:04:29.393117 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:29.803370 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:29.803700 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:30.372288 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0045320987701416016, :worker_monitor=>1.5446507930755615, :worker_dequeue=>0.011384248733520508, :total_time=>1.5609753131866455} [----] I, [2016-09-13T05:04:30.460240 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:30.863113 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:30.863361 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:31.442250 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:31.778615 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:31.778810 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:31.814553 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:04:31.835984 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76597], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:04:31.859262 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76598], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:04:31.881534 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76599], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:04:31.892789 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76600], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:04:32.323786 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:32.686045 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:32.686246 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:33.226106 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:33.588168 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:33.588373 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:34.301612 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:34.710231 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:34.710512 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:35.235977 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:35.482950 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:04:35.614047 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:35.614222 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:35.738862 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76599], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.866656236] seconds [----] I, [2016-09-13T05:04:35.739031 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76599], Delivering... [----] I, [2016-09-13T05:04:35.756136 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76600], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.868753217] seconds [----] I, [2016-09-13T05:04:35.756344 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76600], Delivering... [----] I, [2016-09-13T05:04:35.762457 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032415390014648438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003258228302001953, :pending_vm_jobs=>0.0007147789001464844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005690097808837891} [----] I, [2016-09-13T05:04:35.762802 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76600], State: [ok], Delivered in [0.006474508] seconds [----] I, [2016-09-13T05:04:35.772922 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76597], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.953386571] seconds [----] I, [2016-09-13T05:04:35.773116 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76597], Delivering... [----] I, [2016-09-13T05:04:35.777374 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76597], State: [ok], Delivered in [0.004259342] seconds [----] I, [2016-09-13T05:04:35.789985 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76599], State: [ok], Delivered in [0.050934425] seconds [----] I, [2016-09-13T05:04:35.801456 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76598], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.959321369] seconds [----] I, [2016-09-13T05:04:35.801622 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76598], Delivering... [----] I, [2016-09-13T05:04:35.808580 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76598], State: [ok], Delivered in [0.006944138] seconds [----] I, [2016-09-13T05:04:36.194378 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:36.558441 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:36.558570 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:37.123862 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:37.470096 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:37.470298 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:37.996410 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:38.399402 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:38.399612 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:38.928833 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:39.264828 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:39.265006 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:41.136513 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:41.463834 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:41.464012 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:42.023640 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:42.374694 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:42.374856 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:42.892194 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:43.071940 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:43.224270 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:43.372986 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:43.543008 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:43.692744 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:43.857166 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:44.001238 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:44.156441 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:44.311390 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:44.467098 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:44.618269 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:44.782159 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:44.930356 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:45.077591 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:45.483555 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:45.640496 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:45.834601 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:45.979522 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:46.135132 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:46.282028 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:46.456818 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:46.607207 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:46.759172 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:46.906722 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:04:46.926374 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76601], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:04:46.933288 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:46.958641 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:04:46.963114 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0024929046630859375, :worker_monitor=>1.4509835243225098, :worker_dequeue=>0.008113384246826172, :total_time=>1.4618124961853027} [----] I, [2016-09-13T05:04:47.093781 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:47.254673 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:47.428346 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:47.606034 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:47.766392 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:47.835045 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76601], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.917421391] seconds [----] I, [2016-09-13T05:04:47.835182 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76601], Delivering... [----] I, [2016-09-13T05:04:47.839576 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023469924926757812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023627281188964844, :pending_vm_jobs=>0.00045871734619140625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004112720489501953} [----] I, [2016-09-13T05:04:47.839791 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76601], State: [ok], Delivered in [0.004601979] seconds [----] I, [2016-09-13T05:04:47.925969 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:48.077859 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:48.583093 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:48.754858 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:48.900450 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:49.086632 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:49.240510 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:49.676136 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:49.826186 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:49.994411 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:50.145946 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:50.307930 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:50.455337 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:50.625701 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:50.786901 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:50.940569 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:51.111942 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:51.262806 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:51.414507 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:51.963553 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:04:51 UTC]... [----] I, [2016-09-13T05:04:52.000363 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:04:51 UTC]...Complete [----] I, [2016-09-13T05:04:52.245726 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:58.484070 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:58.675274 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:58.840597 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:59.007631 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:59.210008 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:59.389296 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:59.568760 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:59.748694 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:04:59.903840 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:00.060630 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:00.223444 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:00.369863 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:00.516781 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:00.694628 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:00.852210 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:00.996799 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:01.629228 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:01.815076 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:01.944473 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:05:01.967487 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76602], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:05:01.982588 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:01.995915 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76603], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:05:02.144390 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:02.316452 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:02.474607 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:02.631651 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:02.804018 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:02.982470 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:03.022631 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:05:03.137378 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:03.295787 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:03.474392 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:03.681020 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:03.851456 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:03.967671 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76603], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.991711303] seconds [----] I, [2016-09-13T05:05:03.967855 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76603], Delivering... [----] I, [2016-09-13T05:05:03.973707 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029802322387695312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002997875213623047, :pending_vm_jobs=>0.000766754150390625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005503654479980469} [----] I, [2016-09-13T05:05:03.974045 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76603], State: [ok], Delivered in [0.006187904] seconds [----] I, [2016-09-13T05:05:04.014364 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:04.169388 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:04.325835 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:04.690502 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:04.867195 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:05.038682 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:05.191628 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:05.341792 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:05.506919 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:05.664904 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:05.821471 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:05.921790 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76602], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.971036603] seconds [----] I, [2016-09-13T05:05:05.922002 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76602], Delivering... [----] I, [2016-09-13T05:05:05.926608 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76602], State: [ok], Delivered in [0.004608762] seconds [----] I, [2016-09-13T05:05:05.986552 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:06.138019 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:06.296068 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:06.454119 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:06.616262 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:06.759325 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:06.907107 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:07.056772 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:07.212954 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:07.582285 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:07.769574 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:07.923165 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:08.071733 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:15.234981 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:15.395750 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:15.545448 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:15.704362 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:15.851365 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:16.019943 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:16.181276 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:16.341001 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:16.503407 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:16.655587 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:16.823243 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:16.971915 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:17.007934 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:05:17.024588 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76604], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:05:17.136225 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:17.511939 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:17.689603 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:17.835778 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:17.990181 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:18.140502 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:18.301931 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:18.468867 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:18.638269 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:18.796919 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:18.972628 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:19.147664 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:19.291708 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:19.467761 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:19.527920 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:05:19.534552 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037636756896972656, :worker_monitor=>1.4596643447875977, :worker_dequeue=>0.011765718460083008, :total_time=>1.4754750728607178} [----] I, [2016-09-13T05:05:19.629560 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:19.781796 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:19.946707 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:20.081916 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76604], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.067928142] seconds [----] I, [2016-09-13T05:05:20.082110 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76604], Delivering... [----] I, [2016-09-13T05:05:20.088280 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030965805053710938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031147003173828125, :pending_vm_jobs=>0.0007088184356689453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005802154541015625} [----] I, [2016-09-13T05:05:20.088679 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76604], State: [ok], Delivered in [0.006579686] seconds [----] I, [2016-09-13T05:05:20.122654 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:20.501774 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:20.665378 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:20.819410 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:20.993361 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:21.146623 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:21.302235 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:21.440056 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:21.593124 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:21.759367 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:21.926598 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:22.090635 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:22.233229 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:22.390620 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:22.550409 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:22.700675 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:22.848455 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:23.015267 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:23.388164 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:23.561976 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:23.714218 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:23.865075 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:24.031297 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:24.210598 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:24.367650 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:24.523878 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:24.535114 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:05:24 UTC]... [----] I, [2016-09-13T05:05:24.557290 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:05:24 UTC]...Complete [----] I, [2016-09-13T05:05:24.693360 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:24.854135 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:25.024988 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:25.181236 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:25.328799 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:25.480080 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:25.630323 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:31.814736 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:31.960354 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:32.036861 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:05:32.053493 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76605], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:05:32.064903 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76606], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:05:32.093615 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76607], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:05:32.116368 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76608], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:05:32.359084 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:32.534938 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:32.686167 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:32.830885 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:32.981938 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:33.145651 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:33.308785 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:33.513989 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:33.692763 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:33.918197 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:34.077442 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:34.222756 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:34.374208 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:34.535209 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:34.677230 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:34.827507 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:34.967934 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:35.410115 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:35.583548 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:35.736531 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:35.898840 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:36.043613 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:36.098369 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:05:36.104804 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004812479019165039, :worker_monitor=>1.49540114402771, :worker_dequeue=>0.011725425720214844, :total_time=>1.512460708618164} [----] I, [2016-09-13T05:05:36.179236 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76606], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.121096831] seconds [----] I, [2016-09-13T05:05:36.179461 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76606], Delivering... [----] I, [2016-09-13T05:05:36.186516 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:36.236411 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76606], State: [ok], Delivered in [0.05695998] seconds [----] I, [2016-09-13T05:05:36.242085 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76608], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.138732265] seconds [----] I, [2016-09-13T05:05:36.242248 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76608], Delivering... [----] I, [2016-09-13T05:05:36.249051 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003184795379638672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032029151916503906, :pending_vm_jobs=>0.0007920265197753906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006403923034667969} [----] I, [2016-09-13T05:05:36.249525 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76608], State: [ok], Delivered in [0.007243044] seconds [----] I, [2016-09-13T05:05:36.341673 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:36.490372 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:36.696647 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:36.849874 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:37.005719 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:37.160254 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:37.329382 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:37.491500 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:37.686582 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:37.828709 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:37.971653 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:38.460653 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:38.626642 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:38.787473 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:38.938752 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:39.025260 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76605], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.983218742] seconds [----] I, [2016-09-13T05:05:39.025461 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76605], Delivering... [----] I, [2016-09-13T05:05:39.029935 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76605], State: [ok], Delivered in [0.004473749] seconds [----] I, [2016-09-13T05:05:39.030824 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76607], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.958052425] seconds [----] I, [2016-09-13T05:05:39.030998 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76607], Delivering... [----] I, [2016-09-13T05:05:39.035762 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76607], State: [ok], Delivered in [0.004726011] seconds [----] I, [2016-09-13T05:05:39.081782 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:39.245694 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:39.397182 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:39.544331 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:39.692340 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:39.856486 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:40.287601 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:40.447866 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:40.599339 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:40.749253 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:40.906871 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:41.068439 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:41.237527 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:41.522658 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:41.695910 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:41.865507 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:42.015579 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:42.186778 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:42.344354 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:42.521025 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:42.660682 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:47.131968 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:05:47.150641 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76609], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:05:48.829270 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:49.001118 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:49.144374 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:49.281941 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:49.436844 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:49.592293 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:49.746181 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:49.910105 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:05:50.064953 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T05:05:50.333734 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T05:05:50.334295 #28071:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T05:05:50.334932 #28071:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T05:05:50.335135 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T05:05:50.335355 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T05:05:50.396770 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T05:05:50.397346 #28071:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [76595], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T05:05:50.397805 #28071:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T05:05:50.398248 #28071:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T05:05:50.398649 #28071:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76595], State: [error], Delivered in [93.590694206] seconds [----] I, [2016-09-13T05:05:52.647743 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:05:52.653078 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004105329513549805, :worker_monitor=>1.387962818145752, :worker_dequeue=>0.009138107299804688, :total_time=>1.4014863967895508} [----] I, [2016-09-13T05:05:53.409225 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76609], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.269120924] seconds [----] I, [2016-09-13T05:05:53.409493 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76609], Delivering... [----] I, [2016-09-13T05:05:53.416294 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003612041473388672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003635883331298828, :pending_vm_jobs=>0.0007958412170410156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006350517272949219} [----] I, [2016-09-13T05:05:53.416720 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76609], State: [ok], Delivered in [0.007259857] seconds [----] I, [2016-09-13T05:05:57.653688 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:05:57 UTC]... [----] I, [2016-09-13T05:05:57.676402 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:05:57 UTC]...Complete [----] I, [2016-09-13T05:06:02.166673 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:06:02.185217 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76610], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:06:02.213904 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76611], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:06:02.706063 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:06:03.139507 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76611], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.948032831] seconds [----] I, [2016-09-13T05:06:03.139725 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76611], Delivering... [----] I, [2016-09-13T05:06:03.146534 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003560781478881836, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035789012908935547, :pending_vm_jobs=>0.0008833408355712891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006361246109008789} [----] I, [2016-09-13T05:06:03.147181 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76611], State: [ok], Delivered in [0.007457829] seconds [----] I, [2016-09-13T05:06:03.156818 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76610], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.985059984] seconds [----] I, [2016-09-13T05:06:03.157105 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76610], Delivering... [----] I, [2016-09-13T05:06:03.162765 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76610], State: [ok], Delivered in [0.005654079] seconds [----] I, [2016-09-13T05:06:17.226781 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:06:17.250023 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76612], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:06:18.716133 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:06:19.580924 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76612], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.347501133] seconds [----] I, [2016-09-13T05:06:19.581208 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76612], Delivering... [----] I, [2016-09-13T05:06:19.590899 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005085468292236328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005113840103149414, :pending_vm_jobs=>0.0011174678802490234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009046554565429688} [----] I, [2016-09-13T05:06:19.591461 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76612], State: [ok], Delivered in [0.010211448] seconds [----] I, [2016-09-13T05:06:25.287182 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004659414291381836, :worker_monitor=>1.5470616817474365, :worker_dequeue=>0.011474609375, :total_time=>1.5635035037994385} [----] I, [2016-09-13T05:06:30.287857 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:06:30 UTC]... [----] I, [2016-09-13T05:06:30.311401 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:06:30 UTC]...Complete [----] I, [2016-09-13T05:06:32.263678 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:06:32.284594 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76613], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:06:32.306164 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76614], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:06:32.322621 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76615], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:06:32.351384 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76616], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:06:35.342563 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:06:35.751850 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76614], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.462842198] seconds [----] I, [2016-09-13T05:06:35.752049 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76614], Delivering... [----] I, [2016-09-13T05:06:35.756906 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76616], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.424025908] seconds [----] I, [2016-09-13T05:06:35.757044 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76616], Delivering... [----] I, [2016-09-13T05:06:35.761946 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027599334716796875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027751922607421875, :pending_vm_jobs=>0.0005910396575927734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004630327224731445} [----] I, [2016-09-13T05:06:35.762206 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76616], State: [ok], Delivered in [0.005156464] seconds [----] I, [2016-09-13T05:06:35.802643 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76614], State: [ok], Delivered in [0.050573548] seconds [----] I, [2016-09-13T05:06:36.276992 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76613], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.008029444] seconds [----] I, [2016-09-13T05:06:36.277156 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76613], Delivering... [----] I, [2016-09-13T05:06:36.281563 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76613], State: [ok], Delivered in [0.004391698] seconds [----] I, [2016-09-13T05:06:36.310618 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76615], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.99790013] seconds [----] I, [2016-09-13T05:06:36.310791 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76615], Delivering... [----] I, [2016-09-13T05:06:36.318036 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76615], State: [ok], Delivered in [0.007228985] seconds [----] I, [2016-09-13T05:06:41.954317 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004742145538330078, :worker_monitor=>1.5863597393035889, :worker_dequeue=>0.012027263641357422, :total_time=>1.6035127639770508} [----] I, [2016-09-13T05:06:47.364612 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:06:47.384869 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76617], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:06:52.099869 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:06:52.910764 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76617], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.540014035] seconds [----] I, [2016-09-13T05:06:52.910925 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76617], Delivering... [----] I, [2016-09-13T05:06:52.915356 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024721622467041016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024871826171875, :pending_vm_jobs=>0.0005996227264404297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004132509231567383} [----] I, [2016-09-13T05:06:52.915661 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76617], State: [ok], Delivered in [0.004741377] seconds [----] I, [2016-09-13T05:06:58.839653 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0045511722564697266, :worker_monitor=>1.71999192237854, :worker_dequeue=>0.008055925369262695, :total_time=>1.7329158782958984} [----] I, [2016-09-13T05:07:02.397734 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:07:02.418067 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76618], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:07:02.429466 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76619], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:07:03.840212 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:07:03 UTC]... [----] I, [2016-09-13T05:07:03.863776 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:07:03 UTC]...Complete [----] I, [2016-09-13T05:07:03.880583 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:07:04.128898 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76619], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.705030417] seconds [----] I, [2016-09-13T05:07:04.129200 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76619], Delivering... [----] I, [2016-09-13T05:07:04.139070 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005241870880126953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0052716732025146484, :pending_vm_jobs=>0.0012538433074951172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009231328964233398} [----] I, [2016-09-13T05:07:04.139541 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76619], State: [ok], Delivered in [0.01034576] seconds [----] I, [2016-09-13T05:07:04.166908 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76618], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.763919683] seconds [----] I, [2016-09-13T05:07:04.167125 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76618], Delivering... [----] I, [2016-09-13T05:07:04.172987 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76618], State: [ok], Delivered in [0.005841319] seconds [----] I, [2016-09-13T05:07:08.903749 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T05:07:15.550871 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0046002864837646484, :worker_monitor=>1.620546579360962, :worker_dequeue=>0.01000070571899414, :total_time=>1.635512113571167} [----] I, [2016-09-13T05:07:17.441037 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:07:17.458124 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76620], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:07:20.561958 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:07:20.618450 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76620], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.171759827] seconds [----] I, [2016-09-13T05:07:20.618663 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76620], Delivering... [----] I, [2016-09-13T05:07:20.625990 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003925323486328125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003953218460083008, :pending_vm_jobs=>0.0008921623229980469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068836212158203125} [----] I, [2016-09-13T05:07:20.626522 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76620], State: [ok], Delivered in [0.007833521] seconds [----] I, [2016-09-13T05:07:32.149232 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004717588424682617, :worker_monitor=>1.5322418212890625, :worker_dequeue=>0.012389659881591797, :total_time=>1.549736738204956} [----] I, [2016-09-13T05:07:32.469382 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:07:32.521720 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76621], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:07:32.538750 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76622], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:07:32.555550 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76623], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:07:32.572810 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76624], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:07:37.149911 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:07:37 UTC]... [----] I, [2016-09-13T05:07:37.161201 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:07:37 UTC]...Complete [----] I, [2016-09-13T05:07:37.174027 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:07:37.288993 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76622], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.762072336] seconds [----] I, [2016-09-13T05:07:37.289267 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76622], Delivering... [----] I, [2016-09-13T05:07:37.355810 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76622], State: [ok], Delivered in [0.066534856] seconds [----] I, [2016-09-13T05:07:37.384501 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76624], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.819833131] seconds [----] I, [2016-09-13T05:07:37.384695 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76624], Delivering... [----] I, [2016-09-13T05:07:37.391883 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003647327423095703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036725997924804688, :pending_vm_jobs=>0.0009870529174804688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006787300109863281} [----] I, [2016-09-13T05:07:37.392314 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76624], State: [ok], Delivered in [0.007591961] seconds [----] I, [2016-09-13T05:07:37.424955 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76621], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.950370378] seconds [----] I, [2016-09-13T05:07:37.425244 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76621], Delivering... [----] I, [2016-09-13T05:07:37.431200 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76621], State: [ok], Delivered in [0.005976499] seconds [----] I, [2016-09-13T05:07:37.452891 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76623], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.907443353] seconds [----] I, [2016-09-13T05:07:37.453063 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76623], Delivering... [----] I, [2016-09-13T05:07:37.456160 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76623], State: [ok], Delivered in [0.00307993] seconds [----] I, [2016-09-13T05:07:47.588935 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:07:47.615328 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76625], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:07:48.831464 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:07:48.843224 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0058553218841552734, :server_monitor=>0.12816214561462402, :worker_monitor=>1.493086576461792, :worker_dequeue=>0.017005443572998047, :total_time=>1.6447081565856934} [----] I, [2016-09-13T05:07:48.905643 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76625], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.310066387] seconds [----] I, [2016-09-13T05:07:48.905818 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76625], Delivering... [----] I, [2016-09-13T05:07:48.911450 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002964496612548828, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029823780059814453, :pending_vm_jobs=>0.0007143020629882812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005267620086669922} [----] I, [2016-09-13T05:07:48.911771 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76625], State: [ok], Delivered in [0.005952402] seconds [----] I, [2016-09-13T05:08:02.628556 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:08:02.643152 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76626], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:08:02.660084 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76627], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:08:05.342575 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:08:05.349006 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003839254379272461, :worker_monitor=>1.4523727893829346, :worker_dequeue=>0.01141977310180664, :total_time=>1.4679069519042969} [----] I, [2016-09-13T05:08:05.962969 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76627], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.313425235] seconds [----] I, [2016-09-13T05:08:05.963192 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76627], Delivering... [----] I, [2016-09-13T05:08:05.970284 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003709077835083008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003734111785888672, :pending_vm_jobs=>0.0008871555328369141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006644725799560547} [----] I, [2016-09-13T05:08:05.970652 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76627], State: [ok], Delivered in [0.007476685] seconds [----] I, [2016-09-13T05:08:07.003283 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76626], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.369496733] seconds [----] I, [2016-09-13T05:08:07.003575 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76626], Delivering... [----] I, [2016-09-13T05:08:07.009769 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76626], State: [ok], Delivered in [0.006194327] seconds [----] I, [2016-09-13T05:08:10.349656 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:08:10 UTC]... [----] I, [2016-09-13T05:08:10.367591 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:08:10 UTC]...Complete [----] I, [2016-09-13T05:08:17.673560 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:08:17.699217 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76628], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:08:17.716479 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76629], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:08:17.733668 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76630], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:08:22.062205 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:08:22.070725 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004796266555786133, :worker_monitor=>1.6505858898162842, :worker_dequeue=>0.013916969299316406, :total_time=>1.6696672439575195} [----] I, [2016-09-13T05:08:22.099575 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76628], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.419468343] seconds [----] I, [2016-09-13T05:08:22.099785 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76628], Delivering... [----] I, [2016-09-13T05:08:22.106738 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003566741943359375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003597736358642578, :pending_vm_jobs=>0.0009129047393798828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065538883209228516} [----] I, [2016-09-13T05:08:22.107113 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76628], State: [ok], Delivered in [0.007337757] seconds [----] I, [2016-09-13T05:08:22.133895 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76629], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.430761553] seconds [----] I, [2016-09-13T05:08:22.134092 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76629], Delivering... [----] I, [2016-09-13T05:08:22.135604 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T05:08:22.135842 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5344194560 [----] I, [2016-09-13T05:08:22.135954 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5127647232 [----] I, [2016-09-13T05:08:22.136048 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 216547328 [----] I, [2016-09-13T05:08:22.136142 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1317011456 [----] I, [2016-09-13T05:08:22.136237 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5073702912 [----] I, [2016-09-13T05:08:22.136346 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T05:08:22.136470 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T05:08:22.136582 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 537583616 [----] I, [2016-09-13T05:08:22.136676 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T05:08:22.136766 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8041459712 [----] I, [2016-09-13T05:08:22.136850 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T05:08:22.136943 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T05:08:22.137032 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T05:08:22.137116 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 12288 [----] I, [2016-09-13T05:08:22.137200 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T05:08:22.137324 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T05:08:22.137453 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T05:08:22.137563 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T05:08:22.137653 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T05:08:22.137734 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T05:08:22.137818 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273293312 [----] I, [2016-09-13T05:08:22.137909 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56451072 [----] I, [2016-09-13T05:08:22.138006 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216842240 [----] I, [2016-09-13T05:08:22.138095 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6225920 [----] I, [2016-09-13T05:08:22.138185 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140873728 [----] I, [2016-09-13T05:08:22.138263 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2592464896 [----] I, [2016-09-13T05:08:22.138380 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2280910848 [----] I, [2016-09-13T05:08:22.138524 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T05:08:22.138621 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T05:08:22.138707 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T05:08:22.138796 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37797888 [----] I, [2016-09-13T05:08:22.138877 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102289408 [----] I, [2016-09-13T05:08:22.138969 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53329920 [----] I, [2016-09-13T05:08:22.139048 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110415872 [----] I, [2016-09-13T05:08:22.139128 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155619328 [----] I, [2016-09-13T05:08:22.139214 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T05:08:22.139319 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T05:08:22.139437 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T05:08:22.139545 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T05:08:22.139542 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76630], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.419192617] seconds [----] I, [2016-09-13T05:08:22.139631 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T05:08:22.139717 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T05:08:22.139757 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76630], Delivering... [----] I, [2016-09-13T05:08:22.139801 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T05:08:22.139885 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T05:08:22.139979 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T05:08:22.148788 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:08:21 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [148807.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:08:22.149534 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:08:17 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205293000], Memory % [3.5], CPU Time [235394.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T05:08:22.150129 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:08:15 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [103190.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T05:08:22.150807 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:08:21 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [147901.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:08:22.151378 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:08:12 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [48149.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T05:08:22.152052 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:08:18 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162420000], Memory % [3.1], CPU Time [37260.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T05:08:22.152726 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:08:19 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358681000], Memory % [5.28], CPU Time [199322.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T05:08:22.153376 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:08:19 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [50543.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:08:22.156652 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:08:21 UTC], Process Info: Memory Usage [588488704], Memory Size [932020224], Proportional Set Size: [425604000], Memory % [7.17], CPU Time [675.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:08:22.160498 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:08:18 UTC], Process Info: Memory Usage [558493696], Memory Size [930201600], Proportional Set Size: [406130000], Memory % [6.81], CPU Time [4644.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T05:08:22.164822 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:08:21 UTC], Process Info: Memory Usage [580980736], Memory Size [938082304], Proportional Set Size: [420428000], Memory % [7.08], CPU Time [1272.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T05:08:22.165822 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:08:19 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [206478.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T05:08:22.166754 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:08:19 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [50588.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:08:22.167330 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:08:20 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165804000], Memory % [3.16], CPU Time [38163.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T05:08:22.169831 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:08:20 UTC], Process Info: Memory Usage [598962176], Memory Size [1054564352], Proportional Set Size: [436156000], Memory % [7.3], CPU Time [1568.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:08:22.170362 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76630], State: [ok], Delivered in [0.030551331] seconds [----] I, [2016-09-13T05:08:22.174566 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T05:08:22.174785 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T05:08:22.180155 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T05:08:22.185728 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T05:08:22.190228 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T05:08:22.194133 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T05:08:22.197928 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T05:08:22.201755 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 838 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T05:08:22.205718 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T05:08:22.209691 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T05:08:22.213834 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T05:08:22.219512 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T05:08:22.226050 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T05:08:22.232630 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T05:08:22.237869 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:08:22.238129 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:08:22.238369 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T05:08:22.243660 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358681000], Memory % [5.28], CPU Time [199310.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T05:08:22.244078 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76629], State: [ok], Delivered in [0.10996889] seconds [----] I, [2016-09-13T05:08:32.746609 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:08:32.762339 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76631], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:08:32.773699 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76632], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:08:32.785159 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76633], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:08:32.802487 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76634], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:08:38.556830 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:08:38.563825 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004810810089111328, :worker_monitor=>1.4343109130859375, :worker_dequeue=>0.012755632400512695, :total_time=>1.452223539352417} [----] I, [2016-09-13T05:08:39.323835 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76632], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.55773137] seconds [----] I, [2016-09-13T05:08:39.324036 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76632], Delivering... [----] I, [2016-09-13T05:08:39.392243 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76634], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.597960791] seconds [----] I, [2016-09-13T05:08:39.392518 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76634], Delivering... [----] I, [2016-09-13T05:08:39.398201 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76632], State: [ok], Delivered in [0.074130756] seconds [----] I, [2016-09-13T05:08:39.400177 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004031658172607422, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004056215286254883, :pending_vm_jobs=>0.0009608268737792969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007200002670288086} [----] I, [2016-09-13T05:08:39.400699 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76634], State: [ok], Delivered in [0.008177108] seconds [----] I, [2016-09-13T05:08:40.112228 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76631], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.360329534] seconds [----] I, [2016-09-13T05:08:40.112520 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76631], Delivering... [----] I, [2016-09-13T05:08:40.118327 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76631], State: [ok], Delivered in [0.005765765] seconds [----] I, [2016-09-13T05:08:40.146448 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76633], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.367569108] seconds [----] I, [2016-09-13T05:08:40.146666 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76633], Delivering... [----] I, [2016-09-13T05:08:40.150319 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76633], State: [ok], Delivered in [0.003603249] seconds [----] I, [2016-09-13T05:08:43.564401 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:08:43 UTC]... [----] I, [2016-09-13T05:08:43.580450 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:08:43 UTC]...Complete [----] I, [2016-09-13T05:08:47.815698 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:08:47.832328 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76635], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:08:48.683511 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:08:49.203620 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76635], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.381006157] seconds [----] I, [2016-09-13T05:08:49.203807 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76635], Delivering... [----] I, [2016-09-13T05:08:49.210765 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00353240966796875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035562515258789062, :pending_vm_jobs=>0.0009522438049316406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065534114837646484} [----] I, [2016-09-13T05:08:49.211115 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76635], State: [ok], Delivered in [0.007308123] seconds [----] I, [2016-09-13T05:08:55.044076 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007602214813232422, :worker_monitor=>1.3357694149017334, :worker_dequeue=>0.009738683700561523, :total_time=>1.3534510135650635} [----] I, [2016-09-13T05:09:02.846119 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:09:02.866761 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76636], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:09:02.884037 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76637], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:09:05.070402 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:09:05.632470 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76637], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.759203018] seconds [----] I, [2016-09-13T05:09:05.632672 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76637], Delivering... [----] I, [2016-09-13T05:09:05.639609 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035789012908935547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003600597381591797, :pending_vm_jobs=>0.0008580684661865234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006508827209472656} [----] I, [2016-09-13T05:09:05.639965 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76637], State: [ok], Delivered in [0.007290659] seconds [----] I, [2016-09-13T05:09:07.312348 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76636], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.457336849] seconds [----] I, [2016-09-13T05:09:07.312586 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76636], Delivering... [----] I, [2016-09-13T05:09:07.318194 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76636], State: [ok], Delivered in [0.005609377] seconds [----] I, [2016-09-13T05:09:11.721479 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006017208099365234, :worker_monitor=>1.6308619976043701, :worker_dequeue=>0.006907463073730469, :total_time=>1.6442723274230957} [----] I, [2016-09-13T05:09:16.722002 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:09:16 UTC]... [----] I, [2016-09-13T05:09:16.742187 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:09:16 UTC]...Complete [----] I, [2016-09-13T05:09:17.898490 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:09:17.918360 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76638], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:09:21.774893 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:09:21.855816 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76638], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.950605824] seconds [----] I, [2016-09-13T05:09:21.856109 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76638], Delivering... [----] I, [2016-09-13T05:09:21.866065 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005083560943603516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005113363265991211, :pending_vm_jobs=>0.0012655258178710938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00934743881225586} [----] I, [2016-09-13T05:09:21.866554 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76638], State: [ok], Delivered in [0.010471756] seconds [----] I, [2016-09-13T05:09:28.399251 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0054738521575927734, :worker_monitor=>1.599275827407837, :worker_dequeue=>0.011948108673095703, :total_time=>1.617175817489624} [----] I, [2016-09-13T05:09:32.930887 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:09:32.946807 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76639], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:09:32.958142 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76640], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:09:32.969583 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76641], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:09:32.986678 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76642], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:09:33.409936 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:09:33.924151 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76640], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.973537512] seconds [----] I, [2016-09-13T05:09:33.924398 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76640], Delivering... [----] I, [2016-09-13T05:09:33.986968 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76640], State: [ok], Delivered in [0.062557191] seconds [----] I, [2016-09-13T05:09:34.009775 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76642], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.030760789] seconds [----] I, [2016-09-13T05:09:34.009937 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76642], Delivering... [----] I, [2016-09-13T05:09:34.016357 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003251791000366211, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032787322998046875, :pending_vm_jobs=>0.0008254051208496094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060272216796875} [----] I, [2016-09-13T05:09:34.016764 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76642], State: [ok], Delivered in [0.006815129] seconds [----] I, [2016-09-13T05:09:34.404108 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76639], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.468308746] seconds [----] I, [2016-09-13T05:09:34.404317 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76639], Delivering... [----] I, [2016-09-13T05:09:34.409471 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76639], State: [ok], Delivered in [0.005136734] seconds [----] I, [2016-09-13T05:09:34.432565 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76641], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.469287004] seconds [----] I, [2016-09-13T05:09:34.432743 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76641], Delivering... [----] I, [2016-09-13T05:09:34.435900 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76641], State: [ok], Delivered in [0.003153049] seconds [----] I, [2016-09-13T05:09:44.692795 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039272308349609375, :worker_monitor=>1.2473728656768799, :worker_dequeue=>0.006685495376586914, :total_time=>1.2584095001220703} [----] I, [2016-09-13T05:09:47.998111 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:09:48.010187 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76643], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:09:49.693340 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:09:49 UTC]... [----] I, [2016-09-13T05:09:49.712545 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:09:49 UTC]...Complete [----] I, [2016-09-13T05:09:49.827192 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:09:49.878857 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76643], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.87498789] seconds [----] I, [2016-09-13T05:09:49.879082 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76643], Delivering... [----] I, [2016-09-13T05:09:49.886785 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003930568695068359, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003983497619628906, :pending_vm_jobs=>0.0010039806365966797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007200717926025391} [----] I, [2016-09-13T05:09:49.887213 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76643], State: [ok], Delivered in [0.008126647] seconds [----] I, [2016-09-13T05:10:01.580622 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005283832550048828, :worker_monitor=>1.7091481685638428, :worker_dequeue=>0.012239694595336914, :total_time=>1.7270431518554688} [----] I, [2016-09-13T05:10:03.026744 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:10:03.044837 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76644], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:10:03.069545 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76645], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:10:03.090472 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76646], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:10:03.101671 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76647], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:10:03.113035 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76648], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:10:06.591823 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:10:07.307918 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76648], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.200693045] seconds [----] I, [2016-09-13T05:10:07.308168 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76648], Delivering... [----] I, [2016-09-13T05:10:07.315823 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003926992416381836, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003954410552978516, :pending_vm_jobs=>0.0009367465972900391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007139921188354492} [----] I, [2016-09-13T05:10:07.316240 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76648], State: [ok], Delivered in [0.008071687] seconds [----] I, [2016-09-13T05:10:07.593122 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76644], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.561344499] seconds [----] I, [2016-09-13T05:10:07.593389 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76644], Delivering... [----] I, [2016-09-13T05:10:07.599382 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76644], State: [ok], Delivered in [0.006000987] seconds [----] I, [2016-09-13T05:10:07.621937 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76645], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.570978275] seconds [----] I, [2016-09-13T05:10:07.622116 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76645], Delivering... [----] I, [2016-09-13T05:10:07.624629 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76645], State: [ok], Delivered in [0.002501404] seconds [----] I, [2016-09-13T05:10:07.650539 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76646], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.574973485] seconds [----] I, [2016-09-13T05:10:07.650725 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76646], Delivering... [----] I, [2016-09-13T05:10:07.666962 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76646], State: [ok], Delivered in [0.016227691] seconds [----] I, [2016-09-13T05:10:07.690569 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76647], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.59414537] seconds [----] I, [2016-09-13T05:10:07.690744 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76647], Delivering... [----] I, [2016-09-13T05:10:07.695502 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76647], State: [ok], Delivered in [0.004724443] seconds [----] I, [2016-09-13T05:10:18.020832 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0042722225189208984, :worker_monitor=>1.391860008239746, :worker_dequeue=>0.008026838302612305, :total_time=>1.4046263694763184} [----] I, [2016-09-13T05:10:18.125645 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:10:18.147790 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76649], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:10:23.021598 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:10:23 UTC]... [----] I, [2016-09-13T05:10:23.046126 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:10:23 UTC]...Complete [----] I, [2016-09-13T05:10:23.059917 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:10:23.388200 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76649], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.256094602] seconds [----] I, [2016-09-13T05:10:23.388597 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76649], Delivering... [----] I, [2016-09-13T05:10:23.402706 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0066928863525390625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.006751537322998047, :pending_vm_jobs=>0.0017936229705810547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.013277769088745117} [----] I, [2016-09-13T05:10:23.403506 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76649], State: [ok], Delivered in [0.014862454] seconds [----] I, [2016-09-13T05:10:33.163809 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:10:33.182062 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76650], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:10:33.199248 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76651], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:10:33.233975 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76652], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:10:33.262089 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76653], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:10:34.542811 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:10:34.548439 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00656580924987793, :worker_monitor=>1.4468052387237549, :worker_dequeue=>0.010046720504760742, :total_time=>1.4637818336486816} [----] I, [2016-09-13T05:10:34.787910 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76651], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.601536476] seconds [----] I, [2016-09-13T05:10:34.788121 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76651], Delivering... [----] I, [2016-09-13T05:10:34.856301 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76651], State: [ok], Delivered in [0.068154497] seconds [----] I, [2016-09-13T05:10:34.879219 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76653], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.630375662] seconds [----] I, [2016-09-13T05:10:34.879445 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76653], Delivering... [----] I, [2016-09-13T05:10:34.886059 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033457279205322266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033693313598632812, :pending_vm_jobs=>0.0008747577667236328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006211519241333008} [----] I, [2016-09-13T05:10:34.886509 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76653], State: [ok], Delivered in [0.007079678] seconds [----] I, [2016-09-13T05:10:34.913564 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76650], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.744650621] seconds [----] I, [2016-09-13T05:10:34.913743 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76650], Delivering... [----] I, [2016-09-13T05:10:34.918595 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76650], State: [ok], Delivered in [0.004843698] seconds [----] I, [2016-09-13T05:10:34.942108 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76652], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.737115231] seconds [----] I, [2016-09-13T05:10:34.942265 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76652], Delivering... [----] I, [2016-09-13T05:10:34.945458 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76652], State: [ok], Delivered in [0.003152888] seconds [----] I, [2016-09-13T05:10:48.274243 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:10:48.296329 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76654], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:10:51.008686 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:10:51.015725 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003950595855712891, :worker_monitor=>1.415947437286377, :worker_dequeue=>0.012465953826904297, :total_time=>1.432645320892334} [----] I, [2016-09-13T05:10:51.663784 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76654], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.383745916] seconds [----] I, [2016-09-13T05:10:51.664026 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76654], Delivering... [----] I, [2016-09-13T05:10:51.672246 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003960132598876953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0040132999420166016, :pending_vm_jobs=>0.0009882450103759766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007745504379272461} [----] I, [2016-09-13T05:10:51.672685 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76654], State: [ok], Delivered in [0.008663284] seconds [----] I, [2016-09-13T05:10:56.016279 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:10:56 UTC]... [----] I, [2016-09-13T05:10:56.039226 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:10:56 UTC]...Complete [----] I, [2016-09-13T05:11:03.307699 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:11:03.325234 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76655], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:11:03.342490 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76656], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:11:07.704094 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:11:07.710873 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00394129753112793, :worker_monitor=>1.511446237564087, :worker_dequeue=>0.01178121566772461, :total_time=>1.5275208950042725} [----] I, [2016-09-13T05:11:07.747861 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76656], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.416927345] seconds [----] I, [2016-09-13T05:11:07.748033 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76656], Delivering... [----] I, [2016-09-13T05:11:07.753847 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003009319305419922, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003030538558959961, :pending_vm_jobs=>0.0006999969482421875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005427122116088867} [----] I, [2016-09-13T05:11:07.754132 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76656], State: [ok], Delivered in [0.006100131] seconds [----] I, [2016-09-13T05:11:08.079400 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76655], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.767120661] seconds [----] I, [2016-09-13T05:11:08.079618 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76655], Delivering... [----] I, [2016-09-13T05:11:08.084621 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76655], State: [ok], Delivered in [0.005000934] seconds [----] I, [2016-09-13T05:11:18.356457 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:11:18.379087 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76657], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:11:23.997185 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:11:24.003546 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037102699279785156, :worker_monitor=>1.2499301433563232, :worker_dequeue=>0.01099538803100586, :total_time=>1.264953851699829} [----] I, [2016-09-13T05:11:24.891609 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76657], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.525965522] seconds [----] I, [2016-09-13T05:11:24.891854 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76657], Delivering... [----] I, [2016-09-13T05:11:24.900971 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005026578903198242, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005053043365478516, :pending_vm_jobs=>0.0013599395751953125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008701086044311523} [----] I, [2016-09-13T05:11:24.901303 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76657], State: [ok], Delivered in [0.009454406] seconds [----] I, [2016-09-13T05:11:29.004075 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:11:29 UTC]... [----] I, [2016-09-13T05:11:29.023995 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:11:29 UTC]...Complete [----] I, [2016-09-13T05:11:33.396970 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:11:33.424526 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76658], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:11:33.446252 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76659], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:11:33.691986 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76660], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:11:33.714477 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76661], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:11:34.057718 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:11:34.948809 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76659], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.518247484] seconds [----] I, [2016-09-13T05:11:34.948994 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76659], Delivering... [----] I, [2016-09-13T05:11:34.994799 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76661], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.291002764] seconds [----] I, [2016-09-13T05:11:34.995072 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76661], Delivering... [----] I, [2016-09-13T05:11:35.005365 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0049936771392822266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0051081180572509766, :pending_vm_jobs=>0.0011723041534423828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009743690490722656} [----] I, [2016-09-13T05:11:35.005863 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76661], State: [ok], Delivered in [0.010784278] seconds [----] I, [2016-09-13T05:11:35.011472 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76659], State: [ok], Delivered in [0.062425675] seconds [----] I, [2016-09-13T05:11:35.171807 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76658], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.768360305] seconds [----] I, [2016-09-13T05:11:35.171990 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76658], Delivering... [----] I, [2016-09-13T05:11:35.177030 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76658], State: [ok], Delivered in [0.005027167] seconds [----] I, [2016-09-13T05:11:35.211786 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76660], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.759408942] seconds [----] I, [2016-09-13T05:11:35.211992 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76660], Delivering... [----] I, [2016-09-13T05:11:35.215313 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76660], State: [ok], Delivered in [0.003317779] seconds [----] I, [2016-09-13T05:11:40.492653 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005340099334716797, :worker_monitor=>1.4071216583251953, :worker_dequeue=>0.009330987930297852, :total_time=>1.422184944152832} [----] I, [2016-09-13T05:11:48.726579 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:11:48.743240 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76662], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:11:50.519534 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:11:51.183722 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76662], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.450999353] seconds [----] I, [2016-09-13T05:11:51.183946 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76662], Delivering... [----] I, [2016-09-13T05:11:51.192238 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004259824752807617, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0042874813079833984, :pending_vm_jobs=>0.000990152359008789, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007805347442626953} [----] I, [2016-09-13T05:11:51.192676 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76662], State: [ok], Delivered in [0.008722079] seconds [----] I, [2016-09-13T05:11:57.116115 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003267526626586914, :worker_monitor=>1.5723958015441895, :worker_dequeue=>0.009407997131347656, :total_time=>1.5853209495544434} [----] I, [2016-09-13T05:12:02.116721 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:12:02 UTC]... [----] I, [2016-09-13T05:12:02.150673 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:12:02 UTC]...Complete [----] I, [2016-09-13T05:12:03.758093 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:12:03.777868 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76663], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:12:03.794802 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76664], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:12:07.400554 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:12:08.274866 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76664], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.488018228] seconds [----] I, [2016-09-13T05:12:08.275011 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76664], Delivering... [----] I, [2016-09-13T05:12:08.279292 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023643970489501953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002382040023803711, :pending_vm_jobs=>0.0004944801330566406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004009723663330078} [----] I, [2016-09-13T05:12:08.279559 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76664], State: [ok], Delivered in [0.00454856] seconds [----] I, [2016-09-13T05:12:08.395059 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76663], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.630079355] seconds [----] I, [2016-09-13T05:12:08.395245 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76663], Delivering... [----] I, [2016-09-13T05:12:08.408884 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76663], State: [ok], Delivered in [0.013543914] seconds [----] I, [2016-09-13T05:12:12.426656 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T05:12:14.010045 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006282806396484375, :log_active_servers=>0.012749671936035156, :worker_monitor=>1.5668487548828125, :worker_dequeue=>0.016091346740722656, :total_time=>1.6026217937469482} [----] I, [2016-09-13T05:12:18.810572 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:12:18.829354 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76665], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:12:19.018953 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:12:19.412105 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76665], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.597171346] seconds [----] I, [2016-09-13T05:12:19.412306 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76665], Delivering... [----] I, [2016-09-13T05:12:19.418814 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034112930297851562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035092830657958984, :pending_vm_jobs=>0.0007917881011962891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006108283996582031} [----] I, [2016-09-13T05:12:19.419183 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76665], State: [ok], Delivered in [0.006877733] seconds [----] I, [2016-09-13T05:12:30.676760 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002763032913208008, :worker_monitor=>1.6131353378295898, :worker_dequeue=>0.013995647430419922, :total_time=>1.630234956741333} [----] I, [2016-09-13T05:12:33.840056 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:12:33.875058 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76666], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:12:33.897673 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76667], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:12:33.926508 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76668], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:12:33.955049 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76669], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:12:35.677476 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:12:35 UTC]... [----] I, [2016-09-13T05:12:35.697871 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:12:35 UTC]...Complete [----] I, [2016-09-13T05:12:35.711770 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:12:36.578002 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76667], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.698455933] seconds [----] I, [2016-09-13T05:12:36.578187 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76667], Delivering... [----] I, [2016-09-13T05:12:36.641140 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76669], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.707889551] seconds [----] I, [2016-09-13T05:12:36.641369 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76669], Delivering... [----] I, [2016-09-13T05:12:36.650031 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004838466644287109, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004866838455200195, :pending_vm_jobs=>0.0009987354278564453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008148431777954102} [----] I, [2016-09-13T05:12:36.650518 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76669], State: [ok], Delivered in [0.009090418] seconds [----] I, [2016-09-13T05:12:36.665974 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76667], State: [ok], Delivered in [0.087772851] seconds [----] I, [2016-09-13T05:12:38.486635 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76666], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.643005133] seconds [----] I, [2016-09-13T05:12:38.486780 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76666], Delivering... [----] I, [2016-09-13T05:12:38.490478 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76666], State: [ok], Delivered in [0.003682833] seconds [----] I, [2016-09-13T05:12:38.526648 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76668], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.62483443] seconds [----] I, [2016-09-13T05:12:38.526783 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76668], Delivering... [----] I, [2016-09-13T05:12:38.532172 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76668], State: [ok], Delivered in [0.005358218] seconds [----] I, [2016-09-13T05:12:47.424677 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00818777084350586, :worker_monitor=>1.6681616306304932, :worker_dequeue=>0.013972282409667969, :total_time=>1.6906695365905762} [----] I, [2016-09-13T05:12:48.967092 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:12:49.002714 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76670], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:12:52.434590 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:12:52.859616 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76670], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.883730001] seconds [----] I, [2016-09-13T05:12:52.859897 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76670], Delivering... [----] I, [2016-09-13T05:12:52.870573 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0050623416900634766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005101203918457031, :pending_vm_jobs=>0.001253366470336914, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010022163391113281} [----] I, [2016-09-13T05:12:52.871044 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76670], State: [ok], Delivered in [0.011156509] seconds [----] I, [2016-09-13T05:13:04.017400 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:13:04.034457 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00580596923828125, :server_monitor=>0.14847564697265625, :worker_monitor=>1.407050609588623, :worker_dequeue=>0.01465606689453125, :total_time=>1.5764949321746826} [----] I, [2016-09-13T05:13:04.040855 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76671], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:13:04.063970 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76672], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:13:09.035081 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:13:09 UTC]... [----] I, [2016-09-13T05:13:09.058813 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:13:09 UTC]...Complete [----] I, [2016-09-13T05:13:09.076764 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:13:09.950457 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76672], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.903649792] seconds [----] I, [2016-09-13T05:13:09.950788 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76672], Delivering... [----] I, [2016-09-13T05:13:09.958396 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004130840301513672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004150867462158203, :pending_vm_jobs=>0.0008676052093505859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007061004638671875} [----] I, [2016-09-13T05:13:09.958832 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76672], State: [ok], Delivered in [0.008072641] seconds [----] I, [2016-09-13T05:13:11.641629 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76671], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.619585461] seconds [----] I, [2016-09-13T05:13:11.641835 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76671], Delivering... [----] I, [2016-09-13T05:13:11.647161 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76671], State: [ok], Delivered in [0.005319595] seconds [----] I, [2016-09-13T05:13:19.075258 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:13:19.092369 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76673], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:13:19.138454 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76674], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:13:19.172652 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76675], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:13:20.429143 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:13:20.437487 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005113363265991211, :worker_monitor=>1.3132662773132324, :worker_dequeue=>0.015195369720458984, :total_time=>1.3339769840240479} [----] I, [2016-09-13T05:13:20.687948 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76673], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.607537368] seconds [----] I, [2016-09-13T05:13:20.688252 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76673], Delivering... [----] I, [2016-09-13T05:13:20.698355 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005472421646118164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005508899688720703, :pending_vm_jobs=>0.0012958049774169922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009452342987060547} [----] I, [2016-09-13T05:13:20.698851 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76673], State: [ok], Delivered in [0.010599049] seconds [----] I, [2016-09-13T05:13:20.732978 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76674], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.636835654] seconds [----] I, [2016-09-13T05:13:20.733188 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76674], Delivering... [----] I, [2016-09-13T05:13:20.734605 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T05:13:20.734843 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5341290496 [----] I, [2016-09-13T05:13:20.734968 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5124554752 [----] I, [2016-09-13T05:13:20.735077 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 216735744 [----] I, [2016-09-13T05:13:20.735186 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1317011456 [----] I, [2016-09-13T05:13:20.735306 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5070589952 [----] I, [2016-09-13T05:13:20.735405 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T05:13:20.735540 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T05:13:20.735646 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 537780224 [----] I, [2016-09-13T05:13:20.735761 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T05:13:20.735871 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7958609920 [----] I, [2016-09-13T05:13:20.735971 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T05:13:20.736073 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T05:13:20.736170 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T05:13:20.736287 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 12288 [----] I, [2016-09-13T05:13:20.736404 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T05:13:20.736549 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T05:13:20.736660 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T05:13:20.736765 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T05:13:20.736886 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T05:13:20.736990 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T05:13:20.737086 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273301504 [----] I, [2016-09-13T05:13:20.737179 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56451072 [----] I, [2016-09-13T05:13:20.737285 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216850432 [----] I, [2016-09-13T05:13:20.737385 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T05:13:20.737520 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140873728 [----] I, [2016-09-13T05:13:20.737633 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2597007360 [----] I, [2016-09-13T05:13:20.737748 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2285252608 [----] I, [2016-09-13T05:13:20.737858 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T05:13:20.737956 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T05:13:20.738049 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T05:13:20.738143 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37740544 [----] I, [2016-09-13T05:13:20.738235 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T05:13:20.738355 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53383168 [----] I, [2016-09-13T05:13:20.738497 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110415872 [----] I, [2016-09-13T05:13:20.738613 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155680768 [----] I, [2016-09-13T05:13:20.738715 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T05:13:20.738816 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T05:13:20.738914 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T05:13:20.739006 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T05:13:20.739101 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T05:13:20.739210 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T05:13:20.739335 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T05:13:20.739472 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T05:13:20.739601 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T05:13:20.767163 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76675], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.62519768] seconds [----] I, [2016-09-13T05:13:20.767371 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76675], Delivering... [----] I, [2016-09-13T05:13:20.775217 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:13:20 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [148887.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:13:20.775737 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:13:15 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [103244.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T05:13:20.776229 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:13:17 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [50597.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:13:20.776678 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:13:13 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [48195.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T05:13:20.777166 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:13:19 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205293000], Memory % [3.5], CPU Time [235522.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T05:13:20.777689 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:13:19 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162420000], Memory % [3.1], CPU Time [37300.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T05:13:20.778182 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:13:17 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358681000], Memory % [5.28], CPU Time [199347.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T05:13:20.778701 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:13:20 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [147970.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:13:20.781605 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:13:11 UTC], Process Info: Memory Usage [598962176], Memory Size [1054564352], Proportional Set Size: [436156000], Memory % [7.3], CPU Time [1580.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:13:20.784513 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:13:12 UTC], Process Info: Memory Usage [587268096], Memory Size [915308544], Proportional Set Size: [424412000], Memory % [7.16], CPU Time [727.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:13:20.787184 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:13:18 UTC], Process Info: Memory Usage [557768704], Memory Size [894599168], Proportional Set Size: [405294000], Memory % [6.8], CPU Time [4706.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T05:13:20.789318 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:13:11 UTC], Process Info: Memory Usage [579944448], Memory Size [907542528], Proportional Set Size: [419416000], Memory % [7.07], CPU Time [1318.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T05:13:20.789856 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:13:17 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [206530.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T05:13:20.790361 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:13:17 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [50606.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:13:20.790832 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:13:09 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165804000], Memory % [3.16], CPU Time [38202.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T05:13:20.791186 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76675], State: [ok], Delivered in [0.023807826] seconds [----] I, [2016-09-13T05:13:20.793641 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T05:13:20.793782 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T05:13:20.796472 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T05:13:20.798379 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T05:13:20.800667 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T05:13:20.803007 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T05:13:20.805237 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T05:13:20.807476 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 838 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T05:13:20.809621 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T05:13:20.811690 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T05:13:20.813574 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T05:13:20.815547 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T05:13:20.817715 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T05:13:20.819817 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T05:13:20.821710 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:13:20.821804 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:13:20.821873 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T05:13:20.824743 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [148875.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T05:13:20.825041 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76674], State: [ok], Delivered in [0.091865479] seconds [----] I, [2016-09-13T05:13:34.183600 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:13:34.201093 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76676], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:13:34.212312 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76677], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:13:34.223909 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76678], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:13:34.252848 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76679], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:13:36.790229 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:13:36.794528 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004377841949462891, :worker_monitor=>1.3085696697235107, :worker_dequeue=>0.0077250003814697266, :total_time=>1.320976734161377} [----] I, [2016-09-13T05:13:37.167097 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76677], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.962428667] seconds [----] I, [2016-09-13T05:13:37.167300 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76677], Delivering... [----] I, [2016-09-13T05:13:37.184527 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76679], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.953227916] seconds [----] I, [2016-09-13T05:13:37.184706 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76679], Delivering... [----] I, [2016-09-13T05:13:37.190964 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003242969512939453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032622814178466797, :pending_vm_jobs=>0.0007977485656738281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059092044830322266} [----] I, [2016-09-13T05:13:37.191317 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76679], State: [ok], Delivered in [0.006586021] seconds [----] I, [2016-09-13T05:13:37.229820 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76677], State: [ok], Delivered in [0.062501021] seconds [----] I, [2016-09-13T05:13:38.876075 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76676], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.688752773] seconds [----] I, [2016-09-13T05:13:38.876271 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76676], Delivering... [----] I, [2016-09-13T05:13:38.881528 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76676], State: [ok], Delivered in [0.005244071] seconds [----] I, [2016-09-13T05:13:38.904823 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76678], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.688171925] seconds [----] I, [2016-09-13T05:13:38.907166 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76678], Delivering... [----] I, [2016-09-13T05:13:38.916089 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76678], State: [ok], Delivered in [0.010999237] seconds [----] I, [2016-09-13T05:13:41.795048 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:13:41 UTC]... [----] I, [2016-09-13T05:13:41.818229 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:13:41 UTC]...Complete [----] I, [2016-09-13T05:13:49.264778 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:13:49.287297 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76680], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:13:53.379659 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:13:53.384690 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004230976104736328, :worker_monitor=>1.5155537128448486, :worker_dequeue=>0.00897526741027832, :total_time=>1.5290696620941162} [----] I, [2016-09-13T05:13:53.979479 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76680], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.708700086] seconds [----] I, [2016-09-13T05:13:53.979752 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76680], Delivering... [----] I, [2016-09-13T05:13:53.986719 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003549337387084961, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003574371337890625, :pending_vm_jobs=>0.0009047985076904297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006513833999633789} [----] I, [2016-09-13T05:13:53.987078 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76680], State: [ok], Delivered in [0.007351109] seconds [----] I, [2016-09-13T05:14:04.299169 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:14:04.316181 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76681], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:14:04.327619 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76682], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:14:09.885662 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:14:09.892952 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0049648284912109375, :worker_monitor=>1.345093011856079, :worker_dequeue=>0.013927459716796875, :total_time=>1.3642840385437012} [----] I, [2016-09-13T05:14:10.447206 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76682], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.125497866] seconds [----] I, [2016-09-13T05:14:10.447361 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76682], Delivering... [----] I, [2016-09-13T05:14:10.451255 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021817684173583984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021936893463134766, :pending_vm_jobs=>0.0004382133483886719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0036318302154541016} [----] I, [2016-09-13T05:14:10.451482 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76682], State: [ok], Delivered in [0.004121484] seconds [----] I, [2016-09-13T05:14:12.070256 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76681], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.763198255] seconds [----] I, [2016-09-13T05:14:12.070574 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76681], Delivering... [----] I, [2016-09-13T05:14:12.076117 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76681], State: [ok], Delivered in [0.005558361] seconds [----] I, [2016-09-13T05:14:14.893482 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:14:14 UTC]... [----] I, [2016-09-13T05:14:14.910378 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:14:14 UTC]...Complete [----] I, [2016-09-13T05:14:19.340084 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:14:19.361759 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76683], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:14:19.927961 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:14:20.557119 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76683], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.210678086] seconds [----] I, [2016-09-13T05:14:20.557336 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76683], Delivering... [----] I, [2016-09-13T05:14:20.562432 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028340816497802734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002850770950317383, :pending_vm_jobs=>0.0005736351013183594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004738330841064453} [----] I, [2016-09-13T05:14:20.562729 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76683], State: [ok], Delivered in [0.005396645] seconds [----] I, [2016-09-13T05:14:26.285798 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003904581069946289, :worker_monitor=>1.3416635990142822, :worker_dequeue=>0.008251428604125977, :total_time=>1.3540968894958496} [----] I, [2016-09-13T05:14:34.374236 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:14:34.384572 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76684], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:14:34.396179 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76685], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:14:34.413473 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76686], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:14:34.441775 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76687], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:14:36.311047 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:14:36.687236 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76685], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.298976239] seconds [----] I, [2016-09-13T05:14:36.687513 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76685], Delivering... [----] I, [2016-09-13T05:14:36.701067 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76687], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.274036058] seconds [----] I, [2016-09-13T05:14:36.701331 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76687], Delivering... [----] I, [2016-09-13T05:14:36.708071 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035495758056640625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003572225570678711, :pending_vm_jobs=>0.0008246898651123047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006319761276245117} [----] I, [2016-09-13T05:14:36.708443 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76687], State: [ok], Delivered in [0.007115102] seconds [----] I, [2016-09-13T05:14:36.756367 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76685], State: [ok], Delivered in [0.068820625] seconds [----] I, [2016-09-13T05:14:39.127656 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76684], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.74887405] seconds [----] I, [2016-09-13T05:14:39.127852 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76684], Delivering... [----] I, [2016-09-13T05:14:39.133329 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76684], State: [ok], Delivered in [0.005450417] seconds [----] I, [2016-09-13T05:14:39.158842 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76686], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.757188225] seconds [----] I, [2016-09-13T05:14:39.159037 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76686], Delivering... [----] I, [2016-09-13T05:14:39.162578 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76686], State: [ok], Delivered in [0.003527595] seconds [----] I, [2016-09-13T05:14:42.802352 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004140377044677734, :worker_monitor=>1.4687561988830566, :worker_dequeue=>0.01131582260131836, :total_time=>1.484560489654541} [----] I, [2016-09-13T05:14:47.802995 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:14:47 UTC]... [----] I, [2016-09-13T05:14:47.831971 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:14:47 UTC]...Complete [----] I, [2016-09-13T05:14:49.783929 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:14:49.807549 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76688], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:14:52.875161 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:14:52.933560 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76688], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.141330063] seconds [----] I, [2016-09-13T05:14:52.933751 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76688], Delivering... [----] I, [2016-09-13T05:14:52.940120 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003330707550048828, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003350496292114258, :pending_vm_jobs=>0.0007817745208740234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005972862243652344} [----] I, [2016-09-13T05:14:52.940527 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76688], State: [ok], Delivered in [0.006775046] seconds [----] I, [2016-09-13T05:14:59.986934 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005044221878051758, :worker_monitor=>2.087510824203491, :worker_dequeue=>0.010934114456176758, :total_time=>2.1038289070129395} [----] I, [2016-09-13T05:15:04.822940 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:15:04.865392 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76689], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:15:04.899671 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76690], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:15:05.140207 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:15:05.968340 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76690], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.096597127] seconds [----] I, [2016-09-13T05:15:05.968568 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76690], Delivering... [----] I, [2016-09-13T05:15:05.974818 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003311634063720703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033316612243652344, :pending_vm_jobs=>0.0008072853088378906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00585174560546875} [----] I, [2016-09-13T05:15:05.975164 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76690], State: [ok], Delivered in [0.006601501] seconds [----] I, [2016-09-13T05:15:06.265458 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76689], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.437572856] seconds [----] I, [2016-09-13T05:15:06.265682 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76689], Delivering... [----] I, [2016-09-13T05:15:06.270965 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76689], State: [ok], Delivered in [0.005281411] seconds [----] I, [2016-09-13T05:15:16.705305 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0055942535400390625, :worker_monitor=>1.5277454853057861, :worker_dequeue=>0.009540557861328125, :total_time=>1.543243646621704} [----] I, [2016-09-13T05:15:19.913937 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:15:19.933936 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76691], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:15:21.705927 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:15:21 UTC]... [----] I, [2016-09-13T05:15:21.727671 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:15:21 UTC]...Complete [----] I, [2016-09-13T05:15:21.738755 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:15:22.128202 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76691], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.207637486] seconds [----] I, [2016-09-13T05:15:22.128467 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76691], Delivering... [----] I, [2016-09-13T05:15:22.135030 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034017562866210938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034210681915283203, :pending_vm_jobs=>0.0008866786956787109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006189107894897461} [----] I, [2016-09-13T05:15:22.135398 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76691], State: [ok], Delivered in [0.006977207] seconds [----] I, [2016-09-13T05:15:33.321462 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00437164306640625, :worker_monitor=>1.544574499130249, :worker_dequeue=>0.007761240005493164, :total_time=>1.5570509433746338} [----] I, [2016-09-13T05:15:34.948366 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:15:34.969164 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76692], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:15:34.986443 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76693], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:15:34.997653 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76694], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:15:35.014773 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76695], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:15:38.331884 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:15:39.295031 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76693], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.321213887] seconds [----] I, [2016-09-13T05:15:39.295217 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76693], Delivering... [----] I, [2016-09-13T05:15:39.301346 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76695], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.293463654] seconds [----] I, [2016-09-13T05:15:39.301624 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76695], Delivering... [----] I, [2016-09-13T05:15:39.308697 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037872791290283203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038077831268310547, :pending_vm_jobs=>0.0009024143218994141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006666898727416992} [----] I, [2016-09-13T05:15:39.309100 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76695], State: [ok], Delivered in [0.007488855] seconds [----] I, [2016-09-13T05:15:39.351211 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76693], State: [ok], Delivered in [0.055965863] seconds [----] I, [2016-09-13T05:15:39.368560 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76692], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.414792825] seconds [----] I, [2016-09-13T05:15:39.368754 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76692], Delivering... [----] I, [2016-09-13T05:15:39.373809 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76692], State: [ok], Delivered in [0.005043535] seconds [----] I, [2016-09-13T05:15:39.380022 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76694], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.387604843] seconds [----] I, [2016-09-13T05:15:39.380308 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76694], Delivering... [----] I, [2016-09-13T05:15:39.383916 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76694], State: [ok], Delivered in [0.003650557] seconds [----] I, [2016-09-13T05:15:49.695155 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0045201778411865234, :worker_monitor=>1.3172838687896729, :worker_dequeue=>0.01299905776977539, :total_time=>1.3351943492889404} [----] I, [2016-09-13T05:15:50.027876 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:15:50.048775 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76696], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:15:54.695857 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:15:54 UTC]... [----] I, [2016-09-13T05:15:54.716961 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:15:54 UTC]...Complete [----] I, [2016-09-13T05:15:54.729365 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:15:55.465983 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76696], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.431233156] seconds [----] I, [2016-09-13T05:15:55.466190 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76696], Delivering... [----] I, [2016-09-13T05:15:55.472912 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034651756286621094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003484964370727539, :pending_vm_jobs=>0.0008656978607177734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006278276443481445} [----] I, [2016-09-13T05:15:55.473311 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76696], State: [ok], Delivered in [0.007103026] seconds [----] I, [2016-09-13T05:16:05.064307 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:16:05.088682 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76697], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:16:05.105927 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76698], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:16:06.074978 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:16:06.082018 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004426479339599609, :worker_monitor=>1.3075034618377686, :worker_dequeue=>0.015334844589233398, :total_time=>1.3276817798614502} [----] I, [2016-09-13T05:16:06.540814 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76697], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.468773172] seconds [----] I, [2016-09-13T05:16:06.541059 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76697], Delivering... [----] I, [2016-09-13T05:16:06.547189 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76697], State: [ok], Delivered in [0.006119537] seconds [----] I, [2016-09-13T05:16:06.552535 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76698], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.456903626] seconds [----] I, [2016-09-13T05:16:06.552910 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76698], Delivering... [----] I, [2016-09-13T05:16:06.565320 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.006248950958251953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00628972053527832, :pending_vm_jobs=>0.0016622543334960938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.011615514755249023} [----] I, [2016-09-13T05:16:06.565924 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76698], State: [ok], Delivered in [0.013048398] seconds [----] I, [2016-09-13T05:16:20.118779 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:16:20.134477 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76699], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:16:22.730197 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:16:22.734711 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004119396209716797, :worker_monitor=>1.4945430755615234, :worker_dequeue=>0.00810551643371582, :total_time=>1.5071263313293457} [----] I, [2016-09-13T05:16:23.695914 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76699], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.571990659] seconds [----] I, [2016-09-13T05:16:23.696142 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76699], Delivering... [----] I, [2016-09-13T05:16:23.705090 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038521289825439453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003871917724609375, :pending_vm_jobs=>0.0009164810180664062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00678706169128418} [----] I, [2016-09-13T05:16:23.705560 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76699], State: [ok], Delivered in [0.00940887] seconds [----] I, [2016-09-13T05:16:27.735287 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:16:27 UTC]... [----] I, [2016-09-13T05:16:27.758475 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:16:27 UTC]...Complete [----] I, [2016-09-13T05:16:35.145349 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:16:35.164470 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76700], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:16:35.181025 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76701], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:16:35.198214 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76702], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:16:35.221363 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76703], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:16:39.135902 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:16:39.143193 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007191658020019531, :worker_monitor=>1.324737787246704, :worker_dequeue=>0.01660442352294922, :total_time=>1.3488402366638184} [----] I, [2016-09-13T05:16:39.677857 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76701], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.506917456] seconds [----] I, [2016-09-13T05:16:39.678055 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76701], Delivering... [----] I, [2016-09-13T05:16:39.706561 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76703], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.498936074] seconds [----] I, [2016-09-13T05:16:39.706764 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76703], Delivering... [----] I, [2016-09-13T05:16:39.713611 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036623477935791016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036890506744384766, :pending_vm_jobs=>0.0008392333984375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006460666656494141} [----] I, [2016-09-13T05:16:39.714001 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76703], State: [ok], Delivered in [0.007229839] seconds [----] I, [2016-09-13T05:16:39.747596 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76701], State: [ok], Delivered in [0.06950829] seconds [----] I, [2016-09-13T05:16:39.763710 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76700], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.613834557] seconds [----] I, [2016-09-13T05:16:39.763891 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76700], Delivering... [----] I, [2016-09-13T05:16:39.768968 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76700], State: [ok], Delivered in [0.005069306] seconds [----] I, [2016-09-13T05:16:39.786133 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76702], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.600059339] seconds [----] I, [2016-09-13T05:16:39.786355 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76702], Delivering... [----] I, [2016-09-13T05:16:39.789396 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76702], State: [ok], Delivered in [0.003045511] seconds [----] I, [2016-09-13T05:16:50.235216 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:16:50.254844 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76704], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:16:55.320102 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:16:55.326483 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004258632659912109, :worker_monitor=>1.1312425136566162, :worker_dequeue=>0.011263370513916016, :total_time=>1.147141933441162} [----] I, [2016-09-13T05:16:55.946369 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76704], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.70449811] seconds [----] I, [2016-09-13T05:16:55.946590 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76704], Delivering... [----] I, [2016-09-13T05:16:55.952892 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003294229507446289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003311634063720703, :pending_vm_jobs=>0.0008103847503662109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00593113899230957} [----] I, [2016-09-13T05:16:55.953242 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76704], State: [ok], Delivered in [0.006649774] seconds [----] I, [2016-09-13T05:17:00.326973 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:17:00 UTC]... [----] I, [2016-09-13T05:17:00.346191 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:17:00 UTC]...Complete [----] I, [2016-09-13T05:17:05.267003 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:17:05.295134 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76705], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:17:05.318036 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76706], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:17:05.372480 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:17:06.016476 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76706], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.716179531] seconds [----] I, [2016-09-13T05:17:06.016772 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76706], Delivering... [----] I, [2016-09-13T05:17:06.024052 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003922939300537109, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003943204879760742, :pending_vm_jobs=>0.0009291172027587891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006805896759033203} [----] I, [2016-09-13T05:17:06.024465 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76706], State: [ok], Delivered in [0.00767137] seconds [----] I, [2016-09-13T05:17:06.883996 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76705], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.612685824] seconds [----] I, [2016-09-13T05:17:06.884184 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76705], Delivering... [----] I, [2016-09-13T05:17:06.888851 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76705], State: [ok], Delivered in [0.004658856] seconds [----] I, [2016-09-13T05:17:11.693869 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0046710968017578125, :worker_monitor=>1.301037311553955, :worker_dequeue=>0.008025884628295898, :total_time=>1.314051628112793} [----] I, [2016-09-13T05:17:16.808704 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T05:17:20.331728 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:17:20.352165 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76707], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:17:21.838243 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:17:21.981362 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76707], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.642773905] seconds [----] I, [2016-09-13T05:17:21.981616 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76707], Delivering... [----] I, [2016-09-13T05:17:21.989075 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003907918930053711, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003929615020751953, :pending_vm_jobs=>0.0009524822235107422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0070345401763916016} [----] I, [2016-09-13T05:17:21.989546 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76707], State: [ok], Delivered in [0.007926728] seconds [----] I, [2016-09-13T05:17:28.349472 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004715442657470703, :worker_monitor=>1.4855847358703613, :worker_dequeue=>0.011167049407958984, :total_time=>1.5018303394317627} [----] I, [2016-09-13T05:17:33.350073 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:17:33 UTC]... [----] I, [2016-09-13T05:17:33.369171 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:17:33 UTC]...Complete [----] I, [2016-09-13T05:17:35.364613 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:17:35.381017 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76708], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:17:35.398168 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76709], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:17:35.409291 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76710], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:17:35.426407 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76711], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:17:38.401188 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:17:39.232491 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76709], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.845084693] seconds [----] I, [2016-09-13T05:17:39.232692 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76709], Delivering... [----] I, [2016-09-13T05:17:39.295441 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76709], State: [ok], Delivered in [0.062697931] seconds [----] I, [2016-09-13T05:17:39.302194 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76711], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.883466378] seconds [----] I, [2016-09-13T05:17:39.302412 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76711], Delivering... [----] I, [2016-09-13T05:17:39.309682 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003742694854736328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003876209259033203, :pending_vm_jobs=>0.000926971435546875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006845235824584961} [----] I, [2016-09-13T05:17:39.310077 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76711], State: [ok], Delivered in [0.007659286] seconds [----] I, [2016-09-13T05:17:40.044196 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76708], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.675369949] seconds [----] I, [2016-09-13T05:17:40.044531 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76708], Delivering... [----] I, [2016-09-13T05:17:40.052024 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76708], State: [ok], Delivered in [0.007493681] seconds [----] I, [2016-09-13T05:17:40.101589 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76710], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.6974459] seconds [----] I, [2016-09-13T05:17:40.101856 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76710], Delivering... [----] I, [2016-09-13T05:17:40.112636 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76710], State: [ok], Delivered in [0.010763949] seconds [----] I, [2016-09-13T05:17:45.001827 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005003929138183594, :worker_monitor=>1.5767128467559814, :worker_dequeue=>0.011525869369506836, :total_time=>1.5936110019683838} [----] I, [2016-09-13T05:17:50.438635 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:17:50.472770 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76712], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:17:55.029326 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:17:55.205522 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76712], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.76027653] seconds [----] I, [2016-09-13T05:17:55.205758 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76712], Delivering... [----] I, [2016-09-13T05:17:55.213371 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0040628910064697266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004122018814086914, :pending_vm_jobs=>0.0009646415710449219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00712275505065918} [----] I, [2016-09-13T05:17:55.213813 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76712], State: [ok], Delivered in [0.008050108] seconds [----] I, [2016-09-13T05:18:01.452194 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005010843276977539, :worker_monitor=>1.396268367767334, :worker_dequeue=>0.013859033584594727, :total_time=>1.4155220985412598} [----] I, [2016-09-13T05:18:05.484940 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T05:18:05.496406 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76713], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:18:05.514623 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76714], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:18:05.531067 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76715], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [3600] [----] I, [2016-09-13T05:18:06.452756 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:18:06 UTC]... [----] I, [2016-09-13T05:18:06.474889 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:18:06 UTC]...Complete [----] I, [2016-09-13T05:18:06.490710 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:18:06.519847 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76714], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.018474833] seconds [----] I, [2016-09-13T05:18:06.520056 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76714], Delivering... [----] I, [2016-09-13T05:18:06.526759 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035665035247802734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035903453826904297, :pending_vm_jobs=>0.0008642673492431641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006294965744018555} [----] I, [2016-09-13T05:18:06.527135 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76714], State: [ok], Delivered in [0.00707804] seconds [----] I, [2016-09-13T05:18:07.262758 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76713], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.773468454] seconds [----] I, [2016-09-13T05:18:07.262957 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76713], Delivering... [----] I, [2016-09-13T05:18:07.267868 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76713], State: [ok], Delivered in [0.00490598] seconds [----] I, [2016-09-13T05:18:07.280015 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76715], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [3600], Dequeued in: [1.760219886] seconds [----] I, [2016-09-13T05:18:07.280177 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76715], Delivering... [----] I, [2016-09-13T05:18:07.293465 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76715], State: [ok], Delivered in [0.013244242] seconds [----] I, [2016-09-13T05:18:18.127384 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004082918167114258, :worker_monitor=>1.5951941013336182, :worker_dequeue=>0.010868072509765625, :total_time=>1.6105165481567383} [----] I, [2016-09-13T05:18:20.543908 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:18:20.559657 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76716], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:18:20.571008 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76717], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:18:20.582459 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76718], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:18:23.227797 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:18:23.622952 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76716], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.072958243] seconds [----] I, [2016-09-13T05:18:23.623153 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76716], Delivering... [----] I, [2016-09-13T05:18:23.629345 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003332376480102539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033502578735351562, :pending_vm_jobs=>0.0007357597351074219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005758762359619141} [----] I, [2016-09-13T05:18:23.629705 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76716], State: [ok], Delivered in [0.006554764] seconds [----] I, [2016-09-13T05:18:23.651127 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76717], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.087433674] seconds [----] I, [2016-09-13T05:18:23.651299 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76717], Delivering... [----] I, [2016-09-13T05:18:23.652296 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T05:18:23.652515 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5326766080 [----] I, [2016-09-13T05:18:23.652619 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5109846016 [----] I, [2016-09-13T05:18:23.652696 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 216920064 [----] I, [2016-09-13T05:18:23.652784 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1317011456 [----] I, [2016-09-13T05:18:23.652860 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5055918080 [----] I, [2016-09-13T05:18:23.652928 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T05:18:23.652999 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T05:18:23.653063 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 537931776 [----] I, [2016-09-13T05:18:23.653132 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T05:18:23.653199 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7845539840 [----] I, [2016-09-13T05:18:23.653285 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T05:18:23.653364 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T05:18:23.653458 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T05:18:23.653543 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 32768 [----] I, [2016-09-13T05:18:23.653616 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T05:18:23.653683 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T05:18:23.653749 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T05:18:23.653816 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T05:18:23.653886 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T05:18:23.653951 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T05:18:23.654017 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273289216 [----] I, [2016-09-13T05:18:23.654080 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56438784 [----] I, [2016-09-13T05:18:23.654148 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216850432 [----] I, [2016-09-13T05:18:23.654213 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6242304 [----] I, [2016-09-13T05:18:23.654294 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140873728 [----] I, [2016-09-13T05:18:23.654369 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2612531200 [----] I, [2016-09-13T05:18:23.654461 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2300592128 [----] I, [2016-09-13T05:18:23.654548 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T05:18:23.654627 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T05:18:23.654698 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T05:18:23.654764 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37228544 [----] I, [2016-09-13T05:18:23.654831 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T05:18:23.654895 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53088256 [----] I, [2016-09-13T05:18:23.654957 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110383104 [----] I, [2016-09-13T05:18:23.655020 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155385856 [----] I, [2016-09-13T05:18:23.655083 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T05:18:23.655148 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T05:18:23.655215 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T05:18:23.655296 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T05:18:23.655367 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T05:18:23.655462 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T05:18:23.655547 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T05:18:23.655617 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T05:18:23.655681 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T05:18:23.694946 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T05:18:23.695139 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T05:18:23.698626 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T05:18:23.701109 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T05:18:23.704072 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T05:18:23.706953 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T05:18:23.709921 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T05:18:23.712929 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 838 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T05:18:23.715810 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T05:18:23.718665 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T05:18:23.721466 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T05:18:23.724205 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T05:18:23.727033 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T05:18:23.729997 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T05:18:23.732551 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:18:23.732684 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:18:23.732782 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T05:18:23.736794 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [148939.0], CPU % [0.4], Priority [21] [----] I, [2016-09-13T05:18:23.737125 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76717], State: [ok], Delivered in [0.085826783] seconds [----] I, [2016-09-13T05:18:28.245791 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:18:28.354034 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76718], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.779146926] seconds [----] I, [2016-09-13T05:18:28.354201 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76718], Delivering... [----] I, [2016-09-13T05:18:28.361536 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:18:05 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205293000], Memory % [3.5], CPU Time [235678.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T05:18:28.361996 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:18:15 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347149000], Memory % [5.04], CPU Time [103260.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T05:18:28.362514 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:18:17 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [148026.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:18:28.362940 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:18:13 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48203.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T05:18:28.363499 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:18:17 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162420000], Memory % [3.1], CPU Time [37311.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T05:18:28.363976 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:18:17 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [148950.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:18:28.364528 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:18:16 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [199393.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T05:18:28.365009 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:18:15 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [50614.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:18:28.365476 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:18:09 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165805000], Memory % [3.16], CPU Time [38214.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T05:18:28.368079 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:18:12 UTC], Process Info: Memory Usage [586424320], Memory Size [915906560], Proportional Set Size: [423913000], Memory % [7.15], CPU Time [1651.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:18:28.370075 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:18:12 UTC], Process Info: Memory Usage [587268096], Memory Size [915308544], Proportional Set Size: [424412000], Memory % [7.16], CPU Time [738.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:18:28.372101 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:18:11 UTC], Process Info: Memory Usage [580190208], Memory Size [922746880], Proportional Set Size: [419649000], Memory % [7.07], CPU Time [1330.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T05:18:28.374067 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:18:09 UTC], Process Info: Memory Usage [557768704], Memory Size [909803520], Proportional Set Size: [405526000], Memory % [6.8], CPU Time [4718.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T05:18:28.374616 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:18:16 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [206576.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T05:18:28.375084 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:18:15 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [50622.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:18:28.375407 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76718], State: [ok], Delivered in [0.021201198] seconds [----] I, [2016-09-13T05:18:34.721661 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041370391845703125, :worker_monitor=>1.4535610675811768, :worker_dequeue=>0.01135706901550293, :total_time=>1.4693613052368164} [----] I, [2016-09-13T05:18:35.593813 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:18:35.639002 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76719], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:18:35.650241 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76720], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:18:35.661580 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76721], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:18:35.678744 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76722], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:18:39.722209 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:18:39 UTC]... [----] I, [2016-09-13T05:18:39.747400 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:18:39 UTC]...Complete [----] I, [2016-09-13T05:18:39.764227 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:18:39.890626 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76720], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.247538914] seconds [----] I, [2016-09-13T05:18:39.890817 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76720], Delivering... [----] I, [2016-09-13T05:18:39.947662 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76720], State: [ok], Delivered in [0.056816331] seconds [----] I, [2016-09-13T05:18:39.984133 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76722], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.312431142] seconds [----] I, [2016-09-13T05:18:39.984361 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76722], Delivering... [----] I, [2016-09-13T05:18:39.990806 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033783912658691406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033965110778808594, :pending_vm_jobs=>0.0008423328399658203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006040096282958984} [----] I, [2016-09-13T05:18:39.991161 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76722], State: [ok], Delivered in [0.006813701] seconds [----] I, [2016-09-13T05:18:40.400013 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76719], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.801826269] seconds [----] I, [2016-09-13T05:18:40.400189 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76719], Delivering... [----] I, [2016-09-13T05:18:40.404948 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76719], State: [ok], Delivered in [0.004749729] seconds [----] I, [2016-09-13T05:18:40.428528 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76721], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.773217805] seconds [----] I, [2016-09-13T05:18:40.428710 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76721], Delivering... [----] I, [2016-09-13T05:18:40.435735 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76721], State: [ok], Delivered in [0.007017503] seconds [----] I, [2016-09-13T05:18:50.691904 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:18:50.714399 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76723], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:18:51.119585 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:18:51.124020 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0057675838470458984, :worker_monitor=>1.3184518814086914, :worker_dequeue=>0.007961750030517578, :total_time=>1.332563877105713} [----] I, [2016-09-13T05:18:51.874440 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76723], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.173325402] seconds [----] I, [2016-09-13T05:18:51.874645 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76723], Delivering... [----] I, [2016-09-13T05:18:51.880942 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003325939178466797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033516883850097656, :pending_vm_jobs=>0.0007548332214355469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005943775177001953} [----] I, [2016-09-13T05:18:51.881342 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76723], State: [ok], Delivered in [0.006704407] seconds [----] I, [2016-09-13T05:19:05.732472 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 11. [----] I, [2016-09-13T05:19:05.766446 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76724], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:19:05.788886 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76725], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:19:05.817196 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76726], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:19:07.568761 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:19:07.575770 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004457950592041016, :worker_monitor=>1.4031753540039062, :worker_dequeue=>0.012196540832519531, :total_time=>1.420311450958252} [----] I, [2016-09-13T05:19:07.994760 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76725], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.220227299] seconds [----] I, [2016-09-13T05:19:07.994967 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76725], Delivering... [----] I, [2016-09-13T05:19:08.001347 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032930374145507812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033156871795654297, :pending_vm_jobs=>0.0008180141448974609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006009578704833984} [----] I, [2016-09-13T05:19:08.001743 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76725], State: [ok], Delivered in [0.00676684] seconds [----] I, [2016-09-13T05:19:10.526200 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76724], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.782196715] seconds [----] I, [2016-09-13T05:19:10.526454 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76724], Delivering... [----] I, [2016-09-13T05:19:10.531386 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76724], State: [ok], Delivered in [0.004942015] seconds [----] I, [2016-09-13T05:19:10.560810 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76726], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.755616762] seconds [----] I, [2016-09-13T05:19:10.561013 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76726], Delivering... [----] I, [2016-09-13T05:19:10.589185 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76727], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T05:19:10.612295 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76728], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T05:19:10.612687 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76726], State: [ok], Delivered in [0.05166702] seconds [----] I, [2016-09-13T05:19:12.576337 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:19:12 UTC]... [----] I, [2016-09-13T05:19:12.600563 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:19:12 UTC]...Complete [----] I, [2016-09-13T05:19:12.617960 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T05:19:12.620520 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T05:19:12.921479 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [76727], MiqWorker id: [97], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [2.344274321] seconds [----] I, [2016-09-13T05:19:12.921754 #30088:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76727], Delivering... [----] I, [2016-09-13T05:19:12.926300 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T05:19:12.926533 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T05:19:12.926698 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T05:19:12.926907 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T05:19:12.927087 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:13.215617 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:13.416037 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:13.416240 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:13.768000 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:13.863468 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:13.955081 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:14.273606 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:14.378191 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:14.471231 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:14.563894 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:14.657553 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:14.752756 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:14.846181 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:14.939145 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:15.032535 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:15.125511 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:15.218058 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:15.310543 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:15.403602 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:15.495705 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:15.588558 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:15.680850 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:15.772623 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:19:15.954935 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T05:19:15.955078 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.0040798187255859375, :collect_inventory_for_targets=>0.00010013580322265625, :parse_legacy_inventory=>18.086547136306763, :parse_targeted_inventory=>18.086679458618164, :save_inventory=>0.9753129482269287, :ems_refresh=>19.06459617614746} [----] I, [2016-09-13T05:19:15.971344 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T05:19:15.971604 #30088:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76727], State: [ok], Delivered in [3.049877137] seconds [----] I, [2016-09-13T05:19:17.636756 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T05:19:20.831836 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:19:20.851809 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76729], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:19:20.863148 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76730], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:19:22.280827 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [76728], MiqWorker id: [96], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [11.685427762] seconds [----] I, [2016-09-13T05:19:22.281029 #28071:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76728], Delivering... [----] I, [2016-09-13T05:19:22.284561 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T05:19:22.284732 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T05:19:22.284861 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T05:19:22.285007 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T05:19:22.285169 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:22.728359 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:23.075010 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:23.075201 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:23.596498 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:23.917697 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:23.917927 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:23.933287 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:19:23.937275 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0062906742095947266, :worker_monitor=>1.2862489223480225, :worker_dequeue=>0.007178783416748047, :total_time=>1.299980878829956} [----] I, [2016-09-13T05:19:24.126172 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76729], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.288441154] seconds [----] I, [2016-09-13T05:19:24.126294 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76729], Delivering... [----] I, [2016-09-13T05:19:24.129761 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0018639564514160156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0018744468688964844, :pending_vm_jobs=>0.0004267692565917969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00325775146484375} [----] I, [2016-09-13T05:19:24.129990 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76729], State: [ok], Delivered in [0.003694957] seconds [----] I, [2016-09-13T05:19:24.530548 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:24.865976 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:24.866241 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:25.357880 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:25.600683 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76730], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.744938398] seconds [----] I, [2016-09-13T05:19:25.600865 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76730], Delivering... [----] I, [2016-09-13T05:19:25.686506 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:25.686634 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:25.692149 #2937:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 09:19:23 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_16' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 09:19:23.936019') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2927,,2016-09-13 09:19:23 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2936,,2016-09-13 09:19:22 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2946,2016-09-13 09:19:25 UTC,2016-09-13 09:19:25 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 09:19:25 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 09:19:25 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 09:19:24 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2986,,2016-09-13 09:19:24 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2997,,2016-09-13 09:19:20 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 09:19:05.826622')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,4, 3011,,2016-09-13 08:53:55 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1529, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,500520, 3030,,2016-09-13 08:24:00 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3325, 3054,,2016-09-13 08:23:57 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3327, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,500519, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,500518, 3160,,2016-09-13 07:53:34 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5151, 703,,2016-09-13 08:53:57 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1528, 27056,,2016-09-13 08:53:59 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1525, 28888,,2016-09-13 08:54:02 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1523, 28079,,2016-09-13 09:19:22 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3, 20394,,2016-09-13 08:54:00 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1525, 30096,,2016-09-13 09:19:15 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,9, ACTIVITY_STATS_CSV [----] I, [2016-09-13T05:19:25.692579 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76730], State: [ok], Delivered in [0.091692546] seconds [----] I, [2016-09-13T05:19:26.165409 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:26.510546 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:26.510762 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:33.076926 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:33.401083 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:33.401302 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:33.912221 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:34.235787 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:34.235986 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:34.801945 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:35.150398 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:35.150622 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:35.663782 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:35.875639 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:19:35.891925 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76731], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:19:35.903295 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76732], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:19:35.916009 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76733], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:19:35.931894 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76734], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:19:35.967944 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:35.968173 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:36.478137 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:36.802000 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:36.802291 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:37.334170 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:37.663111 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:37.663373 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:38.148601 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:38.471535 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:38.471713 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:38.961222 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:39.271535 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:39.271672 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:39.788016 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:39.943395 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:40.091904 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:40.232932 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:40.378136 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:40.527830 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:40.669550 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:40.708454 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:19:40.716566 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004092216491699219, :worker_monitor=>1.6090481281280518, :worker_dequeue=>0.012622833251953125, :total_time=>1.6261253356933594} [----] I, [2016-09-13T05:19:40.749204 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76732], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.853231984] seconds [----] I, [2016-09-13T05:19:40.749377 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76732], Delivering... [----] I, [2016-09-13T05:19:40.800611 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76732], State: [ok], Delivered in [0.05120668] seconds [----] I, [2016-09-13T05:19:40.811560 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:40.823528 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76734], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.897469319] seconds [----] I, [2016-09-13T05:19:40.823679 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76734], Delivering... [----] I, [2016-09-13T05:19:40.829025 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002875089645385742, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028924942016601562, :pending_vm_jobs=>0.0006861686706542969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005029201507568359} [----] I, [2016-09-13T05:19:40.829359 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76734], State: [ok], Delivered in [0.005668539] seconds [----] I, [2016-09-13T05:19:40.851939 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76731], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.971106414] seconds [----] I, [2016-09-13T05:19:40.852089 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76731], Delivering... [----] I, [2016-09-13T05:19:40.855910 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76731], State: [ok], Delivered in [0.003819039] seconds [----] I, [2016-09-13T05:19:40.886569 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76733], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.978015903] seconds [----] I, [2016-09-13T05:19:40.886738 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76733], Delivering... [----] I, [2016-09-13T05:19:40.889312 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76733], State: [ok], Delivered in [0.002577953] seconds [----] I, [2016-09-13T05:19:40.960880 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:41.108692 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:41.251389 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:41.403530 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:41.564654 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:41.725692 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:41.868828 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:42.243602 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:42.391991 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:42.535774 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:42.679322 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:42.836666 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:42.982188 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:43.133761 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:43.295477 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:43.463225 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:43.637980 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:45.717062 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:19:45 UTC]... [----] I, [2016-09-13T05:19:45.742310 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:19:45 UTC]...Complete [----] I, [2016-09-13T05:19:49.801662 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:49.955402 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:50.107211 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:50.256120 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:50.407604 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:50.561545 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:50.711361 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:50.943942 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:19:50.959559 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76735], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:19:51.203450 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:51.379076 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:51.532619 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:51.689710 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:51.833159 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:51.988168 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:52.140954 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:52.299530 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:52.458792 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:52.608616 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:52.751791 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:52.893006 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:53.048154 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:53.188573 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:53.335288 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:53.487357 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:53.638783 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:53.986508 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:54.173517 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:54.324700 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:54.479562 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:54.630032 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:54.835741 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:54.978091 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:55.134471 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:55.279846 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:55.430903 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:55.587040 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:55.735140 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:55.890498 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:56.039406 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:56.215586 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:56.371265 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:56.524371 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:56.939565 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:56.999946 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:19:57.006252 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005007743835449219, :worker_monitor=>1.211078405380249, :worker_dequeue=>0.011246919631958008, :total_time=>1.2278218269348145} [----] I, [2016-09-13T05:19:57.115874 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:57.269078 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:57.372470 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76735], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.42261661] seconds [----] I, [2016-09-13T05:19:57.372671 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76735], Delivering... [----] I, [2016-09-13T05:19:57.379333 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032956600189208984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003317117691040039, :pending_vm_jobs=>0.0007460117340087891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006189823150634766} [----] I, [2016-09-13T05:19:57.379800 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76735], State: [ok], Delivered in [0.007108018] seconds [----] I, [2016-09-13T05:19:57.416360 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:57.566728 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:57.703355 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:57.854525 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:58.009344 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:58.163374 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:58.316613 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:58.472958 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:58.633989 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:58.781241 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:58.930751 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:59.345694 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:59.485877 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:19:59.636118 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:00.020016 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:00.181660 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:00.323821 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:00.471103 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:00.634524 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:05.971199 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:20:05.989604 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76736], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:20:06.012610 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76737], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:20:06.041041 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76738], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:20:06.052330 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76739], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:20:06.070675 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76740], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:20:06.801319 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:06.957620 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:07.026698 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:20:07.100271 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:07.249534 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:07.393572 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:07.464892 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76740], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.40572522] seconds [----] I, [2016-09-13T05:20:07.465064 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76740], Delivering... [----] I, [2016-09-13T05:20:07.471039 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003214597702026367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003232240676879883, :pending_vm_jobs=>0.0006842613220214844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005639076232910156} [----] I, [2016-09-13T05:20:07.471436 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76740], State: [ok], Delivered in [0.0063403] seconds [----] I, [2016-09-13T05:20:07.534891 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:07.675519 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:07.784272 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76736], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.807273964] seconds [----] I, [2016-09-13T05:20:07.784511 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76736], Delivering... [----] I, [2016-09-13T05:20:07.786913 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76736], State: [ok], Delivered in [0.002409488] seconds [----] I, [2016-09-13T05:20:07.829937 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76737], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.834896892] seconds [----] I, [2016-09-13T05:20:07.830107 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76737], Delivering... [----] I, [2016-09-13T05:20:07.830788 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:07.841222 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76737], State: [ok], Delivered in [0.011087709] seconds [----] I, [2016-09-13T05:20:07.887103 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76738], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.869029891] seconds [----] I, [2016-09-13T05:20:07.887303 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76738], Delivering... [----] I, [2016-09-13T05:20:07.891718 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76738], State: [ok], Delivered in [0.004431378] seconds [----] I, [2016-09-13T05:20:07.944160 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76739], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.89907442] seconds [----] I, [2016-09-13T05:20:07.944369 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76739], Delivering... [----] I, [2016-09-13T05:20:07.948992 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76739], State: [ok], Delivered in [0.004610965] seconds [----] I, [2016-09-13T05:20:07.981545 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:08.133902 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:08.276606 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:08.423367 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:08.881897 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:09.045921 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:09.194955 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:09.345950 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:09.486300 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:09.639035 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:09.793353 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:09.933628 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:10.085557 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:10.242828 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:10.396198 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:10.535608 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:10.681326 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:10.841481 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:10.982615 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:11.130194 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:11.273197 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:11.730936 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:11.906580 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:12.058729 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:12.213745 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:12.355510 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:12.813391 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:12.971973 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:13.135663 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:13.279751 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:13.321196 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0029518604278564453, :worker_monitor=>1.274111270904541, :worker_dequeue=>0.010523557662963867, :total_time=>1.2878859043121338} [----] I, [2016-09-13T05:20:13.423939 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:13.583456 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:13.721671 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:13.865539 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:14.019540 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:14.163524 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:14.310775 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:14.463409 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:14.865878 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:15.030763 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:15.171668 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:15.317843 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:15.467517 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:15.633514 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:15.784066 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:15.945626 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:16.103882 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:16.242646 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:16.392970 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:16.545921 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:16.702814 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:16.853634 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:17.001628 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:17.142362 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:17.288357 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:17.728070 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:17.903610 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:18.059267 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:18.216597 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:18.321662 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:20:18 UTC]... [----] I, [2016-09-13T05:20:18.345002 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:20:18 UTC]...Complete [----] I, [2016-09-13T05:20:18.363529 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:18.512816 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:18.701091 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:18.876595 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:19.019701 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:19.183441 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:19.329650 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:19.474341 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:19.630333 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:19.772779 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:19.907707 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:20.060408 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:21.086497 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:20:21.104011 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76741], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:20:21.201366 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:21.661650 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:21.828111 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:21.974217 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:22.126163 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:22.277435 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:22.432034 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:22.582714 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:22.767608 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:22.917758 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:23.105050 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:23.266678 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:23.361461 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:20:23.406540 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:23.554860 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:23.595732 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76741], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.503296718] seconds [----] I, [2016-09-13T05:20:23.595905 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76741], Delivering... [----] I, [2016-09-13T05:20:23.602232 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034499168395996094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003468036651611328, :pending_vm_jobs=>0.0007505416870117188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006002187728881836} [----] I, [2016-09-13T05:20:23.602601 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76741], State: [ok], Delivered in [0.006689794] seconds [----] I, [2016-09-13T05:20:23.705969 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:26.322792 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:26.493607 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:26.635569 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:27.177486 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:27.341884 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:27.496988 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:27.640213 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:27.786092 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:27.927953 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:28.091575 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:28.240295 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:28.382701 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:28.530545 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:28.665687 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:28.815605 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:28.973101 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:29.402791 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:29.544637 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:29.699214 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:29.791147 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002794981002807617, :worker_monitor=>1.409867763519287, :worker_dequeue=>0.01212453842163086, :total_time=>1.4250240325927734} [----] I, [2016-09-13T05:20:29.842036 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:30.669632 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:30.822391 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:30.973459 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:31.119569 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:31.267768 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:31.417610 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:31.565579 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:31.708516 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:31.858608 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:31.997131 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:32.140758 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:32.285623 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:32.439510 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:32.578224 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:32.724570 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:32.875608 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:33.021586 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:33.495373 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:33.670719 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:33.836786 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:34.004733 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:34.158802 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:34.300202 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:34.439772 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:34.591356 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:34.729566 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:34.871830 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:35.014713 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:35.162950 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:35.301794 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:35.458042 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:35.616557 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:35.774135 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:35.938006 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:20:36.115284 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:20:36.133953 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76742], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] E, [2016-09-13T05:20:36.147287 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T05:20:36.147640 #28071:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T05:20:36.147942 #28071:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T05:20:36.148029 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T05:20:36.148126 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T05:20:36.160270 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76743], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:20:36.178294 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T05:20:36.178653 #28071:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [76728], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T05:20:36.178867 #28071:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T05:20:36.179104 #28071:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T05:20:36.179281 #28071:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76728], State: [error], Delivered in [73.898248839] seconds [----] I, [2016-09-13T05:20:36.201626 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76744], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:20:36.247142 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76745], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:20:39.919220 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:20:40.750372 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76743], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.612698824] seconds [----] I, [2016-09-13T05:20:40.750577 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76743], Delivering... [----] I, [2016-09-13T05:20:40.761474 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76745], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.550141004] seconds [----] I, [2016-09-13T05:20:40.761668 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76745], Delivering... [----] I, [2016-09-13T05:20:40.767682 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031976699829101562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032148361206054688, :pending_vm_jobs=>0.0007379055023193359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005652904510498047} [----] I, [2016-09-13T05:20:40.768011 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76745], State: [ok], Delivered in [0.006345122] seconds [----] I, [2016-09-13T05:20:40.801168 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76743], State: [ok], Delivered in [0.050576755] seconds [----] I, [2016-09-13T05:20:41.035928 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76742], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.916680277] seconds [----] I, [2016-09-13T05:20:41.036114 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76742], Delivering... [----] I, [2016-09-13T05:20:41.040491 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76742], State: [ok], Delivered in [0.00436472] seconds [----] I, [2016-09-13T05:20:41.069702 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76744], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.904994907] seconds [----] I, [2016-09-13T05:20:41.069840 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76744], Delivering... [----] I, [2016-09-13T05:20:41.071837 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76744], State: [ok], Delivered in [0.002019388] seconds [----] I, [2016-09-13T05:20:46.070054 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0026700496673583984, :worker_monitor=>1.129199504852295, :worker_dequeue=>0.009003877639770508, :total_time=>1.1411375999450684} [----] I, [2016-09-13T05:20:51.070731 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:20:51 UTC]... [----] I, [2016-09-13T05:20:51.104618 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:20:51 UTC]...Complete [----] I, [2016-09-13T05:20:51.260931 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:20:51.281455 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76746], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:20:56.146800 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:20:56.934521 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76746], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.664337508] seconds [----] I, [2016-09-13T05:20:56.934749 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76746], Delivering... [----] I, [2016-09-13T05:20:56.941746 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0039653778076171875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003990888595581055, :pending_vm_jobs=>0.0008080005645751953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006618976593017578} [----] I, [2016-09-13T05:20:56.942168 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76746], State: [ok], Delivered in [0.007419451] seconds [----] I, [2016-09-13T05:21:02.975695 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004092693328857422, :worker_monitor=>1.8076186180114746, :worker_dequeue=>0.011007070541381836, :total_time=>1.8230431079864502} [----] I, [2016-09-13T05:21:06.292149 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:21:06.310038 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76747], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:21:06.384446 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76748], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:21:07.983200 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:21:08.018923 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76748], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.705336266] seconds [----] I, [2016-09-13T05:21:08.019105 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76748], Delivering... [----] I, [2016-09-13T05:21:08.024967 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030536651611328125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003094196319580078, :pending_vm_jobs=>0.0007226467132568359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00551605224609375} [----] I, [2016-09-13T05:21:08.025307 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76748], State: [ok], Delivered in [0.006188399] seconds [----] I, [2016-09-13T05:21:08.179092 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76747], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.882718089] seconds [----] I, [2016-09-13T05:21:08.179291 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76747], Delivering... [----] I, [2016-09-13T05:21:08.183522 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76747], State: [ok], Delivered in [0.0042305] seconds [----] I, [2016-09-13T05:21:19.402520 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0024499893188476562, :worker_monitor=>1.3833162784576416, :worker_dequeue=>0.0060045719146728516, :total_time=>1.3919756412506104} [----] I, [2016-09-13T05:21:21.395762 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:21:21.422865 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76749], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:21:24.403059 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:21:24 UTC]... [----] I, [2016-09-13T05:21:24.424563 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:21:24 UTC]...Complete [----] I, [2016-09-13T05:21:24.441594 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:21:25.148872 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76749], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.743021248] seconds [----] I, [2016-09-13T05:21:25.149059 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76749], Delivering... [----] I, [2016-09-13T05:21:25.156085 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003610372543334961, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036323070526123047, :pending_vm_jobs=>0.0008745193481445312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065975189208984375} [----] I, [2016-09-13T05:21:25.156592 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76749], State: [ok], Delivered in [0.007516955] seconds [----] I, [2016-09-13T05:21:36.088964 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004857063293457031, :worker_monitor=>1.6011121273040771, :worker_dequeue=>0.017118215560913086, :total_time=>1.6235594749450684} [----] I, [2016-09-13T05:21:36.436606 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:21:36.464317 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76750], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:21:36.491796 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76751], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:21:36.525281 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76752], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:21:36.548855 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76753], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:21:41.170340 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:21:41.263637 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76751], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.794443609] seconds [----] I, [2016-09-13T05:21:41.263863 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76751], Delivering... [----] I, [2016-09-13T05:21:41.325999 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76751], State: [ok], Delivered in [0.06212438] seconds [----] I, [2016-09-13T05:21:41.343314 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76753], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.81082528] seconds [----] I, [2016-09-13T05:21:41.343546 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76753], Delivering... [----] I, [2016-09-13T05:21:41.349329 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033578872680664062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003381013870239258, :pending_vm_jobs=>0.0006504058837890625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005413055419921875} [----] I, [2016-09-13T05:21:41.349652 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76753], State: [ok], Delivered in [0.006121863] seconds [----] I, [2016-09-13T05:21:41.389176 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76750], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.946591732] seconds [----] I, [2016-09-13T05:21:41.389396 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76750], Delivering... [----] I, [2016-09-13T05:21:41.394115 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76750], State: [ok], Delivered in [0.004719204] seconds [----] I, [2016-09-13T05:21:41.463110 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76752], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.966605425] seconds [----] I, [2016-09-13T05:21:41.463305 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76752], Delivering... [----] I, [2016-09-13T05:21:41.466560 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76752], State: [ok], Delivered in [0.003258641] seconds [----] I, [2016-09-13T05:21:51.569729 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:21:51.607187 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76754], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:21:52.874208 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:21:52.878201 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003968715667724609, :worker_monitor=>1.6493065357208252, :worker_dequeue=>0.007180213928222656, :total_time=>1.660764217376709} [----] I, [2016-09-13T05:21:53.446962 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76754], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.871085308] seconds [----] I, [2016-09-13T05:21:53.447143 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76754], Delivering... [----] I, [2016-09-13T05:21:53.452623 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002939939498901367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029556751251220703, :pending_vm_jobs=>0.0006470680236816406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005146026611328125} [----] I, [2016-09-13T05:21:53.453036 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76754], State: [ok], Delivered in [0.005868932] seconds [----] I, [2016-09-13T05:21:57.878589 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:21:57 UTC]... [----] I, [2016-09-13T05:21:57.897244 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:21:57 UTC]...Complete [----] I, [2016-09-13T05:22:06.618869 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:22:06.640368 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76755], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:22:06.671645 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76756], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:22:09.632580 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:22:09.639650 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004033088684082031, :worker_monitor=>1.6985583305358887, :worker_dequeue=>0.01287698745727539, :total_time=>1.7157566547393799} [----] I, [2016-09-13T05:22:09.911845 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76756], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.25200655] seconds [----] I, [2016-09-13T05:22:09.912114 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76756], Delivering... [----] I, [2016-09-13T05:22:09.921872 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005003929138183594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0050351619720458984, :pending_vm_jobs=>0.0012149810791015625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009203195571899414} [----] I, [2016-09-13T05:22:09.922445 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76756], State: [ok], Delivered in [0.01028967] seconds [----] I, [2016-09-13T05:22:11.698067 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76755], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.073072653] seconds [----] I, [2016-09-13T05:22:11.698303 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76755], Delivering... [----] I, [2016-09-13T05:22:11.704056 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76755], State: [ok], Delivered in [0.00577886] seconds [----] I, [2016-09-13T05:22:19.676147 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T05:22:21.681350 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:22:21.697447 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76757], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:22:26.000910 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:22:26.006885 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004286050796508789, :worker_monitor=>1.3046369552612305, :worker_dequeue=>0.01077127456665039, :total_time=>1.3199925422668457} [----] I, [2016-09-13T05:22:26.052396 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76757], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.366470071] seconds [----] I, [2016-09-13T05:22:26.052607 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76757], Delivering... [----] I, [2016-09-13T05:22:26.058286 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028989315032958984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002994537353515625, :pending_vm_jobs=>0.0007355213165283203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0053288936614990234} [----] I, [2016-09-13T05:22:26.058581 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76757], State: [ok], Delivered in [0.005976224] seconds [----] I, [2016-09-13T05:22:31.007362 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:22:31 UTC]... [----] I, [2016-09-13T05:22:31.031010 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:22:31 UTC]...Complete [----] I, [2016-09-13T05:22:36.711751 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:22:36.763302 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76758], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:22:36.809191 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76759], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:22:36.848976 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76760], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:22:36.888837 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76761], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:22:42.578397 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:22:42.582775 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005911111831665039, :worker_monitor=>1.511059284210205, :worker_dequeue=>0.008022546768188477, :total_time=>1.5254359245300293} [----] I, [2016-09-13T05:22:43.172919 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76759], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.406272192] seconds [----] I, [2016-09-13T05:22:43.173161 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76759], Delivering... [----] I, [2016-09-13T05:22:43.195607 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76761], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.33583658] seconds [----] I, [2016-09-13T05:22:43.195781 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76761], Delivering... [----] I, [2016-09-13T05:22:43.202711 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032126903533935547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032491683959960938, :pending_vm_jobs=>0.0008604526519775391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065495967864990234} [----] I, [2016-09-13T05:22:43.203162 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76761], State: [ok], Delivered in [0.007350999] seconds [----] I, [2016-09-13T05:22:43.258530 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76759], State: [ok], Delivered in [0.085304691] seconds [----] I, [2016-09-13T05:22:44.835824 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76758], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.117039271] seconds [----] I, [2016-09-13T05:22:44.836030 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76758], Delivering... [----] I, [2016-09-13T05:22:44.841147 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76758], State: [ok], Delivered in [0.005113704] seconds [----] I, [2016-09-13T05:22:44.910009 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76760], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.093980999] seconds [----] I, [2016-09-13T05:22:44.910203 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76760], Delivering... [----] I, [2016-09-13T05:22:44.913847 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76760], State: [ok], Delivered in [0.00363542] seconds [----] I, [2016-09-13T05:22:51.897375 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:22:51.909831 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76762], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:22:52.716775 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:22:53.316068 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76762], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.414312075] seconds [----] I, [2016-09-13T05:22:53.316399 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76762], Delivering... [----] I, [2016-09-13T05:22:53.328140 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005837917327880859, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005878925323486328, :pending_vm_jobs=>0.0015311241149902344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.011055946350097656} [----] I, [2016-09-13T05:22:53.328701 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76762], State: [ok], Delivered in [0.012305082] seconds [----] I, [2016-09-13T05:22:59.417083 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004132747650146484, :worker_monitor=>1.678138017654419, :worker_dequeue=>0.011095523834228516, :total_time=>1.693673849105835} [----] I, [2016-09-13T05:23:04.422260 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:23:04 UTC]... [----] I, [2016-09-13T05:23:04.460220 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:23:04 UTC]...Complete [----] I, [2016-09-13T05:23:06.921926 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T05:23:06.940195 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76763], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:23:06.957225 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76764], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:23:06.980766 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76765], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:23:09.483761 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:23:10.483560 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76764], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.537865643] seconds [----] I, [2016-09-13T05:23:10.483806 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76764], Delivering... [----] I, [2016-09-13T05:23:10.491062 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003820657730102539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038530826568603516, :pending_vm_jobs=>0.0008528232574462891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006857872009277344} [----] I, [2016-09-13T05:23:10.491434 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76764], State: [ok], Delivered in [0.007623908] seconds [----] I, [2016-09-13T05:23:12.020541 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76763], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.094212248] seconds [----] I, [2016-09-13T05:23:12.020717 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76763], Delivering... [----] I, [2016-09-13T05:23:12.025238 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76763], State: [ok], Delivered in [0.004517235] seconds [----] I, [2016-09-13T05:23:12.027586 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76765], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.063083889] seconds [----] I, [2016-09-13T05:23:12.027822 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76765], Delivering... [----] I, [2016-09-13T05:23:12.028236 #2928:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Starting [----] I, [2016-09-13T05:23:12.034122 #2928:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Complete [----] I, [2016-09-13T05:23:12.034505 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76765], State: [ok], Delivered in [0.006655447] seconds [----] I, [2016-09-13T05:23:15.914866 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030913352966308594, :worker_monitor=>1.4143736362457275, :worker_dequeue=>0.006863832473754883, :total_time=>1.424511432647705} [----] I, [2016-09-13T05:23:21.995839 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:23:22.015885 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76766], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:23:22.026007 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76767], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:23:22.037564 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76768], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:23:25.939992 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:23:26.576355 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76766], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.574662919] seconds [----] I, [2016-09-13T05:23:26.576694 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76766], Delivering... [----] I, [2016-09-13T05:23:26.588392 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005997180938720703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.006031513214111328, :pending_vm_jobs=>0.001592397689819336, :vm_jobs_to_dispatch_count=>0, :total_time=>0.011019229888916016} [----] I, [2016-09-13T05:23:26.588957 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76766], State: [ok], Delivered in [0.012277696] seconds [----] I, [2016-09-13T05:23:26.626770 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76768], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.596804046] seconds [----] I, [2016-09-13T05:23:26.626956 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76768], Delivering... [----] I, [2016-09-13T05:23:26.634996 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:23:03 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347149000], Memory % [5.04], CPU Time [103274.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T05:23:26.635560 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:23:13 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48210.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T05:23:26.636217 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:23:15 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162420000], Memory % [3.1], CPU Time [37320.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T05:23:26.636834 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:23:15 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [149046.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:23:26.637410 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:23:13 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [50629.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:23:26.638012 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:23:06 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205293000], Memory % [3.5], CPU Time [235803.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T05:23:26.638665 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:23:15 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [199463.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T05:23:26.639187 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:23:15 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [148121.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:23:26.642338 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:23:06 UTC], Process Info: Memory Usage [597241856], Memory Size [1054453760], Proportional Set Size: [434477000], Memory % [7.28], CPU Time [1792.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:23:26.644642 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:23:06 UTC], Process Info: Memory Usage [587579392], Memory Size [930627584], Proportional Set Size: [424716000], Memory % [7.16], CPU Time [772.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:23:26.646895 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:23:12 UTC], Process Info: Memory Usage [580395008], Memory Size [936378368], Proportional Set Size: [419857000], Memory % [7.08], CPU Time [1341.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T05:23:26.649124 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:23:09 UTC], Process Info: Memory Usage [560480256], Memory Size [929497088], Proportional Set Size: [407962000], Memory % [6.83], CPU Time [4728.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T05:23:26.649548 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76767], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.629462454] seconds [----] I, [2016-09-13T05:23:26.649729 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76767], Delivering... [----] I, [2016-09-13T05:23:26.649744 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:23:15 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [206642.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T05:23:26.650306 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:23:13 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [50664.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:23:26.650853 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:23:09 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165805000], Memory % [3.16], CPU Time [38223.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T05:23:26.651173 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76768], State: [ok], Delivered in [0.024208802] seconds [----] I, [2016-09-13T05:23:26.651237 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T05:23:26.651496 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5341908992 [----] I, [2016-09-13T05:23:26.651619 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5124726784 [----] I, [2016-09-13T05:23:26.651719 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 217182208 [----] I, [2016-09-13T05:23:26.651798 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1319108608 [----] I, [2016-09-13T05:23:26.651879 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5070782464 [----] I, [2016-09-13T05:23:26.651962 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T05:23:26.652041 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T05:23:26.652120 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 538214400 [----] I, [2016-09-13T05:23:26.652201 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T05:23:26.652300 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8033918976 [----] I, [2016-09-13T05:23:26.652385 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T05:23:26.652498 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T05:23:26.652584 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T05:23:26.652670 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 24576 [----] I, [2016-09-13T05:23:26.652772 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T05:23:26.652878 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T05:23:26.652960 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T05:23:26.653054 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T05:23:26.653140 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T05:23:26.653219 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T05:23:26.653320 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273309696 [----] I, [2016-09-13T05:23:26.653404 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56438784 [----] I, [2016-09-13T05:23:26.653576 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216870912 [----] I, [2016-09-13T05:23:26.653681 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T05:23:26.653796 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140873728 [----] I, [2016-09-13T05:23:26.653930 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2597425152 [----] I, [2016-09-13T05:23:26.654064 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2285203456 [----] I, [2016-09-13T05:23:26.654184 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T05:23:26.654296 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T05:23:26.654387 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T05:23:26.654513 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37494784 [----] I, [2016-09-13T05:23:26.654605 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T05:23:26.654687 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53276672 [----] I, [2016-09-13T05:23:26.654773 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110383104 [----] I, [2016-09-13T05:23:26.654854 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155574272 [----] I, [2016-09-13T05:23:26.654931 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T05:23:26.655001 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T05:23:26.655077 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T05:23:26.655152 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T05:23:26.655233 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T05:23:26.655336 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T05:23:26.655444 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T05:23:26.655557 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T05:23:26.655639 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T05:23:26.698280 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T05:23:26.698653 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T05:23:26.706107 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T05:23:26.711292 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T05:23:26.717730 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T05:23:26.723844 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T05:23:26.728590 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T05:23:26.734909 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 839 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T05:23:26.741324 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T05:23:26.747341 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T05:23:26.753499 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T05:23:26.759462 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T05:23:26.765506 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T05:23:26.770672 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T05:23:26.773831 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:23:26.774020 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:23:26.774135 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T05:23:26.778877 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [149034.0], CPU % [0.3], Priority [30] [----] I, [2016-09-13T05:23:26.779360 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76767], State: [ok], Delivered in [0.129599918] seconds [----] I, [2016-09-13T05:23:32.651301 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004209041595458984, :worker_monitor=>1.69014573097229, :worker_dequeue=>0.009331941604614258, :total_time=>1.7039992809295654} [----] I, [2016-09-13T05:23:37.049009 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:23:37.078072 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76769], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:23:37.100911 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76770], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:23:37.112028 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76771], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:23:37.135172 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76772], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:23:37.651877 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:23:37 UTC]... [----] I, [2016-09-13T05:23:37.671936 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:23:37 UTC]...Complete [----] I, [2016-09-13T05:23:37.682858 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:23:37.746735 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76770], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.664050944] seconds [----] I, [2016-09-13T05:23:37.746937 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76770], Delivering... [----] I, [2016-09-13T05:23:37.826983 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76770], State: [ok], Delivered in [0.07999391] seconds [----] I, [2016-09-13T05:23:37.862836 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76772], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.741536363] seconds [----] I, [2016-09-13T05:23:37.863033 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76772], Delivering... [----] I, [2016-09-13T05:23:37.869867 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035529136657714844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035734176635742188, :pending_vm_jobs=>0.0008447170257568359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006455659866333008} [----] I, [2016-09-13T05:23:37.870263 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76772], State: [ok], Delivered in [0.007205708] seconds [----] I, [2016-09-13T05:23:39.129739 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76769], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.075925153] seconds [----] I, [2016-09-13T05:23:39.130006 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76769], Delivering... [----] I, [2016-09-13T05:23:39.137762 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76769], State: [ok], Delivered in [0.007734503] seconds [----] I, [2016-09-13T05:23:39.142556 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76771], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.035686467] seconds [----] I, [2016-09-13T05:23:39.142796 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76771], Delivering... [----] I, [2016-09-13T05:23:39.147056 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76771], State: [ok], Delivered in [0.004250071] seconds [----] I, [2016-09-13T05:23:49.461569 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003964424133300781, :server_monitor=>0.09862947463989258, :worker_monitor=>1.6352243423461914, :worker_dequeue=>0.011213302612304688, :total_time=>1.7493748664855957} [----] I, [2016-09-13T05:23:52.147791 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:23:52.167844 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76773], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:23:54.474385 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:23:55.030404 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76773], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.875447287] seconds [----] I, [2016-09-13T05:23:55.030573 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76773], Delivering... [----] I, [2016-09-13T05:23:55.034795 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022907257080078125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023071765899658203, :pending_vm_jobs=>0.0005660057067871094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003963947296142578} [----] I, [2016-09-13T05:23:55.035086 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76773], State: [ok], Delivered in [0.004511907] seconds [----] I, [2016-09-13T05:24:05.552389 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:24:05.552574 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:24:05.557987 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:24:05.558163 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:24:05.581073 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:24:05.581209 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:24:05.598352 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:24:05.598572 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:24:05.615577 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:24:05.615721 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:24:05.632645 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:24:05.632793 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:24:05.649871 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:24:05.650010 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:24:05.666974 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:24:05.667114 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:24:05.683871 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:24:05.683992 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:24:05.702038 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:24:05.702183 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:24:05.718361 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:24:05.718510 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:24:05.735697 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:24:05.735836 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:24:05.752812 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:24:05.752991 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:24:05.769831 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:24:05.769950 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:24:05.788122 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:24:05.788273 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:24:05.797666 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004107952117919922, :worker_monitor=>1.2903797626495361, :worker_dequeue=>0.006952524185180664, :total_time=>1.3017468452453613} [----] I, [2016-09-13T05:24:06.102462 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:24:06.102584 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:24:06.102656 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:24:06.204364 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:24:06.204949 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T05:24:06.204998 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:24:06.205023 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:24:06.205047 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:24:06.205068 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T05:24:06.205091 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T05:24:06.205111 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:24:06.205132 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T05:24:06.205152 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:24:06.205172 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:24:06.205193 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:24:06.205212 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:24:06.205231 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T05:24:06.205266 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:24:06.205289 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T05:24:06.205308 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T05:24:06.205513 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:24:06.205623 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:24:06.393687 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:24:06.393817 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:24:06.393879 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:24:06.411017 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T05:24:06.411180 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T05:24:06.411308 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T05:24:06.531980 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:24:06.532732 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T05:24:06.532802 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:24:06.532842 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:24:06.532873 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:24:06.532902 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T05:24:06.532931 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T05:24:06.532960 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:24:06.532988 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T05:24:06.533016 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:24:06.533043 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:24:06.533070 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:24:06.533097 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:24:06.533125 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T05:24:06.533152 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:24:06.533179 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T05:24:06.533205 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T05:24:06.533480 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:24:06.533624 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:24:06.540794 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T05:24:06.540926 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T05:24:06.541017 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T05:24:06.582990 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:24:06.583885 #30088:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T05:24:06.583968 #30088:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:24:06.584016 #30088:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:24:06.584053 #30088:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:24:06.584089 #30088:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T05:24:06.584138 #30088:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T05:24:06.584177 #30088:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:24:06.584214 #30088:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T05:24:06.584269 #30088:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:24:06.584309 #30088:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:24:06.584341 #30088:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T05:24:06.584375 #30088:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:24:06.584410 #30088:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T05:24:06.584489 #30088:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:24:06.584527 #30088:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T05:24:06.584561 #30088:34713c] INFO -- : --- [----] I, [2016-09-13T05:24:06.584925 #30088:34713c] INFO -- : :guid: aa80abf2-7989-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:24:06.584990 #30088:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T05:24:06.585176 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T05:24:06.684862 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:24:06.685625 #28071:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T05:24:06.685698 #28071:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:24:06.685740 #28071:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:24:06.685776 #28071:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:24:06.685810 #28071:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T05:24:06.685840 #28071:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T05:24:06.685872 #28071:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:24:06.685903 #28071:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T05:24:06.685936 #28071:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:24:06.685965 #28071:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:24:06.685994 #28071:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T05:24:06.686021 #28071:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:24:06.686075 #28071:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T05:24:06.686106 #28071:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:24:06.686138 #28071:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T05:24:06.686166 #28071:34713c] INFO -- : --- [----] I, [2016-09-13T05:24:06.686517 #28071:34713c] INFO -- : :guid: b49c1882-7985-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:24:06.686586 #28071:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T05:24:06.686748 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T05:24:07.185204 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:24:07.185463 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:24:07.185583 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:24:07.323685 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:24:07.325095 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T05:24:07.325180 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:24:07.325226 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:24:07.325285 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:24:07.325324 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T05:24:07.325358 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T05:24:07.325390 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:24:07.325458 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T05:24:07.325504 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:24:07.325538 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:24:07.325577 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:24:07.325631 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:24:07.325684 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T05:24:07.325736 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T05:24:07.325787 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T05:24:07.325839 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T05:24:07.325892 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T05:24:07.325943 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T05:24:07.326002 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T05:24:07.326091 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T05:24:07.326173 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T05:24:07.326270 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T05:24:07.326362 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T05:24:07.326493 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T05:24:07.326596 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T05:24:07.326675 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T05:24:07.326731 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T05:24:07.326803 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T05:24:07.326860 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T05:24:07.326913 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T05:24:07.326964 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T05:24:07.327016 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T05:24:07.327066 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T05:24:07.327115 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T05:24:07.327181 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T05:24:07.327236 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T05:24:07.327311 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T05:24:07.327363 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T05:24:07.327411 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T05:24:07.327775 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:24:07.327953 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:24:07.328050 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:24:07.346963 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76774], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:24:07.357996 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76775], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:24:09.083951 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:24:09.084107 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:24:09.084194 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:24:09.265170 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:24:09.266161 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T05:24:09.266307 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:24:09.266401 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:24:09.266525 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:24:09.266588 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T05:24:09.266626 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T05:24:09.266665 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:24:09.266701 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T05:24:09.266736 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:24:09.266773 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:24:09.266805 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:24:09.266836 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:24:09.266873 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T05:24:09.266907 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:24:09.266937 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T05:24:09.266970 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T05:24:09.267311 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:24:09.267497 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:24:09.348472 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T05:24:09.348618 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T05:24:09.348690 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T05:24:09.376962 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:24:09.377156 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:24:09.377284 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:24:09.503992 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:24:09.504905 #684:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T05:24:09.504990 #684:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:24:09.505036 #684:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:24:09.505074 #684:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:24:09.505110 #684:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T05:24:09.505144 #684:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T05:24:09.505179 #684:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:24:09.505212 #684:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T05:24:09.505263 #684:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:24:09.505305 #684:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:24:09.505339 #684:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:24:09.505372 #684:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:24:09.505406 #684:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T05:24:09.505483 #684:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T05:24:09.505525 #684:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T05:24:09.505559 #684:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T05:24:09.505591 #684:34713c] INFO -- : --- [----] I, [2016-09-13T05:24:09.505920 #684:34713c] INFO -- : :guid: c253e5f6-7924-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:24:09.505985 #684:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T05:24:09.506109 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T05:24:09.578229 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:24:09.579490 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T05:24:09.579612 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:24:09.579689 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:24:09.579762 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:24:09.579836 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T05:24:09.579902 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T05:24:09.579971 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:24:09.580032 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T05:24:09.580092 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:24:09.580158 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:24:09.580220 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:24:09.580312 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:24:09.580381 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T05:24:09.580485 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T05:24:09.580918 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:24:09.581308 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:24:10.520199 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:24:10.520357 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:24:10.520462 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:24:10.689328 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:24:10.690188 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T05:24:10.690287 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:24:10.690337 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:24:10.690374 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:24:10.690411 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T05:24:10.690515 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T05:24:10.690559 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:24:10.690593 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T05:24:10.690629 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:24:10.690664 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:24:10.690699 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:24:10.690731 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:24:10.690764 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T05:24:10.690797 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:24:10.690845 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T05:24:10.690881 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T05:24:10.691171 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:24:10.691342 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:24:10.798134 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:24:10 UTC]... [----] I, [2016-09-13T05:24:10.815124 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:24:10 UTC]...Complete [----] I, [2016-09-13T05:24:10.826008 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:24:11.255806 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76775], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.903002476] seconds [----] I, [2016-09-13T05:24:11.255996 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76775], Delivering... [----] I, [2016-09-13T05:24:11.262077 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033028125762939453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033202171325683594, :pending_vm_jobs=>0.0007092952728271484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005761384963989258} [----] I, [2016-09-13T05:24:11.262449 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76775], State: [ok], Delivered in [0.006433717] seconds [----] I, [2016-09-13T05:24:12.058680 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T05:24:12.058818 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T05:24:12.058899 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T05:24:12.202604 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:24:12.203444 #20386:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T05:24:12.203529 #20386:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:24:12.203574 #20386:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:24:12.203611 #20386:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:24:12.203645 #20386:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T05:24:12.203679 #20386:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T05:24:12.203712 #20386:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:24:12.203745 #20386:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T05:24:12.203791 #20386:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:24:12.203827 #20386:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:24:12.203860 #20386:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:24:12.203891 #20386:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:24:12.203923 #20386:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T05:24:12.203955 #20386:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T05:24:12.203987 #20386:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T05:24:12.204018 #20386:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T05:24:12.204048 #20386:34713c] INFO -- : --- [----] I, [2016-09-13T05:24:12.204408 #20386:34713c] INFO -- : :guid: e5930efc-7974-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:24:12.204510 #20386:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T05:24:12.204639 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T05:24:12.283804 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:24:12.284046 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:24:12.284205 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:24:12.313017 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76774], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.980393672] seconds [----] I, [2016-09-13T05:24:12.313227 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76774], Delivering... [----] I, [2016-09-13T05:24:12.319631 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76774], State: [ok], Delivered in [0.006387047] seconds [----] I, [2016-09-13T05:24:12.463811 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:24:12.464734 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T05:24:12.464817 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:24:12.464860 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:24:12.464898 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:24:12.464932 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T05:24:12.464967 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T05:24:12.465005 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:24:12.465040 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T05:24:12.465080 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:24:12.465111 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:24:12.465146 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:24:12.465177 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:24:12.465211 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T05:24:12.465301 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:24:12.465369 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T05:24:12.465408 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T05:24:12.465751 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:24:12.465960 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:24:13.345480 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:24:13.345621 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:24:13.345692 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:24:13.493093 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:24:13.493932 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T05:24:13.494018 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:24:13.494063 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:24:13.494100 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:24:13.494136 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T05:24:13.494170 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T05:24:13.494206 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:24:13.494256 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T05:24:13.494300 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:24:13.494335 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:24:13.494368 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:24:13.494401 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:24:13.494479 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T05:24:13.494520 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T05:24:13.494793 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:24:13.495060 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:24:15.339198 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:24:15.339477 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:24:15.339640 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:24:15.551310 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:24:15.552299 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T05:24:15.552389 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:24:15.552479 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:24:15.552530 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:24:15.552573 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T05:24:15.552613 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T05:24:15.552650 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:24:15.552686 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T05:24:15.552723 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:24:15.552759 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:24:15.552794 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:24:15.552829 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:24:15.552867 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T05:24:15.552899 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:24:15.552938 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T05:24:15.552973 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T05:24:15.553315 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:24:15.553541 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:24:15.908147 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:24:15.908269 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:24:15.908328 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:24:16.005133 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:24:16.005695 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T05:24:16.005749 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:24:16.005777 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:24:16.005800 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:24:16.005821 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T05:24:16.005842 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T05:24:16.005863 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:24:16.005884 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T05:24:16.005904 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:24:16.005924 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:24:16.005944 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:24:16.005963 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:24:16.005983 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T05:24:16.006001 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T05:24:16.006177 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:24:16.006403 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:24:16.639492 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:24:16.639688 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:24:16.639794 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:24:16.821120 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:24:16.822056 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T05:24:16.822143 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:24:16.822191 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:24:16.822231 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:24:16.822293 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T05:24:16.822332 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T05:24:16.822369 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:24:16.822403 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T05:24:16.822482 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:24:16.822526 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:24:16.822563 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:24:16.822601 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:24:16.822638 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T05:24:16.822677 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:24:16.822711 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T05:24:16.822742 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T05:24:16.823048 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:24:16.823201 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:24:22.372517 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:24:22.404377 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76776], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:24:22.439340 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:24:22.444444 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003991842269897461, :worker_monitor=>1.588170051574707, :worker_dequeue=>0.009153366088867188, :total_time=>1.6015853881835938} [----] I, [2016-09-13T05:24:23.381985 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76776], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.003706269] seconds [----] I, [2016-09-13T05:24:23.382183 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76776], Delivering... [----] I, [2016-09-13T05:24:23.388112 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029773712158203125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030257701873779297, :pending_vm_jobs=>0.0007338523864746094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005497455596923828} [----] I, [2016-09-13T05:24:23.388480 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76776], State: [ok], Delivered in [0.006292394] seconds [----] I, [2016-09-13T05:24:37.416985 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:24:37.434048 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76777], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:24:37.444120 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76778], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:24:37.455511 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76779], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:24:37.472626 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76780], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:24:38.966321 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:24:38.971495 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003532886505126953, :worker_monitor=>1.4805476665496826, :worker_dequeue=>0.009472131729125977, :total_time=>1.493804693222046} [----] I, [2016-09-13T05:24:39.484573 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76778], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.046478961] seconds [----] I, [2016-09-13T05:24:39.484763 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76778], Delivering... [----] I, [2016-09-13T05:24:39.535966 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76778], State: [ok], Delivered in [0.051179846] seconds [----] I, [2016-09-13T05:24:39.541480 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76780], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.077540872] seconds [----] I, [2016-09-13T05:24:39.541717 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76780], Delivering... [----] I, [2016-09-13T05:24:39.549078 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038247108459472656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00384521484375, :pending_vm_jobs=>0.0009846687316894531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006955146789550781} [----] I, [2016-09-13T05:24:39.549500 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76780], State: [ok], Delivered in [0.007791774] seconds [----] I, [2016-09-13T05:24:39.575615 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76777], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.153808849] seconds [----] I, [2016-09-13T05:24:39.575745 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76777], Delivering... [----] I, [2016-09-13T05:24:39.579019 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76777], State: [ok], Delivered in [0.003265591] seconds [----] I, [2016-09-13T05:24:39.598442 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76779], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.149331916] seconds [----] I, [2016-09-13T05:24:39.598585 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76779], Delivering... [----] I, [2016-09-13T05:24:39.601082 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76779], State: [ok], Delivered in [0.002486353] seconds [----] I, [2016-09-13T05:24:43.972056 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:24:43 UTC]... [----] I, [2016-09-13T05:24:43.992755 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:24:43 UTC]...Complete [----] I, [2016-09-13T05:24:52.484024 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:24:52.501633 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76781], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:24:55.600186 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:24:55.606001 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006666898727416992, :worker_monitor=>1.4010341167449951, :worker_dequeue=>0.010348081588745117, :total_time=>1.418393850326538} [----] I, [2016-09-13T05:24:55.655914 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76781], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.166063307] seconds [----] I, [2016-09-13T05:24:55.656103 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76781], Delivering... [----] I, [2016-09-13T05:24:55.660988 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028896331787109375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029075145721435547, :pending_vm_jobs=>0.0004723072052001953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004508495330810547} [----] I, [2016-09-13T05:24:55.661211 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76781], State: [ok], Delivered in [0.005125396] seconds [----] I, [2016-09-13T05:25:07.512929 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:25:07.529054 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76782], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:25:07.545345 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76783], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:25:12.102296 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:25:12.106999 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004838466644287109, :worker_monitor=>1.4525470733642578, :worker_dequeue=>0.00853276252746582, :total_time=>1.4662775993347168} [----] I, [2016-09-13T05:25:12.741928 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76783], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.207488332] seconds [----] I, [2016-09-13T05:25:12.742114 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76783], Delivering... [----] I, [2016-09-13T05:25:12.748255 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030968189239501953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031228065490722656, :pending_vm_jobs=>0.0007154941558837891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0056264400482177734} [----] I, [2016-09-13T05:25:12.748545 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76783], State: [ok], Delivered in [0.006431552] seconds [----] I, [2016-09-13T05:25:12.776299 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76782], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.25877531] seconds [----] I, [2016-09-13T05:25:12.776546 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76782], Delivering... [----] I, [2016-09-13T05:25:12.781606 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76782], State: [ok], Delivered in [0.005072683] seconds [----] I, [2016-09-13T05:25:17.107473 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:25:17 UTC]... [----] I, [2016-09-13T05:25:17.124445 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:25:17 UTC]...Complete [----] I, [2016-09-13T05:25:22.556378 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:25:22.610901 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76784], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:25:28.641630 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:25:28.648526 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003823518753051758, :worker_monitor=>1.4776930809020996, :worker_dequeue=>0.01230478286743164, :total_time=>1.4941580295562744} [----] I, [2016-09-13T05:25:28.856184 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76784], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.292742039] seconds [----] I, [2016-09-13T05:25:28.856364 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76784], Delivering... [----] I, [2016-09-13T05:25:28.862912 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003078937530517578, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030977725982666016, :pending_vm_jobs=>0.0008192062377929688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0061380863189697266} [----] I, [2016-09-13T05:25:28.863212 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76784], State: [ok], Delivered in [0.00684184] seconds [----] I, [2016-09-13T05:25:37.624605 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:25:37.639162 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76785], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:25:37.662264 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76786], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:25:37.673393 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76787], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:25:37.690614 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76788], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:25:38.675706 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:25:38.930897 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76786], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.287719165] seconds [----] I, [2016-09-13T05:25:38.931142 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76786], Delivering... [----] I, [2016-09-13T05:25:38.936088 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76788], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.254186018] seconds [----] I, [2016-09-13T05:25:38.936197 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76788], Delivering... [----] I, [2016-09-13T05:25:38.940281 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002209901809692383, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002221822738647461, :pending_vm_jobs=>0.0004971027374267578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038361549377441406} [----] I, [2016-09-13T05:25:38.940549 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76788], State: [ok], Delivered in [0.004345987] seconds [----] I, [2016-09-13T05:25:38.987670 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76786], State: [ok], Delivered in [0.056528241] seconds [----] I, [2016-09-13T05:25:39.833575 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76785], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.204708459] seconds [----] I, [2016-09-13T05:25:39.833751 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76785], Delivering... [----] I, [2016-09-13T05:25:39.838628 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76785], State: [ok], Delivered in [0.004856042] seconds [----] I, [2016-09-13T05:25:39.862115 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76787], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.194674323] seconds [----] I, [2016-09-13T05:25:39.862303 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76787], Delivering... [----] I, [2016-09-13T05:25:39.865209 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76787], State: [ok], Delivered in [0.002897526] seconds [----] I, [2016-09-13T05:25:44.931020 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004010438919067383, :worker_monitor=>1.2356057167053223, :worker_dequeue=>0.008474111557006836, :total_time=>1.2484006881713867} [----] I, [2016-09-13T05:25:49.934035 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:25:49 UTC]... [----] I, [2016-09-13T05:25:49.948722 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:25:49 UTC]...Complete [----] I, [2016-09-13T05:25:52.701373 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:25:52.719211 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76789], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:25:55.100487 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:25:56.080116 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76789], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.372926527] seconds [----] I, [2016-09-13T05:25:56.080446 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76789], Delivering... [----] I, [2016-09-13T05:25:56.090476 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004997968673706055, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005033731460571289, :pending_vm_jobs=>0.001234292984008789, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009433269500732422} [----] I, [2016-09-13T05:25:56.090996 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76789], State: [ok], Delivered in [0.010569697] seconds [----] I, [2016-09-13T05:26:01.721521 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0047452449798583984, :worker_monitor=>1.598686695098877, :worker_dequeue=>0.010222196578979492, :total_time=>1.614022970199585} [----] I, [2016-09-13T05:26:07.730178 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:26:07.765318 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76790], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:26:07.782219 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76791], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:26:11.748741 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:26:12.205720 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76791], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.435952537] seconds [----] I, [2016-09-13T05:26:12.205916 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76791], Delivering... [----] I, [2016-09-13T05:26:12.212124 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032973289489746094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003314495086669922, :pending_vm_jobs=>0.0007312297821044922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058443546295166016} [----] I, [2016-09-13T05:26:12.212509 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76791], State: [ok], Delivered in [0.006598359] seconds [----] I, [2016-09-13T05:26:13.035764 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76790], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.301685708] seconds [----] I, [2016-09-13T05:26:13.035990 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76790], Delivering... [----] I, [2016-09-13T05:26:13.041065 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76790], State: [ok], Delivered in [0.005073528] seconds [----] I, [2016-09-13T05:26:18.244997 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006949186325073242, :worker_monitor=>1.4663612842559814, :worker_dequeue=>0.0158538818359375, :total_time=>1.489426851272583} [----] I, [2016-09-13T05:26:22.791097 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:26:22.805542 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76792], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:26:23.245724 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:26:23 UTC]... [----] I, [2016-09-13T05:26:23.262567 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:26:23 UTC]...Complete [----] I, [2016-09-13T05:26:23.273617 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:26:23.298129 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76792], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.502263801] seconds [----] I, [2016-09-13T05:26:23.298326 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76792], Delivering... [----] I, [2016-09-13T05:26:23.304827 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033278465270996094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003345012664794922, :pending_vm_jobs=>0.0008766651153564453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006081104278564453} [----] I, [2016-09-13T05:26:23.305201 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76792], State: [ok], Delivered in [0.006861936] seconds [----] I, [2016-09-13T05:26:34.825553 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005944252014160156, :worker_monitor=>1.5081448554992676, :worker_dequeue=>0.010950803756713867, :total_time=>1.5254583358764648} [----] I, [2016-09-13T05:26:37.815564 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:26:37.828529 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76793], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:26:37.840106 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76794], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:26:37.857656 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76795], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:26:37.880365 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76796], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:26:39.835108 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:26:40.086369 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76794], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.253031842] seconds [----] I, [2016-09-13T05:26:40.086596 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76794], Delivering... [----] I, [2016-09-13T05:26:40.160585 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76794], State: [ok], Delivered in [0.073938343] seconds [----] I, [2016-09-13T05:26:40.168198 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76796], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.298533689] seconds [----] I, [2016-09-13T05:26:40.168395 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76796], Delivering... [----] I, [2016-09-13T05:26:40.174745 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032587051391601562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003339529037475586, :pending_vm_jobs=>0.0007812976837158203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005925178527832031} [----] I, [2016-09-13T05:26:40.175096 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76796], State: [ok], Delivered in [0.006692588] seconds [----] I, [2016-09-13T05:26:40.194799 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76793], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.373520075] seconds [----] I, [2016-09-13T05:26:40.194957 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76793], Delivering... [----] I, [2016-09-13T05:26:40.199463 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76793], State: [ok], Delivered in [0.004471497] seconds [----] I, [2016-09-13T05:26:40.212114 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76795], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.366661828] seconds [----] I, [2016-09-13T05:26:40.212298 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76795], Delivering... [----] I, [2016-09-13T05:26:40.215632 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76795], State: [ok], Delivered in [0.003349519] seconds [----] I, [2016-09-13T05:26:51.386370 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003909111022949219, :worker_monitor=>1.5223162174224854, :worker_dequeue=>0.008732080459594727, :total_time=>1.5353033542633057} [----] I, [2016-09-13T05:26:52.894611 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:26:52.913184 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76797], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:26:56.386938 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:26:56 UTC]... [----] I, [2016-09-13T05:26:56.409209 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:26:56 UTC]...Complete [----] I, [2016-09-13T05:26:56.525557 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:26:56.581140 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76797], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.68081523] seconds [----] I, [2016-09-13T05:26:56.581386 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76797], Delivering... [----] I, [2016-09-13T05:26:56.588491 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036478042602539062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036673545837402344, :pending_vm_jobs=>0.0010616779327392578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0066335201263427734} [----] I, [2016-09-13T05:26:56.588892 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76797], State: [ok], Delivered in [0.007508905] seconds [----] I, [2016-09-13T05:27:07.927796 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:27:07.986408 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76798], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:27:08.015944 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:27:08.020658 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004011631011962891, :worker_monitor=>1.4576194286346436, :worker_dequeue=>0.008661746978759766, :total_time=>1.4705631732940674} [----] I, [2016-09-13T05:27:08.032245 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76799], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:27:10.352828 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76798], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.420654584] seconds [----] I, [2016-09-13T05:27:10.353053 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76798], Delivering... [----] I, [2016-09-13T05:27:10.358357 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76798], State: [ok], Delivered in [0.005270001] seconds [----] I, [2016-09-13T05:27:13.029971 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:27:13.357852 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76799], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.367166541] seconds [----] I, [2016-09-13T05:27:13.357977 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76799], Delivering... [----] I, [2016-09-13T05:27:13.361956 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021195411682128906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021326541900634766, :pending_vm_jobs=>0.0004918575286865234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0037093162536621094} [----] I, [2016-09-13T05:27:13.362198 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76799], State: [ok], Delivered in [0.0042115] seconds [----] I, [2016-09-13T05:27:23.042692 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:27:23.066831 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76800], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:27:23.071315 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T05:27:24.540174 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:27:24.546128 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003807544708251953, :log_active_servers=>0.014513731002807617, :worker_monitor=>1.4637031555175781, :worker_dequeue=>0.010622262954711914, :total_time=>1.4930121898651123} [----] I, [2016-09-13T05:27:24.729515 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76800], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.677953557] seconds [----] I, [2016-09-13T05:27:24.729705 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76800], Delivering... [----] I, [2016-09-13T05:27:24.736213 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032958984375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003345012664794922, :pending_vm_jobs=>0.0007140636444091797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006087779998779297} [----] I, [2016-09-13T05:27:24.736568 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76800], State: [ok], Delivered in [0.006846769] seconds [----] I, [2016-09-13T05:27:29.546695 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:27:29 UTC]... [----] I, [2016-09-13T05:27:29.569164 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:27:29 UTC]...Complete [----] I, [2016-09-13T05:27:38.083131 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:27:38.095053 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76801], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:27:38.106539 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76802], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:27:38.119073 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76803], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:27:38.135047 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76804], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:27:41.161384 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:27:41.172863 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00602269172668457, :worker_monitor=>1.547987937927246, :worker_dequeue=>0.017040729522705078, :total_time=>1.5714852809906006} [----] I, [2016-09-13T05:27:41.861183 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76802], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.762315983] seconds [----] I, [2016-09-13T05:27:41.861382 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76802], Delivering... [----] I, [2016-09-13T05:27:41.866851 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76804], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.739081088] seconds [----] I, [2016-09-13T05:27:41.867029 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76804], Delivering... [----] I, [2016-09-13T05:27:41.873762 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003514528274536133, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035347938537597656, :pending_vm_jobs=>0.0008807182312011719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006369352340698242} [----] I, [2016-09-13T05:27:41.874123 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76804], State: [ok], Delivered in [0.007089213] seconds [----] I, [2016-09-13T05:27:41.912356 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76802], State: [ok], Delivered in [0.050945224] seconds [----] I, [2016-09-13T05:27:43.523899 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76801], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.436443042] seconds [----] I, [2016-09-13T05:27:43.524100 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76801], Delivering... [----] I, [2016-09-13T05:27:43.528666 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76801], State: [ok], Delivered in [0.004533813] seconds [----] I, [2016-09-13T05:27:43.529552 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76803], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.418278551] seconds [----] I, [2016-09-13T05:27:43.529732 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76803], Delivering... [----] I, [2016-09-13T05:27:43.532727 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76803], State: [ok], Delivered in [0.002986279] seconds [----] I, [2016-09-13T05:27:53.148266 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:27:53.208082 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76805], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:27:57.901865 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:27:57.906661 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006417751312255859, :worker_monitor=>1.683030128479004, :worker_dequeue=>0.011205911636352539, :total_time=>1.701228141784668} [----] I, [2016-09-13T05:27:58.018729 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76805], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.861895145] seconds [----] I, [2016-09-13T05:27:58.018922 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76805], Delivering... [----] I, [2016-09-13T05:27:58.025200 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003326892852783203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033485889434814453, :pending_vm_jobs=>0.0007643699645996094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005928993225097656} [----] I, [2016-09-13T05:27:58.025525 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76805], State: [ok], Delivered in [0.006593577] seconds [----] I, [2016-09-13T05:28:02.907140 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:28:02 UTC]... [----] I, [2016-09-13T05:28:02.927708 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:28:02 UTC]...Complete [----] I, [2016-09-13T05:28:08.219071 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:28:08.235654 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76806], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:28:08.246792 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76807], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:28:14.671809 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:28:14.678374 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004203319549560547, :worker_monitor=>1.5768067836761475, :worker_dequeue=>0.01146554946899414, :total_time=>1.5927507877349854} [----] I, [2016-09-13T05:28:15.140006 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76807], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.898822185] seconds [----] I, [2016-09-13T05:28:15.140181 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76807], Delivering... [----] I, [2016-09-13T05:28:15.146740 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035097599029541016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035293102264404297, :pending_vm_jobs=>0.0008175373077392578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0061626434326171875} [----] I, [2016-09-13T05:28:15.147088 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76807], State: [ok], Delivered in [0.006900681] seconds [----] I, [2016-09-13T05:28:16.647254 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76806], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.423934443] seconds [----] I, [2016-09-13T05:28:16.647476 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76806], Delivering... [----] I, [2016-09-13T05:28:16.651911 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76806], State: [ok], Delivered in [0.004461816] seconds [----] I, [2016-09-13T05:28:23.257607 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:28:23.276960 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76808], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:28:23.287015 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76809], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:28:23.298563 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76810], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:28:24.703203 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:28:25.250994 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76808], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.987757873] seconds [----] I, [2016-09-13T05:28:25.251181 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76808], Delivering... [----] I, [2016-09-13T05:28:25.257321 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003267049789428711, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003302335739135742, :pending_vm_jobs=>0.0007333755493164062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005708932876586914} [----] I, [2016-09-13T05:28:25.257673 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76808], State: [ok], Delivered in [0.006492793] seconds [----] I, [2016-09-13T05:28:25.267399 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76809], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.986143657] seconds [----] I, [2016-09-13T05:28:25.267593 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76809], Delivering... [----] I, [2016-09-13T05:28:25.268565 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T05:28:25.268759 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5339832320 [----] I, [2016-09-13T05:28:25.268850 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5122416640 [----] I, [2016-09-13T05:28:25.268922 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 217415680 [----] I, [2016-09-13T05:28:25.269024 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1317011456 [----] I, [2016-09-13T05:28:25.269097 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5068476416 [----] I, [2016-09-13T05:28:25.269169 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T05:28:25.269254 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T05:28:25.269336 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 538427392 [----] I, [2016-09-13T05:28:25.269443 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T05:28:25.269533 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7953780736 [----] I, [2016-09-13T05:28:25.269610 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T05:28:25.269691 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T05:28:25.269763 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T05:28:25.269832 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T05:28:25.269895 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T05:28:25.269962 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T05:28:25.270028 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T05:28:25.270096 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T05:28:25.270260 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T05:28:25.270355 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T05:28:25.270450 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273293312 [----] I, [2016-09-13T05:28:25.270535 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56410112 [----] I, [2016-09-13T05:28:25.270604 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216883200 [----] I, [2016-09-13T05:28:25.270665 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T05:28:25.270728 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140222464 [----] I, [2016-09-13T05:28:25.270799 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2599702528 [----] I, [2016-09-13T05:28:25.270865 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2287235072 [----] I, [2016-09-13T05:28:25.270927 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T05:28:25.270989 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T05:28:25.271052 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T05:28:25.271118 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37158912 [----] I, [2016-09-13T05:28:25.271178 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T05:28:25.271258 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53043200 [----] I, [2016-09-13T05:28:25.271330 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110350336 [----] I, [2016-09-13T05:28:25.271394 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155340800 [----] I, [2016-09-13T05:28:25.271499 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T05:28:25.271580 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T05:28:25.271651 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T05:28:25.271715 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T05:28:25.271780 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T05:28:25.271843 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T05:28:25.271907 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T05:28:25.271974 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T05:28:25.272036 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T05:28:25.306489 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T05:28:25.306691 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T05:28:25.310114 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T05:28:25.312675 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T05:28:25.315750 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T05:28:25.318715 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T05:28:25.321711 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T05:28:25.324651 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 839 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T05:28:25.327566 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T05:28:25.330469 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T05:28:25.333719 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.6 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T05:28:25.336746 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T05:28:25.339685 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T05:28:25.342565 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T05:28:25.345141 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:28:25.345299 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:28:25.345406 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T05:28:25.349642 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [149117.0], CPU % [0.4], Priority [21] [----] I, [2016-09-13T05:28:25.350013 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76809], State: [ok], Delivered in [0.082406164] seconds [----] I, [2016-09-13T05:28:31.058964 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:28:31.065668 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004695892333984375, :worker_monitor=>1.3389582633972168, :worker_dequeue=>0.011725187301635742, :total_time=>1.355708122253418} [----] I, [2016-09-13T05:28:31.341757 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76810], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.050948923] seconds [----] I, [2016-09-13T05:28:31.341979 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76810], Delivering... [----] I, [2016-09-13T05:28:31.350383 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:28:23 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205293000], Memory % [3.5], CPU Time [235945.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T05:28:31.350937 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:28:28 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347152000], Memory % [5.04], CPU Time [103343.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T05:28:31.351469 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:28:25 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212543000], Memory % [3.5], CPU Time [48262.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T05:28:31.352043 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:28:28 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162420000], Memory % [3.1], CPU Time [37372.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T05:28:31.352650 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:28:30 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [148207.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:28:31.353198 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:28:28 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358685000], Memory % [5.28], CPU Time [199518.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T05:28:31.353746 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:28:30 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [149129.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:28:31.354296 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:28:29 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [50688.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:28:31.357395 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:28:27 UTC], Process Info: Memory Usage [597954560], Memory Size [1054453760], Proportional Set Size: [435176000], Memory % [7.29], CPU Time [1817.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:28:31.359584 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:28:27 UTC], Process Info: Memory Usage [588144640], Memory Size [917291008], Proportional Set Size: [425268000], Memory % [7.17], CPU Time [854.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:28:31.361894 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:28:22 UTC], Process Info: Memory Usage [579936256], Memory Size [908050432], Proportional Set Size: [419412000], Memory % [7.07], CPU Time [1414.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T05:28:31.364065 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:28:30 UTC], Process Info: Memory Usage [558211072], Memory Size [896253952], Proportional Set Size: [405890000], Memory % [6.81], CPU Time [4795.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T05:28:31.364682 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:28:28 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [206692.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T05:28:31.365199 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:28:29 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [50697.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:28:31.365725 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:28:21 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165806000], Memory % [3.16], CPU Time [38273.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T05:28:31.366078 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76810], State: [ok], Delivered in [0.024098684] seconds [----] I, [2016-09-13T05:28:36.066286 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:28:36 UTC]... [----] I, [2016-09-13T05:28:36.084177 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:28:36 UTC]...Complete [----] I, [2016-09-13T05:28:38.310086 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:28:38.335836 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76811], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:28:38.358636 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76812], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:28:38.375601 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76813], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:28:38.392784 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76814], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:28:41.114714 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:28:41.444286 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76812], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.104151011] seconds [----] I, [2016-09-13T05:28:41.444476 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76812], Delivering... [----] I, [2016-09-13T05:28:41.478649 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76814], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.093874099] seconds [----] I, [2016-09-13T05:28:41.478816 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76814], Delivering... [----] I, [2016-09-13T05:28:41.484858 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030574798583984375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030736923217773438, :pending_vm_jobs=>0.0007908344268798828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0056917667388916016} [----] I, [2016-09-13T05:28:41.485191 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76814], State: [ok], Delivered in [0.006373055] seconds [----] I, [2016-09-13T05:28:41.495637 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76812], State: [ok], Delivered in [0.051158658] seconds [----] I, [2016-09-13T05:28:43.707198 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76811], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.392265746] seconds [----] I, [2016-09-13T05:28:43.707405 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76811], Delivering... [----] I, [2016-09-13T05:28:43.713736 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76811], State: [ok], Delivered in [0.006288637] seconds [----] I, [2016-09-13T05:28:43.730160 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76813], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.366145117] seconds [----] I, [2016-09-13T05:28:43.730350 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76813], Delivering... [----] I, [2016-09-13T05:28:43.733611 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76813], State: [ok], Delivered in [0.003246967] seconds [----] I, [2016-09-13T05:28:47.608573 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0048792362213134766, :worker_monitor=>1.4694490432739258, :worker_dequeue=>0.012362480163574219, :total_time=>1.4870619773864746} [----] I, [2016-09-13T05:28:53.404950 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:28:53.463782 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76815], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:28:57.638622 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:28:58.640116 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76815], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.229337156] seconds [----] I, [2016-09-13T05:28:58.640382 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76815], Delivering... [----] I, [2016-09-13T05:28:58.647179 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035276412963867188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035545825958251953, :pending_vm_jobs=>0.0008606910705566406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006325721740722656} [----] I, [2016-09-13T05:28:58.647647 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76815], State: [ok], Delivered in [0.007255622] seconds [----] I, [2016-09-13T05:29:04.135404 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006097555160522461, :worker_monitor=>1.4718327522277832, :worker_dequeue=>0.011272907257080078, :total_time=>1.4895777702331543} [----] I, [2016-09-13T05:29:08.476745 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:29:08.524541 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76816], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:29:08.535665 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76817], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:29:09.135860 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:29:09 UTC]... [----] I, [2016-09-13T05:29:09.152845 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:29:09 UTC]...Complete [----] I, [2016-09-13T05:29:09.220305 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:29:09.748034 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76817], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.21798627] seconds [----] I, [2016-09-13T05:29:09.748258 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76817], Delivering... [----] I, [2016-09-13T05:29:09.755580 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003450155258178711, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003467559814453125, :pending_vm_jobs=>0.0007841587066650391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006842374801635742} [----] I, [2016-09-13T05:29:09.756027 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76817], State: [ok], Delivered in [0.007768145] seconds [----] I, [2016-09-13T05:29:10.845514 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76816], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.359368991] seconds [----] I, [2016-09-13T05:29:10.845895 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76816], Delivering... [----] I, [2016-09-13T05:29:10.853289 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76816], State: [ok], Delivered in [0.007421808] seconds [----] I, [2016-09-13T05:29:20.830629 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004666328430175781, :worker_monitor=>1.5698702335357666, :worker_dequeue=>0.010197162628173828, :total_time=>1.58518648147583} [----] I, [2016-09-13T05:29:23.547103 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:29:23.560122 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76818], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:29:25.840861 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:29:25.896595 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76818], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.343612044] seconds [----] I, [2016-09-13T05:29:25.896808 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76818], Delivering... [----] I, [2016-09-13T05:29:25.903882 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036497116088867188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036716461181640625, :pending_vm_jobs=>0.0009090900421142578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006651878356933594} [----] I, [2016-09-13T05:29:25.904327 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76818], State: [ok], Delivered in [0.007512606] seconds [----] I, [2016-09-13T05:29:37.341801 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004047393798828125, :worker_monitor=>1.4601635932922363, :worker_dequeue=>0.015355587005615234, :total_time=>1.4799072742462158} [----] I, [2016-09-13T05:29:38.572692 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:29:38.585064 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76819], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:29:38.596336 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76820], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:29:38.608063 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76821], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:29:38.625145 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76822], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:29:42.342365 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:29:42 UTC]... [----] I, [2016-09-13T05:29:42.361957 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:29:42 UTC]...Complete [----] I, [2016-09-13T05:29:42.373170 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:29:42.962890 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76820], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.374334817] seconds [----] I, [2016-09-13T05:29:42.963147 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76820], Delivering... [----] I, [2016-09-13T05:29:43.008524 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76822], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.392076332] seconds [----] I, [2016-09-13T05:29:43.008707 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76822], Delivering... [----] I, [2016-09-13T05:29:43.015080 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003346681594848633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033669471740722656, :pending_vm_jobs=>0.0008244514465332031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00602412223815918} [----] I, [2016-09-13T05:29:43.015504 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76822], State: [ok], Delivered in [0.006738007] seconds [----] I, [2016-09-13T05:29:43.027624 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76820], State: [ok], Delivered in [0.06447569] seconds [----] I, [2016-09-13T05:29:43.970595 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76819], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.393677277] seconds [----] I, [2016-09-13T05:29:43.970768 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76819], Delivering... [----] I, [2016-09-13T05:29:43.975506 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76819], State: [ok], Delivered in [0.00473032] seconds [----] I, [2016-09-13T05:29:43.983370 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76821], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.382258525] seconds [----] I, [2016-09-13T05:29:43.983580 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76821], Delivering... [----] I, [2016-09-13T05:29:43.991654 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76821], State: [ok], Delivered in [0.008044425] seconds [----] I, [2016-09-13T05:29:53.900408 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038819313049316406, :worker_monitor=>1.4854369163513184, :worker_dequeue=>0.012001752853393555, :total_time=>1.5016343593597412} [----] I, [2016-09-13T05:29:54.013556 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:29:54.039361 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76823], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:29:58.910080 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:29:59.096819 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76823], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.077183518] seconds [----] I, [2016-09-13T05:29:59.097018 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76823], Delivering... [----] I, [2016-09-13T05:29:59.103581 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00348663330078125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035042762756347656, :pending_vm_jobs=>0.0008029937744140625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006159782409667969} [----] I, [2016-09-13T05:29:59.104050 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76823], State: [ok], Delivered in [0.007017843] seconds [----] I, [2016-09-13T05:30:09.055278 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:30:09.079178 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76824], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:30:09.102113 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76825], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:30:09.119255 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76826], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:30:09.153633 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76827], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:30:09.164764 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76828], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:30:10.147257 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:30:10.151086 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038449764251708984, :worker_monitor=>1.207705020904541, :worker_dequeue=>0.006703376770019531, :total_time=>1.2185075283050537} [----] I, [2016-09-13T05:30:10.222557 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76828], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.063425721] seconds [----] I, [2016-09-13T05:30:10.222806 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76828], Delivering... [----] I, [2016-09-13T05:30:10.232128 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0046710968017578125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004697322845458984, :pending_vm_jobs=>0.0010273456573486328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008367061614990234} [----] I, [2016-09-13T05:30:10.232599 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76828], State: [ok], Delivered in [0.009772704] seconds [----] I, [2016-09-13T05:30:11.113807 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76824], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.050762774] seconds [----] I, [2016-09-13T05:30:11.113957 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76824], Delivering... [----] I, [2016-09-13T05:30:11.115701 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76824], State: [ok], Delivered in [0.001739992] seconds [----] I, [2016-09-13T05:30:11.141912 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76825], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.054780841] seconds [----] I, [2016-09-13T05:30:11.142024 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76825], Delivering... [----] I, [2016-09-13T05:30:11.148658 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76825], State: [ok], Delivered in [0.006612535] seconds [----] I, [2016-09-13T05:30:11.159143 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76826], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.051698151] seconds [----] I, [2016-09-13T05:30:11.159313 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76826], Delivering... [----] I, [2016-09-13T05:30:11.164624 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76826], State: [ok], Delivered in [0.005288468] seconds [----] I, [2016-09-13T05:30:11.164994 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76827], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.041713293] seconds [----] I, [2016-09-13T05:30:11.165117 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76827], Delivering... [----] I, [2016-09-13T05:30:11.167640 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76827], State: [ok], Delivered in [0.002513913] seconds [----] I, [2016-09-13T05:30:15.151648 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:30:15 UTC]... [----] I, [2016-09-13T05:30:15.176712 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:30:15 UTC]...Complete [----] I, [2016-09-13T05:30:24.175622 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:30:24.233720 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76829], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:30:26.480073 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:30:26.483544 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003931522369384766, :worker_monitor=>1.166696310043335, :worker_dequeue=>0.00777888298034668, :total_time=>1.1786489486694336} [----] I, [2016-09-13T05:30:27.319601 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76829], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.139138296] seconds [----] I, [2016-09-13T05:30:27.319787 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76829], Delivering... [----] I, [2016-09-13T05:30:27.326022 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003093719482421875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032155513763427734, :pending_vm_jobs=>0.00077056884765625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005872488021850586} [----] I, [2016-09-13T05:30:27.326376 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76829], State: [ok], Delivered in [0.006581619] seconds [----] I, [2016-09-13T05:30:39.244266 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:30:39.256669 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76830], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:30:39.267813 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76831], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:30:39.279271 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76832], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:30:39.296503 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76833], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:30:42.916188 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:30:42.923208 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004297018051147461, :worker_monitor=>1.391021490097046, :worker_dequeue=>0.01271510124206543, :total_time=>1.4083824157714844} [----] I, [2016-09-13T05:30:43.450739 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76831], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.190319094] seconds [----] I, [2016-09-13T05:30:43.450876 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76831], Delivering... [----] I, [2016-09-13T05:30:43.454570 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76833], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.166623625] seconds [----] I, [2016-09-13T05:30:43.454739 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76833], Delivering... [----] I, [2016-09-13T05:30:43.460948 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00325775146484375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003277301788330078, :pending_vm_jobs=>0.0007827281951904297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005859375} [----] I, [2016-09-13T05:30:43.461310 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76833], State: [ok], Delivered in [0.006560487] seconds [----] I, [2016-09-13T05:30:43.500657 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76831], State: [ok], Delivered in [0.049735161] seconds [----] I, [2016-09-13T05:30:44.289392 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76830], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.04069224] seconds [----] I, [2016-09-13T05:30:44.289583 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76830], Delivering... [----] I, [2016-09-13T05:30:44.293724 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76830], State: [ok], Delivered in [0.004149934] seconds [----] I, [2016-09-13T05:30:44.306187 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76832], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.033505108] seconds [----] I, [2016-09-13T05:30:44.306400 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76832], Delivering... [----] I, [2016-09-13T05:30:44.309521 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76832], State: [ok], Delivered in [0.003128417] seconds [----] I, [2016-09-13T05:30:47.923735 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:30:47 UTC]... [----] I, [2016-09-13T05:30:47.940263 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:30:47 UTC]...Complete [----] I, [2016-09-13T05:30:54.308140 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:30:54.351806 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76834], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:30:59.247744 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:30:59.252725 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0070416927337646484, :worker_monitor=>1.2650518417358398, :worker_dequeue=>0.009020566940307617, :total_time=>1.2814040184020996} [----] I, [2016-09-13T05:30:59.394406 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76834], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.080294333] seconds [----] I, [2016-09-13T05:30:59.394633 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76834], Delivering... [----] I, [2016-09-13T05:30:59.401742 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035953521728515625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036170482635498047, :pending_vm_jobs=>0.0009760856628417969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00672459602355957} [----] I, [2016-09-13T05:30:59.402195 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76834], State: [ok], Delivered in [0.007557151] seconds [----] I, [2016-09-13T05:31:09.365237 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:31:09.382798 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76835], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:31:09.405910 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76836], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:31:15.428275 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:31:15.432293 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003963470458984375, :worker_monitor=>1.133218765258789, :worker_dequeue=>0.007307291030883789, :total_time=>1.1447439193725586} [----] I, [2016-09-13T05:31:15.697490 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76836], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.307996352] seconds [----] I, [2016-09-13T05:31:15.697729 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76836], Delivering... [----] I, [2016-09-13T05:31:15.704073 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033872127532958984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034291744232177734, :pending_vm_jobs=>0.0007421970367431641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005959749221801758} [----] I, [2016-09-13T05:31:15.704479 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76836], State: [ok], Delivered in [0.006746109] seconds [----] I, [2016-09-13T05:31:17.468861 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76835], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.098162837] seconds [----] I, [2016-09-13T05:31:17.469081 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76835], Delivering... [----] I, [2016-09-13T05:31:17.475584 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76835], State: [ok], Delivered in [0.006488024] seconds [----] I, [2016-09-13T05:31:20.432981 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:31:20 UTC]... [----] I, [2016-09-13T05:31:20.451364 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:31:20 UTC]...Complete [----] I, [2016-09-13T05:31:24.421835 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:31:24.445624 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76837], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:31:25.672253 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:31:25.806532 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76837], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.374885401] seconds [----] I, [2016-09-13T05:31:25.806838 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76837], Delivering... [----] I, [2016-09-13T05:31:25.816480 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00433349609375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004405021667480469, :pending_vm_jobs=>0.0008718967437744141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007027387619018555} [----] I, [2016-09-13T05:31:25.816854 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76837], State: [ok], Delivered in [0.010037004] seconds [----] I, [2016-09-13T05:31:32.078015 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004009723663330078, :worker_monitor=>1.387702226638794, :worker_dequeue=>0.006743192672729492, :total_time=>1.3989059925079346} [----] I, [2016-09-13T05:31:39.457211 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:31:39.474389 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76838], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:31:39.504606 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76839], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:31:39.525915 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76840], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:31:39.542796 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76841], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:31:42.111121 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:31:42.903455 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76839], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.424806821] seconds [----] I, [2016-09-13T05:31:42.903645 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76839], Delivering... [----] I, [2016-09-13T05:31:42.960545 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76841], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.426307015] seconds [----] I, [2016-09-13T05:31:42.960733 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76841], Delivering... [----] I, [2016-09-13T05:31:42.967185 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035736560821533203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00360870361328125, :pending_vm_jobs=>0.0007503032684326172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006142139434814453} [----] I, [2016-09-13T05:31:42.967559 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76841], State: [ok], Delivered in [0.006806669] seconds [----] I, [2016-09-13T05:31:42.977869 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76839], State: [ok], Delivered in [0.07419827] seconds [----] I, [2016-09-13T05:31:44.549256 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76838], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.088551642] seconds [----] I, [2016-09-13T05:31:44.549591 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76838], Delivering... [----] I, [2016-09-13T05:31:44.556860 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76838], State: [ok], Delivered in [0.007261485] seconds [----] I, [2016-09-13T05:31:44.577942 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76840], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.06832255] seconds [----] I, [2016-09-13T05:31:44.578210 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76840], Delivering... [----] I, [2016-09-13T05:31:44.583479 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76840], State: [ok], Delivered in [0.005206764] seconds [----] I, [2016-09-13T05:31:48.218496 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002866506576538086, :worker_monitor=>1.0762083530426025, :worker_dequeue=>0.020555734634399414, :total_time=>1.100113868713379} [----] I, [2016-09-13T05:31:53.219111 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:31:53 UTC]... [----] I, [2016-09-13T05:31:53.238070 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:31:53 UTC]...Complete [----] I, [2016-09-13T05:31:54.552555 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:31:54.575553 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76842], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:31:58.256895 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:31:59.118467 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76842], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.560937384] seconds [----] I, [2016-09-13T05:31:59.118651 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76842], Delivering... [----] I, [2016-09-13T05:31:59.124373 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003025054931640625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00304412841796875, :pending_vm_jobs=>0.0007519721984863281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005382061004638672} [----] I, [2016-09-13T05:31:59.124691 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76842], State: [ok], Delivered in [0.006040297] seconds [----] I, [2016-09-13T05:32:04.904774 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00408935546875, :worker_monitor=>1.6234042644500732, :worker_dequeue=>0.01509404182434082, :total_time=>1.642899990081787} [----] I, [2016-09-13T05:32:09.585111 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:32:09.600236 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76843], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:32:09.629501 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76844], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:32:09.914167 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:32:10.230200 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76844], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.625265017] seconds [----] I, [2016-09-13T05:32:10.230572 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76844], Delivering... [----] I, [2016-09-13T05:32:10.241370 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005743265151977539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005771160125732422, :pending_vm_jobs=>0.001352071762084961, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010172843933105469} [----] I, [2016-09-13T05:32:10.241881 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76844], State: [ok], Delivered in [0.01132167] seconds [----] I, [2016-09-13T05:32:11.692109 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76843], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.103379638] seconds [----] I, [2016-09-13T05:32:11.692278 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76843], Delivering... [----] I, [2016-09-13T05:32:11.697168 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76843], State: [ok], Delivered in [0.004857532] seconds [----] I, [2016-09-13T05:32:21.494698 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005793094635009766, :worker_monitor=>1.5384981632232666, :worker_dequeue=>0.013887882232666016, :total_time=>1.558704137802124} [----] I, [2016-09-13T05:32:24.639316 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:32:24.652877 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76845], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:32:26.495207 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:32:26 UTC]... [----] I, [2016-09-13T05:32:26.514547 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:32:26 UTC]...Complete [----] I, [2016-09-13T05:32:26.593879 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T05:32:26.596628 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:32:26.755507 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76845], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.110813355] seconds [----] I, [2016-09-13T05:32:26.755832 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76845], Delivering... [----] I, [2016-09-13T05:32:26.762758 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035881996154785156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036110877990722656, :pending_vm_jobs=>0.0008294582366943359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006307363510131836} [----] I, [2016-09-13T05:32:26.763099 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76845], State: [ok], Delivered in [0.007300547] seconds [----] I, [2016-09-13T05:32:37.984901 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030808448791503906, :worker_monitor=>1.3129284381866455, :worker_dequeue=>0.05082511901855469, :total_time=>1.367056131362915} [----] I, [2016-09-13T05:32:39.665735 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:32:39.686303 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76846], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:32:39.697558 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76847], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:32:39.715199 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76848], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:32:39.743527 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76849], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:32:42.998397 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:32:43.395026 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76847], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.704499907] seconds [----] I, [2016-09-13T05:32:43.395175 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76847], Delivering... [----] I, [2016-09-13T05:32:43.440650 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76847], State: [ok], Delivered in [0.04542546] seconds [----] I, [2016-09-13T05:32:43.486857 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76849], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.756247945] seconds [----] I, [2016-09-13T05:32:43.487074 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76849], Delivering... [----] I, [2016-09-13T05:32:43.493659 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033888816833496094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003419160842895508, :pending_vm_jobs=>0.0008070468902587891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006215333938598633} [----] I, [2016-09-13T05:32:43.493995 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76849], State: [ok], Delivered in [0.006912154] seconds [----] I, [2016-09-13T05:32:44.806393 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76846], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.133544354] seconds [----] I, [2016-09-13T05:32:44.806578 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76846], Delivering... [----] I, [2016-09-13T05:32:44.811262 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76846], State: [ok], Delivered in [0.004651927] seconds [----] I, [2016-09-13T05:32:44.858345 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76848], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.154650999] seconds [----] I, [2016-09-13T05:32:44.858613 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76848], Delivering... [----] I, [2016-09-13T05:32:44.862757 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76848], State: [ok], Delivered in [0.004129448] seconds [----] I, [2016-09-13T05:32:54.756508 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:32:54.762210 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037810802459716797, :worker_monitor=>1.7186169624328613, :worker_dequeue=>0.01512289047241211, :total_time=>1.7378227710723877} [----] I, [2016-09-13T05:32:54.806874 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76850], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:32:59.762804 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:32:59 UTC]... [----] I, [2016-09-13T05:32:59.783773 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:32:59 UTC]...Complete [----] I, [2016-09-13T05:32:59.797748 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:32:59.938625 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76850], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.174603169] seconds [----] I, [2016-09-13T05:32:59.938833 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76850], Delivering... [----] I, [2016-09-13T05:32:59.945622 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036520957946777344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003671407699584961, :pending_vm_jobs=>0.0008299350738525391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063974857330322266} [----] I, [2016-09-13T05:32:59.946022 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76850], State: [ok], Delivered in [0.007189872] seconds [----] I, [2016-09-13T05:33:09.818837 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:33:09.841150 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76851], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:33:09.864089 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76852], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:33:11.426599 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:33:11.432744 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003897428512573242, :worker_monitor=>1.5973880290985107, :worker_dequeue=>0.010621786117553711, :total_time=>1.6121711730957031} [----] I, [2016-09-13T05:33:11.705482 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76852], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.858712251] seconds [----] I, [2016-09-13T05:33:11.705634 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76852], Delivering... [----] I, [2016-09-13T05:33:11.710309 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024857521057128906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025081634521484375, :pending_vm_jobs=>0.0005788803100585938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0043370723724365234} [----] I, [2016-09-13T05:33:11.710642 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76852], State: [ok], Delivered in [0.004997469] seconds [----] I, [2016-09-13T05:33:11.967258 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76851], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.143863507] seconds [----] I, [2016-09-13T05:33:11.967474 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76851], Delivering... [----] I, [2016-09-13T05:33:11.971707 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76851], State: [ok], Delivered in [0.004252343] seconds [----] I, [2016-09-13T05:33:24.877244 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:33:24.893900 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76853], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:33:24.915947 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76854], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:33:24.938605 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76855], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:33:28.161389 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:33:28.166306 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004271745681762695, :worker_monitor=>1.6890158653259277, :worker_dequeue=>0.008852958679199219, :total_time=>1.702439308166504} [----] I, [2016-09-13T05:33:28.822785 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76853], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.939131964] seconds [----] I, [2016-09-13T05:33:28.822925 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76853], Delivering... [----] I, [2016-09-13T05:33:28.827738 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002238750457763672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002254009246826172, :pending_vm_jobs=>0.0005285739898681641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00449681282043457} [----] I, [2016-09-13T05:33:28.828060 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76853], State: [ok], Delivered in [0.005117729] seconds [----] I, [2016-09-13T05:33:28.863587 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76854], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.965360859] seconds [----] I, [2016-09-13T05:33:28.863723 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76854], Delivering... [----] I, [2016-09-13T05:33:28.864493 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T05:33:28.864614 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5330022400 [----] I, [2016-09-13T05:33:28.864683 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5112410112 [----] I, [2016-09-13T05:33:28.864763 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 217612288 [----] I, [2016-09-13T05:33:28.864841 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1317011456 [----] I, [2016-09-13T05:33:28.864890 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5058449408 [----] I, [2016-09-13T05:33:28.864946 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T05:33:28.864991 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T05:33:28.865034 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 538652672 [----] I, [2016-09-13T05:33:28.865075 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T05:33:28.865115 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7849746432 [----] I, [2016-09-13T05:33:28.865157 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T05:33:28.865198 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T05:33:28.865255 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T05:33:28.865300 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T05:33:28.865339 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T05:33:28.865382 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T05:33:28.865443 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T05:33:28.865500 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T05:33:28.865545 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T05:33:28.865593 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T05:33:28.865635 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273301504 [----] I, [2016-09-13T05:33:28.865674 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56422400 [----] I, [2016-09-13T05:33:28.865715 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216879104 [----] I, [2016-09-13T05:33:28.865756 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T05:33:28.865796 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140877824 [----] I, [2016-09-13T05:33:28.865836 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2610528256 [----] I, [2016-09-13T05:33:28.865876 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2297868288 [----] I, [2016-09-13T05:33:28.865918 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T05:33:28.865957 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T05:33:28.865997 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T05:33:28.866043 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37236736 [----] I, [2016-09-13T05:33:28.866085 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T05:33:28.866139 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53084160 [----] I, [2016-09-13T05:33:28.866185 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110383104 [----] I, [2016-09-13T05:33:28.866238 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155381760 [----] I, [2016-09-13T05:33:28.866292 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T05:33:28.866338 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T05:33:28.866377 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T05:33:28.866433 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T05:33:28.866487 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T05:33:28.866531 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T05:33:28.866573 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T05:33:28.866619 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T05:33:28.866658 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T05:33:28.880287 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76855], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.957679187] seconds [----] I, [2016-09-13T05:33:28.880515 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76855], Delivering... [----] I, [2016-09-13T05:33:28.888756 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:33:16 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347149000], Memory % [5.04], CPU Time [103358.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T05:33:28.889380 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:33:27 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [148264.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:33:28.889926 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:33:27 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [50703.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:33:28.890372 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:33:26 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48271.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T05:33:28.890916 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:33:26 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162420000], Memory % [3.1], CPU Time [37381.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T05:33:28.891432 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:33:24 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205293000], Memory % [3.5], CPU Time [236105.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T05:33:28.891961 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:33:27 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [199553.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T05:33:28.892465 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:33:27 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [149190.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:33:28.895351 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:33:17 UTC], Process Info: Memory Usage [588144640], Memory Size [917291008], Proportional Set Size: [425268000], Memory % [7.17], CPU Time [864.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:33:28.897515 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:33:17 UTC], Process Info: Memory Usage [587374592], Memory Size [917688320], Proportional Set Size: [424841000], Memory % [7.16], CPU Time [1863.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:33:28.899586 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:33:22 UTC], Process Info: Memory Usage [580157440], Memory Size [922206208], Proportional Set Size: [419625000], Memory % [7.07], CPU Time [1425.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T05:33:28.901560 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:33:20 UTC], Process Info: Memory Usage [558481408], Memory Size [911458304], Proportional Set Size: [406122000], Memory % [6.81], CPU Time [4807.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T05:33:28.902093 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:33:27 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [206725.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T05:33:28.902620 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:33:27 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [50712.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:33:28.903059 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:33:22 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165805000], Memory % [3.16], CPU Time [38283.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T05:33:28.903389 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76855], State: [ok], Delivered in [0.022897034] seconds [----] I, [2016-09-13T05:33:28.917286 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T05:33:28.917504 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T05:33:28.921388 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T05:33:28.923890 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T05:33:28.926642 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T05:33:28.929403 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T05:33:28.932030 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T05:33:28.934703 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 839 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T05:33:28.937310 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T05:33:28.941628 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T05:33:28.946253 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T05:33:28.950949 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T05:33:28.955447 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T05:33:28.960576 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T05:33:28.964281 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:33:28.964628 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:33:28.964797 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T05:33:28.971061 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [149180.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:33:28.971546 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76854], State: [ok], Delivered in [0.107771458] seconds [----] I, [2016-09-13T05:33:33.166891 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:33:33 UTC]... [----] I, [2016-09-13T05:33:33.189864 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:33:33 UTC]...Complete [----] I, [2016-09-13T05:33:39.950990 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:33:39.967103 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76856], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:33:40.001792 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76857], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:33:40.018508 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76858], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:33:40.041580 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76859], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:33:44.580136 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:33:44.586257 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005289554595947266, :worker_monitor=>1.2310540676116943, :worker_dequeue=>0.010974407196044922, :total_time=>1.2478508949279785} [----] I, [2016-09-13T05:33:45.054567 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76857], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.083344254] seconds [----] I, [2016-09-13T05:33:45.054757 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76857], Delivering... [----] I, [2016-09-13T05:33:45.081965 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76859], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.05466295] seconds [----] I, [2016-09-13T05:33:45.082231 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76859], Delivering... [----] I, [2016-09-13T05:33:45.087537 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76856], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.131852418] seconds [----] I, [2016-09-13T05:33:45.087758 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76856], Delivering... [----] I, [2016-09-13T05:33:45.089967 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0046710968017578125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004691123962402344, :pending_vm_jobs=>0.0007703304290771484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007248401641845703} [----] I, [2016-09-13T05:33:45.090287 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76859], State: [ok], Delivered in [0.00809286] seconds [----] I, [2016-09-13T05:33:45.094049 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76856], State: [ok], Delivered in [0.006277006] seconds [----] I, [2016-09-13T05:33:45.128094 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76857], State: [ok], Delivered in [0.073272072] seconds [----] I, [2016-09-13T05:33:45.145080 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76858], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.137727453] seconds [----] I, [2016-09-13T05:33:45.145286 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76858], Delivering... [----] I, [2016-09-13T05:33:45.148284 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76858], State: [ok], Delivered in [0.002986132] seconds [----] I, [2016-09-13T05:33:55.053507 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:33:55.070168 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76860], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:34:01.173396 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:34:01.177108 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005228996276855469, :worker_monitor=>1.5546209812164307, :worker_dequeue=>0.006610870361328125, :total_time=>1.5668120384216309} [----] I, [2016-09-13T05:34:01.243207 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76860], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.183244293] seconds [----] I, [2016-09-13T05:34:01.243458 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76860], Delivering... [----] I, [2016-09-13T05:34:01.249958 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003489255905151367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035114288330078125, :pending_vm_jobs=>0.0007734298706054688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006089210510253906} [----] I, [2016-09-13T05:34:01.250349 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76860], State: [ok], Delivered in [0.006900595] seconds [----] I, [2016-09-13T05:34:06.177663 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:34:06 UTC]... [----] I, [2016-09-13T05:34:06.201658 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:34:06 UTC]...Complete [----] I, [2016-09-13T05:34:10.084357 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 11. [----] I, [2016-09-13T05:34:10.110638 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76861], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:34:10.127491 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76862], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:34:10.150233 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76863], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:34:11.237231 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:34:11.351016 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76862], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.230690862] seconds [----] I, [2016-09-13T05:34:11.351252 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76862], Delivering... [----] I, [2016-09-13T05:34:11.358759 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004395008087158203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004415273666381836, :pending_vm_jobs=>0.0008330345153808594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007115840911865234} [----] I, [2016-09-13T05:34:11.359155 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76862], State: [ok], Delivered in [0.007913463] seconds [----] I, [2016-09-13T05:34:12.265817 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76861], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.168903021] seconds [----] I, [2016-09-13T05:34:12.266074 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76861], Delivering... [----] I, [2016-09-13T05:34:12.271326 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76863], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.126854354] seconds [----] I, [2016-09-13T05:34:12.271612 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76863], Delivering... [----] I, [2016-09-13T05:34:12.272842 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76861], State: [ok], Delivered in [0.006714459] seconds [----] I, [2016-09-13T05:34:12.299904 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76864], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T05:34:12.316800 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76865], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T05:34:12.317274 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76863], State: [ok], Delivered in [0.045639573] seconds [----] I, [2016-09-13T05:34:17.452132 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T05:34:17.454498 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T05:34:17.454683 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040166378021240234, :worker_monitor=>1.1908867359161377, :worker_dequeue=>0.011969804763793945, :total_time=>1.2071502208709717} [----] I, [2016-09-13T05:34:17.880971 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [76865], MiqWorker id: [96], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [5.573847584] seconds [----] I, [2016-09-13T05:34:17.881204 #28071:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76865], Delivering... [----] I, [2016-09-13T05:34:17.884990 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T05:34:17.885176 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T05:34:17.885327 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T05:34:17.885523 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T05:34:17.885702 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:18.012699 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [76864], MiqWorker id: [97], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [5.721005254] seconds [----] I, [2016-09-13T05:34:18.012947 #30088:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76864], Delivering... [----] I, [2016-09-13T05:34:18.016975 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T05:34:18.017168 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T05:34:18.017323 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T05:34:18.017518 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T05:34:18.017684 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:18.300556 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:18.354040 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:18.499323 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:18.499546 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:18.668824 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:18.669009 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:18.834943 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:18.931292 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:19.022608 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:19.158783 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:19.318366 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:19.422743 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:19.456821 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:19.457009 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:19.515495 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:19.607730 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:19.699572 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:19.792135 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:19.884294 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:19.950391 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:19.977383 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:20.068943 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:20.171453 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:20.264441 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:20.266537 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:20.266693 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:20.356522 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:20.449376 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:20.543003 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:20.635240 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:20.726948 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:20.777520 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:20.818820 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:34:21.016238 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T05:34:21.016381 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.0040798187255859375, :collect_inventory_for_targets=>0.00011897087097167969, :parse_legacy_inventory=>21.005531787872314, :parse_targeted_inventory=>21.005680561065674, :save_inventory=>1.0548665523529053, :ems_refresh=>22.063520193099976} [----] I, [2016-09-13T05:34:21.040432 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T05:34:21.040834 #30088:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76864], State: [ok], Delivered in [3.027915496] seconds [----] I, [2016-09-13T05:34:21.091577 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:21.091701 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:21.622715 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:21.940246 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:21.940470 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:22.551575 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:22.893781 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:22.894006 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:24.405328 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:24.703348 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:24.703540 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:25.165279 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:34:25.204458 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:25.217547 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76866], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:34:25.521382 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:25.521612 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:25.995595 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:26.305809 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:26.305975 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:26.813283 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:27.479969 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:34:28.469371 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76866], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.298222458] seconds [----] I, [2016-09-13T05:34:28.469623 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76866], Delivering... [----] I, [2016-09-13T05:34:28.475867 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003381490707397461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034003257751464844, :pending_vm_jobs=>0.00074005126953125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005887031555175781} [----] I, [2016-09-13T05:34:28.476199 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76866], State: [ok], Delivered in [0.006593032] seconds [----] I, [2016-09-13T05:34:33.172598 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:33.172776 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:33.673946 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:33.951587 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003544330596923828, :worker_monitor=>1.4496607780456543, :worker_dequeue=>0.011384725570678711, :total_time=>1.464815378189087} [----] I, [2016-09-13T05:34:33.975001 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:33.975182 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:34.458033 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:34.809747 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:34.809948 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:35.282301 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:35.590091 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:35.590371 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:36.125115 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:36.274129 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:36.416695 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:36.560239 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:36.706455 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:36.853617 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:36.998034 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:37.138776 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:37.280149 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:37.421950 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:37.568463 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:37.718847 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:37.856269 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:37.991472 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:38.136395 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:38.524077 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:38.671561 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:38.810746 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:38.952015 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:34:38 UTC]... [----] I, [2016-09-13T05:34:38.964082 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:38.971911 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:34:38 UTC]...Complete [----] I, [2016-09-13T05:34:39.106072 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:39.248166 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:39.401763 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:39.544845 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:39.694391 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:39.841701 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:39.992095 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:40.147233 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:40.229330 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:34:40.246485 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76867], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:34:40.257824 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76868], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:34:40.274875 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76869], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:34:40.288232 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:40.292035 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76870], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:34:40.703050 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:40.849802 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:40.991722 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:41.144045 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:41.578364 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:41.739578 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:41.879550 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:42.033363 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:42.181165 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:42.332641 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:42.473342 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:42.617273 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:42.762330 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:42.916098 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:43.056669 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:43.199088 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:43.339341 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:43.484076 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:43.628343 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:44.053250 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:34:44.572449 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76868], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.321756657] seconds [----] I, [2016-09-13T05:34:44.572719 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76868], Delivering... [----] I, [2016-09-13T05:34:44.600646 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76870], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.316161636] seconds [----] I, [2016-09-13T05:34:44.600833 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76870], Delivering... [----] I, [2016-09-13T05:34:44.607000 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031960010528564453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003215312957763672, :pending_vm_jobs=>0.0008182525634765625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00583195686340332} [----] I, [2016-09-13T05:34:44.607377 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76870], State: [ok], Delivered in [0.006541322] seconds [----] I, [2016-09-13T05:34:44.623457 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76868], State: [ok], Delivered in [0.050719984] seconds [----] I, [2016-09-13T05:34:45.395856 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76867], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.16149755] seconds [----] I, [2016-09-13T05:34:45.396034 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76867], Delivering... [----] I, [2016-09-13T05:34:45.400780 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76867], State: [ok], Delivered in [0.004714959] seconds [----] I, [2016-09-13T05:34:45.406743 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76869], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.142674852] seconds [----] I, [2016-09-13T05:34:45.406910 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76869], Delivering... [----] I, [2016-09-13T05:34:45.414248 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76869], State: [ok], Delivered in [0.007294357] seconds [----] I, [2016-09-13T05:34:49.789646 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:49.933333 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:50.355302 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003916501998901367, :worker_monitor=>1.2793018817901611, :worker_dequeue=>0.011343717575073242, :total_time=>1.2950019836425781} [----] I, [2016-09-13T05:34:50.378075 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:50.550229 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:50.690169 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:50.831606 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:50.982698 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:51.162738 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:51.313651 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:51.459280 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:51.599898 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:51.740237 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:51.884108 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:52.025008 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:52.173807 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:52.321374 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:52.463794 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:52.636884 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:52.771774 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:53.300871 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:53.456967 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:53.606597 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:53.760445 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:53.916392 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:54.060763 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:54.201455 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:54.376665 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:54.522976 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:54.686812 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:54.848487 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:55.013669 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:55.165064 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:55.304614 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:34:55.326477 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76871], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:34:55.364437 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:34:55.404449 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:55.549486 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:55.689939 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:55.709800 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76871], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.399322572] seconds [----] I, [2016-09-13T05:34:55.710004 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76871], Delivering... [----] I, [2016-09-13T05:34:55.716809 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036706924438476562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036933422088623047, :pending_vm_jobs=>0.0008189678192138672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063686370849609375} [----] I, [2016-09-13T05:34:55.717249 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76871], State: [ok], Delivered in [0.007201066] seconds [----] I, [2016-09-13T05:34:55.845760 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:56.378279 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:56.546004 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:56.690894 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:56.828574 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:56.985100 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:57.130713 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:57.303387 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:57.448839 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:57.592249 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:57.742020 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:57.882715 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:58.027590 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:58.177872 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:58.405097 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:58.551747 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:58.698762 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:58.855792 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:59.437441 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:59.629949 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:59.786366 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:34:59.932829 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:00.083913 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:00.226758 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:00.367993 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:00.533320 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:00.679235 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:06.664520 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004193305969238281, :worker_monitor=>1.263932704925537, :worker_dequeue=>0.007993459701538086, :total_time=>1.2764325141906738} [----] I, [2016-09-13T05:35:06.851772 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:06.999780 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:07.143109 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:07.291261 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:07.436178 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:07.571800 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:07.722623 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:07.868276 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:08.256784 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:08.420795 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:08.567802 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:08.712477 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:08.854377 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:09.002585 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:09.146467 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:09.287795 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:09.443378 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:09.593607 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:09.737742 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:09.883025 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:10.033534 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:10.182448 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:10.323453 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:10.338046 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:35:10.355246 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76872], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:35:10.372451 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76873], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:35:10.462913 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:10.606087 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:11.001273 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:11.160502 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:11.307017 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:11.459255 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:11.604170 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:11.664989 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:35:11 UTC]... [----] I, [2016-09-13T05:35:11.686554 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:35:11 UTC]...Complete [----] I, [2016-09-13T05:35:11.697061 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:35:11.757225 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:11.812625 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76873], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.451938776] seconds [----] I, [2016-09-13T05:35:11.812821 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76873], Delivering... [----] I, [2016-09-13T05:35:11.819283 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034132003784179688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003435373306274414, :pending_vm_jobs=>0.0007698535919189453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006031990051269531} [----] I, [2016-09-13T05:35:11.819724 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76873], State: [ok], Delivered in [0.0068223] seconds [----] I, [2016-09-13T05:35:11.892628 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:12.043318 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:12.193230 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:12.346131 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:12.493901 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:12.522699 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76872], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.180155375] seconds [----] I, [2016-09-13T05:35:12.522932 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76872], Delivering... [----] I, [2016-09-13T05:35:12.528318 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76872], State: [ok], Delivered in [0.005402274] seconds [----] I, [2016-09-13T05:35:12.651136 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:12.795040 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:12.941163 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:13.079506 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:13.222729 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:13.367448 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:13.883788 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:14.036553 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:14.177656 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:14.337519 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:14.481263 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:14.624502 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:14.772368 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:14.915910 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:15.065185 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:15.212655 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:15.356085 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:15.504911 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:15.648498 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:15.784247 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:15.927640 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:16.074962 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:16.221676 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:16.519798 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:16.682003 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:16.825179 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:16.967671 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:17.145963 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:17.291445 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:17.430879 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:17.588482 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:17.736649 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:23.363025 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004641056060791016, :worker_monitor=>1.6250989437103271, :worker_dequeue=>0.00878453254699707, :total_time=>1.6388795375823975} [----] I, [2016-09-13T05:35:23.805660 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:23.950918 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:24.099642 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:24.245084 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:24.386076 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:24.535048 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:24.684753 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:24.832442 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:25.232707 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:25.384785 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:35:25.401166 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76874], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:35:25.404340 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:25.552853 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:25.702020 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:25.842368 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:25.999140 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:26.137747 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:26.280510 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:26.424970 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:26.568143 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:26.706198 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:26.863080 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:27.007182 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:27.154849 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:27.300005 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:27.447111 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:27.603322 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:28.096964 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:28.256773 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:28.372753 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:35:28.395182 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:28.552065 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:28.707918 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:28.852320 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:28.938504 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76874], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.547540187] seconds [----] I, [2016-09-13T05:35:28.938666 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76874], Delivering... [----] I, [2016-09-13T05:35:28.944486 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003015279769897461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003033161163330078, :pending_vm_jobs=>0.0007474422454833984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005460262298583984} [----] I, [2016-09-13T05:35:28.944786 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76874], State: [ok], Delivered in [0.006106493] seconds [----] I, [2016-09-13T05:35:29.000929 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:29.141604 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:29.293483 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:29.434028 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:29.580327 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:29.726539 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:29.885080 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:30.041972 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:30.185539 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:30.333767 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:30.478130 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:30.886749 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:31.042299 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:31.195876 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:31.336101 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:31.479391 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:31.626919 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:31.768726 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:31.917690 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:32.062934 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:32.209816 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:32.351545 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:32.500831 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:32.643727 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:32.782832 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:32.920504 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:33.062514 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:35:33.211641 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T05:35:33.425749 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T05:35:33.426124 #28071:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T05:35:33.426527 #28071:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T05:35:33.426665 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T05:35:33.426795 #28071:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T05:35:33.458939 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T05:35:33.459472 #28071:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [76865], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T05:35:33.459757 #28071:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T05:35:33.460018 #28071:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T05:35:33.460250 #28071:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76865], State: [error], Delivered in [75.579033587] seconds [----] I, [2016-09-13T05:35:39.653704 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004186391830444336, :worker_monitor=>1.244157075881958, :worker_dequeue=>0.008328676223754883, :total_time=>1.2569451332092285} [----] I, [2016-09-13T05:35:40.413593 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:35:40.431467 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76875], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:35:40.448655 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76876], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:35:40.469949 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76877], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:35:40.494050 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76878], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:35:44.654264 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:35:44 UTC]... [----] I, [2016-09-13T05:35:44.686978 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:35:44 UTC]...Complete [----] I, [2016-09-13T05:35:44.790185 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:35:45.030352 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76876], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.594388769] seconds [----] I, [2016-09-13T05:35:45.030568 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76876], Delivering... [----] I, [2016-09-13T05:35:45.064229 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76878], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.584791448] seconds [----] I, [2016-09-13T05:35:45.064390 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76878], Delivering... [----] I, [2016-09-13T05:35:45.069732 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028846263885498047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002899646759033203, :pending_vm_jobs=>0.0006096363067626953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005030393600463867} [----] I, [2016-09-13T05:35:45.070044 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76878], State: [ok], Delivered in [0.005646403] seconds [----] I, [2016-09-13T05:35:45.081167 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76876], State: [ok], Delivered in [0.050580566] seconds [----] I, [2016-09-13T05:35:45.590302 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76875], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.1717751] seconds [----] I, [2016-09-13T05:35:45.590561 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76875], Delivering... [----] I, [2016-09-13T05:35:45.595469 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76875], State: [ok], Delivered in [0.004889217] seconds [----] I, [2016-09-13T05:35:45.641861 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76877], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.187368582] seconds [----] I, [2016-09-13T05:35:45.642053 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76877], Delivering... [----] I, [2016-09-13T05:35:45.649533 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76877], State: [ok], Delivered in [0.007469693] seconds [----] I, [2016-09-13T05:35:55.505651 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:35:55.515608 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76879], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:35:56.052520 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:35:56.056704 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004059553146362305, :worker_monitor=>1.2274532318115234, :worker_dequeue=>0.007653713226318359, :total_time=>1.2395222187042236} [----] I, [2016-09-13T05:35:56.201577 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76879], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.691180075] seconds [----] I, [2016-09-13T05:35:56.201711 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76879], Delivering... [----] I, [2016-09-13T05:35:56.206030 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002252340316772461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022635459899902344, :pending_vm_jobs=>0.0005052089691162109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004035234451293945} [----] I, [2016-09-13T05:35:56.206254 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76879], State: [ok], Delivered in [0.004545728] seconds [----] I, [2016-09-13T05:36:10.526441 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:36:10.538772 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76880], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:36:10.550107 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76881], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:36:12.279245 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:36:12.283281 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004021167755126953, :worker_monitor=>1.1824052333831787, :worker_dequeue=>0.00906991958618164, :total_time=>1.195756196975708} [----] I, [2016-09-13T05:36:12.299092 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76881], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.754991269] seconds [----] I, [2016-09-13T05:36:12.299314 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76881], Delivering... [----] I, [2016-09-13T05:36:12.305523 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032739639282226562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003292083740234375, :pending_vm_jobs=>0.0007545948028564453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005755901336669922} [----] I, [2016-09-13T05:36:12.305859 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76881], State: [ok], Delivered in [0.00656502] seconds [----] I, [2016-09-13T05:36:12.710313 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76880], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.179404958] seconds [----] I, [2016-09-13T05:36:12.710492 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76880], Delivering... [----] I, [2016-09-13T05:36:12.713921 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76880], State: [ok], Delivered in [0.003467523] seconds [----] I, [2016-09-13T05:36:17.283815 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:36:17 UTC]... [----] I, [2016-09-13T05:36:17.298920 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:36:17 UTC]...Complete [----] I, [2016-09-13T05:36:25.561658 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:36:25.579944 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76882], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:36:28.834872 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:36:28.843358 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005177497863769531, :worker_monitor=>1.4970777034759521, :worker_dequeue=>0.015695571899414062, :total_time=>1.5183470249176025} [----] I, [2016-09-13T05:36:29.442085 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76882], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.874619902] seconds [----] I, [2016-09-13T05:36:29.442280 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76882], Delivering... [----] I, [2016-09-13T05:36:29.450563 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004151105880737305, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00417327880859375, :pending_vm_jobs=>0.0011363029479980469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007862567901611328} [----] I, [2016-09-13T05:36:29.451000 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76882], State: [ok], Delivered in [0.008706043] seconds [----] I, [2016-09-13T05:36:40.590609 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:36:40.607586 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76883], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:36:40.618753 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76884], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:36:40.630152 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76885], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:36:40.641624 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76886], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:36:44.977470 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:36:44.983384 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005872249603271484, :worker_monitor=>1.0882713794708252, :worker_dequeue=>0.011407613754272461, :total_time=>1.1059379577636719} [----] I, [2016-09-13T05:36:45.540066 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76884], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.929340745] seconds [----] I, [2016-09-13T05:36:45.540182 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76884], Delivering... [----] I, [2016-09-13T05:36:45.563050 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76886], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.926460495] seconds [----] I, [2016-09-13T05:36:45.563171 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76886], Delivering... [----] I, [2016-09-13T05:36:45.566991 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002135038375854492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002148866653442383, :pending_vm_jobs=>0.0004544258117675781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003587007522583008} [----] I, [2016-09-13T05:36:45.567272 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76886], State: [ok], Delivered in [0.004092092] seconds [----] I, [2016-09-13T05:36:45.568596 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76884], State: [ok], Delivered in [0.028393542] seconds [----] I, [2016-09-13T05:36:45.803060 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76883], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.209144791] seconds [----] I, [2016-09-13T05:36:45.803181 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76883], Delivering... [----] I, [2016-09-13T05:36:45.806047 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76883], State: [ok], Delivered in [0.002859505] seconds [----] I, [2016-09-13T05:36:45.825688 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76885], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.203329038] seconds [----] I, [2016-09-13T05:36:45.825799 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76885], Delivering... [----] I, [2016-09-13T05:36:45.827673 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76885], State: [ok], Delivered in [0.001868554] seconds [----] I, [2016-09-13T05:36:49.984077 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:36:49 UTC]... [----] I, [2016-09-13T05:36:50.003024 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:36:49 UTC]...Complete [----] I, [2016-09-13T05:36:55.650923 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:36:55.667038 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76887], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:37:01.645071 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:37:01.651689 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004364967346191406, :worker_monitor=>1.49281644821167, :worker_dequeue=>0.011602640151977539, :total_time=>1.5090835094451904} [----] I, [2016-09-13T05:37:01.700590 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76887], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.046269419] seconds [----] I, [2016-09-13T05:37:01.700778 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76887], Delivering... [----] I, [2016-09-13T05:37:01.706954 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032706260681152344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032880306243896484, :pending_vm_jobs=>0.0007345676422119141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057942867279052734} [----] I, [2016-09-13T05:37:01.707303 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76887], State: [ok], Delivered in [0.006524837] seconds [----] I, [2016-09-13T05:37:10.677088 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:37:10.695102 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76888], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:37:10.711668 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76889], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:37:11.680062 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:37:11.797819 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76889], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.096108128] seconds [----] I, [2016-09-13T05:37:11.797997 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76889], Delivering... [----] I, [2016-09-13T05:37:11.804053 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032196044921875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003240823745727539, :pending_vm_jobs=>0.0007305145263671875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005719900131225586} [----] I, [2016-09-13T05:37:11.804481 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76889], State: [ok], Delivered in [0.006450658] seconds [----] I, [2016-09-13T05:37:13.312317 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76888], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.62979877] seconds [----] I, [2016-09-13T05:37:13.312568 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76888], Delivering... [----] I, [2016-09-13T05:37:13.318335 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76888], State: [ok], Delivered in [0.005757879] seconds [----] I, [2016-09-13T05:37:17.992180 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004351377487182617, :worker_monitor=>1.2878284454345703, :worker_dequeue=>0.012406110763549805, :total_time=>1.3049237728118896} [----] I, [2016-09-13T05:37:22.992813 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:37:22 UTC]... [----] I, [2016-09-13T05:37:23.009164 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:37:22 UTC]...Complete [----] I, [2016-09-13T05:37:25.723682 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:37:25.763542 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76890], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:37:28.042457 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T05:37:28.048437 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:37:28.295185 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76890], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.565725854] seconds [----] I, [2016-09-13T05:37:28.295405 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76890], Delivering... [----] I, [2016-09-13T05:37:28.301727 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032215118408203125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032396316528320312, :pending_vm_jobs=>0.0008115768432617188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005892276763916016} [----] I, [2016-09-13T05:37:28.302069 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76890], State: [ok], Delivered in [0.006663236] seconds [----] I, [2016-09-13T05:37:34.554864 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040547847747802734, :worker_monitor=>1.4837725162506104, :worker_dequeue=>0.011241912841796875, :total_time=>1.4993863105773926} [----] I, [2016-09-13T05:37:40.773935 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:37:40.786231 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76891], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:37:40.797640 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76892], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:37:40.808995 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76893], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:37:40.820676 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76894], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:37:44.588076 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:37:45.426000 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76892], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.637069555] seconds [----] I, [2016-09-13T05:37:45.426170 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76892], Delivering... [----] I, [2016-09-13T05:37:45.478007 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76892], State: [ok], Delivered in [0.051806808] seconds [----] I, [2016-09-13T05:37:45.500902 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76894], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.686125123] seconds [----] I, [2016-09-13T05:37:45.501034 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76894], Delivering... [----] I, [2016-09-13T05:37:45.505576 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002406597137451172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002421140670776367, :pending_vm_jobs=>0.0005228519439697266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004267454147338867} [----] I, [2016-09-13T05:37:45.505861 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76894], State: [ok], Delivered in [0.004806583] seconds [----] I, [2016-09-13T05:37:46.400219 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76891], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.623294664] seconds [----] I, [2016-09-13T05:37:46.400412 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76891], Delivering... [----] I, [2016-09-13T05:37:46.403838 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76893], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.602727854] seconds [----] I, [2016-09-13T05:37:46.404000 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76893], Delivering... [----] I, [2016-09-13T05:37:46.404757 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76891], State: [ok], Delivered in [0.004337373] seconds [----] I, [2016-09-13T05:37:46.407245 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76893], State: [ok], Delivered in [0.003219309] seconds [----] I, [2016-09-13T05:37:51.002114 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040857791900634766, :worker_monitor=>1.391700029373169, :worker_dequeue=>0.010494232177734375, :total_time=>1.4065754413604736} [----] I, [2016-09-13T05:37:55.832079 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:37:55.849877 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76895], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:37:56.002778 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:37:56 UTC]... [----] I, [2016-09-13T05:37:56.022184 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:37:56 UTC]...Complete [----] I, [2016-09-13T05:37:56.164127 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:37:56.622621 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76895], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.784680378] seconds [----] I, [2016-09-13T05:37:56.622956 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76895], Delivering... [----] I, [2016-09-13T05:37:56.634824 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0058629512786865234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005904436111450195, :pending_vm_jobs=>0.0015060901641845703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.011013269424438477} [----] I, [2016-09-13T05:37:56.635406 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76895], State: [ok], Delivered in [0.012461372] seconds [----] I, [2016-09-13T05:38:07.709503 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005666494369506836, :worker_monitor=>1.5007686614990234, :worker_dequeue=>0.011016368865966797, :total_time=>1.5177719593048096} [----] I, [2016-09-13T05:38:10.859903 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:38:10.866961 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76896], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:38:10.878377 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76897], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:38:12.718855 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:38:12.776184 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76897], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.905636349] seconds [----] I, [2016-09-13T05:38:12.776391 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76897], Delivering... [----] I, [2016-09-13T05:38:12.783326 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035605430603027344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036499500274658203, :pending_vm_jobs=>0.0008215904235839844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006518840789794922} [----] I, [2016-09-13T05:38:12.783701 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76897], State: [ok], Delivered in [0.007303294] seconds [----] I, [2016-09-13T05:38:13.536121 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76896], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.67349115] seconds [----] I, [2016-09-13T05:38:13.536315 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76896], Delivering... [----] I, [2016-09-13T05:38:13.541044 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76896], State: [ok], Delivered in [0.004735107] seconds [----] I, [2016-09-13T05:38:24.123862 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004486560821533203, :worker_monitor=>1.3596076965332031, :worker_dequeue=>0.01191568374633789, :total_time=>1.3763606548309326} [----] I, [2016-09-13T05:38:25.886961 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:38:25.907365 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76898], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:38:25.930389 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76899], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:38:25.941590 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76900], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:38:29.124540 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:38:29 UTC]... [----] I, [2016-09-13T05:38:29.147360 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:38:29 UTC]...Complete [----] I, [2016-09-13T05:38:29.159723 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:38:29.821752 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76898], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.928758806] seconds [----] I, [2016-09-13T05:38:29.821922 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76898], Delivering... [----] I, [2016-09-13T05:38:29.827947 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003010988235473633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030324459075927734, :pending_vm_jobs=>0.0006949901580810547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005370378494262695} [----] I, [2016-09-13T05:38:29.828278 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76898], State: [ok], Delivered in [0.006356428] seconds [----] I, [2016-09-13T05:38:29.861660 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76899], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.949782451] seconds [----] I, [2016-09-13T05:38:29.861839 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76899], Delivering... [----] I, [2016-09-13T05:38:29.863255 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T05:38:29.863517 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5342720000 [----] I, [2016-09-13T05:38:29.863634 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5124845568 [----] I, [2016-09-13T05:38:29.863724 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 217874432 [----] I, [2016-09-13T05:38:29.863806 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1317011456 [----] I, [2016-09-13T05:38:29.863891 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5070905344 [----] I, [2016-09-13T05:38:29.863988 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T05:38:29.864075 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T05:38:29.864156 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 538894336 [----] I, [2016-09-13T05:38:29.864257 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T05:38:29.864344 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8031903744 [----] I, [2016-09-13T05:38:29.864451 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T05:38:29.864555 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T05:38:29.864636 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T05:38:29.864718 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T05:38:29.864805 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T05:38:29.864882 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T05:38:29.864962 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T05:38:29.865039 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T05:38:29.865116 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T05:38:29.865192 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T05:38:29.865302 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273301504 [----] I, [2016-09-13T05:38:29.865391 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56410112 [----] I, [2016-09-13T05:38:29.865513 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216891392 [----] I, [2016-09-13T05:38:29.865601 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T05:38:29.865678 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140230656 [----] I, [2016-09-13T05:38:29.865761 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2598064128 [----] I, [2016-09-13T05:38:29.865843 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2285129728 [----] I, [2016-09-13T05:38:29.865923 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T05:38:29.866000 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T05:38:29.866077 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T05:38:29.866160 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37203968 [----] I, [2016-09-13T05:38:29.866263 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T05:38:29.866348 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53288960 [----] I, [2016-09-13T05:38:29.866452 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110350336 [----] I, [2016-09-13T05:38:29.866548 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155586560 [----] I, [2016-09-13T05:38:29.866633 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T05:38:29.866712 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T05:38:29.866794 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T05:38:29.866874 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T05:38:29.866950 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T05:38:29.867032 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T05:38:29.867111 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T05:38:29.867184 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T05:38:29.867284 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T05:38:29.905179 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T05:38:29.905461 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T05:38:29.909525 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T05:38:29.912526 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T05:38:29.916129 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T05:38:29.919773 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T05:38:29.923405 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T05:38:29.927234 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 839 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T05:38:29.930972 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T05:38:29.934595 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T05:38:29.938042 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T05:38:29.941397 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T05:38:29.944833 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T05:38:29.948210 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T05:38:29.951459 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:38:29.951623 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:38:29.951739 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T05:38:29.956348 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [200502000], Memory % [3.38], CPU Time [149290.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:38:29.956752 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76899], State: [ok], Delivered in [0.09489721] seconds [----] I, [2016-09-13T05:38:34.181166 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:38:34.560091 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76900], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.625239815] seconds [----] I, [2016-09-13T05:38:34.560263 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76900], Delivering... [----] I, [2016-09-13T05:38:34.565937 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:38:23 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200502000], Memory % [3.36], CPU Time [149305.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:38:34.566289 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:38:16 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347152000], Memory % [5.04], CPU Time [103374.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T05:38:34.566704 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:38:21 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [50717.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:38:34.567025 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:38:14 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212544000], Memory % [3.5], CPU Time [48279.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T05:38:34.567403 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:38:23 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162420000], Memory % [3.1], CPU Time [37391.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T05:38:34.567779 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:38:10 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205293000], Memory % [3.5], CPU Time [236219.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T05:38:34.568134 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:38:22 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358685000], Memory % [5.28], CPU Time [199622.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T05:38:34.568486 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:38:23 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [148372.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:38:34.568801 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:38:22 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357918000], Memory % [5.27], CPU Time [206792.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T05:38:34.569118 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:38:22 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [50759.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:38:34.569448 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:38:22 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165806000], Memory % [3.16], CPU Time [38292.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T05:38:34.571338 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:38:23 UTC], Process Info: Memory Usage [598315008], Memory Size [1054515200], Proportional Set Size: [435569000], Memory % [7.29], CPU Time [2004.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:38:34.572664 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:38:21 UTC], Process Info: Memory Usage [588488704], Memory Size [931971072], Proportional Set Size: [425605000], Memory % [7.17], CPU Time [899.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:38:34.573932 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:38:23 UTC], Process Info: Memory Usage [580378624], Memory Size [936361984], Proportional Set Size: [419844000], Memory % [7.08], CPU Time [1435.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T05:38:34.575249 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:38:20 UTC], Process Info: Memory Usage [559022080], Memory Size [930201600], Proportional Set Size: [406619000], Memory % [6.82], CPU Time [4818.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T05:38:34.575514 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76900], State: [ok], Delivered in [0.015255433] seconds [----] I, [2016-09-13T05:38:40.668452 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003965616226196289, :worker_monitor=>1.4638125896453857, :worker_dequeue=>0.009872198104858398, :total_time=>1.4779963493347168} [----] I, [2016-09-13T05:38:40.952887 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:38:40.965947 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76901], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:38:40.981696 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76902], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:38:41.004903 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76903], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:38:41.021874 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76904], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:38:45.681782 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:38:46.033633 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76902], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.063306251] seconds [----] I, [2016-09-13T05:38:46.033769 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76902], Delivering... [----] I, [2016-09-13T05:38:46.084699 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76902], State: [ok], Delivered in [0.050904469] seconds [----] I, [2016-09-13T05:38:46.107899 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76904], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.095278967] seconds [----] I, [2016-09-13T05:38:46.108026 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76904], Delivering... [----] I, [2016-09-13T05:38:46.112254 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023360252380371094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023512840270996094, :pending_vm_jobs=>0.0004839897155761719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00393986701965332} [----] I, [2016-09-13T05:38:46.112541 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76904], State: [ok], Delivered in [0.004515891] seconds [----] I, [2016-09-13T05:38:46.639120 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76901], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.681592925] seconds [----] I, [2016-09-13T05:38:46.639310 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76901], Delivering... [----] I, [2016-09-13T05:38:46.643890 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76901], State: [ok], Delivered in [0.004560224] seconds [----] I, [2016-09-13T05:38:46.656285 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76903], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.670138332] seconds [----] I, [2016-09-13T05:38:46.656432 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76903], Delivering... [----] I, [2016-09-13T05:38:46.658814 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76903], State: [ok], Delivered in [0.002399344] seconds [----] I, [2016-09-13T05:38:56.031655 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:38:56.061601 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76905], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:38:57.192849 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:38:57.196595 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0024518966674804688, :worker_monitor=>1.479814052581787, :worker_dequeue=>0.006551980972290039, :total_time=>1.488987684249878} [----] I, [2016-09-13T05:38:57.228519 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76905], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.191899476] seconds [----] I, [2016-09-13T05:38:57.228747 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76905], Delivering... [----] I, [2016-09-13T05:38:57.235523 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035858154296875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003608226776123047, :pending_vm_jobs=>0.000804901123046875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006334781646728516} [----] I, [2016-09-13T05:38:57.235859 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76905], State: [ok], Delivered in [0.007130908] seconds [----] I, [2016-09-13T05:39:02.197078 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:39:02 UTC]... [----] I, [2016-09-13T05:39:02.218106 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:39:02 UTC]...Complete [----] I, [2016-09-13T05:39:11.071116 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:39:11.091147 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76906], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:39:11.102335 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76907], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:39:13.804472 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:39:13.811593 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035119056701660156, :worker_monitor=>1.4198687076568604, :worker_dequeue=>0.012911796569824219, :total_time=>1.4365789890289307} [----] I, [2016-09-13T05:39:14.325905 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76907], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.228789658] seconds [----] I, [2016-09-13T05:39:14.326121 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76907], Delivering... [----] I, [2016-09-13T05:39:14.333886 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038442611694335938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003871440887451172, :pending_vm_jobs=>0.0009236335754394531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007206439971923828} [----] I, [2016-09-13T05:39:14.334282 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76907], State: [ok], Delivered in [0.008156982] seconds [----] I, [2016-09-13T05:39:16.765862 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76906], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.68860748] seconds [----] I, [2016-09-13T05:39:16.766075 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76906], Delivering... [----] I, [2016-09-13T05:39:16.771911 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76906], State: [ok], Delivered in [0.005823545] seconds [----] I, [2016-09-13T05:39:26.114841 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:39:26.142730 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76908], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:39:30.459237 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:39:30.462811 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004651069641113281, :worker_monitor=>1.6100451946258545, :worker_dequeue=>0.0066070556640625, :total_time=>1.6215906143188477} [----] I, [2016-09-13T05:39:30.502291 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76908], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.381661347] seconds [----] I, [2016-09-13T05:39:30.502446 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76908], Delivering... [----] I, [2016-09-13T05:39:30.507109 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024437904357910156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002475261688232422, :pending_vm_jobs=>0.0005958080291748047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004380941390991211} [----] I, [2016-09-13T05:39:30.507334 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76908], State: [ok], Delivered in [0.004906491] seconds [----] I, [2016-09-13T05:39:35.463324 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:39:35 UTC]... [----] I, [2016-09-13T05:39:35.480277 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:39:35 UTC]...Complete [----] I, [2016-09-13T05:39:41.154007 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:39:41.165342 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76909], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:39:41.177876 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76910], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:39:41.188157 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76911], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:39:41.205389 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76912], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:39:46.811689 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:39:46.825945 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030286312103271484, :worker_monitor=>1.2795398235321045, :worker_dequeue=>0.0231473445892334, :total_time=>1.3059654235839844} [----] I, [2016-09-13T05:39:46.841267 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76910], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.672054771] seconds [----] I, [2016-09-13T05:39:46.841524 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76910], Delivering... [----] I, [2016-09-13T05:39:46.862599 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76912], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.665390043] seconds [----] I, [2016-09-13T05:39:46.862732 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76912], Delivering... [----] I, [2016-09-13T05:39:46.866910 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002291440963745117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002305269241333008, :pending_vm_jobs=>0.00047278404235839844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003889322280883789} [----] I, [2016-09-13T05:39:46.867176 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76912], State: [ok], Delivered in [0.004450396] seconds [----] I, [2016-09-13T05:39:46.891059 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76909], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.732716906] seconds [----] I, [2016-09-13T05:39:46.891174 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76909], Delivering... [----] I, [2016-09-13T05:39:46.894319 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76909], State: [ok], Delivered in [0.003137051] seconds [----] I, [2016-09-13T05:39:46.908318 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76910], State: [ok], Delivered in [0.066782576] seconds [----] I, [2016-09-13T05:39:46.913905 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76911], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.730785] seconds [----] I, [2016-09-13T05:39:46.914013 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76911], Delivering... [----] I, [2016-09-13T05:39:46.915901 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76911], State: [ok], Delivered in [0.001883448] seconds [----] I, [2016-09-13T05:39:56.217396 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:39:56.262601 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76913], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:39:56.851136 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:39:57.658639 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76913], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.434966392] seconds [----] I, [2016-09-13T05:39:57.658869 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76913], Delivering... [----] I, [2016-09-13T05:39:57.666165 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004001140594482422, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004038572311401367, :pending_vm_jobs=>0.0008394718170166016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068814754486083984} [----] I, [2016-09-13T05:39:57.666547 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76913], State: [ok], Delivered in [0.007683724] seconds [----] I, [2016-09-13T05:40:03.249902 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041925907135009766, :worker_monitor=>1.3802235126495361, :worker_dequeue=>0.007145881652832031, :total_time=>1.3918368816375732} [----] I, [2016-09-13T05:40:08.250475 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:40:08 UTC]... [----] I, [2016-09-13T05:40:08.263708 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:40:08 UTC]...Complete [----] I, [2016-09-13T05:40:11.271477 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:40:11.297245 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76914], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:40:11.320218 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76915], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:40:11.331143 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76916], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:40:11.343961 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76917], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:40:11.371229 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76918], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:40:13.404571 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:40:13.783218 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76918], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.434111293] seconds [----] I, [2016-09-13T05:40:13.783470 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76918], Delivering... [----] I, [2016-09-13T05:40:13.790680 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037162303924560547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00379180908203125, :pending_vm_jobs=>0.0008847713470458984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006764650344848633} [----] I, [2016-09-13T05:40:13.791150 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76918], State: [ok], Delivered in [0.007686471] seconds [----] I, [2016-09-13T05:40:14.051578 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76914], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.774624645] seconds [----] I, [2016-09-13T05:40:14.051728 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76914], Delivering... [----] I, [2016-09-13T05:40:14.053774 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76914], State: [ok], Delivered in [0.002036546] seconds [----] I, [2016-09-13T05:40:14.057308 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76915], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.754834667] seconds [----] I, [2016-09-13T05:40:14.057539 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76915], Delivering... [----] I, [2016-09-13T05:40:14.069634 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76915], State: [ok], Delivered in [0.012075487] seconds [----] I, [2016-09-13T05:40:14.074047 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76916], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.748882532] seconds [----] I, [2016-09-13T05:40:14.074216 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76916], Delivering... [----] I, [2016-09-13T05:40:14.079138 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76916], State: [ok], Delivered in [0.004913971] seconds [----] I, [2016-09-13T05:40:14.097101 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76917], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.76199395] seconds [----] I, [2016-09-13T05:40:14.097306 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76917], Delivering... [----] I, [2016-09-13T05:40:14.102466 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76917], State: [ok], Delivered in [0.005134483] seconds [----] I, [2016-09-13T05:40:20.036558 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00438690185546875, :worker_monitor=>1.6035130023956299, :worker_dequeue=>0.015492916107177734, :total_time=>1.6237297058105469} [----] I, [2016-09-13T05:40:26.382589 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:40:26.394205 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76919], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:40:30.059845 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:40:30.897756 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76919], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.509533017] seconds [----] I, [2016-09-13T05:40:30.897955 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76919], Delivering... [----] I, [2016-09-13T05:40:30.904843 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00356292724609375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035886764526367188, :pending_vm_jobs=>0.0008540153503417969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006497859954833984} [----] I, [2016-09-13T05:40:30.905229 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76919], State: [ok], Delivered in [0.007263615] seconds [----] I, [2016-09-13T05:40:36.428285 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003909111022949219, :worker_monitor=>1.3467605113983154, :worker_dequeue=>0.01226949691772461, :total_time=>1.3632259368896484} [----] I, [2016-09-13T05:40:41.406510 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:40:41.424363 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76920], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:40:41.428998 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:40:41 UTC]... [----] I, [2016-09-13T05:40:41.445113 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:40:41 UTC]...Complete [----] I, [2016-09-13T05:40:41.445683 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76921], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:40:41.453130 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:40:41.468572 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76922], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:40:41.491298 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76923], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:40:42.022755 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76921], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.595071022] seconds [----] I, [2016-09-13T05:40:42.022959 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76921], Delivering... [----] I, [2016-09-13T05:40:42.085546 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76921], State: [ok], Delivered in [0.062543702] seconds [----] I, [2016-09-13T05:40:44.171396 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76920], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.759457951] seconds [----] I, [2016-09-13T05:40:44.171648 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76920], Delivering... [----] I, [2016-09-13T05:40:44.176985 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76920], State: [ok], Delivered in [0.00533277] seconds [----] I, [2016-09-13T05:40:46.466046 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:40:47.046927 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76923], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.563574746] seconds [----] I, [2016-09-13T05:40:47.047139 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76923], Delivering... [----] I, [2016-09-13T05:40:47.054238 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003718137741088867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037424564361572266, :pending_vm_jobs=>0.0008540153503417969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006638050079345703} [----] I, [2016-09-13T05:40:47.054651 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76923], State: [ok], Delivered in [0.007510818] seconds [----] I, [2016-09-13T05:40:47.228787 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76922], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.774391191] seconds [----] I, [2016-09-13T05:40:47.229048 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76922], Delivering... [----] I, [2016-09-13T05:40:47.237829 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76922], State: [ok], Delivered in [0.0087698] seconds [----] I, [2016-09-13T05:40:53.033117 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005491971969604492, :worker_monitor=>1.5435357093811035, :worker_dequeue=>0.012696504592895508, :total_time=>1.5620660781860352} [----] I, [2016-09-13T05:40:56.508720 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:40:56.525530 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76924], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:40:58.043088 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:40:58.183170 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76924], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.668134689] seconds [----] I, [2016-09-13T05:40:58.183411 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76924], Delivering... [----] I, [2016-09-13T05:40:58.190597 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038046836853027344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038292407989501953, :pending_vm_jobs=>0.0007927417755126953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006731271743774414} [----] I, [2016-09-13T05:40:58.190966 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76924], State: [ok], Delivered in [0.0075557] seconds [----] I, [2016-09-13T05:41:09.480035 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037682056427001953, :worker_monitor=>1.3904156684875488, :worker_dequeue=>0.01805400848388672, :total_time=>1.412595272064209} [----] I, [2016-09-13T05:41:11.536873 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:41:11.554689 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76925], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:41:11.571952 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76926], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:41:14.480686 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:41:14 UTC]... [----] I, [2016-09-13T05:41:14.497281 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:41:14 UTC]...Complete [----] I, [2016-09-13T05:41:14.571326 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:41:15.366542 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76926], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.805290765] seconds [----] I, [2016-09-13T05:41:15.366734 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76926], Delivering... [----] I, [2016-09-13T05:41:15.373170 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003531932830810547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003553152084350586, :pending_vm_jobs=>0.0007650852203369141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060732364654541016} [----] I, [2016-09-13T05:41:15.373532 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76926], State: [ok], Delivered in [0.006794142] seconds [----] I, [2016-09-13T05:41:17.331998 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76925], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.789196934] seconds [----] I, [2016-09-13T05:41:17.332208 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76925], Delivering... [----] I, [2016-09-13T05:41:17.337247 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76925], State: [ok], Delivered in [0.005024992] seconds [----] I, [2016-09-13T05:41:26.181095 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003872394561767578, :worker_monitor=>1.5748836994171143, :worker_dequeue=>0.0074117183685302734, :total_time=>1.586430549621582} [----] I, [2016-09-13T05:41:26.585685 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:41:26.613125 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76927], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:41:31.191883 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:41:31.480810 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76927], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.885720948] seconds [----] I, [2016-09-13T05:41:31.480994 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76927], Delivering... [----] I, [2016-09-13T05:41:31.488498 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003246784210205078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003284931182861328, :pending_vm_jobs=>0.0007648468017578125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057260990142822266} [----] I, [2016-09-13T05:41:31.488857 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76927], State: [ok], Delivered in [0.007859906] seconds [----] I, [2016-09-13T05:41:41.651068 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:41:41.669305 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76928], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:41:41.686448 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76929], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:41:41.709513 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76930], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:41:41.732070 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76931], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:41:42.719739 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:41:42.728017 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003934144973754883, :worker_monitor=>1.490767478942871, :worker_dequeue=>0.014329910278320312, :total_time=>1.5093753337860107} [----] I, [2016-09-13T05:41:43.556479 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76929], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.883093335] seconds [----] I, [2016-09-13T05:41:43.556679 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76929], Delivering... [----] I, [2016-09-13T05:41:43.623767 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76931], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.904364932] seconds [----] I, [2016-09-13T05:41:43.623934 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76931], Delivering... [----] I, [2016-09-13T05:41:43.629354 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76929], State: [ok], Delivered in [0.072651487] seconds [----] I, [2016-09-13T05:41:43.630488 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003712177276611328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037322044372558594, :pending_vm_jobs=>0.0007357597351074219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006203651428222656} [----] I, [2016-09-13T05:41:43.630823 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76931], State: [ok], Delivered in [0.006883221] seconds [----] I, [2016-09-13T05:41:44.423473 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76928], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.768161877] seconds [----] I, [2016-09-13T05:41:44.423582 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76928], Delivering... [----] I, [2016-09-13T05:41:44.426224 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76928], State: [ok], Delivered in [0.002624357] seconds [----] I, [2016-09-13T05:41:44.429114 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76930], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.736899488] seconds [----] I, [2016-09-13T05:41:44.429234 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76930], Delivering... [----] I, [2016-09-13T05:41:44.431206 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76930], State: [ok], Delivered in [0.001958576] seconds [----] I, [2016-09-13T05:41:47.728637 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:41:47 UTC]... [----] I, [2016-09-13T05:41:47.784838 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:41:47 UTC]...Complete [----] I, [2016-09-13T05:41:56.746329 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:41:56.767307 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76932], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:41:59.068868 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:41:59.072722 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004106998443603516, :worker_monitor=>1.2432386875152588, :worker_dequeue=>0.006897449493408203, :total_time=>1.254547119140625} [----] I, [2016-09-13T05:41:59.523537 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76932], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.771396384] seconds [----] I, [2016-09-13T05:41:59.523781 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76932], Delivering... [----] I, [2016-09-13T05:41:59.531300 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0041010379791259766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004124164581298828, :pending_vm_jobs=>0.0008759498596191406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007055044174194336} [----] I, [2016-09-13T05:41:59.531656 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76932], State: [ok], Delivered in [0.007878316] seconds [----] I, [2016-09-13T05:42:11.779308 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:42:11.801805 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76933], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:42:11.813169 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76934], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:42:15.540870 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:42:15.546149 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004152059555053711, :worker_monitor=>1.4164268970489502, :worker_dequeue=>0.009565591812133789, :total_time=>1.430403232574463} [----] I, [2016-09-13T05:42:15.904835 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76934], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.097241259] seconds [----] I, [2016-09-13T05:42:15.905034 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76934], Delivering... [----] I, [2016-09-13T05:42:15.912411 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036504268646240234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037865638732910156, :pending_vm_jobs=>0.0008451938629150391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006917238235473633} [----] I, [2016-09-13T05:42:15.912828 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76934], State: [ok], Delivered in [0.007773785] seconds [----] I, [2016-09-13T05:42:17.563586 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76933], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.779006541] seconds [----] I, [2016-09-13T05:42:17.563939 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76933], Delivering... [----] I, [2016-09-13T05:42:17.570107 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76933], State: [ok], Delivered in [0.006190994] seconds [----] I, [2016-09-13T05:42:20.546799 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:42:20 UTC]... [----] I, [2016-09-13T05:42:20.561643 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:42:20 UTC]...Complete [----] I, [2016-09-13T05:42:26.825323 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:42:26.841857 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76935], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:42:30.698528 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T05:42:32.348661 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:42:32.354381 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004574298858642578, :log_active_servers=>0.01485133171081543, :worker_monitor=>1.6441230773925781, :worker_dequeue=>0.011198043823242188, :total_time=>1.675222396850586} [----] I, [2016-09-13T05:42:32.659551 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76935], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.828042798] seconds [----] I, [2016-09-13T05:42:32.659779 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76935], Delivering... [----] I, [2016-09-13T05:42:32.668062 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0044133663177490234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004439353942871094, :pending_vm_jobs=>0.0009908676147460938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007829666137695312} [----] I, [2016-09-13T05:42:32.668505 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76935], State: [ok], Delivered in [0.00871812] seconds [----] I, [2016-09-13T05:42:41.853688 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:42:41.870597 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76936], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:42:41.881943 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76937], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:42:41.893143 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76938], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:42:41.910475 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76939], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:42:42.384478 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:42:43.070802 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76937], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.196197501] seconds [----] I, [2016-09-13T05:42:43.071013 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76937], Delivering... [----] I, [2016-09-13T05:42:43.122007 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76937], State: [ok], Delivered in [0.050974888] seconds [----] I, [2016-09-13T05:42:43.146098 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76939], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.244039747] seconds [----] I, [2016-09-13T05:42:43.146291 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76939], Delivering... [----] I, [2016-09-13T05:42:43.152380 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003222227096557617, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032393932342529297, :pending_vm_jobs=>0.0007483959197998047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005715131759643555} [----] I, [2016-09-13T05:42:43.152765 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76939], State: [ok], Delivered in [0.006470667] seconds [----] I, [2016-09-13T05:42:44.700106 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76936], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.841761766] seconds [----] I, [2016-09-13T05:42:44.700467 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76936], Delivering... [----] I, [2016-09-13T05:42:44.709067 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76936], State: [ok], Delivered in [0.008602117] seconds [----] I, [2016-09-13T05:42:44.762486 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76938], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.875021813] seconds [----] I, [2016-09-13T05:42:44.762725 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76938], Delivering... [----] I, [2016-09-13T05:42:44.766791 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76938], State: [ok], Delivered in [0.004056376] seconds [----] I, [2016-09-13T05:42:48.781303 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003798961639404297, :worker_monitor=>1.3763937950134277, :worker_dequeue=>0.009479284286499023, :total_time=>1.3900761604309082} [----] I, [2016-09-13T05:42:53.782005 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:42:53 UTC]... [----] I, [2016-09-13T05:42:53.801820 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:42:53 UTC]...Complete [----] I, [2016-09-13T05:42:56.922098 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:42:56.968120 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76940], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:42:58.830877 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:42:59.316684 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76940], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.387924517] seconds [----] I, [2016-09-13T05:42:59.316884 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76940], Delivering... [----] I, [2016-09-13T05:42:59.323159 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003180980682373047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032012462615966797, :pending_vm_jobs=>0.0008287429809570312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005882978439331055} [----] I, [2016-09-13T05:42:59.323564 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76940], State: [ok], Delivered in [0.006688476] seconds [----] I, [2016-09-13T05:43:05.238670 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00406193733215332, :worker_monitor=>1.3854789733886719, :worker_dequeue=>0.010735034942626953, :total_time=>1.4005811214447021} [----] I, [2016-09-13T05:43:11.980405 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:43:11.996784 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76941], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:43:12.008017 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76942], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:43:15.266784 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:43:15.449207 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76942], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.446950476] seconds [----] I, [2016-09-13T05:43:15.449407 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76942], Delivering... [----] I, [2016-09-13T05:43:15.456817 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037660598754882812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003821134567260742, :pending_vm_jobs=>0.0009074211120605469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006925344467163086} [----] I, [2016-09-13T05:43:15.457217 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76942], State: [ok], Delivered in [0.007784727] seconds [----] I, [2016-09-13T05:43:17.900069 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76941], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.914821222] seconds [----] I, [2016-09-13T05:43:17.900359 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76941], Delivering... [----] I, [2016-09-13T05:43:17.906038 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76941], State: [ok], Delivered in [0.005672249] seconds [----] I, [2016-09-13T05:43:21.351282 #2763:34713c] INFO -- : MIQ(MiqServer#validate_worker) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit [----] I, [2016-09-13T05:43:21.374065 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76943], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_uptime_exceeded", {:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T05:43:21.374267 #2763:34713c] INFO -- : MIQ(MiqServer#stop_worker) Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3], status [started]... [----] I, [2016-09-13T05:43:21.394030 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76944], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T05:43:21.408100 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3] is being requested to exit [----] I, [2016-09-13T05:43:21.625228 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:43:21.631221 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003961324691772461, :worker_monitor=>1.3411943912506104, :worker_dequeue=>0.01216888427734375, :total_time=>1.35760498046875} [----] I, [2016-09-13T05:43:23.911940 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76943], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_uptime_exceeded", {:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [2.559278921] seconds [----] I, [2016-09-13T05:43:23.912136 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76943], Delivering... [----] I, [2016-09-13T05:43:23.951460 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_uptime_exceeded"> inputs=<{:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1074, :miq_event_id=>1074, "EventStream::event_stream"=>1074, :event_stream_id=>1074}> [----] I, [2016-09-13T05:43:23.969382 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76944], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [2.593920952] seconds [----] I, [2016-09-13T05:43:23.969584 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76944], Delivering... [----] I, [2016-09-13T05:43:23.988071 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76945], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1074, :miq_event_id=>1074, "EventStream::event_stream"=>1074, :event_stream_id=>1074}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T05:43:23.988494 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76943], State: [ok], Delivered in [0.07634882] seconds [----] I, [2016-09-13T05:43:23.991364 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_stop"> inputs=<{:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1075, :miq_event_id=>1075, "EventStream::event_stream"=>1075, :event_stream_id=>1075}> [----] I, [2016-09-13T05:43:24.029009 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76946], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1075, :miq_event_id=>1075, "EventStream::event_stream"=>1075, :event_stream_id=>1075}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T05:43:24.029618 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76944], State: [ok], Delivered in [0.059989753] seconds [----] I, [2016-09-13T05:43:24.332386 #28071:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [96], PID [28071], GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:43:14 UTC], Process Info: Memory Usage [598315008], Memory Size [1054515200], Proportional Set Size: [435583000], Memory % [7.29], CPU Time [2016.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:43:24.332953 #28071:34713c] INFO -- : EMS [livingontheedge.hawkular.org] as [jdoe] ID [96] PID [28071] GUID [b49c1882-7985-11e6-87c1-fa163e7d01a3] Exit request received. Worker exiting. [----] I, [2016-09-13T05:43:26.631703 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:43:26 UTC]... [----] I, [2016-09-13T05:43:26.648440 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:43:26 UTC]...Complete [----] I, [2016-09-13T05:43:26.726702 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:43:27.019564 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:43:27.038754 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76945], MiqWorker id: [14], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1074, :miq_event_id=>1074, "EventStream::event_stream"=>1074, :event_stream_id=>1074}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [3.072748961] seconds [----] I, [2016-09-13T05:43:27.038942 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76945], Delivering... [----] I, [2016-09-13T05:43:27.040564 #2937:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1074, :miq_event_id=>1074, "EventStream::event_stream"=>1074, :event_stream_id=>1074} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T05:43:27.042849 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76947], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:43:27.045176 #2937:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1074&MiqEvent%3A%3Amiq_event=1074&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B96%5D%2C%20PID%3A%20%5B28071%5D%2C%20GUID%3A%20%5Bb49c1882-7985-11e6-87c1-fa163e7d01a3%5D%20uptime%20has%20reached%20the%20interval%20of%207200%20seconds%2C%20requesting%20worker%20to%20exit&event_stream_id=1074&event_type=evm_worker_uptime_exceeded&miq_event_id=1074&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T05:43:27.054166 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76948], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:43:27.061826 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76946], MiqWorker id: [13], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1075, :miq_event_id=>1075, "EventStream::event_stream"=>1075, :event_stream_id=>1075}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [3.053582575] seconds [----] I, [2016-09-13T05:43:27.062019 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76946], Delivering... [----] I, [2016-09-13T05:43:27.063835 #2928:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1075, :miq_event_id=>1075, "EventStream::event_stream"=>1075, :event_stream_id=>1075} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T05:43:27.065689 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76949], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:43:27.069209 #2928:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1075&MiqEvent%3A%3Amiq_event=1075&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B96%5D%2C%20PID%3A%20%5B28071%5D%2C%20GUID%3A%20%5Bb49c1882-7985-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1075&event_type=evm_worker_stop&miq_event_id=1075&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T05:43:27.069719 #2937:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1074&MiqEvent%3A%3Amiq_event=1074&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B96%5D%2C%20PID%3A%20%5B28071%5D%2C%20GUID%3A%20%5Bb49c1882-7985-11e6-87c1-fa163e7d01a3%5D%20uptime%20has%20reached%20the%20interval%20of%207200%20seconds%2C%20requesting%20worker%20to%20exit&event_stream_id=1074&event_type=evm_worker_uptime_exceeded&miq_event_id=1074&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T05:43:27.103529 #2928:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1075&MiqEvent%3A%3Amiq_event=1075&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B96%5D%2C%20PID%3A%20%5B28071%5D%2C%20GUID%3A%20%5Bb49c1882-7985-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1075&event_type=evm_worker_stop&miq_event_id=1075&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T05:43:27.114387 #2937:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create] [----] I, [2016-09-13T05:43:27.124706 #2937:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T05:43:27.135158 #2937:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T05:43:27.145404 #2937:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T05:43:27.148125 #2937:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T05:43:27.156363 #2937:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T05:43:27.160386 #2937:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T05:43:27.162773 #2937:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 09:43:26", os_priority: 30, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 432046080, memory_size: 729399296, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 202019000, has_active_websocket: true>] [----] I, [2016-09-13T05:43:27.162915 #2937:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_uptime_exceeded] [----] I, [2016-09-13T05:43:27.173797 #2937:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_uptime_exceeded] [----] I, [2016-09-13T05:43:27.173903 #2937:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_uptime_exceeded] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T05:43:27.177986 #2937:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T05:43:27.178310 #2937:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create] [----] I, [2016-09-13T05:43:27.178801 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76945], State: [ok], Delivered in [0.139881755] seconds [----] I, [2016-09-13T05:43:27.191399 #2928:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T05:43:27.211807 #2928:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T05:43:27.232263 #2928:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_stop] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T05:43:27.252650 #2928:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T05:43:27.258099 #2928:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T05:43:27.274037 #2928:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T05:43:27.281846 #2928:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T05:43:27.286227 #2928:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 09:43:26", os_priority: 30, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 432046080, memory_size: 729399296, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 202019000, has_active_websocket: true>] [----] I, [2016-09-13T05:43:27.286480 #2928:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_stop] [----] I, [2016-09-13T05:43:27.311326 #2928:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_stop] [----] I, [2016-09-13T05:43:27.311624 #2928:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_stop] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T05:43:27.319949 #2928:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T05:43:27.320573 #2928:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T05:43:27.321326 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76946], State: [ok], Delivered in [0.259302945] seconds [----] I, [2016-09-13T05:43:31.743395 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:43:32.540467 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76947], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.514926019] seconds [----] I, [2016-09-13T05:43:32.540649 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76947], Delivering... [----] I, [2016-09-13T05:43:32.546865 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003307342529296875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003325939178466797, :pending_vm_jobs=>0.0007600784301757812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005884885787963867} [----] I, [2016-09-13T05:43:32.547200 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76947], State: [ok], Delivered in [0.006529555] seconds [----] I, [2016-09-13T05:43:32.568661 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76948], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.520740555] seconds [----] I, [2016-09-13T05:43:32.568836 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76948], Delivering... [----] I, [2016-09-13T05:43:32.569847 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T05:43:32.570041 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4918214656 [----] I, [2016-09-13T05:43:32.570168 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4700114944 [----] I, [2016-09-13T05:43:32.570280 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 218099712 [----] I, [2016-09-13T05:43:32.570358 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1103101952 [----] I, [2016-09-13T05:43:32.570465 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4646146048 [----] I, [2016-09-13T05:43:32.570552 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T05:43:32.570632 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T05:43:32.570698 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 539148288 [----] I, [2016-09-13T05:43:32.570766 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T05:43:32.570834 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7182344192 [----] I, [2016-09-13T05:43:32.570908 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T05:43:32.570974 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T05:43:32.571041 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T05:43:32.571109 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T05:43:32.571176 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T05:43:32.571269 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T05:43:32.571340 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T05:43:32.571404 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T05:43:32.571515 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T05:43:32.571588 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T05:43:32.571656 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273301504 [----] I, [2016-09-13T05:43:32.571740 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56414208 [----] I, [2016-09-13T05:43:32.571813 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216887296 [----] I, [2016-09-13T05:43:32.571878 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6127616 [----] I, [2016-09-13T05:43:32.571942 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140894208 [----] I, [2016-09-13T05:43:32.572011 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3024113664 [----] I, [2016-09-13T05:43:32.572077 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2710958080 [----] I, [2016-09-13T05:43:32.572148 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T05:43:32.572237 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T05:43:32.572310 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T05:43:32.572380 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 35250176 [----] I, [2016-09-13T05:43:32.572479 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T05:43:32.572556 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53088256 [----] I, [2016-09-13T05:43:32.572626 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110383104 [----] I, [2016-09-13T05:43:32.572697 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155385856 [----] I, [2016-09-13T05:43:32.572768 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T05:43:32.572838 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T05:43:32.572906 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T05:43:32.572972 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T05:43:32.573037 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T05:43:32.573102 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T05:43:32.573165 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T05:43:32.573294 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T05:43:32.573368 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T05:43:32.613279 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T05:43:32.613600 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T05:43:32.618680 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T05:43:32.621600 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T05:43:32.625096 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T05:43:32.628678 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T05:43:32.631950 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T05:43:32.634954 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 840 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T05:43:32.637997 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T05:43:32.641380 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T05:43:32.644631 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.6 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T05:43:32.647779 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T05:43:32.651469 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T05:43:32.656630 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T05:43:32.660243 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:43:32.660392 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:43:32.660535 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T05:43:32.664683 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [202019000], Memory % [5.27], CPU Time [149356.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T05:43:32.665039 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76948], State: [ok], Delivered in [0.096185067] seconds [----] I, [2016-09-13T05:43:36.877604 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker.sync_workers) Workers are being synchronized: Current: ["ems_15"], Desired: ["ems_15", "ems_16"] [----] I, [2016-09-13T05:43:36.974791 #2763:34713c] INFO -- : :kill_algorithm: [----] I, [2016-09-13T05:43:36.974915 #2763:34713c] INFO -- : :name: :used_swap_percent_gt_value [----] I, [2016-09-13T05:43:36.974977 #2763:34713c] INFO -- : :value: 80 [----] I, [2016-09-13T05:43:36.975015 #2763:34713c] INFO -- : :miq_server_time_threshold: 120 [----] I, [2016-09-13T05:43:36.975049 #2763:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T05:43:36.975096 #2763:34713c] INFO -- : :poll: 2 [----] I, [2016-09-13T05:43:36.975128 #2763:34713c] INFO -- : :start_algorithm: [----] I, [2016-09-13T05:43:36.975174 #2763:34713c] INFO -- : :name: :used_swap_percent_lt_value [----] I, [2016-09-13T05:43:36.975231 #2763:34713c] INFO -- : :value: 60 [----] I, [2016-09-13T05:43:36.975265 #2763:34713c] INFO -- : :sync_interval: 1800 [----] I, [2016-09-13T05:43:36.975304 #2763:34713c] INFO -- : :wait_for_started_timeout: 600 [----] I, [2016-09-13T05:43:37.310405 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker.close_pg_sockets_inherited_from_parent) Closing socket: 21 [----] I, [2016-09-13T05:43:37.420984 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76950], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T05:43:37.421213 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#start) Worker started: ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3] [----] I, [2016-09-13T05:43:37.671328 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:43:37.672243 #3290:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T05:43:37.672308 #3290:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:43:37.672362 #3290:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:43:37.672431 #3290:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:43:37.672500 #3290:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T05:43:37.672546 #3290:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T05:43:37.672596 #3290:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:43:37.672641 #3290:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T05:43:37.672674 #3290:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:43:37.672714 #3290:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:43:37.672761 #3290:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T05:43:37.672798 #3290:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:43:37.672841 #3290:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T05:43:37.672873 #3290:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:43:37.672916 #3290:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T05:43:37.672953 #3290:34713c] INFO -- : --- [----] I, [2016-09-13T05:43:37.673365 #3290:34713c] INFO -- : :guid: 8b41dc22-7996-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:43:37.673471 #3290:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T05:43:38.279858 #2763:34713c] INFO -- : MIQ(MiqServer#clean_worker_records) SQL Record for Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [96], PID: [28071], GUID: [b49c1882-7985-11e6-87c1-fa163e7d01a3], Status: [stopped] is being deleted [----] I, [2016-09-13T05:43:38.481230 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:43:38.484638 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004071712493896484, :worker_monitor=>1.7235820293426514, :worker_dequeue=>0.006170749664306641, :total_time=>1.7341015338897705} [----] I, [2016-09-13T05:43:38.626219 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76949], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [11.567873637] seconds [----] I, [2016-09-13T05:43:38.626395 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76949], Delivering... [----] I, [2016-09-13T05:43:38.633306 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:43:29 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347147000], Memory % [5.04], CPU Time [103437.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T05:43:38.633893 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:43:37 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200497000], Memory % [3.36], CPU Time [149372.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:43:38.634335 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:43:26 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212532000], Memory % [3.5], CPU Time [48314.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T05:43:38.634828 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:43:37 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169057000], Memory % [3.14], CPU Time [50764.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:43:38.635332 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:43:27 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205283000], Memory % [3.5], CPU Time [236344.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T05:43:38.635856 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:43:36 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162407000], Memory % [3.1], CPU Time [37423.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T05:43:38.636348 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:43:36 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358684000], Memory % [5.28], CPU Time [199679.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T05:43:38.636843 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:43:37 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202014000], Memory % [3.38], CPU Time [148451.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:43:38.639493 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:43:32 UTC], Process Info: Memory Usage [587268096], Memory Size [915308544], Proportional Set Size: [424301000], Memory % [7.16], CPU Time [968.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:43:38.641581 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:43:33 UTC], Process Info: Memory Usage [579993600], Memory Size [908541952], Proportional Set Size: [419401000], Memory % [7.07], CPU Time [1496.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T05:43:38.643612 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:43:30 UTC], Process Info: Memory Usage [557531136], Memory Size [895369216], Proportional Set Size: [405222000], Memory % [6.8], CPU Time [4869.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T05:43:38.644105 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:43:36 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357919000], Memory % [5.27], CPU Time [206859.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T05:43:38.644621 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:43:38 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177787000], Memory % [3.2], CPU Time [50775.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:43:38.645056 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:43:34 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165789000], Memory % [3.16], CPU Time [38323.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T05:43:38.645378 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76949], State: [ok], Delivered in [0.018974355] seconds [----] I, [2016-09-13T05:43:39.227078 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76950], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [1.87116668] seconds [----] I, [2016-09-13T05:43:39.227279 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76950], Delivering... [----] I, [2016-09-13T05:43:39.248815 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_start"> inputs=<{:event_details=>"Worker started: ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1076, :miq_event_id=>1076, "EventStream::event_stream"=>1076, :event_stream_id=>1076}> [----] I, [2016-09-13T05:43:39.273640 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76951], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1076, :miq_event_id=>1076, "EventStream::event_stream"=>1076, :event_stream_id=>1076}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T05:43:39.274125 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76950], State: [ok], Delivered in [0.046811278] seconds [----] I, [2016-09-13T05:43:42.076897 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:43:42.094662 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76952], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:43:42.117740 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76953], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:43:42.140570 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76954], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:43:42.169259 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76955], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:43:43.494636 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:43:43.701746 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76951], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1076, :miq_event_id=>1076, "EventStream::event_stream"=>1076, :event_stream_id=>1076}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [4.444243701] seconds [----] I, [2016-09-13T05:43:43.701929 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76951], Delivering... [----] I, [2016-09-13T05:43:43.703945 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1076, :miq_event_id=>1076, "EventStream::event_stream"=>1076, :event_stream_id=>1076} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T05:43:43.709667 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1076&MiqEvent%3A%3Amiq_event=1076&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B98%5D%2C%20PID%20%5B3290%5D%2C%20GUID%20%5B8b41dc22-7996-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1076&event_type=evm_worker_start&miq_event_id=1076&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T05:43:43.747560 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1076&MiqEvent%3A%3Amiq_event=1076&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B98%5D%2C%20PID%20%5B3290%5D%2C%20GUID%20%5B8b41dc22-7996-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1076&event_type=evm_worker_start&miq_event_id=1076&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T05:43:43.753578 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76953], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.652629721] seconds [----] I, [2016-09-13T05:43:43.753904 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76953], Delivering... [----] I, [2016-09-13T05:43:43.849004 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76953], State: [ok], Delivered in [0.09511602] seconds [----] I, [2016-09-13T05:43:43.874714 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T05:43:43.894916 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76955], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.739946828] seconds [----] I, [2016-09-13T05:43:43.895121 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76955], Delivering... [----] I, [2016-09-13T05:43:43.901538 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003372669219970703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033915042877197266, :pending_vm_jobs=>0.0008182525634765625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059735774993896484} [----] I, [2016-09-13T05:43:43.901839 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76955], State: [ok], Delivered in [0.00671509] seconds [----] I, [2016-09-13T05:43:43.905557 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T05:43:43.929033 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_start] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T05:43:43.949623 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T05:43:43.955529 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T05:43:43.973474 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T05:43:43.982337 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T05:43:43.987203 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 09:43:26", os_priority: 21, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 277401600, memory_size: 578035712, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 202014000, has_active_websocket: true>] [----] I, [2016-09-13T05:43:43.987479 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_start] [----] I, [2016-09-13T05:43:44.008952 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_start] [----] I, [2016-09-13T05:43:44.009243 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_start] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T05:43:44.018361 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T05:43:44.018976 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T05:43:44.019773 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76951], State: [ok], Delivered in [0.317827487] seconds [----] I, [2016-09-13T05:43:44.177114 #3290:34713c] INFO -- : MIQ(AuthUseridPassword#validation_successful) [ExtManagementSystem] [16], previously valid/invalid on: [2016-09-13 07:43:06 UTC]/[], previous status: [Valid] [----] I, [2016-09-13T05:43:44.209464 #3290:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76956], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 16], "ems_auth_valid", {}] [----] I, [2016-09-13T05:43:44.763728 #3290:34713c] INFO -- : ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner started. ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Zone [default], Role [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket] [----] I, [2016-09-13T05:43:44.764162 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_wait_for_worker_monitor) EMS [livingontheedge.hawkular.org] as [jdoe] Checking that worker monitor has started before doing work [----] I, [2016-09-13T05:43:44.768111 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_wait_for_worker_monitor) EMS [livingontheedge.hawkular.org] as [jdoe] Starting work since worker monitor has started [----] I, [2016-09-13T05:43:44.768255 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_before_work_loop) EMS [livingontheedge.hawkular.org] as [jdoe] Queueing initial refresh for EMS. [----] I, [2016-09-13T05:43:44.797668 #3290:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76957], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T05:43:44.800571 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#worker_monitor_drb) EMS [livingontheedge.hawkular.org] as [jdoe] Initializing DRb Connection to MiqServer with ID=[1], NAME=[EVM], PID=[2763], GUID=[36647afc-71a3-11e6-838a-fa163e68952f] DRb URI=[druby://127.0.0.1:41718] [----] I, [2016-09-13T05:43:45.329808 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76952], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.248337597] seconds [----] I, [2016-09-13T05:43:45.329941 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76952], Delivering... [----] I, [2016-09-13T05:43:45.333362 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76952], State: [ok], Delivered in [0.003416858] seconds [----] I, [2016-09-13T05:43:45.351471 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76954], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.225450611] seconds [----] I, [2016-09-13T05:43:45.351577 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76954], Delivering... [----] I, [2016-09-13T05:43:45.353339 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76954], State: [ok], Delivered in [0.0017509] seconds [----] I, [2016-09-13T05:43:48.509540 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:43:48.515822 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T05:43:51.416363 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76956], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 16], "ems_auth_valid", {}], Dequeued in: [7.217538543] seconds [----] I, [2016-09-13T05:43:51.416626 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76956], Delivering... [----] I, [2016-09-13T05:43:51.431728 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"ems_auth_valid"> inputs=<{"MiqEvent::miq_event"=>1077, :miq_event_id=>1077, "EventStream::event_stream"=>1077, :event_stream_id=>1077}> [----] I, [2016-09-13T05:43:51.455612 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76958], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>16, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1077, :miq_event_id=>1077, "EventStream::event_stream"=>1077, :event_stream_id=>1077}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T05:43:51.456008 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76956], State: [ok], Delivered in [0.03937232] seconds [----] I, [2016-09-13T05:43:54.912281 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:43:54.917555 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T05:43:54.917741 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005387306213378906, :worker_monitor=>1.386199712753296, :worker_dequeue=>0.009421348571777344, :total_time=>1.4014384746551514} [----] I, [2016-09-13T05:43:54.993019 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76958], MiqWorker id: [16], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>16, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1077, :miq_event_id=>1077, "EventStream::event_stream"=>1077, :event_stream_id=>1077}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [3.550081776] seconds [----] I, [2016-09-13T05:43:54.993228 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76958], Delivering... [----] I, [2016-09-13T05:43:54.995227 #2957:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1077, :miq_event_id=>1077, "EventStream::event_stream"=>1077, :event_stream_id=>1077} for object [ManageIQ::Providers::Hawkular::MiddlewareManager.16] with state [] to Automate [----] I, [2016-09-13T05:43:55.000917 #2957:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1077&ExtManagementSystem%3A%3Aext_management_system=16&MiqEvent%3A%3Amiq_event=1077&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1077&event_type=ems_auth_valid&miq_event_id=1077&object_name=Event&vmdb_object_type=ext_management_system] [----] I, [2016-09-13T05:43:55.031453 #2957:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1077&ExtManagementSystem%3A%3Aext_management_system=16&MiqEvent%3A%3Amiq_event=1077&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1077&event_type=ems_auth_valid&miq_event_id=1077&object_name=Event&vmdb_object_type=ext_management_system ManageIQ/System] [----] I, [2016-09-13T05:43:55.121396 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T05:43:55.145808 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T05:43:55.167347 #2957:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/ems_auth_valid] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T05:43:55.193454 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T05:43:55.199593 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T05:43:55.216866 #2957:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T05:43:55.221122 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [76957], MiqWorker id: [98], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [10.440717293] seconds [----] I, [2016-09-13T05:43:55.221516 #3290:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76957], Delivering... [----] I, [2016-09-13T05:43:55.225522 #2957:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T05:43:55.229878 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#] [----] I, [2016-09-13T05:43:55.230173 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [ems_auth_valid] [----] I, [2016-09-13T05:43:55.237113 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T05:43:55.237364 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T05:43:55.237573 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T05:43:55.237810 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T05:43:55.244265 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:43:55.250377 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [ems_auth_valid] [----] I, [2016-09-13T05:43:55.250696 #2957:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [ems_auth_valid] Target: ManageIQ::Providers::Hawkular::MiddlewareManager Name: [Hawkular-Provider], Id: [16] [----] I, [2016-09-13T05:43:55.260101 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T05:43:55.260751 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T05:43:55.261623 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76958], State: [ok], Delivered in [0.268392619] seconds [----] I, [2016-09-13T05:43:57.182705 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:43:57.203338 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76959], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:43:59.918170 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:43:59 UTC]... [----] I, [2016-09-13T05:43:59.940387 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:43:59 UTC]...Complete [----] I, [2016-09-13T05:43:59.950932 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:44:00.146315 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76959], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.957935361] seconds [----] I, [2016-09-13T05:44:00.146538 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76959], Delivering... [----] I, [2016-09-13T05:44:00.152799 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032074451446533203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00322723388671875, :pending_vm_jobs=>0.0008027553558349609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005873918533325195} [----] I, [2016-09-13T05:44:00.153149 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76959], State: [ok], Delivered in [0.006609851] seconds [----] I, [2016-09-13T05:44:01.721034 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:02.037805 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:02.037992 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:02.560392 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:02.858492 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:02.858677 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:03.397844 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:03.717537 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:03.717718 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:04.216605 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:04.542940 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:04.543121 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:05.073486 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:05.381765 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:05.381937 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:05.879283 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:06.190194 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:06.190319 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:06.668015 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:06.967705 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:06.967894 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:07.449790 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:07.777941 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:07.778114 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:08.281730 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:08.576454 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:08.576637 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:09.063606 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:09.367408 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:09.367694 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:09.869002 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:10.183583 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:10.183738 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:10.669129 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:10.981733 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:10.981910 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:11.443705 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005242347717285156, :worker_monitor=>1.454606533050537, :worker_dequeue=>0.011100053787231445, :total_time=>1.4713830947875977} [----] I, [2016-09-13T05:44:11.522305 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:12.216619 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:44:12.238863 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76960], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:44:12.254864 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76961], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:44:16.454473 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:44:17.277959 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76961], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.033253556] seconds [----] I, [2016-09-13T05:44:17.278130 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76961], Delivering... [----] I, [2016-09-13T05:44:17.284321 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031516551971435547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031709671020507812, :pending_vm_jobs=>0.0008492469787597656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005845308303833008} [----] I, [2016-09-13T05:44:17.284693 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76961], State: [ok], Delivered in [0.006555162] seconds [----] I, [2016-09-13T05:44:17.885870 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:17.886055 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:18.342829 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:18.474234 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76960], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.246638115] seconds [----] I, [2016-09-13T05:44:18.474494 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76960], Delivering... [----] I, [2016-09-13T05:44:18.479815 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76960], State: [ok], Delivered in [0.005344634] seconds [----] I, [2016-09-13T05:44:18.507260 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:18.651715 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:18.795944 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:18.942459 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:19.083824 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:19.226648 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:19.373329 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:19.514191 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:19.657246 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:19.790219 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:19.933207 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:20.072319 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:20.217315 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:20.369293 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:20.822677 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:20.965146 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:21.102744 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:21.244072 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:21.386146 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:21.528762 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:21.672724 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:21.812730 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:21.953353 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:22.098349 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:22.246276 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:22.398584 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:22.546730 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:22.684495 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:22.827309 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:22.977753 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:23.132699 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:23.526803 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:23.686437 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:23.829334 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:23.971111 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:24.106540 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:24.245291 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:24.391675 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:24.529583 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:24.670587 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:24.812077 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:24.960632 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:25.111048 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:25.252498 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:25.398057 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:25.544410 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:25.683986 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:25.821909 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:26.216274 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:26.390605 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:26.536487 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:26.678253 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:26.827237 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:26.969252 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:27.113142 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:27.258756 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:27.289878 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:44:27.306398 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76962], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:44:27.395388 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:27.531919 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:27.668590 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:27.782338 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:44:27.786347 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006208658218383789, :worker_monitor=>1.2942533493041992, :worker_dequeue=>0.007181406021118164, :total_time=>1.3080832958221436} [----] I, [2016-09-13T05:44:27.809169 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:27.948270 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:28.090354 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:28.235725 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:28.375146 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76962], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.077997113] seconds [----] I, [2016-09-13T05:44:28.375343 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76962], Delivering... [----] I, [2016-09-13T05:44:28.381564 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031905174255371094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032105445861816406, :pending_vm_jobs=>0.0008180141448974609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058476924896240234} [----] I, [2016-09-13T05:44:28.381909 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76962], State: [ok], Delivered in [0.006558526] seconds [----] I, [2016-09-13T05:44:28.385230 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:28.523390 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:28.988864 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:32.786812 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:44:32 UTC]... [----] I, [2016-09-13T05:44:32.815012 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:44:32 UTC]...Complete [----] I, [2016-09-13T05:44:35.157742 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:35.291781 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:35.429593 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:35.568027 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:35.710127 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:35.850638 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:36.000334 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:36.144803 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:36.283407 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:36.425122 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:36.568740 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:36.709944 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:36.855506 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:36.998909 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:37.135187 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:37.345196 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:37.892069 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:38.044678 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:38.187680 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:38.332722 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:38.483782 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:38.621477 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:38.762229 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:38.902050 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:39.046361 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:39.195699 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:39.343225 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:39.491147 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:39.639147 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:39.789348 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:39.940613 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:40.080020 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:40.227705 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:40.640156 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:40.787210 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:40.933406 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:41.084678 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:41.224282 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:41.371247 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:41.519652 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:41.662910 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:41.817243 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:41.963275 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:42.124605 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:42.267384 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:42.318854 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:44:42.335319 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76963], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:44:42.346632 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76964], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:44:42.358079 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76965], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:44:42.375225 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76966], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:44:42.409264 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:42.550040 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:42.699014 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:42.873478 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:43.008576 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:43.482243 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:43.648362 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:43.791930 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:43.942525 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:44.077770 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:44.217362 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:44.352662 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:44.501924 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:44.518679 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:44:44.528584 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004525661468505859, :worker_monitor=>1.5596075057983398, :worker_dequeue=>0.015441179275512695, :total_time=>1.5798900127410889} [----] I, [2016-09-13T05:44:44.547041 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76964], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.206314723] seconds [----] I, [2016-09-13T05:44:44.547262 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76964], Delivering... [----] I, [2016-09-13T05:44:44.604087 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76964], State: [ok], Delivered in [0.05680075] seconds [----] I, [2016-09-13T05:44:44.652459 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:44.653107 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76966], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.285281204] seconds [----] I, [2016-09-13T05:44:44.653342 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76966], Delivering... [----] I, [2016-09-13T05:44:44.660078 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003639698028564453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003659963607788086, :pending_vm_jobs=>0.0008015632629394531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006329059600830078} [----] I, [2016-09-13T05:44:44.660495 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76966], State: [ok], Delivered in [0.007143345] seconds [----] I, [2016-09-13T05:44:44.794016 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:44.940830 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:45.078097 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:45.216504 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:45.360121 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:45.500922 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:45.564269 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76963], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.239529987] seconds [----] I, [2016-09-13T05:44:45.564541 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76963], Delivering... [----] I, [2016-09-13T05:44:45.569966 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76963], State: [ok], Delivered in [0.005404768] seconds [----] I, [2016-09-13T05:44:45.575832 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76965], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.223445115] seconds [----] I, [2016-09-13T05:44:45.576132 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76965], Delivering... [----] I, [2016-09-13T05:44:45.580861 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76965], State: [ok], Delivered in [0.004728929] seconds [----] I, [2016-09-13T05:44:45.645120 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:51.800977 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:52.316288 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:52.713030 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:52.846450 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:52.984829 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:53.131287 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:53.270865 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:53.413603 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:53.552899 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:53.702235 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:53.855006 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:54.024005 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:54.162785 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:54.306161 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:54.458107 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:54.610022 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:54.747364 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:54.901516 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:55.318201 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:55.481488 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:55.637385 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:55.776780 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:55.921697 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:56.070566 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:56.210918 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:56.372271 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:56.516786 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:56.670819 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:56.809407 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:56.949910 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:57.093019 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:57.228528 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:57.407731 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:57.568169 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:57.720695 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:57.734975 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:44:57.792535 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76967], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:44:58.462395 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:58.776393 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:58.946853 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:59.085611 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:59.224059 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:59.369905 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:59.523495 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:59.684264 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:59.839412 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:44:59.988669 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:00.125194 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:00.265746 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:00.466391 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:00.609503 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:00.749827 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:45:00.751807 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:00.754548 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006565570831298828, :worker_monitor=>1.1810252666473389, :worker_dequeue=>0.008213996887207031, :total_time=>1.1961555480957031} [----] I, [2016-09-13T05:45:00.781230 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76967], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.000281147] seconds [----] I, [2016-09-13T05:45:00.781446 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76967], Delivering... [----] I, [2016-09-13T05:45:00.787577 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003096342086791992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031173229217529297, :pending_vm_jobs=>0.0008249282836914062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005747079849243164} [----] I, [2016-09-13T05:45:00.787905 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76967], State: [ok], Delivered in [0.006483209] seconds [----] I, [2016-09-13T05:45:00.886291 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:01.035871 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:01.481006 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:01.645977 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:01.787347 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:01.944796 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:02.080620 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:02.244884 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:02.384643 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:02.527142 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:02.673598 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:05.755001 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:45:05 UTC]... [----] I, [2016-09-13T05:45:05.798322 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:45:05 UTC]...Complete [----] I, [2016-09-13T05:45:08.820027 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:08.967278 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:09.111003 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:09.256270 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:09.400070 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:09.545542 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:12.811371 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:45:12.838558 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76968], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:45:12.855727 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76969], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:45:14.839252 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:14.973958 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:15.358076 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:15.518904 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:15.660557 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:15.814213 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:15.948401 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:16.089081 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:16.232798 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:16.374640 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:16.521820 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:16.659138 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:16.801911 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:16.942627 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:17.083290 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:17.221494 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:17.237838 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:45:17.244152 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004464149475097656, :worker_monitor=>1.3969082832336426, :worker_dequeue=>0.011435270309448242, :total_time=>1.4131171703338623} [----] I, [2016-09-13T05:45:17.361380 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:17.497703 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:17.633701 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:17.678772 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76969], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.834605384] seconds [----] I, [2016-09-13T05:45:17.678972 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76969], Delivering... [----] I, [2016-09-13T05:45:17.685510 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003490447998046875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035102367401123047, :pending_vm_jobs=>0.0008096694946289062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00616455078125} [----] I, [2016-09-13T05:45:17.685794 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76969], State: [ok], Delivered in [0.0068361] seconds [----] I, [2016-09-13T05:45:18.190605 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:18.368412 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:18.513802 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:18.660156 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:18.695807 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76968], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.879976489] seconds [----] I, [2016-09-13T05:45:18.695963 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76968], Delivering... [----] I, [2016-09-13T05:45:18.700054 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76968], State: [ok], Delivered in [0.004064827] seconds [----] I, [2016-09-13T05:45:18.801493 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:18.942014 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:19.083007 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:19.219665 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:19.361294 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:19.524482 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:19.673938 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:19.807222 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:19.947030 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:20.091436 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:20.233056 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:20.392623 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:45:20.554164 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T05:45:20.758072 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T05:45:20.758683 #3290:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T05:45:20.759225 #3290:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T05:45:20.759450 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T05:45:20.759761 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T05:45:20.800693 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T05:45:20.801244 #3290:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [76957], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T05:45:20.801568 #3290:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T05:45:20.801844 #3290:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T05:45:20.802085 #3290:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76957], State: [error], Delivered in [85.580644165] seconds [----] I, [2016-09-13T05:45:27.867872 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:45:27.884276 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76970], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:45:33.601815 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:45:33.608896 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004694938659667969, :worker_monitor=>1.3105170726776123, :worker_dequeue=>0.012603759765625, :total_time=>1.3281352519989014} [----] I, [2016-09-13T05:45:33.759076 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76970], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.885124982] seconds [----] I, [2016-09-13T05:45:33.759308 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76970], Delivering... [----] I, [2016-09-13T05:45:33.766769 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003646373748779297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037088394165039062, :pending_vm_jobs=>0.0013990402221679688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0070192813873291016} [----] I, [2016-09-13T05:45:33.767089 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76970], State: [ok], Delivered in [0.007782565] seconds [----] I, [2016-09-13T05:45:38.609491 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:45:38 UTC]... [----] I, [2016-09-13T05:45:38.627031 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:45:38 UTC]...Complete [----] I, [2016-09-13T05:45:42.897828 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:45:42.918960 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76971], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:45:42.929996 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76972], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:45:42.941451 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76973], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:45:42.958676 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76974], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:45:43.742737 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:45:43.861743 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76972], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.938280668] seconds [----] I, [2016-09-13T05:45:43.861917 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76972], Delivering... [----] I, [2016-09-13T05:45:43.918842 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76972], State: [ok], Delivered in [0.056892737] seconds [----] I, [2016-09-13T05:45:43.964502 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76974], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.013172606] seconds [----] I, [2016-09-13T05:45:43.964681 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76974], Delivering... [----] I, [2016-09-13T05:45:43.970333 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030219554901123047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030412673950195312, :pending_vm_jobs=>0.0007166862487792969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00535130500793457} [----] I, [2016-09-13T05:45:43.970676 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76974], State: [ok], Delivered in [0.006001359] seconds [----] I, [2016-09-13T05:45:45.793153 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76971], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.889084759] seconds [----] I, [2016-09-13T05:45:45.793367 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76971], Delivering... [----] I, [2016-09-13T05:45:45.798044 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76971], State: [ok], Delivered in [0.004666719] seconds [----] I, [2016-09-13T05:45:45.821712 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76973], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.885777597] seconds [----] I, [2016-09-13T05:45:45.821884 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76973], Delivering... [----] I, [2016-09-13T05:45:45.829276 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76973], State: [ok], Delivered in [0.007385522] seconds [----] I, [2016-09-13T05:45:49.775747 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005036354064941406, :worker_monitor=>1.001875400543213, :worker_dequeue=>0.0185854434967041, :total_time=>1.0258681774139404} [----] I, [2016-09-13T05:45:57.971699 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:45:57.992585 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76975], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:45:59.797061 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:46:00.141470 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76975], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.163541117] seconds [----] I, [2016-09-13T05:46:00.141734 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76975], Delivering... [----] I, [2016-09-13T05:46:00.151353 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004917621612548828, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004945993423461914, :pending_vm_jobs=>0.0012199878692626953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009068489074707031} [----] I, [2016-09-13T05:46:00.151888 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76975], State: [ok], Delivered in [0.010148673] seconds [----] I, [2016-09-13T05:46:06.131364 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004050254821777344, :worker_monitor=>1.3126494884490967, :worker_dequeue=>0.009873628616333008, :total_time=>1.3269360065460205} [----] I, [2016-09-13T05:46:11.131930 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:46:11 UTC]... [----] I, [2016-09-13T05:46:11.147672 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:46:11 UTC]...Complete [----] I, [2016-09-13T05:46:13.007877 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:46:13.045229 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76976], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:46:13.062240 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76977], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:46:16.174219 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:46:16.273703 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76977], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.220850437] seconds [----] I, [2016-09-13T05:46:16.273853 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76977], Delivering... [----] I, [2016-09-13T05:46:16.278553 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026361942291259766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002649068832397461, :pending_vm_jobs=>0.0005404949188232422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004408359527587891} [----] I, [2016-09-13T05:46:16.278825 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76977], State: [ok], Delivered in [0.004972707] seconds [----] I, [2016-09-13T05:46:18.931530 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76976], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.915081536] seconds [----] I, [2016-09-13T05:46:18.931752 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76976], Delivering... [----] I, [2016-09-13T05:46:18.936818 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76976], State: [ok], Delivered in [0.005067233] seconds [----] I, [2016-09-13T05:46:22.693611 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005864143371582031, :worker_monitor=>1.4956316947937012, :worker_dequeue=>0.011006355285644531, :total_time=>1.5129420757293701} [----] I, [2016-09-13T05:46:28.074962 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:46:28.091103 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76978], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:46:32.719936 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:46:33.456549 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76978], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.375816736] seconds [----] I, [2016-09-13T05:46:33.456676 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76978], Delivering... [----] I, [2016-09-13T05:46:33.461076 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002328634262084961, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023431777954101562, :pending_vm_jobs=>0.0005500316619873047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0041315555572509766} [----] I, [2016-09-13T05:46:33.461359 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76978], State: [ok], Delivered in [0.004669964] seconds [----] I, [2016-09-13T05:46:39.095254 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005218029022216797, :worker_monitor=>1.3507130146026611, :worker_dequeue=>0.011414527893066406, :total_time=>1.3677358627319336} [----] I, [2016-09-13T05:46:43.101410 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:46:43.119730 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76979], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:46:43.130792 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76980], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:46:43.142454 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76981], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:46:43.159931 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76982], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:46:44.095784 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:46:44 UTC]... [----] I, [2016-09-13T05:46:44.113974 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:46:44 UTC]...Complete [----] I, [2016-09-13T05:46:44.224660 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:46:44.571279 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76980], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.448851513] seconds [----] I, [2016-09-13T05:46:44.571481 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76980], Delivering... [----] I, [2016-09-13T05:46:44.576892 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76982], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.425152912] seconds [----] I, [2016-09-13T05:46:44.577056 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76982], Delivering... [----] I, [2016-09-13T05:46:44.583397 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034415721893310547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003459453582763672, :pending_vm_jobs=>0.0007829666137695312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060100555419921875} [----] I, [2016-09-13T05:46:44.583837 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76982], State: [ok], Delivered in [0.006772817] seconds [----] I, [2016-09-13T05:46:44.616623 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76980], State: [ok], Delivered in [0.045162407] seconds [----] I, [2016-09-13T05:46:46.011188 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76981], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.877048187] seconds [----] I, [2016-09-13T05:46:46.011368 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76981], Delivering... [----] I, [2016-09-13T05:46:46.018784 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76981], State: [ok], Delivered in [0.007405932] seconds [----] I, [2016-09-13T05:46:46.023226 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76979], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.918851564] seconds [----] I, [2016-09-13T05:46:46.023522 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76979], Delivering... [----] I, [2016-09-13T05:46:46.030609 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76979], State: [ok], Delivered in [0.007106873] seconds [----] I, [2016-09-13T05:46:55.557648 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0055501461029052734, :worker_monitor=>1.2934675216674805, :worker_dequeue=>0.007691383361816406, :total_time=>1.3070447444915771} [----] I, [2016-09-13T05:46:58.172162 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:46:58.188324 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76983], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:47:00.567707 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:47:00.750126 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76983], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.572156759] seconds [----] I, [2016-09-13T05:47:00.750354 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76983], Delivering... [----] I, [2016-09-13T05:47:00.756766 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033299922943115234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003348112106323242, :pending_vm_jobs=>0.0007851123809814453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005957603454589844} [----] I, [2016-09-13T05:47:00.757122 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76983], State: [ok], Delivered in [0.006780101] seconds [----] I, [2016-09-13T05:47:11.753958 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00394129753112793, :worker_monitor=>1.146529197692871, :worker_dequeue=>0.008114337921142578, :total_time=>1.1589300632476807} [----] I, [2016-09-13T05:47:13.201628 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:47:13.228485 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76984], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:47:13.245439 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76985], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:47:16.754609 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:47:16 UTC]... [----] I, [2016-09-13T05:47:16.782380 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:47:16 UTC]...Complete [----] I, [2016-09-13T05:47:16.795332 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:47:16.840079 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76985], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.60572853] seconds [----] I, [2016-09-13T05:47:16.840391 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76985], Delivering... [----] I, [2016-09-13T05:47:16.851332 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00553584098815918, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005571126937866211, :pending_vm_jobs=>0.00139617919921875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.01025080680847168} [----] I, [2016-09-13T05:47:16.851908 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76985], State: [ok], Delivered in [0.011513502] seconds [----] I, [2016-09-13T05:47:19.137938 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76984], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.93213428] seconds [----] I, [2016-09-13T05:47:19.138203 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76984], Delivering... [----] I, [2016-09-13T05:47:19.142974 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76984], State: [ok], Delivered in [0.00480266] seconds [----] I, [2016-09-13T05:47:28.233631 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00438380241394043, :worker_monitor=>1.4014360904693604, :worker_dequeue=>0.008970022201538086, :total_time=>1.4151372909545898} [----] I, [2016-09-13T05:47:28.257848 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:47:28.274031 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76986], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:47:33.252016 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T05:47:33.257882 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:47:33.988601 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76986], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.724635879] seconds [----] I, [2016-09-13T05:47:33.988790 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76986], Delivering... [----] I, [2016-09-13T05:47:33.995442 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035636425018310547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035843849182128906, :pending_vm_jobs=>0.0008194446563720703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006276369094848633} [----] I, [2016-09-13T05:47:33.995835 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76986], State: [ok], Delivered in [0.007027204] seconds [----] I, [2016-09-13T05:47:43.286220 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:47:43.296910 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76987], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:47:43.308130 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76988], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:47:43.321691 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76989], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:47:43.336820 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76990], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:47:44.532959 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:47:44.539524 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040895938873291016, :worker_monitor=>1.2369821071624756, :worker_dequeue=>0.011991262435913086, :total_time=>1.253361463546753} [----] I, [2016-09-13T05:47:45.052375 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76988], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.751289652] seconds [----] I, [2016-09-13T05:47:45.052609 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76988], Delivering... [----] I, [2016-09-13T05:47:45.099941 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76990], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.768584191] seconds [----] I, [2016-09-13T05:47:45.100148 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76990], Delivering... [----] I, [2016-09-13T05:47:45.106572 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003337383270263672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033583641052246094, :pending_vm_jobs=>0.0007967948913574219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006020545959472656} [----] I, [2016-09-13T05:47:45.106904 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76990], State: [ok], Delivered in [0.006748428] seconds [----] I, [2016-09-13T05:47:45.120341 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76988], State: [ok], Delivered in [0.067668258] seconds [----] I, [2016-09-13T05:47:46.257110 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76987], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.966059596] seconds [----] I, [2016-09-13T05:47:46.257310 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76987], Delivering... [----] I, [2016-09-13T05:47:46.261821 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76987], State: [ok], Delivered in [0.004501869] seconds [----] I, [2016-09-13T05:47:46.269438 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76989], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.955710516] seconds [----] I, [2016-09-13T05:47:46.269567 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76989], Delivering... [----] I, [2016-09-13T05:47:46.272683 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76989], State: [ok], Delivered in [0.003092147] seconds [----] I, [2016-09-13T05:47:49.539986 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:47:49 UTC]... [----] I, [2016-09-13T05:47:49.554952 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:47:49 UTC]...Complete [----] I, [2016-09-13T05:47:58.352130 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:47:58.372698 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76991], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:48:01.911310 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:48:01.917840 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0052716732025146484, :worker_monitor=>2.2230868339538574, :worker_dequeue=>0.011660337448120117, :total_time=>2.2405614852905273} [----] I, [2016-09-13T05:48:02.303565 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76991], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.945049623] seconds [----] I, [2016-09-13T05:48:02.303896 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76991], Delivering... [----] I, [2016-09-13T05:48:02.311901 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004639387130737305, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004791736602783203, :pending_vm_jobs=>0.0008366107940673828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007427215576171875} [----] I, [2016-09-13T05:48:02.312323 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76991], State: [ok], Delivered in [0.00845502] seconds [----] I, [2016-09-13T05:48:13.386353 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:48:13.405859 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76992], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:48:13.428874 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76993], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:48:18.839764 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:48:18.843073 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0046689510345458984, :worker_monitor=>1.8877887725830078, :worker_dequeue=>0.006062030792236328, :total_time=>1.8989472389221191} [----] I, [2016-09-13T05:48:19.429461 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76992], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.038309488] seconds [----] I, [2016-09-13T05:48:19.429677 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76992], Delivering... [----] I, [2016-09-13T05:48:19.435064 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76992], State: [ok], Delivered in [0.005362939] seconds [----] I, [2016-09-13T05:48:19.454193 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76993], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.042144692] seconds [----] I, [2016-09-13T05:48:19.454473 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76993], Delivering... [----] I, [2016-09-13T05:48:19.461579 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003943443298339844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003977775573730469, :pending_vm_jobs=>0.0008533000946044922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0066699981689453125} [----] I, [2016-09-13T05:48:19.462043 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76993], State: [ok], Delivered in [0.007586355] seconds [----] I, [2016-09-13T05:48:23.843497 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:48:23 UTC]... [----] I, [2016-09-13T05:48:23.863711 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:48:23 UTC]...Complete [----] I, [2016-09-13T05:48:28.441378 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:48:28.458029 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76994], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:48:28.480256 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76995], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:48:28.508766 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76996], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:48:28.893654 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:48:29.521408 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76994], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.075943314] seconds [----] I, [2016-09-13T05:48:29.521607 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [76994], Delivering... [----] I, [2016-09-13T05:48:29.527306 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030670166015625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030832290649414062, :pending_vm_jobs=>0.0007097721099853516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005391120910644531} [----] I, [2016-09-13T05:48:29.527650 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [76994], State: [ok], Delivered in [0.006027833] seconds [----] I, [2016-09-13T05:48:29.573328 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76995], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.112452643] seconds [----] I, [2016-09-13T05:48:29.573583 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76995], Delivering... [----] I, [2016-09-13T05:48:29.574820 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T05:48:29.575105 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5338882048 [----] I, [2016-09-13T05:48:29.575294 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5120495616 [----] I, [2016-09-13T05:48:29.575472 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 218386432 [----] I, [2016-09-13T05:48:29.575627 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1319108608 [----] I, [2016-09-13T05:48:29.575759 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5066534912 [----] I, [2016-09-13T05:48:29.575874 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T05:48:29.576001 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T05:48:29.576128 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 539443200 [----] I, [2016-09-13T05:48:29.576294 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T05:48:29.576444 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7955767296 [----] I, [2016-09-13T05:48:29.576596 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T05:48:29.576731 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T05:48:29.576864 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T05:48:29.576990 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 12288 [----] I, [2016-09-13T05:48:29.577124 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T05:48:29.577278 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T05:48:29.577409 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T05:48:29.577565 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T05:48:29.577677 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T05:48:29.577792 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T05:48:29.577910 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273309696 [----] I, [2016-09-13T05:48:29.578041 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56414208 [----] I, [2016-09-13T05:48:29.578159 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216895488 [----] I, [2016-09-13T05:48:29.578304 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T05:48:29.578446 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140894208 [----] I, [2016-09-13T05:48:29.578606 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2601152512 [----] I, [2016-09-13T05:48:29.578731 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2287706112 [----] I, [2016-09-13T05:48:29.578850 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T05:48:29.578967 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T05:48:29.579081 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T05:48:29.579211 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37384192 [----] I, [2016-09-13T05:48:29.579330 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102293504 [----] I, [2016-09-13T05:48:29.579482 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53145600 [----] I, [2016-09-13T05:48:29.579620 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110383104 [----] I, [2016-09-13T05:48:29.579731 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155439104 [----] I, [2016-09-13T05:48:29.579842 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T05:48:29.579950 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T05:48:29.580051 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T05:48:29.580178 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T05:48:29.580310 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T05:48:29.580458 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T05:48:29.580599 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T05:48:29.580727 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T05:48:29.580842 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T05:48:29.600635 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76996], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.117272002] seconds [----] I, [2016-09-13T05:48:29.600853 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [76996], Delivering... [----] I, [2016-09-13T05:48:29.609542 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:48:18 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202018000], Memory % [3.38], CPU Time [148540.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:48:29.610085 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:48:13 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205291000], Memory % [3.5], CPU Time [236498.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T05:48:29.610551 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:48:17 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347147000], Memory % [5.04], CPU Time [103451.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T05:48:29.611056 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:48:14 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [48321.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T05:48:29.611640 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:48:16 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162418000], Memory % [3.1], CPU Time [37432.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T05:48:29.612098 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:48:18 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [149461.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:48:29.612599 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:48:16 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [199712.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T05:48:29.613067 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:48:17 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50780.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:48:29.615944 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:48:11 UTC], Process Info: Memory Usage [600252416], Memory Size [1025564672], Proportional Set Size: [435049000], Memory % [7.32], CPU Time [286.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:48:29.617892 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:48:12 UTC], Process Info: Memory Usage [587268096], Memory Size [915308544], Proportional Set Size: [424321000], Memory % [7.16], CPU Time [978.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:48:29.619918 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:48:11 UTC], Process Info: Memory Usage [557801472], Memory Size [909524992], Proportional Set Size: [405478000], Memory % [6.8], CPU Time [4879.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T05:48:29.621610 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T05:48:29.621771 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T05:48:29.622018 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:48:13 UTC], Process Info: Memory Usage [580206592], Memory Size [922173440], Proportional Set Size: [419648000], Memory % [7.07], CPU Time [1508.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T05:48:29.622569 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:48:16 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [206886.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T05:48:29.623041 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:48:17 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [50789.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:48:29.623524 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:48:10 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38332.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T05:48:29.623932 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76996], State: [ok], Delivered in [0.023061957] seconds [----] I, [2016-09-13T05:48:29.624845 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T05:48:29.627063 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T05:48:29.630254 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T05:48:29.634685 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T05:48:29.639534 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T05:48:29.644407 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 840 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T05:48:29.648310 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T05:48:29.651256 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T05:48:29.654087 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T05:48:29.656782 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T05:48:29.659390 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T05:48:29.661931 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T05:48:29.664479 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>2}} [----] I, [2016-09-13T05:48:29.664611 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:48:29.664702 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T05:48:29.668576 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [202018000], Memory % [3.36], CPU Time [148531.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:48:29.668941 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [76995], State: [ok], Delivered in [0.095359411] seconds [----] I, [2016-09-13T05:48:35.461394 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004009723663330078, :worker_monitor=>1.5462849140167236, :worker_dequeue=>0.00669407844543457, :total_time=>1.5572733879089355} [----] I, [2016-09-13T05:48:43.520078 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:48:43.538482 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76997], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:48:43.561289 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76998], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:48:43.584190 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [76999], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:48:43.607005 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77000], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:48:45.486615 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:48:45.836228 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [76998], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.293680023] seconds [----] I, [2016-09-13T05:48:45.836478 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76998], Delivering... [----] I, [2016-09-13T05:48:45.864457 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77000], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.273177562] seconds [----] I, [2016-09-13T05:48:45.864654 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77000], Delivering... [----] I, [2016-09-13T05:48:45.870907 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003358602523803711, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003376483917236328, :pending_vm_jobs=>0.0007791519165039062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005918264389038086} [----] I, [2016-09-13T05:48:45.871262 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77000], State: [ok], Delivered in [0.006604495] seconds [----] I, [2016-09-13T05:48:45.898815 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76998], State: [ok], Delivered in [0.062323744] seconds [----] I, [2016-09-13T05:48:46.510399 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76997], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.984521836] seconds [----] I, [2016-09-13T05:48:46.510729 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76997], Delivering... [----] I, [2016-09-13T05:48:46.516459 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76997], State: [ok], Delivered in [0.005695063] seconds [----] I, [2016-09-13T05:48:46.550295 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [76999], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.984328985] seconds [----] I, [2016-09-13T05:48:46.550528 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [76999], Delivering... [----] I, [2016-09-13T05:48:46.553581 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [76999], State: [ok], Delivered in [0.003057068] seconds [----] I, [2016-09-13T05:48:52.006966 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0027315616607666016, :server_monitor=>0.057723045349121094, :worker_monitor=>1.4381582736968994, :worker_dequeue=>0.013307571411132812, :total_time=>1.512225866317749} [----] I, [2016-09-13T05:48:57.007451 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:48:57 UTC]... [----] I, [2016-09-13T05:48:57.024186 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:48:57 UTC]...Complete [----] I, [2016-09-13T05:48:58.615944 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:48:58.635730 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77001], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:49:02.048950 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:49:03.059279 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77001], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.438257953] seconds [----] I, [2016-09-13T05:49:03.059519 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77001], Delivering... [----] I, [2016-09-13T05:49:03.065969 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003448486328125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034694671630859375, :pending_vm_jobs=>0.0007517337799072266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006044626235961914} [----] I, [2016-09-13T05:49:03.066321 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77001], State: [ok], Delivered in [0.00680724] seconds [----] I, [2016-09-13T05:49:08.566930 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0027360916137695312, :worker_monitor=>1.4954192638397217, :worker_dequeue=>0.012657403945922852, :total_time=>1.5110740661621094} [----] I, [2016-09-13T05:49:13.647712 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 11. [----] I, [2016-09-13T05:49:13.676039 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77002], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:49:13.698684 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77003], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:49:13.723248 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77004], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:49:18.596734 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:49:19.161859 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77004], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.45752091] seconds [----] I, [2016-09-13T05:49:19.162053 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77004], Delivering... [----] I, [2016-09-13T05:49:19.168364 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003350973129272461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003373861312866211, :pending_vm_jobs=>0.0007703304290771484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005925893783569336} [----] I, [2016-09-13T05:49:19.168730 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77004], State: [ok], Delivered in [0.006675601] seconds [----] I, [2016-09-13T05:49:19.648122 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77002], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.988011153] seconds [----] I, [2016-09-13T05:49:19.648455 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77002], Delivering... [----] I, [2016-09-13T05:49:19.655117 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77002], State: [ok], Delivered in [0.006681321] seconds [----] I, [2016-09-13T05:49:19.699808 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77003], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.013958245] seconds [----] I, [2016-09-13T05:49:19.700111 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77003], Delivering... [----] I, [2016-09-13T05:49:19.739387 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77005], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T05:49:19.768150 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77006], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T05:49:19.768661 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77003], State: [ok], Delivered in [0.06856645] seconds [----] I, [2016-09-13T05:49:25.233928 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T05:49:25.235380 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T05:49:25.235538 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005238056182861328, :worker_monitor=>1.612992286682129, :worker_dequeue=>0.012932062149047852, :total_time=>1.6315715312957764} [----] I, [2016-09-13T05:49:28.733000 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:49:28.750537 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77007], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:49:28.763659 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77008], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:49:30.235973 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:49:30 UTC]... [----] I, [2016-09-13T05:49:30.259683 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:49:30 UTC]...Complete [----] I, [2016-09-13T05:49:30.267212 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:49:30.269658 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T05:49:30.270942 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T05:49:31.202820 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [77006], MiqWorker id: [98], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [11.456971535] seconds [----] I, [2016-09-13T05:49:31.203041 #3290:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77006], Delivering... [----] I, [2016-09-13T05:49:31.206886 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T05:49:31.207052 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T05:49:31.207199 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T05:49:31.207361 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T05:49:31.207544 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:31.276477 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77007], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.53692478] seconds [----] I, [2016-09-13T05:49:31.276675 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77007], Delivering... [----] I, [2016-09-13T05:49:31.282638 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030934810638427734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031113624572753906, :pending_vm_jobs=>0.0007662773132324219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005635261535644531} [----] I, [2016-09-13T05:49:31.282964 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77007], State: [ok], Delivered in [0.006284065] seconds [----] I, [2016-09-13T05:49:31.639017 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:31.723272 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77008], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.968185688] seconds [----] I, [2016-09-13T05:49:31.723497 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77008], Delivering... [----] I, [2016-09-13T05:49:31.811106 #2937:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 09:49:30 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_16' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 09:49:30.269856') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2927,,2016-09-13 09:49:31 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2936,,2016-09-13 09:49:28 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2946,2016-09-13 09:49:31 UTC,2016-09-13 09:49:31 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 09:49:31 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 09:49:31 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 09:49:29 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2986,,2016-09-13 09:49:29 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2997,,2016-09-13 09:49:28 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 09:49:13.727481')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 3011,,2016-09-13 09:24:09 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1522, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,502326, 3030,,2016-09-13 08:24:00 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5131, 3054,,2016-09-13 09:24:13 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1518, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,502325, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,502324, 3160,,2016-09-13 09:24:16 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1515, 3298,,2016-09-13 09:49:31 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 703,,2016-09-13 09:24:09 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1522, 27056,,2016-09-13 08:53:59 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3332, 28888,,2016-09-13 08:54:02 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3329, 20394,,2016-09-13 09:24:12 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1519, 30096,,2016-09-13 09:49:22 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,8, ACTIVITY_STATS_CSV [----] I, [2016-09-13T05:49:31.811536 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77008], State: [ok], Delivered in [0.088042062] seconds [----] I, [2016-09-13T05:49:31.992102 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:31.992291 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:32.486865 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:32.803505 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:32.803653 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:32.894077 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [77005], MiqWorker id: [97], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [13.171783826] seconds [----] I, [2016-09-13T05:49:32.894313 #30088:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77005], Delivering... [----] I, [2016-09-13T05:49:32.898130 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T05:49:32.898336 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T05:49:32.898487 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T05:49:32.898662 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T05:49:32.898822 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:33.182215 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:33.277575 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:33.382624 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:33.382904 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:33.587491 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:33.587746 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:33.722452 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:33.827770 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:33.920122 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:34.127019 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:34.222442 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:34.327130 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:34.420773 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:34.428182 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:34.428370 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:34.513788 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:34.606142 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:34.698875 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:34.793245 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:34.886565 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:34.902664 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:34.979644 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:35.073936 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:35.167461 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:35.218606 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:35.219128 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:35.260823 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:35.358598 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:35.452810 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:35.546293 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:35.639391 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:35.732686 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T05:49:35.738642 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:35.960898 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T05:49:35.961118 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.0040798187255859375, :collect_inventory_for_targets=>0.00012540817260742188, :parse_legacy_inventory=>23.95740056037903, :parse_targeted_inventory=>23.957578420639038, :save_inventory=>1.1650011539459229, :ems_refresh=>25.125972747802734} [----] I, [2016-09-13T05:49:35.985131 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T05:49:35.985459 #30088:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77005], State: [ok], Delivered in [3.091144139] seconds [----] I, [2016-09-13T05:49:36.058137 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:36.058308 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:36.553633 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:36.863344 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:36.863540 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:37.372069 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:37.769392 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:37.769597 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:38.269054 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:38.572957 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:38.573464 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:39.055460 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:39.375409 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:39.375603 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:39.856322 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:40.155788 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:40.155955 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:40.646744 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:40.952456 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:40.952730 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:41.436666 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:41.747320 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:41.747503 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:41.812866 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00419163703918457, :worker_monitor=>1.4963264465332031, :worker_dequeue=>0.011881589889526367, :total_time=>1.512735366821289} [----] I, [2016-09-13T05:49:42.236491 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:42.400140 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:42.540043 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:42.675838 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:43.777652 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:49:43.796768 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77009], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:49:43.817861 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77010], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:49:43.853136 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77011], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:49:43.880652 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77012], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:49:46.828218 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:49:46.875708 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77010], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.074569962] seconds [----] I, [2016-09-13T05:49:46.875978 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77010], Delivering... [----] I, [2016-09-13T05:49:46.898458 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77012], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.03252326] seconds [----] I, [2016-09-13T05:49:46.898736 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77012], Delivering... [----] I, [2016-09-13T05:49:46.909529 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005626678466796875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005674839019775391, :pending_vm_jobs=>0.0014061927795410156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010168790817260742} [----] I, [2016-09-13T05:49:46.910009 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77012], State: [ok], Delivered in [0.011270467] seconds [----] I, [2016-09-13T05:49:46.932712 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77010], State: [ok], Delivered in [0.056746767] seconds [----] I, [2016-09-13T05:49:46.960870 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77009], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.178608439] seconds [----] I, [2016-09-13T05:49:46.961058 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77009], Delivering... [----] I, [2016-09-13T05:49:46.965308 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77009], State: [ok], Delivered in [0.004238164] seconds [----] I, [2016-09-13T05:49:46.967456 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77011], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.14402308] seconds [----] I, [2016-09-13T05:49:46.967571 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77011], Delivering... [----] I, [2016-09-13T05:49:46.969568 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77011], State: [ok], Delivered in [0.001994483] seconds [----] I, [2016-09-13T05:49:48.831789 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:48.984233 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:49.124789 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:49.262923 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:49.404054 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:49.543045 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:49.681346 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:49.822238 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:49.970319 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:50.108299 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:50.245783 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:50.563943 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:51.719267 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:51.866946 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:52.005980 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:52.155886 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:52.296776 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:52.433054 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:52.578178 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:52.720582 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:52.864743 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:53.006780 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:53.141517 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:53.280381 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:53.417557 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:53.557575 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:53.701306 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:53.840920 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:54.460407 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:54.626049 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:54.776244 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:54.912669 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:55.054727 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:55.198891 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:55.341721 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:55.478391 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:55.617230 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:55.755545 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:55.899875 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:56.067578 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:56.244113 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:56.391177 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:56.553003 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:56.739617 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:56.885230 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:57.318598 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:57.493519 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:57.642914 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:57.778266 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:57.945996 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:58.085836 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:58.211502 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0060765743255615234, :worker_monitor=>1.2143831253051758, :worker_dequeue=>0.0070192813873291016, :total_time=>1.227787733078003} [----] I, [2016-09-13T05:49:58.224013 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:58.365095 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:58.502670 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:58.641995 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:58.782948 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:58.892560 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T05:49:58.921080 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:58.932122 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77013], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:49:58.943470 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77014], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:49:58.954884 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77015], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:49:58.966198 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77016], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:49:59.064987 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:59.216099 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:59.370002 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:59.526343 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:49:59.676886 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:03.212080 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:50:03 UTC]... [----] I, [2016-09-13T05:50:03.269507 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:50:03 UTC]...Complete [----] I, [2016-09-13T05:50:03.282566 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:50:03.532663 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77013], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.634262292] seconds [----] I, [2016-09-13T05:50:03.532889 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77013], Delivering... [----] I, [2016-09-13T05:50:03.539823 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003676891326904297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003698110580444336, :pending_vm_jobs=>0.0008466243743896484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006479740142822266} [----] I, [2016-09-13T05:50:03.540232 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77013], State: [ok], Delivered in [0.007349857] seconds [----] I, [2016-09-13T05:50:05.069618 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77015], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.120958675] seconds [----] I, [2016-09-13T05:50:05.069815 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77015], Delivering... [----] I, [2016-09-13T05:50:05.077553 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77014], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.139892482] seconds [----] I, [2016-09-13T05:50:05.077859 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77014], Delivering... [----] I, [2016-09-13T05:50:05.081276 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77014], State: [ok], Delivered in [0.00340813] seconds [----] I, [2016-09-13T05:50:05.083496 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77015], State: [ok], Delivered in [0.013608213] seconds [----] I, [2016-09-13T05:50:05.115131 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77016], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.15503133] seconds [----] I, [2016-09-13T05:50:05.115378 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77016], Delivering... [----] I, [2016-09-13T05:50:05.121254 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77016], State: [ok], Delivered in [0.005855232] seconds [----] I, [2016-09-13T05:50:06.139157 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:06.282569 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:06.422007 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:06.568569 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:06.709719 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:06.851109 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:06.991849 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:07.129617 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:07.282536 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:07.419225 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:07.563580 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:07.742744 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:07.888841 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:08.023988 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:08.169462 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:08.312021 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:08.454543 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:08.946195 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:09.102800 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:09.249477 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:09.392715 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:09.537192 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:09.679298 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:09.820145 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:09.959307 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:10.101745 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:10.241452 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:10.381898 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:10.516715 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:10.657482 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:10.801947 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:10.942671 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:11.090959 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:11.233635 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:11.603760 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:11.811908 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:11.947959 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:12.089909 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:12.226876 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:12.363605 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:12.509544 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:12.652468 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:12.795696 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:12.941807 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:13.085605 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:13.231635 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:13.370325 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:13.532628 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:13.753117 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:13.946273 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:13.978021 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T05:50:13.989045 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77017], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:50:14.001766 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77018], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:50:14.012094 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77019], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:50:14.023525 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77020], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:50:14.130479 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:14.511047 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:14.662658 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:14.811046 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:14.830949 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:50:14.834835 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003954887390136719, :worker_monitor=>1.5182902812957764, :worker_dequeue=>0.007022857666015625, :total_time=>1.5295283794403076} [----] I, [2016-09-13T05:50:14.956200 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:15.098921 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:15.243855 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:15.381801 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:15.525307 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:15.619555 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77020], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.601964719] seconds [----] I, [2016-09-13T05:50:15.619715 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77020], Delivering... [----] I, [2016-09-13T05:50:15.623745 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022330284118652344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002245664596557617, :pending_vm_jobs=>0.0004839897155761719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0037682056427001953} [----] I, [2016-09-13T05:50:15.624007 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77020], State: [ok], Delivered in [0.004290538] seconds [----] I, [2016-09-13T05:50:15.662779 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:15.806275 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:15.950401 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:16.089497 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:16.232717 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:16.375359 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:16.509358 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:16.654447 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:17.218467 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77017], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.236727698] seconds [----] I, [2016-09-13T05:50:17.218645 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77017], Delivering... [----] I, [2016-09-13T05:50:17.223694 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77017], State: [ok], Delivered in [0.004999341] seconds [----] I, [2016-09-13T05:50:17.226300 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77018], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.233816807] seconds [----] I, [2016-09-13T05:50:17.226565 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77018], Delivering... [----] I, [2016-09-13T05:50:17.252946 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77021], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 09:50:17 UTC] [----] I, [2016-09-13T05:50:17.281378 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77019], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.276377529] seconds [----] I, [2016-09-13T05:50:17.281586 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77019], Delivering... [----] I, [2016-09-13T05:50:17.310566 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77022], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 09:50:17 UTC] [----] I, [2016-09-13T05:50:17.311195 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77018], State: [ok], Delivered in [0.084595721] seconds [----] I, [2016-09-13T05:50:17.315780 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77023], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 09:50:17 UTC] [----] I, [2016-09-13T05:50:17.351674 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77024], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 09:50:17 UTC] [----] I, [2016-09-13T05:50:17.352180 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77019], State: [ok], Delivered in [0.070533089] seconds [----] I, [2016-09-13T05:50:19.844563 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:50:20.367509 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77021], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 09:50:17 UTC], Dequeued in: [3.131299524] seconds [----] I, [2016-09-13T05:50:20.367716 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77021], Delivering... [----] I, [2016-09-13T05:50:20.368029 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 09:50:17 UTC]... [----] I, [2016-09-13T05:50:20.370381 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T05:50:20.372534 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 09:50:17 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T05:50:20.372859 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77021], State: [ok], Delivered in [0.005126118] seconds [----] I, [2016-09-13T05:50:20.413290 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77022], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 09:50:17 UTC], Dequeued in: [3.152891552] seconds [----] I, [2016-09-13T05:50:20.413504 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77022], Delivering... [----] I, [2016-09-13T05:50:20.413829 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 09:50:17 UTC]... [----] I, [2016-09-13T05:50:20.416572 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T05:50:20.418746 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 09:50:17 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T05:50:20.418884 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77023], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 09:50:17 UTC], Dequeued in: [3.130735019] seconds [----] I, [2016-09-13T05:50:20.419029 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77023], Delivering... [----] I, [2016-09-13T05:50:20.419067 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77022], State: [ok], Delivered in [0.005554743] seconds [----] I, [2016-09-13T05:50:20.419309 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 09:50:17 UTC]... [----] I, [2016-09-13T05:50:20.421779 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T05:50:20.458957 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77024], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 09:50:17 UTC], Dequeued in: [3.133968444] seconds [----] I, [2016-09-13T05:50:20.459129 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77024], Delivering... [----] I, [2016-09-13T05:50:20.459447 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 09:50:17 UTC]... [----] I, [2016-09-13T05:50:20.462060 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T05:50:20.497272 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 09:50:17 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T05:50:20.497659 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77023], State: [ok], Delivered in [0.078608957] seconds [----] I, [2016-09-13T05:50:20.535908 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 09:50:17 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T05:50:20.536331 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77024], State: [ok], Delivered in [0.077176429] seconds [----] I, [2016-09-13T05:50:22.814329 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:23.239908 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:23.409301 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:23.555397 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:23.693564 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:23.835753 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:24.004676 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:24.141215 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:24.292699 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:24.446129 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:24.587838 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:24.729752 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:24.872052 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:25.023539 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:25.165879 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:25.309628 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:25.450381 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:25.589142 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:26.028464 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:26.186052 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:26.330615 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:26.470976 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:26.611915 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:26.752575 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:26.893026 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:27.034733 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:27.175947 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:27.314880 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:27.458632 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:27.602825 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:27.736773 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:27.880234 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:28.019242 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:28.160375 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:28.303064 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:28.842676 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:29.000250 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:29.034568 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:50:29.056363 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77025], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:50:29.142715 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:29.286665 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:29.423085 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:29.559782 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:29.714774 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:29.854391 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:29.985873 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:30.122208 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:30.263751 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:30.400779 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:30.543473 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:30.684808 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:30.820214 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:30.958095 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:31.077503 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:50:31.083505 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005795001983642578, :worker_monitor=>1.2019412517547607, :worker_dequeue=>0.01069021224975586, :total_time=>1.218806505203247} [----] I, [2016-09-13T05:50:31.101971 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:31.484493 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:31.648028 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:31.740822 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77025], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.700380397] seconds [----] I, [2016-09-13T05:50:31.741004 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77025], Delivering... [----] I, [2016-09-13T05:50:31.747172 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031633377075195312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003209829330444336, :pending_vm_jobs=>0.0007917881011962891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058138370513916016} [----] I, [2016-09-13T05:50:31.747533 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77025], State: [ok], Delivered in [0.006523799] seconds [----] I, [2016-09-13T05:50:31.790591 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:31.932895 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:32.068829 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:32.221971 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:32.366192 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:32.506800 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:32.649180 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:32.790537 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:32.937542 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:33.082379 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:33.224716 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:33.363253 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:33.496317 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:33.641502 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:36.084010 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:50:36 UTC]... [----] I, [2016-09-13T05:50:36.106032 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:50:36 UTC]...Complete [----] I, [2016-09-13T05:50:39.797604 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:40.311754 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:40.454720 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:40.597651 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:40.739926 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:40.896611 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:41.042374 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:41.182748 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:41.326808 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:41.471027 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:41.635664 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:41.780055 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:41.926988 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:42.080489 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:42.223251 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:42.365978 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:42.512445 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:42.655314 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:43.110116 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:43.271902 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:43.413078 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:43.547576 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:43.710542 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:43.853913 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:44.026001 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:44.068681 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:50:44.112393 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77026], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:50:44.135081 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77027], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:50:44.152091 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77028], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:50:44.169288 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:44.175726 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77029], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:50:44.314697 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:44.466984 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:44.609056 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:44.747376 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:44.896623 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:45.037990 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:45.185152 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:45.328714 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T05:50:45.467050 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T05:50:45.655946 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T05:50:45.656182 #3290:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T05:50:45.656351 #3290:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T05:50:45.656411 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T05:50:45.656503 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T05:50:45.683467 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T05:50:45.683871 #3290:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [77006], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T05:50:45.684703 #3290:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T05:50:45.684968 #3290:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T05:50:45.685182 #3290:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77006], State: [error], Delivered in [74.482134443] seconds [----] I, [2016-09-13T05:50:47.587095 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:50:47.595019 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004095315933227539, :worker_monitor=>1.4299817085266113, :worker_dequeue=>0.017565011978149414, :total_time=>1.4519274234771729} [----] I, [2016-09-13T05:50:47.621969 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77027], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.504865974] seconds [----] I, [2016-09-13T05:50:47.622177 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77027], Delivering... [----] I, [2016-09-13T05:50:47.649937 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77029], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.488711842] seconds [----] I, [2016-09-13T05:50:47.650139 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77029], Delivering... [----] I, [2016-09-13T05:50:47.656331 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003298521041870117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033447742462158203, :pending_vm_jobs=>0.0007662773132324219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005828857421875} [----] I, [2016-09-13T05:50:47.656709 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77029], State: [ok], Delivered in [0.006562343] seconds [----] I, [2016-09-13T05:50:47.683857 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77027], State: [ok], Delivered in [0.061680246] seconds [----] I, [2016-09-13T05:50:47.701032 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77026], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.627796846] seconds [----] I, [2016-09-13T05:50:47.701188 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77026], Delivering... [----] I, [2016-09-13T05:50:47.704633 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77026], State: [ok], Delivered in [0.003436915] seconds [----] I, [2016-09-13T05:50:47.758620 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77028], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.617828156] seconds [----] I, [2016-09-13T05:50:47.758875 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77028], Delivering... [----] I, [2016-09-13T05:50:47.762982 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77028], State: [ok], Delivered in [0.004124328] seconds [----] I, [2016-09-13T05:50:59.187639 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:50:59.213799 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77030], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:51:04.380859 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:51:04.387240 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004037618637084961, :worker_monitor=>1.6181323528289795, :worker_dequeue=>0.01129007339477539, :total_time=>1.633788824081421} [----] I, [2016-09-13T05:51:04.998804 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77030], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.804755374] seconds [----] I, [2016-09-13T05:51:04.999010 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77030], Delivering... [----] I, [2016-09-13T05:51:05.009065 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004548549652099609, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004622459411621094, :pending_vm_jobs=>0.0014407634735107422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009512186050415039} [----] I, [2016-09-13T05:51:05.009660 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77030], State: [ok], Delivered in [0.010619674] seconds [----] I, [2016-09-13T05:51:09.387746 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:51:09 UTC]... [----] I, [2016-09-13T05:51:09.408225 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:51:09 UTC]...Complete [----] I, [2016-09-13T05:51:14.226919 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:51:14.236220 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77031], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:51:14.247717 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77032], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:51:14.445776 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:51:14.842397 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77032], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.602253] seconds [----] I, [2016-09-13T05:51:14.842610 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77032], Delivering... [----] I, [2016-09-13T05:51:14.848526 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003133058547973633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003151416778564453, :pending_vm_jobs=>0.0007433891296386719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005507230758666992} [----] I, [2016-09-13T05:51:14.848849 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77032], State: [ok], Delivered in [0.006239064] seconds [----] I, [2016-09-13T05:51:14.888034 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77031], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.656361849] seconds [----] I, [2016-09-13T05:51:14.888220 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77031], Delivering... [----] I, [2016-09-13T05:51:14.892384 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77031], State: [ok], Delivered in [0.004152412] seconds [----] I, [2016-09-13T05:51:20.983261 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005164146423339844, :worker_monitor=>1.519240379333496, :worker_dequeue=>0.007277250289916992, :total_time=>1.5319898128509521} [----] I, [2016-09-13T05:51:29.259745 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:51:29.276628 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77033], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:51:31.006498 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:51:31.122220 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77033], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.857443874] seconds [----] I, [2016-09-13T05:51:31.122356 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77033], Delivering... [----] I, [2016-09-13T05:51:31.126045 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002084493637084961, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020987987518310547, :pending_vm_jobs=>0.0003981590270996094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0034236907958984375} [----] I, [2016-09-13T05:51:31.126259 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77033], State: [ok], Delivered in [0.003904121] seconds [----] I, [2016-09-13T05:51:37.413873 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003358125686645508, :worker_monitor=>1.385049819946289, :worker_dequeue=>0.013171672821044922, :total_time=>1.401855707168579} [----] I, [2016-09-13T05:51:42.414401 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:51:42 UTC]... [----] I, [2016-09-13T05:51:42.442453 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:51:42 UTC]...Complete [----] I, [2016-09-13T05:51:44.285609 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:51:44.324025 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77034], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:51:44.402899 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77035], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:51:44.427191 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77036], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:51:44.449909 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77037], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:51:47.466731 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:51:47.987330 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77035], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.65984116] seconds [----] I, [2016-09-13T05:51:47.987523 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77035], Delivering... [----] I, [2016-09-13T05:51:48.044455 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77035], State: [ok], Delivered in [0.056887614] seconds [----] I, [2016-09-13T05:51:48.084614 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77037], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.646805453] seconds [----] I, [2016-09-13T05:51:48.084781 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77037], Delivering... [----] I, [2016-09-13T05:51:48.090680 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031075477600097656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003124237060546875, :pending_vm_jobs=>0.0007252693176269531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005579471588134766} [----] I, [2016-09-13T05:51:48.091025 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77037], State: [ok], Delivered in [0.006232975] seconds [----] I, [2016-09-13T05:51:48.141839 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77034], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.852989923] seconds [----] I, [2016-09-13T05:51:48.142009 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77034], Delivering... [----] I, [2016-09-13T05:51:48.146063 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77034], State: [ok], Delivered in [0.004042771] seconds [----] I, [2016-09-13T05:51:48.187335 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77036], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.778279849] seconds [----] I, [2016-09-13T05:51:48.187533 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77036], Delivering... [----] I, [2016-09-13T05:51:48.190486 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77036], State: [ok], Delivered in [0.002915079] seconds [----] I, [2016-09-13T05:51:53.966398 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0031027793884277344, :worker_monitor=>1.482985019683838, :worker_dequeue=>0.006242036819458008, :total_time=>1.4925591945648193} [----] I, [2016-09-13T05:51:59.462243 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:51:59.490385 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77038], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:52:04.075896 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:52:04.385856 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77038], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.9178518] seconds [----] I, [2016-09-13T05:52:04.386052 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77038], Delivering... [----] I, [2016-09-13T05:52:04.394332 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0040552616119384766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004074573516845703, :pending_vm_jobs=>0.0008904933929443359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007818222045898438} [----] I, [2016-09-13T05:52:04.394842 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77038], State: [ok], Delivered in [0.008763069] seconds [----] I, [2016-09-13T05:52:10.957225 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004273653030395508, :worker_monitor=>1.8533246517181396, :worker_dequeue=>0.019634485244750977, :total_time=>1.877579927444458} [----] I, [2016-09-13T05:52:14.502549 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:52:14.530459 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77039], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:52:14.557883 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77040], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:52:15.957750 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:52:15 UTC]... [----] I, [2016-09-13T05:52:15.973910 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:52:15 UTC]...Complete [----] I, [2016-09-13T05:52:15.984236 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:52:16.837327 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77040], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.301068575] seconds [----] I, [2016-09-13T05:52:16.837604 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77040], Delivering... [----] I, [2016-09-13T05:52:16.847280 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0048906803131103516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004918813705444336, :pending_vm_jobs=>0.0012488365173339844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009123802185058594} [----] I, [2016-09-13T05:52:16.847776 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77040], State: [ok], Delivered in [0.010168069] seconds [----] I, [2016-09-13T05:52:18.460848 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77039], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.953375106] seconds [----] I, [2016-09-13T05:52:18.461124 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77039], Delivering... [----] I, [2016-09-13T05:52:18.467969 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77039], State: [ok], Delivered in [0.006828784] seconds [----] I, [2016-09-13T05:52:27.615202 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038514137268066406, :worker_monitor=>1.5946564674377441, :worker_dequeue=>0.009471893310546875, :total_time=>1.608309268951416} [----] I, [2016-09-13T05:52:29.569106 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:52:29.591797 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77041], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:52:32.624494 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:52:32.997321 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77041], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.423228402] seconds [----] I, [2016-09-13T05:52:32.997481 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77041], Delivering... [----] I, [2016-09-13T05:52:33.002117 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024344921112060547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024497509002685547, :pending_vm_jobs=>0.0005614757537841797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004348039627075195} [----] I, [2016-09-13T05:52:33.002430 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77041], State: [ok], Delivered in [0.004929318] seconds [----] I, [2016-09-13T05:52:37.649369 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T05:52:44.414899 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004008054733276367, :worker_monitor=>1.727721929550171, :worker_dequeue=>0.017203330993652344, :total_time=>1.7493114471435547} [----] I, [2016-09-13T05:52:44.603992 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:52:44.625845 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77042], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:52:44.643052 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77043], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:52:44.677564 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77044], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:52:44.723924 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77045], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:52:49.415503 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:52:49 UTC]... [----] I, [2016-09-13T05:52:49.448796 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:52:49 UTC]...Complete [----] I, [2016-09-13T05:52:49.462713 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:52:50.135098 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77043], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.506065555] seconds [----] I, [2016-09-13T05:52:50.135352 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77043], Delivering... [----] I, [2016-09-13T05:52:50.187787 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77045], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.498945264] seconds [----] I, [2016-09-13T05:52:50.188045 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77045], Delivering... [----] I, [2016-09-13T05:52:50.195926 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004058361053466797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004095792770385742, :pending_vm_jobs=>0.0010654926300048828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00740814208984375} [----] I, [2016-09-13T05:52:50.196361 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77045], State: [ok], Delivered in [0.008328831] seconds [----] I, [2016-09-13T05:52:50.253577 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77043], State: [ok], Delivered in [0.118201795] seconds [----] I, [2016-09-13T05:52:51.622883 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77042], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.015307235] seconds [----] I, [2016-09-13T05:52:51.623141 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77042], Delivering... [----] I, [2016-09-13T05:52:51.629595 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77042], State: [ok], Delivered in [0.006441316] seconds [----] I, [2016-09-13T05:52:51.674174 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77044], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.027068952] seconds [----] I, [2016-09-13T05:52:51.674459 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77044], Delivering... [----] I, [2016-09-13T05:52:51.685178 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77044], State: [ok], Delivered in [0.010708369] seconds [----] I, [2016-09-13T05:52:59.748325 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:52:59.770924 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77046], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:53:01.236236 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:53:01.241301 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004061460494995117, :server_monitor=>0.11151885986328125, :worker_monitor=>1.6147406101226807, :worker_dequeue=>0.009884119033813477, :total_time=>1.7406377792358398} [----] I, [2016-09-13T05:53:01.376740 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77046], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.620803317] seconds [----] I, [2016-09-13T05:53:01.376884 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77046], Delivering... [----] I, [2016-09-13T05:53:01.382335 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002905130386352539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029456615447998047, :pending_vm_jobs=>0.0006783008575439453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005151987075805664} [----] I, [2016-09-13T05:53:01.382682 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77046], State: [ok], Delivered in [0.005776717] seconds [----] I, [2016-09-13T05:53:14.788515 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:53:14.805239 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77047], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:53:14.816518 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77048], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:53:17.693676 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:53:17.699783 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005418300628662109, :worker_monitor=>1.3545968532562256, :worker_dequeue=>0.010767459869384766, :total_time=>1.3711514472961426} [----] I, [2016-09-13T05:53:18.509588 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77048], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.698750508] seconds [----] I, [2016-09-13T05:53:18.509962 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77048], Delivering... [----] I, [2016-09-13T05:53:18.519292 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004409074783325195, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004443645477294922, :pending_vm_jobs=>0.0010981559753417969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008658170700073242} [----] I, [2016-09-13T05:53:18.519801 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77048], State: [ok], Delivered in [0.009844954] seconds [----] I, [2016-09-13T05:53:18.799901 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77047], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.006713966] seconds [----] I, [2016-09-13T05:53:18.800104 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77047], Delivering... [----] I, [2016-09-13T05:53:18.805473 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77047], State: [ok], Delivered in [0.005330181] seconds [----] I, [2016-09-13T05:53:22.700273 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:53:22 UTC]... [----] I, [2016-09-13T05:53:22.719513 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:53:22 UTC]...Complete [----] I, [2016-09-13T05:53:29.827783 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:53:29.847210 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77049], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:53:29.868577 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77050], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:53:29.891455 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77051], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:53:34.069121 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:53:34.075461 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0050237178802490234, :worker_monitor=>1.310152530670166, :worker_dequeue=>0.011317253112792969, :total_time=>1.3269128799438477} [----] I, [2016-09-13T05:53:34.612045 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77049], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.778367663] seconds [----] I, [2016-09-13T05:53:34.612291 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77049], Delivering... [----] I, [2016-09-13T05:53:34.619185 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035827159881591797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003606081008911133, :pending_vm_jobs=>0.0008423328399658203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006460666656494141} [----] I, [2016-09-13T05:53:34.619549 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77049], State: [ok], Delivered in [0.007258202] seconds [----] I, [2016-09-13T05:53:34.655699 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77050], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.801368926] seconds [----] I, [2016-09-13T05:53:34.655876 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77050], Delivering... [----] I, [2016-09-13T05:53:34.657103 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T05:53:34.657322 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5354741760 [----] I, [2016-09-13T05:53:34.657443 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5136072704 [----] I, [2016-09-13T05:53:34.657536 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 218669056 [----] I, [2016-09-13T05:53:34.657613 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1319108608 [----] I, [2016-09-13T05:53:34.657685 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5082103808 [----] I, [2016-09-13T05:53:34.657758 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T05:53:34.657826 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T05:53:34.657895 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 539729920 [----] I, [2016-09-13T05:53:34.657963 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T05:53:34.658036 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8117657600 [----] I, [2016-09-13T05:53:34.658108 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T05:53:34.658197 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T05:53:34.658276 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T05:53:34.658350 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T05:53:34.658443 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T05:53:34.658549 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T05:53:34.658628 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T05:53:34.658698 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T05:53:34.658768 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T05:53:34.658838 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T05:53:34.658910 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273313792 [----] I, [2016-09-13T05:53:34.658985 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56414208 [----] I, [2016-09-13T05:53:34.659057 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216899584 [----] I, [2016-09-13T05:53:34.659122 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T05:53:34.659217 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140894208 [----] I, [2016-09-13T05:53:34.659297 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2585194496 [----] I, [2016-09-13T05:53:34.659365 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2271461376 [----] I, [2016-09-13T05:53:34.659455 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T05:53:34.659544 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T05:53:34.659619 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T05:53:34.659687 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37654528 [----] I, [2016-09-13T05:53:34.659755 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102293504 [----] I, [2016-09-13T05:53:34.659829 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53342208 [----] I, [2016-09-13T05:53:34.659898 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110383104 [----] I, [2016-09-13T05:53:34.659971 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155635712 [----] I, [2016-09-13T05:53:34.660037 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T05:53:34.660107 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T05:53:34.660192 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T05:53:34.660270 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T05:53:34.660346 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T05:53:34.660450 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T05:53:34.660537 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T05:53:34.660609 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T05:53:34.660720 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T05:53:34.669372 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77051], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.795515214] seconds [----] I, [2016-09-13T05:53:34.669670 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77051], Delivering... [----] I, [2016-09-13T05:53:34.678080 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:53:29 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [236631.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T05:53:34.678656 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:53:29 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [103468.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T05:53:34.679281 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:53:32 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162418000], Memory % [3.1], CPU Time [37442.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T05:53:34.679873 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:53:33 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202018000], Memory % [3.38], CPU Time [148640.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:53:34.680464 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:53:30 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [199806.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T05:53:34.680990 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:53:33 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [149559.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:53:34.681584 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:53:33 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50796.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:53:34.682054 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:53:26 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [48330.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T05:53:34.685203 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:53:26 UTC], Process Info: Memory Usage [587579392], Memory Size [930627584], Proportional Set Size: [424627000], Memory % [7.16], CPU Time [1018.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:53:34.687793 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:53:25 UTC], Process Info: Memory Usage [612663296], Memory Size [1134075904], Proportional Set Size: [447314000], Memory % [7.47], CPU Time [438.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:53:34.690181 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:53:31 UTC], Process Info: Memory Usage [558612480], Memory Size [930906112], Proportional Set Size: [406128000], Memory % [6.81], CPU Time [4892.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T05:53:34.692461 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:53:23 UTC], Process Info: Memory Usage [580460544], Memory Size [938426368], Proportional Set Size: [419897000], Memory % [7.08], CPU Time [1520.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T05:53:34.693063 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:53:33 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [206980.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T05:53:34.693646 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:53:33 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [50836.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:53:34.694112 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:53:22 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165804000], Memory % [3.16], CPU Time [38343.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T05:53:34.694509 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77051], State: [ok], Delivered in [0.024861757] seconds [----] I, [2016-09-13T05:53:34.695535 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T05:53:34.695733 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T05:53:34.699821 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T05:53:34.702845 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T05:53:34.706470 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T05:53:34.710024 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T05:53:34.713794 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T05:53:34.717469 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 840 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T05:53:34.720907 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T05:53:34.724533 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T05:53:34.728100 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T05:53:34.731387 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T05:53:34.734921 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T05:53:34.738122 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T05:53:34.740999 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:53:34.741174 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:53:34.741283 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T05:53:34.746796 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [200500000], Memory % [5.28], CPU Time [149545.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T05:53:34.747270 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77050], State: [ok], Delivered in [0.0913475] seconds [----] I, [2016-09-13T05:53:44.903077 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:53:44.929629 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77052], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:53:44.943121 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77053], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:53:44.960397 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77054], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:53:44.983242 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77055], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:53:50.704585 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:53:50.711306 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038352012634277344, :worker_monitor=>1.5888547897338867, :worker_dequeue=>0.012103796005249023, :total_time=>1.6051013469696045} [----] I, [2016-09-13T05:53:50.861357 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77053], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.92754352] seconds [----] I, [2016-09-13T05:53:50.861578 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77053], Delivering... [----] I, [2016-09-13T05:53:50.929730 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77055], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.960535397] seconds [----] I, [2016-09-13T05:53:50.929920 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77055], Delivering... [----] I, [2016-09-13T05:53:50.935202 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77053], State: [ok], Delivered in [0.073600679] seconds [----] I, [2016-09-13T05:53:50.936601 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003270387649536133, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003296375274658203, :pending_vm_jobs=>0.0008592605590820312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006251096725463867} [----] I, [2016-09-13T05:53:50.936933 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77055], State: [ok], Delivered in [0.007015548] seconds [----] I, [2016-09-13T05:53:51.948231 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77052], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.040883267] seconds [----] I, [2016-09-13T05:53:51.948516 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77052], Delivering... [----] I, [2016-09-13T05:53:51.954235 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77052], State: [ok], Delivered in [0.005760395] seconds [----] I, [2016-09-13T05:53:51.980938 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77054], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.032773126] seconds [----] I, [2016-09-13T05:53:51.981119 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77054], Delivering... [----] I, [2016-09-13T05:53:51.984281 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77054], State: [ok], Delivered in [0.003162586] seconds [----] I, [2016-09-13T05:53:55.711932 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:53:55 UTC]... [----] I, [2016-09-13T05:53:55.735141 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:53:55 UTC]...Complete [----] I, [2016-09-13T05:53:59.994618 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:54:00.015334 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77056], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:54:00.856187 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:54:01.006163 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77056], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.005842886] seconds [----] I, [2016-09-13T05:54:01.006370 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77056], Delivering... [----] I, [2016-09-13T05:54:01.016035 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0044515132904052734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00447535514831543, :pending_vm_jobs=>0.0008587837219238281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009158849716186523} [----] I, [2016-09-13T05:54:01.016527 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77056], State: [ok], Delivered in [0.010155114] seconds [----] I, [2016-09-13T05:54:07.233124 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:54:07.233450 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:54:07.250069 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:54:07.250320 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:54:07.267027 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:54:07.267245 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:54:07.278315 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:54:07.278516 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:54:07.295640 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:54:07.295835 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:54:07.312661 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:54:07.312849 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:54:07.329825 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:54:07.330000 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:54:07.348956 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:54:07.349334 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:54:07.370245 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:54:07.370496 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:54:07.392935 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:54:07.393139 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:54:07.409903 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:54:07.410083 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:54:07.427278 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:54:07.427562 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:54:07.455971 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:54:07.456186 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:54:07.472788 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:54:07.472971 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:54:07.489978 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T05:54:07.490231 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T05:54:07.505347 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.008693218231201172, :worker_monitor=>1.6214640140533447, :worker_dequeue=>0.01120448112487793, :total_time=>1.6417784690856934} [----] I, [2016-09-13T05:54:09.973644 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:54:09.973802 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:54:09.973911 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:54:10.030954 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:54:10.031131 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:54:10.031249 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:54:10.157042 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:54:10.158045 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T05:54:10.158136 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:54:10.158207 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:54:10.158249 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:54:10.158288 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T05:54:10.158322 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T05:54:10.158355 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:54:10.158388 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T05:54:10.158459 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:54:10.158506 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:54:10.158542 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:54:10.158574 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:54:10.158607 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T05:54:10.158638 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:54:10.158671 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T05:54:10.158703 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T05:54:10.159027 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:54:10.159205 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:54:10.211705 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:54:10.212550 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T05:54:10.212633 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:54:10.212678 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:54:10.212713 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:54:10.212749 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T05:54:10.212784 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T05:54:10.212825 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:54:10.212876 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T05:54:10.212916 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:54:10.212950 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:54:10.212982 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:54:10.213014 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:54:10.213049 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T05:54:10.213083 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:54:10.213117 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T05:54:10.213159 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T05:54:10.213478 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:54:10.213660 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:54:10.890333 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:54:10.890475 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:54:10.890558 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:54:11.008209 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:54:11.008781 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T05:54:11.008846 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:54:11.008882 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:54:11.008910 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:54:11.008938 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T05:54:11.008966 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T05:54:11.008995 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:54:11.009022 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T05:54:11.009049 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:54:11.009075 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:54:11.009100 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:54:11.009126 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:54:11.009166 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T05:54:11.009197 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T05:54:11.009408 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:54:11.009638 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:54:11.091653 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:54:11.091805 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:54:11.091883 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:54:11.188794 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T05:54:11.188910 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T05:54:11.188995 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T05:54:11.230671 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:54:11.231455 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T05:54:11.231534 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:54:11.231577 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:54:11.231613 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:54:11.231647 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T05:54:11.231678 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T05:54:11.231711 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:54:11.231742 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T05:54:11.231775 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:54:11.231806 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:54:11.231837 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:54:11.231874 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:54:11.231905 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T05:54:11.231936 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:54:11.231974 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T05:54:11.232003 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T05:54:11.232295 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:54:11.232460 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:54:11.308480 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:54:11.309304 #684:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T05:54:11.309378 #684:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:54:11.309450 #684:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:54:11.309507 #684:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:54:11.309545 #684:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T05:54:11.309580 #684:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T05:54:11.309614 #684:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:54:11.309659 #684:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T05:54:11.309695 #684:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:54:11.309728 #684:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:54:11.309760 #684:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:54:11.309791 #684:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:54:11.309822 #684:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T05:54:11.309854 #684:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T05:54:11.309885 #684:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T05:54:11.309916 #684:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T05:54:11.309946 #684:34713c] INFO -- : --- [----] I, [2016-09-13T05:54:11.310313 #684:34713c] INFO -- : :guid: c253e5f6-7924-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:54:11.310381 #684:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T05:54:11.310531 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T05:54:13.048955 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:54:13.049107 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:54:13.049219 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:54:13.069770 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:54:13.069921 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:54:13.070007 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:54:13.233685 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:54:13.235120 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T05:54:13.235241 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:54:13.235298 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:54:13.235336 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:54:13.235374 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T05:54:13.235411 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T05:54:13.235499 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:54:13.235546 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T05:54:13.235586 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:54:13.235624 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:54:13.235660 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:54:13.235697 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:54:13.235734 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T05:54:13.235772 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:54:13.235822 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T05:54:13.235860 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T05:54:13.236209 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:54:13.236403 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:54:13.243910 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:54:13.244770 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T05:54:13.244858 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:54:13.244905 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:54:13.244942 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:54:13.244980 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T05:54:13.245014 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T05:54:13.245048 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:54:13.245082 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T05:54:13.245118 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:54:13.245175 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:54:13.245219 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:54:13.245255 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:54:13.245288 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T05:54:13.245322 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:54:13.245358 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T05:54:13.245390 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T05:54:13.245714 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:54:13.245906 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:54:14.004298 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T05:54:14.004476 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T05:54:14.004566 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T05:54:14.119787 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:54:14.120364 #20386:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T05:54:14.120436 #20386:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:54:14.120491 #20386:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:54:14.120524 #20386:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:54:14.120550 #20386:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T05:54:14.120575 #20386:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T05:54:14.120598 #20386:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:54:14.120621 #20386:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T05:54:14.120643 #20386:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:54:14.120666 #20386:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:54:14.120688 #20386:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:54:14.120709 #20386:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:54:14.120732 #20386:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T05:54:14.120753 #20386:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T05:54:14.120775 #20386:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T05:54:14.120796 #20386:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T05:54:14.120817 #20386:34713c] INFO -- : --- [----] I, [2016-09-13T05:54:14.121049 #20386:34713c] INFO -- : :guid: e5930efc-7974-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:54:14.121094 #20386:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T05:54:14.121194 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T05:54:14.920345 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:54:14.920519 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:54:14.920597 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:54:15.027632 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:54:15.027815 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:54:15.027889 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:54:15.066986 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:54:15.067711 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T05:54:15.067794 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:54:15.067839 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:54:15.067875 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:54:15.067911 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T05:54:15.067944 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T05:54:15.067979 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:54:15.068014 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T05:54:15.068060 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:54:15.068098 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:54:15.068131 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:54:15.068188 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:54:15.068228 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T05:54:15.068260 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T05:54:15.068557 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:54:15.068810 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:54:15.157733 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:54:15.159127 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T05:54:15.159231 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:54:15.159277 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:54:15.159314 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:54:15.159348 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T05:54:15.159382 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T05:54:15.159440 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:54:15.159495 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T05:54:15.159533 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:54:15.159566 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:54:15.159599 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:54:15.159631 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:54:15.159664 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T05:54:15.159697 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T05:54:15.159731 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T05:54:15.159763 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T05:54:15.159797 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T05:54:15.159829 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T05:54:15.159863 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T05:54:15.159897 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T05:54:15.159930 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T05:54:15.159962 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T05:54:15.159994 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T05:54:15.160026 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T05:54:15.160058 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T05:54:15.160091 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T05:54:15.160123 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T05:54:15.160172 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T05:54:15.160213 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T05:54:15.160263 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T05:54:15.160300 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T05:54:15.160332 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T05:54:15.160364 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T05:54:15.160395 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T05:54:15.160461 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T05:54:15.160505 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T05:54:15.160538 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T05:54:15.160571 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T05:54:15.160602 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T05:54:15.160878 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:54:15.161026 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:54:15.161100 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:54:15.188117 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77057], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:54:15.215443 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77058], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:54:15.779585 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:54:15.779747 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:54:15.779824 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:54:15.934166 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:54:15.935053 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T05:54:15.935134 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:54:15.935209 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:54:15.935252 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:54:15.935289 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T05:54:15.935327 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T05:54:15.935363 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:54:15.935397 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T05:54:15.935473 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:54:15.935520 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:54:15.935573 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:54:15.935611 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:54:15.935647 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T05:54:15.935681 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:54:15.935714 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T05:54:15.935747 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T05:54:15.936052 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:54:15.936236 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:54:16.015574 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T05:54:16.015763 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T05:54:16.016758 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T05:54:16.116124 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:54:16.116296 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:54:16.116381 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:54:16.243756 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:54:16.245013 #3290:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T05:54:16.245097 #3290:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:54:16.245142 #3290:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:54:16.245206 #3290:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:54:16.245243 #3290:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T05:54:16.245280 #3290:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T05:54:16.245316 #3290:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:54:16.245351 #3290:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T05:54:16.245386 #3290:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:54:16.245446 #3290:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:54:16.245504 #3290:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T05:54:16.245540 #3290:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:54:16.245577 #3290:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T05:54:16.245610 #3290:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:54:16.245640 #3290:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T05:54:16.245669 #3290:34713c] INFO -- : --- [----] I, [2016-09-13T05:54:16.246467 #3290:34713c] INFO -- : :guid: 8b41dc22-7996-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:54:16.246560 #3290:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T05:54:16.246752 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T05:54:16.282944 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:54:16.284361 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T05:54:16.284517 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:54:16.284609 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:54:16.284679 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:54:16.284759 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T05:54:16.284834 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T05:54:16.284896 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:54:16.284954 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T05:54:16.285014 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:54:16.285075 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:54:16.285133 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:54:16.285221 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:54:16.285282 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T05:54:16.285339 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:54:16.285400 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T05:54:16.285520 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T05:54:16.286002 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:54:16.286325 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:54:16.425143 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T05:54:16.425319 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T05:54:16.425410 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T05:54:16.575250 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:54:16.576039 #30088:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T05:54:16.576113 #30088:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:54:16.576170 #30088:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:54:16.576208 #30088:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:54:16.576254 #30088:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T05:54:16.576288 #30088:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T05:54:16.576318 #30088:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:54:16.576351 #30088:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T05:54:16.576382 #30088:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:54:16.576410 #30088:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:54:16.576476 #30088:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T05:54:16.576513 #30088:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:54:16.576545 #30088:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T05:54:16.576574 #30088:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T05:54:16.576607 #30088:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T05:54:16.576634 #30088:34713c] INFO -- : --- [----] I, [2016-09-13T05:54:16.576957 #30088:34713c] INFO -- : :guid: aa80abf2-7989-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:54:16.577013 #30088:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T05:54:16.577190 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T05:54:17.530313 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:54:17.797774 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T05:54:17.797975 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T05:54:17.798114 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T05:54:17.948886 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T05:54:17.949696 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T05:54:17.949783 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T05:54:17.949830 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T05:54:17.949868 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T05:54:17.949904 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T05:54:17.949939 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T05:54:17.949974 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T05:54:17.950009 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T05:54:17.950043 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T05:54:17.950076 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T05:54:17.950109 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T05:54:17.950142 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T05:54:17.950204 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T05:54:17.950240 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T05:54:17.950548 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T05:54:17.950844 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T05:54:18.295733 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77058], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.101535458] seconds [----] I, [2016-09-13T05:54:18.295943 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77058], Delivering... [----] I, [2016-09-13T05:54:18.302728 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003580331802368164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003605365753173828, :pending_vm_jobs=>0.0008590221405029297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006395816802978516} [----] I, [2016-09-13T05:54:18.303106 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77058], State: [ok], Delivered in [0.00716733] seconds [----] I, [2016-09-13T05:54:19.249870 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77057], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.084273555] seconds [----] I, [2016-09-13T05:54:19.250100 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77057], Delivering... [----] I, [2016-09-13T05:54:19.255932 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77057], State: [ok], Delivered in [0.005843144] seconds [----] I, [2016-09-13T05:54:24.097528 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004055976867675781, :worker_monitor=>1.5479910373687744, :worker_dequeue=>0.007915019989013672, :total_time=>1.560274362564087} [----] I, [2016-09-13T05:54:29.098005 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:54:29 UTC]... [----] I, [2016-09-13T05:54:29.116034 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:54:29 UTC]...Complete [----] I, [2016-09-13T05:54:30.227945 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:54:30.246249 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77059], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:54:34.140184 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:54:34.298001 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77059], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.063482736] seconds [----] I, [2016-09-13T05:54:34.298225 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77059], Delivering... [----] I, [2016-09-13T05:54:34.305005 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034809112548828125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003507375717163086, :pending_vm_jobs=>0.0009517669677734375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006392240524291992} [----] I, [2016-09-13T05:54:34.305389 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77059], State: [ok], Delivered in [0.007179367] seconds [----] I, [2016-09-13T05:54:40.465881 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003778696060180664, :worker_monitor=>1.3077945709228516, :worker_dequeue=>0.006635427474975586, :total_time=>1.3185014724731445} [----] I, [2016-09-13T05:54:45.258771 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:54:45.269225 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77060], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:54:45.292298 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77061], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:54:45.303557 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77062], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:54:45.332377 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77063], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:54:45.476356 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:54:46.344136 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77061], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.071096182] seconds [----] I, [2016-09-13T05:54:46.344469 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77061], Delivering... [----] I, [2016-09-13T05:54:46.349549 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77063], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.036780187] seconds [----] I, [2016-09-13T05:54:46.349728 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77063], Delivering... [----] I, [2016-09-13T05:54:46.356379 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00339508056640625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034427642822265625, :pending_vm_jobs=>0.0008587837219238281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062713623046875} [----] I, [2016-09-13T05:54:46.356806 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77063], State: [ok], Delivered in [0.007067808] seconds [----] I, [2016-09-13T05:54:46.384881 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77060], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.12142041] seconds [----] I, [2016-09-13T05:54:46.385062 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77060], Delivering... [----] I, [2016-09-13T05:54:46.389719 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77060], State: [ok], Delivered in [0.004642072] seconds [----] I, [2016-09-13T05:54:46.400834 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77061], State: [ok], Delivered in [0.056392314] seconds [----] I, [2016-09-13T05:54:46.412448 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77062], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.114515845] seconds [----] I, [2016-09-13T05:54:46.412629 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77062], Delivering... [----] I, [2016-09-13T05:54:46.415724 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77062], State: [ok], Delivered in [0.003087576] seconds [----] I, [2016-09-13T05:54:56.917660 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004143238067626953, :worker_monitor=>1.3966045379638672, :worker_dequeue=>0.011681079864501953, :total_time=>1.412745714187622} [----] I, [2016-09-13T05:55:00.346387 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:55:00.393290 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77064], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:55:00.412770 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77065], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:55:01.918238 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:55:01 UTC]... [----] I, [2016-09-13T05:55:01.938014 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:55:01 UTC]...Complete [----] I, [2016-09-13T05:55:02.063757 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:55:02.575948 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77064], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.221115861] seconds [----] I, [2016-09-13T05:55:02.576177 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77064], Delivering... [----] I, [2016-09-13T05:55:02.582621 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032417774200439453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032618045806884766, :pending_vm_jobs=>0.0007925033569335938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005980968475341797} [----] I, [2016-09-13T05:55:02.582977 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77064], State: [ok], Delivered in [0.006833614] seconds [----] I, [2016-09-13T05:55:04.484880 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77065], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.087160851] seconds [----] I, [2016-09-13T05:55:04.485116 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77065], Delivering... [----] I, [2016-09-13T05:55:04.490784 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77065], State: [ok], Delivered in [0.005647168] seconds [----] I, [2016-09-13T05:55:15.427235 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:55:15.444643 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77066], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:55:17.980315 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:55:18.707660 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77066], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.274020833] seconds [----] I, [2016-09-13T05:55:18.707894 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77066], Delivering... [----] I, [2016-09-13T05:55:18.716216 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004269599914550781, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004344940185546875, :pending_vm_jobs=>0.0010986328125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007820606231689453} [----] I, [2016-09-13T05:55:18.716563 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77066], State: [ok], Delivered in [0.008677241] seconds [----] I, [2016-09-13T05:55:29.155940 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039348602294921875, :worker_monitor=>1.1375117301940918, :worker_dequeue=>0.006685495376586914, :total_time=>1.1483924388885498} [----] I, [2016-09-13T05:55:30.456738 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:55:30.484752 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77067], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:55:30.513321 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77068], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:55:34.156469 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:55:34 UTC]... [----] I, [2016-09-13T05:55:34.175955 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:55:34 UTC]...Complete [----] I, [2016-09-13T05:55:34.186734 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:55:34.564910 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77067], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.102332421] seconds [----] I, [2016-09-13T05:55:34.565100 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77067], Delivering... [----] I, [2016-09-13T05:55:34.570523 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77068], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.081513951] seconds [----] I, [2016-09-13T05:55:34.570695 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77068], Delivering... [----] I, [2016-09-13T05:55:34.572347 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003530263900756836, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035479068756103516, :pending_vm_jobs=>0.0009729862213134766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0067806243896484375} [----] I, [2016-09-13T05:55:34.572810 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77067], State: [ok], Delivered in [0.00768361] seconds [----] I, [2016-09-13T05:55:34.575078 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77068], State: [ok], Delivered in [0.0043755] seconds [----] I, [2016-09-13T05:55:45.520651 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003829479217529297, :worker_monitor=>1.3092799186706543, :worker_dequeue=>0.0061397552490234375, :total_time=>1.3196401596069336} [----] I, [2016-09-13T05:55:45.524531 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T05:55:45.547543 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77069], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:55:45.558745 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77070], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:55:45.581977 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77071], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:55:50.530814 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:55:50.925042 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77069], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.396377804] seconds [----] I, [2016-09-13T05:55:50.925224 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77069], Delivering... [----] I, [2016-09-13T05:55:50.931960 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77071], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.364804576] seconds [----] I, [2016-09-13T05:55:50.932167 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77071], Delivering... [----] I, [2016-09-13T05:55:50.938735 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033974647521972656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034172534942626953, :pending_vm_jobs=>0.0008754730224609375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006162166595458984} [----] I, [2016-09-13T05:55:50.939095 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77071], State: [ok], Delivered in [0.006947255] seconds [----] I, [2016-09-13T05:55:50.964812 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77069], State: [ok], Delivered in [0.039577085] seconds [----] I, [2016-09-13T05:55:52.673857 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77070], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.121394273] seconds [----] I, [2016-09-13T05:55:52.674052 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77070], Delivering... [----] I, [2016-09-13T05:55:52.677273 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77070], State: [ok], Delivered in [0.003217436] seconds [----] I, [2016-09-13T05:56:00.592331 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:56:00.633265 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77072], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:56:00.662992 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77073], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:56:01.795056 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:56:01.802229 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004228353500366211, :worker_monitor=>1.2314352989196777, :worker_dequeue=>0.011447906494140625, :total_time=>1.247480869293213} [----] I, [2016-09-13T05:56:02.022540 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77072], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.426501973] seconds [----] I, [2016-09-13T05:56:02.022672 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77072], Delivering... [----] I, [2016-09-13T05:56:02.028123 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002489805221557617, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025234222412109375, :pending_vm_jobs=>0.0005846023559570312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005136013031005859} [----] I, [2016-09-13T05:56:02.028473 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77072], State: [ok], Delivered in [0.005759683] seconds [----] I, [2016-09-13T05:56:04.702506 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77073], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.065743718] seconds [----] I, [2016-09-13T05:56:04.702698 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77073], Delivering... [----] I, [2016-09-13T05:56:04.707242 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77073], State: [ok], Delivered in [0.004538485] seconds [----] I, [2016-09-13T05:56:06.802737 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:56:06 UTC]... [----] I, [2016-09-13T05:56:06.822093 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:56:06 UTC]...Complete [----] I, [2016-09-13T05:56:15.675673 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:56:15.699273 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77074], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:56:18.376781 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:56:18.383778 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039789676666259766, :worker_monitor=>1.4063713550567627, :worker_dequeue=>0.012064933776855469, :total_time=>1.422736644744873} [----] I, [2016-09-13T05:56:19.145051 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77074], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.463391138] seconds [----] I, [2016-09-13T05:56:19.145248 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77074], Delivering... [----] I, [2016-09-13T05:56:19.151340 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031316280364990234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031495094299316406, :pending_vm_jobs=>0.0007941722869873047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005693197250366211} [----] I, [2016-09-13T05:56:19.151684 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77074], State: [ok], Delivered in [0.006426333] seconds [----] I, [2016-09-13T05:56:30.711042 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:56:30.727832 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77075], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:56:30.744827 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77076], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:56:34.754699 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:56:34.761073 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004205942153930664, :worker_monitor=>1.32792329788208, :worker_dequeue=>0.011509180068969727, :total_time=>1.3439977169036865} [----] I, [2016-09-13T05:56:34.790858 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77075], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.074069701] seconds [----] I, [2016-09-13T05:56:34.791020 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77075], Delivering... [----] I, [2016-09-13T05:56:34.796341 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77076], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.06446796] seconds [----] I, [2016-09-13T05:56:34.796468 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77076], Delivering... [----] I, [2016-09-13T05:56:34.797968 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037903785705566406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003810405731201172, :pending_vm_jobs=>0.0008397102355957031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006554841995239258} [----] I, [2016-09-13T05:56:34.798339 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77075], State: [ok], Delivered in [0.00730614] seconds [----] I, [2016-09-13T05:56:34.799776 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77076], State: [ok], Delivered in [0.003305146] seconds [----] I, [2016-09-13T05:56:39.761705 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:56:39 UTC]... [----] I, [2016-09-13T05:56:39.779513 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:56:39 UTC]...Complete [----] I, [2016-09-13T05:56:45.756906 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T05:56:45.773610 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77077], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:56:45.791897 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77078], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:56:45.807990 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77079], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:56:51.265169 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:56:51.269689 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003978729248046875, :worker_monitor=>1.441673994064331, :worker_dequeue=>0.008290767669677734, :total_time=>1.4542622566223145} [----] I, [2016-09-13T05:56:51.339614 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77078], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.558235476] seconds [----] I, [2016-09-13T05:56:51.339825 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77078], Delivering... [----] I, [2016-09-13T05:56:51.396550 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77078], State: [ok], Delivered in [0.056725496] seconds [----] I, [2016-09-13T05:56:51.419609 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77079], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.62165602] seconds [----] I, [2016-09-13T05:56:51.419766 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77079], Delivering... [----] I, [2016-09-13T05:56:51.425599 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002956867218017578, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029740333557128906, :pending_vm_jobs=>0.0007750988006591797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005505084991455078} [----] I, [2016-09-13T05:56:51.425923 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77079], State: [ok], Delivered in [0.006148301] seconds [----] I, [2016-09-13T05:56:52.893855 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77077], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.13098941] seconds [----] I, [2016-09-13T05:56:52.894059 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77077], Delivering... [----] I, [2016-09-13T05:56:52.897094 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77077], State: [ok], Delivered in [0.003049302] seconds [----] I, [2016-09-13T05:57:00.819111 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:57:00.831355 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77080], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:57:00.859836 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77081], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:57:01.296351 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:57:01.482799 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77080], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.6597521] seconds [----] I, [2016-09-13T05:57:01.482989 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77080], Delivering... [----] I, [2016-09-13T05:57:01.489251 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032660961151123047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032846927642822266, :pending_vm_jobs=>0.0007677078247070312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005851268768310547} [----] I, [2016-09-13T05:57:01.489602 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77080], State: [ok], Delivered in [0.006608863] seconds [----] I, [2016-09-13T05:57:01.922787 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77081], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.086933065] seconds [----] I, [2016-09-13T05:57:01.923036 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77081], Delivering... [----] I, [2016-09-13T05:57:01.928376 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77081], State: [ok], Delivered in [0.005333541] seconds [----] I, [2016-09-13T05:57:07.939859 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005597352981567383, :worker_monitor=>1.6230707168579102, :worker_dequeue=>0.009467124938964844, :total_time=>1.6385219097137451} [----] I, [2016-09-13T05:57:12.940559 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:57:12 UTC]... [----] I, [2016-09-13T05:57:12.956784 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:57:12 UTC]...Complete [----] I, [2016-09-13T05:57:15.872038 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:57:15.888373 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77082], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:57:18.086560 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:57:18.597208 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77082], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.719005765] seconds [----] I, [2016-09-13T05:57:18.597348 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77082], Delivering... [----] I, [2016-09-13T05:57:18.601981 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024831295013427734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024967193603515625, :pending_vm_jobs=>0.0006015300750732422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004369258880615234} [----] I, [2016-09-13T05:57:18.602311 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77082], State: [ok], Delivered in [0.004956687] seconds [----] I, [2016-09-13T05:57:24.606229 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003898143768310547, :worker_monitor=>1.5009212493896484, :worker_dequeue=>0.0072612762451171875, :total_time=>1.5123343467712402} [----] I, [2016-09-13T05:57:30.900740 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:57:30.919771 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77083], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:57:30.931100 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77084], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:57:34.635396 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:57:34.708843 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77083], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.802094497] seconds [----] I, [2016-09-13T05:57:34.709040 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77083], Delivering... [----] I, [2016-09-13T05:57:34.715806 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003621816635131836, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003643512725830078, :pending_vm_jobs=>0.0008478164672851562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00638127326965332} [----] I, [2016-09-13T05:57:34.716211 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77083], State: [ok], Delivered in [0.007165074] seconds [----] I, [2016-09-13T05:57:35.005940 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77084], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.082449901] seconds [----] I, [2016-09-13T05:57:35.006133 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77084], Delivering... [----] I, [2016-09-13T05:57:35.011537 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77084], State: [ok], Delivered in [0.005388812] seconds [----] I, [2016-09-13T05:57:39.663411 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T05:57:41.059473 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004832744598388672, :log_active_servers=>0.01590895652770996, :worker_monitor=>1.3849635124206543, :worker_dequeue=>0.010675430297851562, :total_time=>1.4168345928192139} [----] I, [2016-09-13T05:57:45.942573 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T05:57:45.980219 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77085], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:57:45.991532 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77086], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:57:46.011805 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77087], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:57:46.060071 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:57:46 UTC]... [----] I, [2016-09-13T05:57:46.080129 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:57:46 UTC]...Complete [----] I, [2016-09-13T05:57:46.092515 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:57:46.794569 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77085], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.847566299] seconds [----] I, [2016-09-13T05:57:46.794708 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77085], Delivering... [----] I, [2016-09-13T05:57:46.806359 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77087], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.80547915] seconds [----] I, [2016-09-13T05:57:46.806581 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77087], Delivering... [----] I, [2016-09-13T05:57:46.813234 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035948753356933594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003617525100708008, :pending_vm_jobs=>0.0008101463317871094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062787532806396484} [----] I, [2016-09-13T05:57:46.813604 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77087], State: [ok], Delivered in [0.00701777] seconds [----] I, [2016-09-13T05:57:46.857692 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77085], State: [ok], Delivered in [0.062937399] seconds [----] I, [2016-09-13T05:57:47.057827 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77086], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.071780442] seconds [----] I, [2016-09-13T05:57:47.058036 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77086], Delivering... [----] I, [2016-09-13T05:57:47.061441 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77086], State: [ok], Delivered in [0.00336484] seconds [----] I, [2016-09-13T05:57:57.824745 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037288665771484375, :worker_monitor=>1.6952683925628662, :worker_dequeue=>0.009948015213012695, :total_time=>1.709216594696045} [----] I, [2016-09-13T05:58:01.024674 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:58:01.040412 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77088], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:58:01.051803 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77089], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:58:02.838956 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:58:03.029508 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77088], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.998527622] seconds [----] I, [2016-09-13T05:58:03.029708 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77088], Delivering... [----] I, [2016-09-13T05:58:03.036149 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003326416015625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033464431762695312, :pending_vm_jobs=>0.0007827281951904297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060558319091796875} [----] I, [2016-09-13T05:58:03.036546 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77088], State: [ok], Delivered in [0.006832149] seconds [----] I, [2016-09-13T05:58:05.120849 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77089], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.076021922] seconds [----] I, [2016-09-13T05:58:05.121050 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77089], Delivering... [----] I, [2016-09-13T05:58:05.125938 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77089], State: [ok], Delivered in [0.004870773] seconds [----] I, [2016-09-13T05:58:14.048195 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0027763843536376953, :worker_monitor=>1.1607654094696045, :worker_dequeue=>0.010386943817138672, :total_time=>1.1741955280303955} [----] I, [2016-09-13T05:58:16.063749 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:58:16.078998 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77090], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:58:19.048751 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:58:19 UTC]... [----] I, [2016-09-13T05:58:19.073517 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:58:19 UTC]...Complete [----] I, [2016-09-13T05:58:19.193131 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:58:20.131033 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77090], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.061740637] seconds [----] I, [2016-09-13T05:58:20.131315 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77090], Delivering... [----] I, [2016-09-13T05:58:20.137971 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003319978713989258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033414363861083984, :pending_vm_jobs=>0.0007851123809814453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005960226058959961} [----] I, [2016-09-13T05:58:20.138344 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77090], State: [ok], Delivered in [0.007043397] seconds [----] I, [2016-09-13T05:58:31.089250 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T05:58:31.106616 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77091], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:58:31.118186 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77092], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:58:31.135354 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77093], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:58:31.158276 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77094], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:58:35.169955 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:58:35.240798 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77091], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.147467985] seconds [----] I, [2016-09-13T05:58:35.241107 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77091], Delivering... [----] I, [2016-09-13T05:58:35.248746 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004215717315673828, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0042438507080078125, :pending_vm_jobs=>0.0009479522705078125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007102489471435547} [----] I, [2016-09-13T05:58:35.249110 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77091], State: [ok], Delivered in [0.008037137] seconds [----] I, [2016-09-13T05:58:35.285522 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77094], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.145824481] seconds [----] I, [2016-09-13T05:58:35.285710 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77094], Delivering... [----] I, [2016-09-13T05:58:35.285780 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77093], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.164626098] seconds [----] I, [2016-09-13T05:58:35.285780 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77092], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.176209388] seconds [----] I, [2016-09-13T05:58:35.285992 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77093], Delivering... [----] I, [2016-09-13T05:58:35.286016 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77092], Delivering... [----] I, [2016-09-13T05:58:35.287283 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T05:58:35.287528 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5354356736 [----] I, [2016-09-13T05:58:35.287629 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5135454208 [----] I, [2016-09-13T05:58:35.287706 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 218902528 [----] I, [2016-09-13T05:58:35.287770 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1319108608 [----] I, [2016-09-13T05:58:35.287836 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5081485312 [----] I, [2016-09-13T05:58:35.287900 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T05:58:35.287967 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T05:58:35.288030 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 539959296 [----] I, [2016-09-13T05:58:35.288095 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T05:58:35.288192 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8039178240 [----] I, [2016-09-13T05:58:35.288266 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T05:58:35.288330 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T05:58:35.288397 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T05:58:35.288496 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T05:58:35.288567 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T05:58:35.288631 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T05:58:35.288692 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T05:58:35.288756 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T05:58:35.288817 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T05:58:35.288880 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T05:58:35.288943 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273309696 [----] I, [2016-09-13T05:58:35.289009 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56414208 [----] I, [2016-09-13T05:58:35.289072 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216895488 [----] I, [2016-09-13T05:58:35.289146 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T05:58:35.289219 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140894208 [----] I, [2016-09-13T05:58:35.289283 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2586423296 [----] I, [2016-09-13T05:58:35.289347 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2272460800 [----] I, [2016-09-13T05:58:35.289434 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T05:58:35.289515 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T05:58:35.289579 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T05:58:35.289645 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37605376 [----] I, [2016-09-13T05:58:35.289709 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102293504 [----] I, [2016-09-13T05:58:35.289776 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53305344 [----] I, [2016-09-13T05:58:35.289849 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110383104 [----] I, [2016-09-13T05:58:35.289971 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155598848 [----] I, [2016-09-13T05:58:35.290091 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T05:58:35.290236 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T05:58:35.290365 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T05:58:35.290346 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77094], State: [ok], Delivered in [0.004600102] seconds [----] I, [2016-09-13T05:58:35.290535 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T05:58:35.290672 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T05:58:35.290807 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T05:58:35.290946 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T05:58:35.291085 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T05:58:35.291263 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T05:58:35.299341 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:58:16 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [236760.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T05:58:35.300078 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:58:29 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202018000], Memory % [3.38], CPU Time [148718.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:58:35.300764 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:58:27 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162418000], Memory % [3.1], CPU Time [37490.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T05:58:35.301332 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:58:18 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [103533.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T05:58:35.302195 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:58:29 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [199857.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T05:58:35.302885 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:58:29 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [149638.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T05:58:35.303592 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:58:28 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50852.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:58:35.304184 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:58:27 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [48381.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T05:58:35.308077 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:58:26 UTC], Process Info: Memory Usage [613490688], Memory Size [1135435776], Proportional Set Size: [448141000], Memory % [7.48], CPU Time [472.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:58:35.310999 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:58:27 UTC], Process Info: Memory Usage [588144640], Memory Size [917291008], Proportional Set Size: [425179000], Memory % [7.17], CPU Time [1103.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T05:58:35.313781 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:58:21 UTC], Process Info: Memory Usage [557744128], Memory Size [896253952], Proportional Set Size: [405377000], Memory % [6.8], CPU Time [4961.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T05:58:35.316457 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:58:24 UTC], Process Info: Memory Usage [579928064], Memory Size [907526144], Proportional Set Size: [419377000], Memory % [7.07], CPU Time [1586.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T05:58:35.317126 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:58:29 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [207033.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T05:58:35.317804 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:58:28 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [50869.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T05:58:35.318407 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 09:58:23 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165804000], Memory % [3.16], CPU Time [38393.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T05:58:35.318815 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77093], State: [ok], Delivered in [0.032825243] seconds [----] I, [2016-09-13T05:58:35.328335 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T05:58:35.328558 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T05:58:35.332150 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T05:58:35.334717 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T05:58:35.337739 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T05:58:35.340849 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T05:58:35.343864 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T05:58:35.348625 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 840 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T05:58:35.353744 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T05:58:35.359047 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T05:58:35.364453 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.6 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T05:58:35.369670 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T05:58:35.373280 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T05:58:35.376118 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T05:58:35.378800 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:58:35.378956 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T05:58:35.379053 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T05:58:35.383364 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [148706.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T05:58:35.383750 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77092], State: [ok], Delivered in [0.097738552] seconds [----] I, [2016-09-13T05:58:46.189670 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T05:58:46.249697 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77095], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:58:46.267094 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77096], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:58:46.313937 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77097], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:58:46.786029 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:58:46.792682 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0034644603729248047, :worker_monitor=>1.584028720855713, :worker_dequeue=>0.012064456939697266, :total_time=>1.5998773574829102} [----] I, [2016-09-13T05:58:47.324286 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77095], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.129258032] seconds [----] I, [2016-09-13T05:58:47.324398 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77095], Delivering... [----] I, [2016-09-13T05:58:47.352836 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77097], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.076163065] seconds [----] I, [2016-09-13T05:58:47.352997 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77097], Delivering... [----] I, [2016-09-13T05:58:47.358376 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029549598693847656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029921531677246094, :pending_vm_jobs=>0.0006363391876220703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0050792694091796875} [----] I, [2016-09-13T05:58:47.358701 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77097], State: [ok], Delivered in [0.005697421] seconds [----] I, [2016-09-13T05:58:47.369769 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77095], State: [ok], Delivered in [0.045345612] seconds [----] I, [2016-09-13T05:58:47.410374 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77096], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.155777746] seconds [----] I, [2016-09-13T05:58:47.410571 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77096], Delivering... [----] I, [2016-09-13T05:58:47.413410 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77096], State: [ok], Delivered in [0.002828046] seconds [----] I, [2016-09-13T05:58:51.793175 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:58:51 UTC]... [----] I, [2016-09-13T05:58:51.815927 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:58:51 UTC]...Complete [----] I, [2016-09-13T05:59:01.323999 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T05:59:01.341408 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77098], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:59:01.352835 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77099], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:59:03.086100 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:59:03.091390 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00400233268737793, :worker_monitor=>1.2278995513916016, :worker_dequeue=>0.009799957275390625, :total_time=>1.2420361042022705} [----] I, [2016-09-13T05:59:03.519087 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77098], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.19002267] seconds [----] I, [2016-09-13T05:59:03.519288 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77098], Delivering... [----] I, [2016-09-13T05:59:03.525151 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003172159194946289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031883716583251953, :pending_vm_jobs=>0.0006949901580810547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005483388900756836} [----] I, [2016-09-13T05:59:03.525485 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77098], State: [ok], Delivered in [0.006199958] seconds [----] I, [2016-09-13T05:59:05.490920 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77099], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.145545226] seconds [----] I, [2016-09-13T05:59:05.491230 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77099], Delivering... [----] I, [2016-09-13T05:59:05.498391 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77099], State: [ok], Delivered in [0.007186631] seconds [----] I, [2016-09-13T05:59:16.363798 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:59:16.387742 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77100], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:59:19.405866 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:59:19.409468 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003103017807006836, :worker_monitor=>1.2720139026641846, :worker_dequeue=>0.006479501724243164, :total_time=>1.2818191051483154} [----] I, [2016-09-13T05:59:19.670596 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77100], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.297752958] seconds [----] I, [2016-09-13T05:59:19.670789 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77100], Delivering... [----] I, [2016-09-13T05:59:19.677175 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003419160842895508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003441333770751953, :pending_vm_jobs=>0.0007266998291015625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005997419357299805} [----] I, [2016-09-13T05:59:19.677601 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77100], State: [ok], Delivered in [0.006784083] seconds [----] I, [2016-09-13T05:59:24.409937 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:59:24 UTC]... [----] I, [2016-09-13T05:59:24.429683 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:59:24 UTC]...Complete [----] I, [2016-09-13T05:59:31.400468 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T05:59:31.418648 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77101], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:59:31.435521 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77102], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:59:31.458260 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77103], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:59:31.487042 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77104], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:59:36.226751 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:59:36.231196 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004032611846923828, :worker_monitor=>1.6414802074432373, :worker_dequeue=>0.008231163024902344, :total_time=>1.654036045074463} [----] I, [2016-09-13T05:59:36.815558 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77103], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.376341045] seconds [----] I, [2016-09-13T05:59:36.815733 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77103], Delivering... [----] I, [2016-09-13T05:59:36.827168 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77101], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.421274787] seconds [----] I, [2016-09-13T05:59:36.827358 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77101], Delivering... [----] I, [2016-09-13T05:59:36.833777 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003338336944580078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033562183380126953, :pending_vm_jobs=>0.0008287429809570312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005994081497192383} [----] I, [2016-09-13T05:59:36.834109 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77101], State: [ok], Delivered in [0.006732374] seconds [----] I, [2016-09-13T05:59:36.918550 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77103], State: [ok], Delivered in [0.102780018] seconds [----] I, [2016-09-13T05:59:38.617025 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77102], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.19250518] seconds [----] I, [2016-09-13T05:59:38.617232 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77102], Delivering... [----] I, [2016-09-13T05:59:38.621580 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77102], State: [ok], Delivered in [0.004337035] seconds [----] I, [2016-09-13T05:59:38.623800 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77104], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.160801794] seconds [----] I, [2016-09-13T05:59:38.624028 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77104], Delivering... [----] I, [2016-09-13T05:59:38.631742 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77104], State: [ok], Delivered in [0.007726871] seconds [----] I, [2016-09-13T05:59:46.501014 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T05:59:46.518670 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77105], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T05:59:52.529805 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T05:59:52.533675 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002833127975463867, :worker_monitor=>1.2651705741882324, :worker_dequeue=>0.0071332454681396484, :total_time=>1.2753715515136719} [----] I, [2016-09-13T05:59:53.004931 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77105], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.49678428] seconds [----] I, [2016-09-13T05:59:53.005212 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77105], Delivering... [----] I, [2016-09-13T05:59:53.013889 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0047054290771484375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004731893539428711, :pending_vm_jobs=>0.0011301040649414062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00809335708618164} [----] I, [2016-09-13T05:59:53.014368 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77105], State: [ok], Delivered in [0.009172397] seconds [----] I, [2016-09-13T05:59:57.534257 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:59:57 UTC]... [----] I, [2016-09-13T05:59:57.559770 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 09:59:57 UTC]...Complete [----] I, [2016-09-13T06:00:01.886917 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 7. [----] I, [2016-09-13T06:00:01.924681 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77106], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:00:01.959068 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77107], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:00:01.987618 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77108], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:00:01.998867 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77109], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:00:02.000941 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget] [----] I, [2016-09-13T06:00:02.027942 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77110], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473764400] [----] I, [2016-09-13T06:00:02.028168 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T06:00:02.030207 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget] [----] I, [2016-09-13T06:00:02.044735 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77111], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473764400] [----] I, [2016-09-13T06:00:02.044929 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T06:00:02.061696 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77112], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:00:02.584185 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 7 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:00:02.753473 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77106], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.85782977] seconds [----] I, [2016-09-13T06:00:02.753669 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77106], Delivering... [----] I, [2016-09-13T06:00:02.759096 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77107], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.826738176] seconds [----] I, [2016-09-13T06:00:02.759331 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77107], Delivering... [----] I, [2016-09-13T06:00:02.760262 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003376007080078125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033981800079345703, :pending_vm_jobs=>0.0008828639984130859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00620579719543457} [----] I, [2016-09-13T06:00:02.760637 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77106], State: [ok], Delivered in [0.006951304] seconds [----] I, [2016-09-13T06:00:02.761821 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77107], State: [ok], Delivered in [0.002493415] seconds [----] I, [2016-09-13T06:00:02.798778 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77108], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.831509506] seconds [----] I, [2016-09-13T06:00:02.798974 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77108], Delivering... [----] I, [2016-09-13T06:00:02.809157 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77108], State: [ok], Delivered in [0.010143817] seconds [----] I, [2016-09-13T06:00:02.815896 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77109], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.822106969] seconds [----] I, [2016-09-13T06:00:02.816069 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77109], Delivering... [----] I, [2016-09-13T06:00:02.822158 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77109], State: [ok], Delivered in [0.006066746] seconds [----] I, [2016-09-13T06:00:02.838653 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77112], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.787560948] seconds [----] I, [2016-09-13T06:00:02.838817 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77112], Delivering... [----] I, [2016-09-13T06:00:02.843371 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77112], State: [ok], Delivered in [0.004536819] seconds [----] I, [2016-09-13T06:00:02.850652 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77110], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473764400], Dequeued in: [0.848000725] seconds [----] I, [2016-09-13T06:00:02.850833 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77110], Delivering... [----] I, [2016-09-13T06:00:02.861618 #2937:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered Hosts] invoking action: [generate_widget] for target: [rss_newest_hosts] [----] I, [2016-09-13T06:00:02.873358 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77111], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473764400], Dequeued in: [0.841165001] seconds [----] I, [2016-09-13T06:00:02.873550 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77111], Delivering... [----] I, [2016-09-13T06:00:02.882714 #2928:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered VMs] invoking action: [generate_widget] for target: [rss_newest_vms] [----] I, [2016-09-13T06:00:02.919068 #2937:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [213], Name: [Generate Widget: 'EVM: Recently Discovered Hosts'] for: [1] groups [----] I, [2016-09-13T06:00:02.924387 #2928:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [214], Name: [Generate Widget: 'EVM: Recently Discovered VMs'] for: [1] groups [----] I, [2016-09-13T06:00:02.941853 #2928:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered VMs] ID: [19] Queueing Content Generation [----] I, [2016-09-13T06:00:02.959288 #2937:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered Hosts] ID: [18] Queueing Content Generation [----] I, [2016-09-13T06:00:02.971507 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77113], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T06:00:02.971809 #2928:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered VMs] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered VMs] [----] I, [2016-09-13T06:00:02.994216 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77114], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T06:00:02.994570 #2937:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered Hosts] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered Hosts] [----] I, [2016-09-13T06:00:03.008780 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77111], State: [ok], Delivered in [0.135171875] seconds [----] I, [2016-09-13T06:00:03.051040 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77110], State: [ok], Delivered in [0.200151472] seconds [----] I, [2016-09-13T06:00:09.208090 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=reporting, wcount=2, priority=200 [----] I, [2016-09-13T06:00:09.212677 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038466453552246094, :worker_monitor=>1.6070091724395752, :worker_dequeue=>0.012001514434814453, :total_time=>1.6232268810272217} [----] I, [2016-09-13T06:00:10.832611 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [77113], MiqWorker id: [18], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [7.88343063] seconds [----] I, [2016-09-13T06:00:10.832801 #2978:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77113], Delivering... [----] I, [2016-09-13T06:00:10.850543 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T06:00:10.889195 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T06:00:10.889716 #2978:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77113], State: [ok], Delivered in [0.056913646] seconds [----] I, [2016-09-13T06:00:10.892151 #2978:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [77113], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T06:00:10.892336 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [19], MiqTask ID: [214], Status: [ok] [----] I, [2016-09-13T06:00:10.897603 #2978:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [214] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T06:00:10.969750 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [77114], MiqWorker id: [18], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [7.998090892] seconds [----] I, [2016-09-13T06:00:10.969961 #2978:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77114], Delivering... [----] I, [2016-09-13T06:00:10.987311 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T06:00:11.014782 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T06:00:11.015282 #2978:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77114], State: [ok], Delivered in [0.045315924] seconds [----] I, [2016-09-13T06:00:11.017803 #2978:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [77114], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T06:00:11.018121 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [18], MiqTask ID: [213], Status: [ok] [----] I, [2016-09-13T06:00:11.023460 #2978:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [213] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T06:00:17.076982 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:00:17.089185 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77115], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:00:17.094820 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered VMs] with id: [19] [----] I, [2016-09-13T06:00:17.094952 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_19 [----] I, [2016-09-13T06:00:17.097506 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T06:00:17.097793 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 11:00:00 UTC [----] I, [2016-09-13T06:00:17.099045 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered VMs] schedule updated to run at 2016-09-13 11:00:00 UTC with interval 3600 [----] I, [2016-09-13T06:00:17.099337 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered Hosts] with id: [18] [----] I, [2016-09-13T06:00:17.099457 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_18 [----] I, [2016-09-13T06:00:17.101712 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T06:00:17.102003 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 11:00:00 UTC [----] I, [2016-09-13T06:00:17.103328 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered Hosts] schedule updated to run at 2016-09-13 11:00:00 UTC with interval 3600 [----] I, [2016-09-13T06:00:19.244015 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:00:20.228356 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77115], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.147019986] seconds [----] I, [2016-09-13T06:00:20.228629 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77115], Delivering... [----] I, [2016-09-13T06:00:20.234544 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032813549041748047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032973289489746094, :pending_vm_jobs=>0.0006639957427978516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0054912567138671875} [----] I, [2016-09-13T06:00:20.234885 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77115], State: [ok], Delivered in [0.0062706] seconds [----] I, [2016-09-13T06:00:25.610123 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004328727722167969, :worker_monitor=>1.3497002124786377, :worker_dequeue=>0.007943153381347656, :total_time=>1.362267017364502} [----] I, [2016-09-13T06:00:30.610714 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:00:30 UTC]... [----] I, [2016-09-13T06:00:30.633357 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:00:30 UTC]...Complete [----] I, [2016-09-13T06:00:32.109768 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:00:32.130269 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77116], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:00:32.147537 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77117], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:00:32.164621 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77118], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:00:32.175572 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77119], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:00:35.776588 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:00:36.130369 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77116], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.014526594] seconds [----] I, [2016-09-13T06:00:36.130583 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77116], Delivering... [----] I, [2016-09-13T06:00:36.139705 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004153251647949219, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0041811466217041016, :pending_vm_jobs=>0.0013957023620605469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008718729019165039} [----] I, [2016-09-13T06:00:36.140225 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77116], State: [ok], Delivered in [0.00958453] seconds [----] I, [2016-09-13T06:00:36.160041 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77118], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.008513096] seconds [----] I, [2016-09-13T06:00:36.160247 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77118], Delivering... [----] I, [2016-09-13T06:00:36.164708 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77117], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.030116172] seconds [----] I, [2016-09-13T06:00:36.164952 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77117], Delivering... [----] I, [2016-09-13T06:00:36.172919 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77117], State: [ok], Delivered in [0.007938362] seconds [----] I, [2016-09-13T06:00:36.204713 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77119], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.034816725] seconds [----] I, [2016-09-13T06:00:36.204947 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77119], Delivering... [----] I, [2016-09-13T06:00:36.208989 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77119], State: [ok], Delivered in [0.004022798] seconds [----] I, [2016-09-13T06:00:36.216237 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77118], State: [ok], Delivered in [0.055887009] seconds [----] I, [2016-09-13T06:00:41.897484 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004004716873168945, :worker_monitor=>1.1037542819976807, :worker_dequeue=>0.006162166595458984, :total_time=>1.1142239570617676} [----] I, [2016-09-13T06:00:47.191221 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:00:47.216257 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77120], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:00:51.923464 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:00:52.427951 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77120], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.230629714] seconds [----] I, [2016-09-13T06:00:52.428170 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77120], Delivering... [----] I, [2016-09-13T06:00:52.434731 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033750534057617188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033943653106689453, :pending_vm_jobs=>0.0008320808410644531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006104230880737305} [----] I, [2016-09-13T06:00:52.435107 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77120], State: [ok], Delivered in [0.006956913] seconds [----] I, [2016-09-13T06:00:58.282248 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005112171173095703, :worker_monitor=>1.3362793922424316, :worker_dequeue=>0.010255813598632812, :total_time=>1.3521440029144287} [----] I, [2016-09-13T06:01:02.227110 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T06:01:02.273174 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77121], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:01:02.319230 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77122], id: [], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:01:02.353636 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77123], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:01:03.282753 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:01:03 UTC]... [----] I, [2016-09-13T06:01:03.307652 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:01:03 UTC]...Complete [----] I, [2016-09-13T06:01:03.318488 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:01:03.439772 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77122], MiqWorker id: [14], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.158255126] seconds [----] I, [2016-09-13T06:01:03.439985 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77122], Delivering... [----] I, [2016-09-13T06:01:03.459674 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77121], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.22834651] seconds [----] I, [2016-09-13T06:01:03.460005 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77121], Delivering... [----] I, [2016-09-13T06:01:03.468796 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005020618438720703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005045413970947266, :pending_vm_jobs=>0.0009677410125732422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008173704147338867} [----] I, [2016-09-13T06:01:03.471833 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77121], State: [ok], Delivered in [0.011809311] seconds [----] I, [2016-09-13T06:01:03.513987 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77123], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.1899762] seconds [----] I, [2016-09-13T06:01:03.514253 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77123], Delivering... [----] I, [2016-09-13T06:01:03.520688 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77123], State: [ok], Delivered in [0.00641311] seconds [----] I, [2016-09-13T06:01:15.462010 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0060498714447021484, :worker_monitor=>2.1019656658172607, :worker_dequeue=>0.010668516159057617, :total_time=>2.119135856628418} [----] I, [2016-09-13T06:01:17.366107 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:01:17.394153 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77124], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:01:20.470630 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:01:20.693792 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77124], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.321896535] seconds [----] I, [2016-09-13T06:01:20.693940 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77124], Delivering... [----] I, [2016-09-13T06:01:20.698270 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002335071563720703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023500919342041016, :pending_vm_jobs=>0.0005650520324707031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004044771194458008} [----] I, [2016-09-13T06:01:20.698542 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77124], State: [ok], Delivered in [0.004599274] seconds [----] I, [2016-09-13T06:01:32.409258 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:01:32.489562 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77125], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:01:32.551876 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77126], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:01:32.673580 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77127], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:01:32.758288 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77128], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:01:33.251937 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:01:33.255790 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038466453552246094, :worker_monitor=>2.7441678047180176, :worker_dequeue=>0.010089635848999023, :total_time=>2.7584235668182373} [----] I, [2016-09-13T06:01:33.655007 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77125], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.241683177] seconds [----] I, [2016-09-13T06:01:33.655168 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77125], Delivering... [----] I, [2016-09-13T06:01:33.659640 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025544166564941406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002567291259765625, :pending_vm_jobs=>0.00046825408935546875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0042378902435302734} [----] I, [2016-09-13T06:01:33.659874 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77125], State: [ok], Delivered in [0.004716584] seconds [----] I, [2016-09-13T06:01:33.803187 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77127], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.245115319] seconds [----] I, [2016-09-13T06:01:33.803308 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77127], Delivering... [----] I, [2016-09-13T06:01:33.866506 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77127], State: [ok], Delivered in [0.063153415] seconds [----] I, [2016-09-13T06:01:33.951947 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77126], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.459455001] seconds [----] I, [2016-09-13T06:01:33.952069 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77126], Delivering... [----] I, [2016-09-13T06:01:33.957992 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77126], State: [ok], Delivered in [0.005814838] seconds [----] I, [2016-09-13T06:01:34.050065 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77128], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.370960052] seconds [----] I, [2016-09-13T06:01:34.050626 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77128], Delivering... [----] I, [2016-09-13T06:01:34.055890 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77128], State: [ok], Delivered in [0.005330811] seconds [----] I, [2016-09-13T06:01:38.256335 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:01:38 UTC]... [----] I, [2016-09-13T06:01:38.303836 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:01:38 UTC]...Complete [----] I, [2016-09-13T06:01:47.770677 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:01:47.810713 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77129], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:01:50.941106 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:01:50.958226 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002674102783203125, :worker_monitor=>2.332488775253296, :worker_dequeue=>0.025762081146240234, :total_time=>2.3611984252929688} [----] I, [2016-09-13T06:01:51.071332 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77129], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.293038579] seconds [----] I, [2016-09-13T06:01:51.071579 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77129], Delivering... [----] I, [2016-09-13T06:01:51.077735 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002907991409301758, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029273033142089844, :pending_vm_jobs=>0.0008566379547119141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005758523941040039} [----] I, [2016-09-13T06:01:51.078150 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77129], State: [ok], Delivered in [0.006552186] seconds [----] I, [2016-09-13T06:02:02.826879 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:02:02.862779 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77130], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:02:02.942896 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77131], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:02:08.219516 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:02:08.230637 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037033557891845703, :worker_monitor=>2.2163920402526855, :worker_dequeue=>0.02108454704284668, :total_time=>2.241541624069214} [----] I, [2016-09-13T06:02:08.300728 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77130], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.464758139] seconds [----] I, [2016-09-13T06:02:08.300987 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77130], Delivering... [----] I, [2016-09-13T06:02:08.311077 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004983186721801758, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005011320114135742, :pending_vm_jobs=>0.001260519027709961, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009596824645996094} [----] I, [2016-09-13T06:02:08.311584 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77130], State: [ok], Delivered in [0.010583442] seconds [----] I, [2016-09-13T06:02:10.285464 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77131], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.418271475] seconds [----] I, [2016-09-13T06:02:10.285692 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77131], Delivering... [----] I, [2016-09-13T06:02:10.290829 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77131], State: [ok], Delivered in [0.005122458] seconds [----] I, [2016-09-13T06:02:13.231342 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:02:13 UTC]... [----] I, [2016-09-13T06:02:13.261487 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:02:13 UTC]...Complete [----] I, [2016-09-13T06:02:17.960216 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:02:18.017654 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77132], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:02:18.293785 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:02:18.469867 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77132], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.503485823] seconds [----] I, [2016-09-13T06:02:18.470077 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77132], Delivering... [----] I, [2016-09-13T06:02:18.476040 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035996437072753906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036232471466064453, :pending_vm_jobs=>0.0006194114685058594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005582571029663086} [----] I, [2016-09-13T06:02:18.476654 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77132], State: [ok], Delivered in [0.006526369] seconds [----] I, [2016-09-13T06:02:25.258024 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005428791046142578, :worker_monitor=>1.9412896633148193, :worker_dequeue=>0.0093536376953125, :total_time=>1.9564838409423828} [----] I, [2016-09-13T06:02:33.026641 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:02:33.049134 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77133], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:02:33.095268 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77134], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:02:33.123159 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77135], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:02:33.157723 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77136], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:02:35.291970 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:02:35.705651 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77133], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.673475407] seconds [----] I, [2016-09-13T06:02:35.705858 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77133], Delivering... [----] I, [2016-09-13T06:02:35.711540 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003307342529296875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003328084945678711, :pending_vm_jobs=>0.0006039142608642578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005304574966430664} [----] I, [2016-09-13T06:02:35.711852 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77133], State: [ok], Delivered in [0.006000527] seconds [----] I, [2016-09-13T06:02:35.832487 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77135], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.73075514] seconds [----] I, [2016-09-13T06:02:35.832702 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77135], Delivering... [----] I, [2016-09-13T06:02:35.899091 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77135], State: [ok], Delivered in [0.066358265] seconds [----] I, [2016-09-13T06:02:37.436929 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77134], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.384952132] seconds [----] I, [2016-09-13T06:02:37.437153 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77134], Delivering... [----] I, [2016-09-13T06:02:37.442795 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77134], State: [ok], Delivered in [0.005627155] seconds [----] I, [2016-09-13T06:02:37.500077 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77136], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.373155674] seconds [----] I, [2016-09-13T06:02:37.500349 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77136], Delivering... [----] I, [2016-09-13T06:02:37.504689 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77136], State: [ok], Delivered in [0.004308897] seconds [----] I, [2016-09-13T06:02:40.478148 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T06:02:42.857645 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005193471908569336, :server_monitor=>0.15724873542785645, :log_active_servers=>0.016518592834472656, :worker_monitor=>2.3708391189575195, :worker_dequeue=>0.008195877075195312, :total_time=>2.5585107803344727} [----] I, [2016-09-13T06:02:46.053810 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77122], State: [ok], Delivered in [102.613788108] seconds [----] I, [2016-09-13T06:02:47.858212 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:02:47 UTC]... [----] I, [2016-09-13T06:02:47.914770 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:02:47 UTC]...Complete [----] I, [2016-09-13T06:02:48.178761 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:02:48.200328 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77137], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:02:52.950042 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:02:53.098834 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77137], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.913993869] seconds [----] I, [2016-09-13T06:02:53.099037 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77137], Delivering... [----] I, [2016-09-13T06:02:53.105443 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034363269805908203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003459930419921875, :pending_vm_jobs=>0.0007672309875488281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005956411361694336} [----] I, [2016-09-13T06:02:53.105792 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77137], State: [ok], Delivered in [0.006752987] seconds [----] I, [2016-09-13T06:03:00.592670 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004389524459838867, :worker_monitor=>2.619842290878296, :worker_dequeue=>0.011563539505004883, :total_time=>2.636075496673584} [----] I, [2016-09-13T06:03:03.212058 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:03:03.252108 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77138], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:03:03.286335 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77139], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:03:05.598410 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:03:06.235624 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77139], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.977654201] seconds [----] I, [2016-09-13T06:03:06.235801 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77139], Delivering... [----] I, [2016-09-13T06:03:06.241699 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003099679946899414, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031175613403320312, :pending_vm_jobs=>0.0007343292236328125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005585193634033203} [----] I, [2016-09-13T06:03:06.242005 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77139], State: [ok], Delivered in [0.006200214] seconds [----] I, [2016-09-13T06:03:07.197354 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77138], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.980628171] seconds [----] I, [2016-09-13T06:03:07.197560 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77138], Delivering... [----] I, [2016-09-13T06:03:07.201475 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77138], State: [ok], Delivered in [0.003907825] seconds [----] I, [2016-09-13T06:03:16.808910 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00405430793762207, :worker_monitor=>1.1744410991668701, :worker_dequeue=>0.011969804763793945, :total_time=>1.1907823085784912} [----] I, [2016-09-13T06:03:18.298759 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:03:18.318347 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77140], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:03:21.809458 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:03:21 UTC]... [----] I, [2016-09-13T06:03:21.828201 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:03:21 UTC]...Complete [----] I, [2016-09-13T06:03:21.838863 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:03:22.290224 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77140], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.985294951] seconds [----] I, [2016-09-13T06:03:22.290508 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77140], Delivering... [----] I, [2016-09-13T06:03:22.300972 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005475044250488281, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005503654479980469, :pending_vm_jobs=>0.0011818408966064453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009643793106079102} [----] I, [2016-09-13T06:03:22.301399 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77140], State: [ok], Delivered in [0.010931165] seconds [----] I, [2016-09-13T06:03:33.332253 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T06:03:33.358721 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77141], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:03:33.368706 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:03:33.372190 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004845142364501953, :worker_monitor=>1.5001590251922607, :worker_dequeue=>0.006315946578979492, :total_time=>1.5117366313934326} [----] I, [2016-09-13T06:03:33.387760 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77142], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:03:33.410233 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77143], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:03:33.444598 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77144], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:03:33.449862 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77141], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.112898632] seconds [----] I, [2016-09-13T06:03:33.449965 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77141], Delivering... [----] I, [2016-09-13T06:03:33.450589 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T06:03:33.450716 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5353934848 [----] I, [2016-09-13T06:03:33.450771 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5134815232 [----] I, [2016-09-13T06:03:33.450818 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 219119616 [----] I, [2016-09-13T06:03:33.450859 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1319108608 [----] I, [2016-09-13T06:03:33.450900 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5080834048 [----] I, [2016-09-13T06:03:33.450938 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T06:03:33.450977 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T06:03:33.451016 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 540659712 [----] I, [2016-09-13T06:03:33.451054 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T06:03:33.451094 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7916212224 [----] I, [2016-09-13T06:03:33.451146 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T06:03:33.451190 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T06:03:33.451238 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T06:03:33.451304 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 409600 [----] I, [2016-09-13T06:03:33.451358 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T06:03:33.451398 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T06:03:33.451459 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T06:03:33.451502 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T06:03:33.451543 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T06:03:33.451581 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T06:03:33.451628 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273772544 [----] I, [2016-09-13T06:03:33.451669 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56647680 [----] I, [2016-09-13T06:03:33.451710 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217124864 [----] I, [2016-09-13T06:03:33.451747 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6225920 [----] I, [2016-09-13T06:03:33.451786 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141131776 [----] I, [2016-09-13T06:03:33.451826 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2587119616 [----] I, [2016-09-13T06:03:33.451865 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2272714752 [----] I, [2016-09-13T06:03:33.451903 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T06:03:33.451940 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T06:03:33.451976 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T06:03:33.452012 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37634048 [----] I, [2016-09-13T06:03:33.452058 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102285312 [----] I, [2016-09-13T06:03:33.452098 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53198848 [----] I, [2016-09-13T06:03:33.452148 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110637056 [----] I, [2016-09-13T06:03:33.452190 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155484160 [----] I, [2016-09-13T06:03:33.452227 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T06:03:33.452264 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T06:03:33.452303 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T06:03:33.452340 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T06:03:33.452377 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T06:03:33.452429 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T06:03:33.452480 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T06:03:33.452521 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 8192 [----] I, [2016-09-13T06:03:33.452559 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T06:03:33.455625 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77145], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:03:33.479013 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77146], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:03:33.495475 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T06:03:33.495808 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T06:03:33.499157 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T06:03:33.501621 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T06:03:33.504499 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T06:03:33.507339 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T06:03:33.510196 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T06:03:33.513147 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 841 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T06:03:33.516055 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T06:03:33.518915 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T06:03:33.521706 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.6 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T06:03:33.524515 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T06:03:33.527327 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 182 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T06:03:33.530084 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T06:03:33.533293 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:03:33.533516 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:03:33.533683 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>4, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T06:03:33.538194 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202018000], Memory % [3.38], CPU Time [148769.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:03:33.538559 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77141], State: [ok], Delivered in [0.088561161] seconds [----] I, [2016-09-13T06:03:38.381612 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:03:38.547356 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77142], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.184350445] seconds [----] I, [2016-09-13T06:03:38.547579 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77142], Delivering... [----] I, [2016-09-13T06:03:38.555805 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:03:32 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202018000], Memory % [3.38], CPU Time [148783.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:03:38.556294 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:03:30 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347147000], Memory % [5.04], CPU Time [103549.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T06:03:38.556813 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:03:32 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50883.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:03:38.557515 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:03:27 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212538000], Memory % [3.5], CPU Time [48389.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T06:03:38.558100 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:03:30 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162418000], Memory % [3.1], CPU Time [37500.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T06:03:38.558632 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:03:18 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [236926.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T06:03:38.559110 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:03:31 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358681000], Memory % [5.28], CPU Time [201395.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T06:03:38.559633 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:03:32 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [149688.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:03:38.562756 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:03:27 UTC], Process Info: Memory Usage [611033088], Memory Size [978149376], Proportional Set Size: [445756000], Memory % [7.45], CPU Time [557.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:03:38.565084 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:03:28 UTC], Process Info: Memory Usage [588144640], Memory Size [917291008], Proportional Set Size: [425179000], Memory % [7.17], CPU Time [1116.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:03:38.567403 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:03:24 UTC], Process Info: Memory Usage [580149248], Memory Size [921681920], Proportional Set Size: [419592000], Memory % [7.07], CPU Time [1597.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T06:03:38.569514 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:03:32 UTC], Process Info: Memory Usage [558014464], Memory Size [911982592], Proportional Set Size: [405617000], Memory % [6.8], CPU Time [4972.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T06:03:38.570266 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:03:31 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [207098.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T06:03:38.570802 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:03:32 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [50885.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:03:38.571244 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:03:23 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38404.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T06:03:38.571602 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77142], State: [ok], Delivered in [0.024024989] seconds [----] I, [2016-09-13T06:03:38.599868 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77144], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.185330158] seconds [----] I, [2016-09-13T06:03:38.600032 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77144], Delivering... [----] I, [2016-09-13T06:03:38.610078 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77146], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.141126374] seconds [----] I, [2016-09-13T06:03:38.610282 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77146], Delivering... [----] I, [2016-09-13T06:03:38.616642 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034329891204833984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003452301025390625, :pending_vm_jobs=>0.0007503032684326172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005939960479736328} [----] I, [2016-09-13T06:03:38.616974 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77146], State: [ok], Delivered in [0.006690111] seconds [----] I, [2016-09-13T06:03:38.638309 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77144], State: [ok], Delivered in [0.038269249] seconds [----] I, [2016-09-13T06:03:40.370368 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77143], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.976669663] seconds [----] I, [2016-09-13T06:03:40.370588 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77143], Delivering... [----] I, [2016-09-13T06:03:40.376469 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77143], State: [ok], Delivered in [0.005856656] seconds [----] I, [2016-09-13T06:03:40.427225 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77145], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.976965498] seconds [----] I, [2016-09-13T06:03:40.427562 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77145], Delivering... [----] I, [2016-09-13T06:03:40.430475 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77145], State: [ok], Delivered in [0.002881471] seconds [----] I, [2016-09-13T06:03:48.493972 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:03:48.513184 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77147], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:03:49.990439 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:03:49.997438 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006459712982177734, :worker_monitor=>1.5243523120880127, :worker_dequeue=>0.012525796890258789, :total_time=>1.5436935424804688} [----] I, [2016-09-13T06:03:50.747590 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77147], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.247496368] seconds [----] I, [2016-09-13T06:03:50.747832 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77147], Delivering... [----] I, [2016-09-13T06:03:50.754560 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035753250122070312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003600597381591797, :pending_vm_jobs=>0.00087738037109375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006337881088256836} [----] I, [2016-09-13T06:03:50.754951 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77147], State: [ok], Delivered in [0.007144153] seconds [----] I, [2016-09-13T06:03:54.997990 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:03:54 UTC]... [----] I, [2016-09-13T06:03:55.015898 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:03:54 UTC]...Complete [----] I, [2016-09-13T06:04:03.526168 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 11. [----] I, [2016-09-13T06:04:03.558894 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77148], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:04:03.576580 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77149], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:04:03.587299 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77150], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:04:06.522170 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:04:06.529214 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004782438278198242, :worker_monitor=>1.4588007926940918, :worker_dequeue=>0.012677192687988281, :total_time=>1.476592779159546} [----] I, [2016-09-13T06:04:06.856597 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77150], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.27443093] seconds [----] I, [2016-09-13T06:04:06.856874 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77150], Delivering... [----] I, [2016-09-13T06:04:06.866337 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005040884017944336, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005070209503173828, :pending_vm_jobs=>0.0011887550354003906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008926630020141602} [----] I, [2016-09-13T06:04:06.866839 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77150], State: [ok], Delivered in [0.009963502] seconds [----] I, [2016-09-13T06:04:07.556815 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77148], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.012127644] seconds [----] I, [2016-09-13T06:04:07.557016 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77148], Delivering... [----] I, [2016-09-13T06:04:07.587777 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77151], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T06:04:07.602395 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77152], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T06:04:07.602820 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77148], State: [ok], Delivered in [0.045795383] seconds [----] I, [2016-09-13T06:04:07.625048 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77149], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.058236557] seconds [----] I, [2016-09-13T06:04:07.625236 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77149], Delivering... [----] I, [2016-09-13T06:04:07.629618 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77149], State: [ok], Delivered in [0.004377578] seconds [----] I, [2016-09-13T06:04:11.544634 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T06:04:11.547177 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T06:04:16.563465 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T06:04:16.565009 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T06:04:17.906562 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [77152], MiqWorker id: [98], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [10.312568857] seconds [----] I, [2016-09-13T06:04:17.906826 #3290:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77152], Delivering... [----] I, [2016-09-13T06:04:17.911155 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T06:04:17.911349 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T06:04:17.911546 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T06:04:17.911725 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T06:04:17.911927 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:18.100715 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [77151], MiqWorker id: [97], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [10.526103309] seconds [----] I, [2016-09-13T06:04:18.100994 #30088:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77151], Delivering... [----] I, [2016-09-13T06:04:18.105365 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T06:04:18.105606 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T06:04:18.105762 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T06:04:18.105952 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T06:04:18.106144 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:18.351832 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:18.391020 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:18.592483 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:18.592666 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:18.601396 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:04:18.642443 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77153], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:04:18.659731 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:18.659913 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:18.933484 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:19.030809 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:19.120948 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:19.147635 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:19.414606 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:19.451455 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:19.451657 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:19.519714 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:19.612525 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:19.705040 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:19.796794 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:19.890347 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:19.936070 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:19.981812 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:20.073193 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:20.166702 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:20.248471 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:20.248640 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:20.260222 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:20.351783 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:20.444476 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:20.535753 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:20.627816 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:20.696934 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:20.720056 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:20.811311 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:20.903616 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:04:21.014177 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:21.014451 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:21.122311 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T06:04:21.122552 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.0040798187255859375, :collect_inventory_for_targets=>0.0001456737518310547, :parse_legacy_inventory=>26.85983920097351, :parse_targeted_inventory=>26.860039472579956, :save_inventory=>1.278721809387207, :ems_refresh=>28.142584800720215} [----] I, [2016-09-13T06:04:21.139349 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T06:04:21.139764 #30088:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77151], State: [ok], Delivered in [3.038806616] seconds [----] I, [2016-09-13T06:04:21.482534 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:21.783112 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:21.783247 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:22.291865 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:22.576784 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:22.576934 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:22.650065 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:04:22.654506 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003045320510864258, :worker_monitor=>1.0778913497924805, :worker_dequeue=>0.007894515991210938, :total_time=>1.089106798171997} [----] I, [2016-09-13T06:04:22.688320 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77153], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.081296899] seconds [----] I, [2016-09-13T06:04:22.688476 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77153], Delivering... [----] I, [2016-09-13T06:04:22.693078 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024962425231933594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025091171264648438, :pending_vm_jobs=>0.0006070137023925781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00429987907409668} [----] I, [2016-09-13T06:04:22.693355 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77153], State: [ok], Delivered in [0.00488309] seconds [----] I, [2016-09-13T06:04:23.078520 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:23.378532 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:23.378735 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:23.854938 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:24.146548 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:24.146717 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:24.657590 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:24.955441 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:24.955608 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:25.439093 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:25.749615 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:25.749813 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:26.228034 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:26.547322 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:26.547528 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:27.018857 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:27.313626 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:27.313772 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:27.655013 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:04:27 UTC]... [----] I, [2016-09-13T06:04:27.676528 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:04:27 UTC]...Complete [----] I, [2016-09-13T06:04:27.775805 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:28.069740 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:28.069915 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:28.546437 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:28.704315 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:28.843037 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:28.978235 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:29.112223 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:29.251045 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:29.387407 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:29.528806 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:29.666307 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:29.803479 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:29.947569 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:30.085482 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:30.239924 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:30.375922 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:30.507077 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:30.861191 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:31.016377 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:31.157318 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:31.296588 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:31.433634 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:31.569972 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:31.715148 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:31.860226 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:31.998677 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:32.140874 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:32.278583 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:32.418820 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:32.556693 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:32.696306 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:32.842569 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:32.990007 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:33.125304 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:33.573234 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:33.656796 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:04:33.682867 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77154], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:04:33.705787 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77155], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:04:33.728465 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77156], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:04:33.732723 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:33.756761 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77157], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:04:38.946312 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:04:38.952435 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0048215389251708984, :worker_monitor=>1.231461524963379, :worker_dequeue=>0.011597156524658203, :total_time=>1.2483277320861816} [----] I, [2016-09-13T06:04:39.082627 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77155], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.395434923] seconds [----] I, [2016-09-13T06:04:39.082772 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77155], Delivering... [----] I, [2016-09-13T06:04:39.088297 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77157], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.350257588] seconds [----] I, [2016-09-13T06:04:39.088501 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77157], Delivering... [----] I, [2016-09-13T06:04:39.093885 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002941131591796875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002957582473754883, :pending_vm_jobs=>0.0006470680236816406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005086421966552734} [----] I, [2016-09-13T06:04:39.094160 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77157], State: [ok], Delivered in [0.005667772] seconds [----] I, [2016-09-13T06:04:39.122398 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77155], State: [ok], Delivered in [0.03959589] seconds [----] I, [2016-09-13T06:04:39.907884 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:40.046711 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:40.185308 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:40.325567 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:40.471455 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:40.627916 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:40.769359 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:40.808210 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77154], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.146715491] seconds [----] I, [2016-09-13T06:04:40.808332 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77154], Delivering... [----] I, [2016-09-13T06:04:40.811246 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77154], State: [ok], Delivered in [0.002914759] seconds [----] I, [2016-09-13T06:04:40.836902 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77156], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.123717828] seconds [----] I, [2016-09-13T06:04:40.837134 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77156], Delivering... [----] I, [2016-09-13T06:04:40.844947 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77156], State: [ok], Delivered in [0.007806046] seconds [----] I, [2016-09-13T06:04:40.917412 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:41.061657 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:41.207389 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:41.343883 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:41.483912 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:41.625171 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:41.768468 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:41.912681 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:42.345132 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:42.506784 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:42.647644 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:42.793863 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:42.934571 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:43.123313 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:43.266641 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:43.408273 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:43.549515 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:43.692868 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:43.834364 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:43.967451 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:44.111353 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:44.253674 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:44.393941 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:44.533313 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:44.671214 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:45.030379 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:45.179248 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:45.329200 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:45.465338 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:45.604350 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:45.749531 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:45.888716 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:46.027303 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:46.165767 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:46.310002 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:46.450545 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:46.592479 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:46.726766 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:46.868046 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:47.014041 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:47.152403 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:47.295574 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:47.835182 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:47.974657 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:48.110847 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:48.248135 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:48.398919 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:48.543365 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:48.678358 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:48.769980 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:04:48.814553 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:48.825941 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77158], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:04:48.948191 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:49.080990 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:49.096686 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:04:49.197684 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77158], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.420792362] seconds [----] I, [2016-09-13T06:04:49.197971 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77158], Delivering... [----] I, [2016-09-13T06:04:49.208006 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0052301883697509766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0052602291107177734, :pending_vm_jobs=>0.001283884048461914, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009481430053710938} [----] I, [2016-09-13T06:04:49.208521 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77158], State: [ok], Delivered in [0.010537023] seconds [----] I, [2016-09-13T06:04:49.215700 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:49.351306 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:49.499884 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:49.642852 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:49.786665 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:49.924660 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:50.060365 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:50.556832 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:50.713734 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:55.641261 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039539337158203125, :worker_monitor=>1.514435052871704, :worker_dequeue=>0.018221139907836914, :total_time=>1.5369138717651367} [----] I, [2016-09-13T06:04:56.874664 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:57.012560 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:57.149534 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:57.294055 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:57.455376 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:57.597034 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:57.739403 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:57.921004 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:58.074765 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:58.224991 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:58.365322 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:58.503400 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:58.688635 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:58.850400 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:58.996706 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:59.570920 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:59.768713 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:04:59.913644 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:00.050962 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:00.200706 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:00.396895 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:00.531741 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:00.641956 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:05:00 UTC]... [----] I, [2016-09-13T06:05:00.665910 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:05:00 UTC]...Complete [----] I, [2016-09-13T06:05:00.669252 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:00.804509 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:00.939916 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:01.084876 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:01.224211 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:01.369814 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:01.514668 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:01.656917 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:01.803659 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:01.954022 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:02.421077 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:02.567374 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:02.720505 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:02.858759 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:02.993971 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:03.137008 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:03.277479 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:03.413619 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:03.553154 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:03.691905 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:03.843358 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:05:03.882940 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77159], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:05:03.894100 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77160], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:05:05.692286 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:05:06.317222 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77160], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.428450335] seconds [----] I, [2016-09-13T06:05:06.317396 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77160], Delivering... [----] I, [2016-09-13T06:05:06.321713 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023555755615234375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002371549606323242, :pending_vm_jobs=>0.0005075931549072266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0040073394775390625} [----] I, [2016-09-13T06:05:06.321955 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77160], State: [ok], Delivered in [0.004563718] seconds [----] I, [2016-09-13T06:05:07.991841 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77159], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.143819087] seconds [----] I, [2016-09-13T06:05:07.992082 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77159], Delivering... [----] I, [2016-09-13T06:05:07.997236 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77159], State: [ok], Delivered in [0.005171751] seconds [----] I, [2016-09-13T06:05:09.868881 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:10.011081 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:10.164245 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:10.311180 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:10.472483 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:10.652961 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:10.796149 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:11.131260 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:11.280229 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:11.423319 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:11.561584 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:11.702275 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:11.837368 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:11.904609 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039823055267333984, :worker_monitor=>1.1880602836608887, :worker_dequeue=>0.014242410659790039, :total_time=>1.2065742015838623} [----] I, [2016-09-13T06:05:11.979142 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:12.112909 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:12.246030 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:12.395720 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:12.536377 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:12.671515 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:12.807849 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:12.951911 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:13.091870 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:13.232068 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:13.374695 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:13.748984 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:13.902606 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:14.042689 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:14.202396 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:14.340780 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:14.483616 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:14.622204 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:14.804822 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:14.947095 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:15.086016 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:15.223869 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:15.369309 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:15.512769 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:15.647188 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:15.785196 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:15.925329 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:16.120206 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:16.531701 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:16.673959 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:16.807989 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:16.959462 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:17.093970 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:17.237889 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:17.384620 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:17.524798 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:17.668736 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:17.810690 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:17.952282 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:18.093934 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:18.233145 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:18.377891 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:18.519063 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:18.659742 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:18.808025 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:18.905703 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:05:18.931149 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77161], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:05:19.191726 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:19.354200 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:19.488394 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:19.646772 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:19.782957 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:19.923908 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:20.069661 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:20.224842 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:20.364284 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:20.502709 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:20.647498 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:21.931606 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:05:22.462919 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77161], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.551706199] seconds [----] I, [2016-09-13T06:05:22.463174 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77161], Delivering... [----] I, [2016-09-13T06:05:22.470883 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004027366638183594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00405120849609375, :pending_vm_jobs=>0.0011451244354248047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007168769836425781} [----] I, [2016-09-13T06:05:22.471251 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77161], State: [ok], Delivered in [0.008105269] seconds [----] I, [2016-09-13T06:05:26.802664 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:26.942639 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:27.087696 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:27.227293 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:27.370307 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:27.508766 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:27.998979 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:28.111200 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003797292709350586, :worker_monitor=>1.1614742279052734, :worker_dequeue=>0.006987571716308594, :total_time=>1.172490119934082} [----] I, [2016-09-13T06:05:28.156622 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:28.295618 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:28.433924 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:28.573524 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:28.714098 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:28.863919 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:29.006125 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:29.146403 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:29.289023 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:29.434041 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:29.575560 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:29.716695 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:29.856675 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:29.996201 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:30.138760 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:05:30.285918 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T06:05:30.479707 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T06:05:30.480105 #3290:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T06:05:30.480469 #3290:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T06:05:30.480600 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T06:05:30.480722 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T06:05:30.506241 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T06:05:30.506688 #3290:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [77152], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T06:05:30.506944 #3290:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T06:05:30.507209 #3290:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T06:05:30.507404 #3290:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77152], State: [error], Delivered in [72.600608453] seconds [----] I, [2016-09-13T06:05:33.111827 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:05:33 UTC]... [----] I, [2016-09-13T06:05:33.129031 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:05:33 UTC]...Complete [----] I, [2016-09-13T06:05:33.944395 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:05:33.963686 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77162], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:05:33.974784 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77163], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:05:33.986376 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77164], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:05:34.009513 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77165], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:05:38.160151 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:05:38.551846 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77163], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.582208394] seconds [----] I, [2016-09-13T06:05:38.551965 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77163], Delivering... [----] I, [2016-09-13T06:05:38.580343 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77163], State: [ok], Delivered in [0.028366284] seconds [----] I, [2016-09-13T06:05:38.597457 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77165], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.601704473] seconds [----] I, [2016-09-13T06:05:38.597549 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77165], Delivering... [----] I, [2016-09-13T06:05:38.600755 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0015895366668701172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0016009807586669922, :pending_vm_jobs=>0.00041985511779785156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003011941909790039} [----] I, [2016-09-13T06:05:38.600957 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77165], State: [ok], Delivered in [0.003404795] seconds [----] I, [2016-09-13T06:05:41.049577 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77162], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.098497462] seconds [----] I, [2016-09-13T06:05:41.049755 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77162], Delivering... [----] I, [2016-09-13T06:05:41.054162 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77162], State: [ok], Delivered in [0.004331547] seconds [----] I, [2016-09-13T06:05:41.089626 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77164], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.109397122] seconds [----] I, [2016-09-13T06:05:41.089854 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77164], Delivering... [----] I, [2016-09-13T06:05:41.093404 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77164], State: [ok], Delivered in [0.003545224] seconds [----] I, [2016-09-13T06:05:44.614946 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040569305419921875, :worker_monitor=>1.4305503368377686, :worker_dequeue=>0.011615514755249023, :total_time=>1.4465432167053223} [----] I, [2016-09-13T06:05:49.021925 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:05:49.063442 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77166], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:05:49.725811 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:05:50.200521 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77166], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.172801279] seconds [----] I, [2016-09-13T06:05:50.200718 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77166], Delivering... [----] I, [2016-09-13T06:05:50.207091 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003322601318359375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033419132232666016, :pending_vm_jobs=>0.0008594989776611328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006002187728881836} [----] I, [2016-09-13T06:05:50.207479 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77166], State: [ok], Delivered in [0.006736708] seconds [----] I, [2016-09-13T06:06:01.030617 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00723576545715332, :worker_monitor=>1.261892318725586, :worker_dequeue=>0.010646820068359375, :total_time=>1.280064582824707} [----] I, [2016-09-13T06:06:04.074674 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:06:04.091877 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77167], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:06:04.103368 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77168], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:06:06.031216 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:06:06 UTC]... [----] I, [2016-09-13T06:06:06.069066 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:06:06 UTC]...Complete [----] I, [2016-09-13T06:06:06.079886 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:06:06.814204 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77168], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.71710956] seconds [----] I, [2016-09-13T06:06:06.814443 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77168], Delivering... [----] I, [2016-09-13T06:06:06.821784 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036973953247070312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003720521926879883, :pending_vm_jobs=>0.0013456344604492188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006925106048583984} [----] I, [2016-09-13T06:06:06.822201 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77168], State: [ok], Delivered in [0.007782979] seconds [----] I, [2016-09-13T06:06:08.264027 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77167], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.184900258] seconds [----] I, [2016-09-13T06:06:08.264307 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77167], Delivering... [----] I, [2016-09-13T06:06:08.271104 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77167], State: [ok], Delivered in [0.006789753] seconds [----] I, [2016-09-13T06:06:17.704041 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00413060188293457, :worker_monitor=>1.5894036293029785, :worker_dequeue=>0.007752180099487305, :total_time=>1.601637363433838} [----] I, [2016-09-13T06:06:19.114220 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:06:19.132697 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77169], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:06:22.714644 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:06:22.903384 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77169], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.784376712] seconds [----] I, [2016-09-13T06:06:22.903611 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77169], Delivering... [----] I, [2016-09-13T06:06:22.909952 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003219127655029297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032379627227783203, :pending_vm_jobs=>0.0009095668792724609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059452056884765625} [----] I, [2016-09-13T06:06:22.910338 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77169], State: [ok], Delivered in [0.006722562] seconds [----] I, [2016-09-13T06:06:34.032863 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003941059112548828, :worker_monitor=>1.2710340023040771, :worker_dequeue=>0.007042884826660156, :total_time=>1.2822751998901367} [----] I, [2016-09-13T06:06:34.140947 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:06:34.154265 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77170], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:06:34.165904 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77171], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:06:34.177167 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77172], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:06:34.189543 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77173], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:06:39.033282 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:06:39 UTC]... [----] I, [2016-09-13T06:06:39.045853 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:06:39 UTC]...Complete [----] I, [2016-09-13T06:06:39.054001 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:06:40.046372 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77171], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.889149049] seconds [----] I, [2016-09-13T06:06:40.046574 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77171], Delivering... [----] I, [2016-09-13T06:06:40.052010 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77173], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.869217831] seconds [----] I, [2016-09-13T06:06:40.052199 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77173], Delivering... [----] I, [2016-09-13T06:06:40.058792 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003345966339111328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00336456298828125, :pending_vm_jobs=>0.0009357929229736328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062351226806640625} [----] I, [2016-09-13T06:06:40.059203 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77173], State: [ok], Delivered in [0.006979149] seconds [----] I, [2016-09-13T06:06:40.091864 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77171], State: [ok], Delivered in [0.04526303] seconds [----] I, [2016-09-13T06:06:41.402204 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77170], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.257383632] seconds [----] I, [2016-09-13T06:06:41.402386 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77170], Delivering... [----] I, [2016-09-13T06:06:41.406756 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77170], State: [ok], Delivered in [0.004368859] seconds [----] I, [2016-09-13T06:06:41.434916 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77172], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.264486287] seconds [----] I, [2016-09-13T06:06:41.435064 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77172], Delivering... [----] I, [2016-09-13T06:06:41.437910 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77172], State: [ok], Delivered in [0.002834373] seconds [----] I, [2016-09-13T06:06:49.198856 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:06:49.218731 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77174], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:06:50.403396 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:06:50.412927 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037550926208496094, :worker_monitor=>1.3191454410552979, :worker_dequeue=>0.015215635299682617, :total_time=>1.3384788036346436} [----] I, [2016-09-13T06:06:50.503711 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77174], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.299355048] seconds [----] I, [2016-09-13T06:06:50.503896 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77174], Delivering... [----] I, [2016-09-13T06:06:50.510159 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032646656036376953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003282308578491211, :pending_vm_jobs=>0.0007739067077636719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058498382568359375} [----] I, [2016-09-13T06:06:50.510473 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77174], State: [ok], Delivered in [0.006549572] seconds [----] I, [2016-09-13T06:07:04.230272 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:07:04.246383 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77175], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:07:04.257691 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77176], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:07:07.034531 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:07:07.040887 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00402522087097168, :worker_monitor=>1.4869537353515625, :worker_dequeue=>0.011607646942138672, :total_time=>1.5029065608978271} [----] I, [2016-09-13T06:07:07.249602 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77176], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.99754787] seconds [----] I, [2016-09-13T06:07:07.249783 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77176], Delivering... [----] I, [2016-09-13T06:07:07.255911 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003313302993774414, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033321380615234375, :pending_vm_jobs=>0.0007171630859375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005769491195678711} [----] I, [2016-09-13T06:07:07.256292 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77176], State: [ok], Delivered in [0.006508575] seconds [----] I, [2016-09-13T06:07:08.883635 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77175], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.648828581] seconds [----] I, [2016-09-13T06:07:08.883804 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77175], Delivering... [----] I, [2016-09-13T06:07:08.888284 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77175], State: [ok], Delivered in [0.004481763] seconds [----] I, [2016-09-13T06:07:12.041473 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:07:12 UTC]... [----] I, [2016-09-13T06:07:12.060773 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:07:12 UTC]...Complete [----] I, [2016-09-13T06:07:19.269274 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:07:19.289528 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77177], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:07:23.540789 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:07:23.545396 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004206418991088867, :worker_monitor=>1.4231598377227783, :worker_dequeue=>0.008172035217285156, :total_time=>1.4358882904052734} [----] I, [2016-09-13T06:07:23.767850 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77177], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.492899778] seconds [----] I, [2016-09-13T06:07:23.768028 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77177], Delivering... [----] I, [2016-09-13T06:07:23.772352 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002360820770263672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023767948150634766, :pending_vm_jobs=>0.0004992485046386719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004036426544189453} [----] I, [2016-09-13T06:07:23.772639 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77177], State: [ok], Delivered in [0.004609821] seconds [----] I, [2016-09-13T06:07:34.300811 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:07:34.322162 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77178], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:07:34.339504 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77179], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:07:34.356664 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77180], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:07:34.381558 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77181], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:07:39.995291 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:07:40.002346 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004102945327758789, :worker_monitor=>1.4067199230194092, :worker_dequeue=>0.012776374816894531, :total_time=>1.4239730834960938} [----] I, [2016-09-13T06:07:40.929814 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77179], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.60275921] seconds [----] I, [2016-09-13T06:07:40.930003 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77179], Delivering... [----] I, [2016-09-13T06:07:40.939737 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77181], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.573171952] seconds [----] I, [2016-09-13T06:07:40.939944 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77181], Delivering... [----] I, [2016-09-13T06:07:40.947043 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036623477935791016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036907196044921875, :pending_vm_jobs=>0.0010454654693603516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00653839111328125} [----] I, [2016-09-13T06:07:40.947490 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77181], State: [ok], Delivered in [0.007554538] seconds [----] I, [2016-09-13T06:07:40.985150 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77179], State: [ok], Delivered in [0.055107557] seconds [----] I, [2016-09-13T06:07:41.979507 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77178], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.674507441] seconds [----] I, [2016-09-13T06:07:41.979705 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77178], Delivering... [----] I, [2016-09-13T06:07:41.984836 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77178], State: [ok], Delivered in [0.005113303] seconds [----] I, [2016-09-13T06:07:42.019537 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77180], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.674566564] seconds [----] I, [2016-09-13T06:07:42.019670 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77180], Delivering... [----] I, [2016-09-13T06:07:42.022001 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77180], State: [ok], Delivered in [0.002320001] seconds [----] I, [2016-09-13T06:07:45.002833 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:07:45 UTC]... [----] I, [2016-09-13T06:07:45.024807 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:07:45 UTC]...Complete [----] I, [2016-09-13T06:07:45.043145 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T06:07:49.394245 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:07:49.413825 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77182], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:07:50.063777 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:07:51.056728 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77182], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.653415257] seconds [----] I, [2016-09-13T06:07:51.056975 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77182], Delivering... [----] I, [2016-09-13T06:07:51.066902 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005146503448486328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005184173583984375, :pending_vm_jobs=>0.0012416839599609375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009397268295288086} [----] I, [2016-09-13T06:07:51.067394 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77182], State: [ok], Delivered in [0.010395309] seconds [----] I, [2016-09-13T06:07:56.517857 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004152059555053711, :worker_monitor=>1.436044454574585, :worker_dequeue=>0.007006406784057617, :total_time=>1.4475102424621582} [----] I, [2016-09-13T06:08:04.426693 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:08:04.447298 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77183], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:08:04.457882 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77184], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:08:06.645123 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:08:07.195712 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77184], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.742675715] seconds [----] I, [2016-09-13T06:08:07.195961 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77184], Delivering... [----] I, [2016-09-13T06:08:07.203350 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003938913345336914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003966569900512695, :pending_vm_jobs=>0.0008957386016845703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006901741027832031} [----] I, [2016-09-13T06:08:07.203748 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77184], State: [ok], Delivered in [0.007796117] seconds [----] I, [2016-09-13T06:08:09.132853 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77183], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.700264231] seconds [----] I, [2016-09-13T06:08:09.133056 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77183], Delivering... [----] I, [2016-09-13T06:08:09.138570 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77183], State: [ok], Delivered in [0.005516589] seconds [----] I, [2016-09-13T06:08:13.043000 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003852367401123047, :worker_monitor=>1.376051902770996, :worker_dequeue=>0.01084446907043457, :total_time=>1.3911001682281494} [----] I, [2016-09-13T06:08:18.043687 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:08:18 UTC]... [----] I, [2016-09-13T06:08:18.064014 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:08:18 UTC]...Complete [----] I, [2016-09-13T06:08:19.472847 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:08:19.498541 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77185], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:08:23.091646 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:08:23.281351 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77185], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.802317679] seconds [----] I, [2016-09-13T06:08:23.281554 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77185], Delivering... [----] I, [2016-09-13T06:08:23.288224 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032465457916259766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033617019653320312, :pending_vm_jobs=>0.0008981227874755859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062525272369384766} [----] I, [2016-09-13T06:08:23.288599 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77185], State: [ok], Delivered in [0.007038845] seconds [----] I, [2016-09-13T06:08:29.609242 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004691362380981445, :worker_monitor=>1.4983737468719482, :worker_dequeue=>0.007384300231933594, :total_time=>1.5107920169830322} [----] I, [2016-09-13T06:08:34.514411 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T06:08:34.525886 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77186], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:08:34.537194 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77187], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:08:34.549874 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77188], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:08:34.560049 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77189], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:08:34.579043 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77190], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:08:34.601915 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77191], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:08:34.620378 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:08:35.396220 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77186], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.877179106] seconds [----] I, [2016-09-13T06:08:35.396408 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77186], Delivering... [----] I, [2016-09-13T06:08:35.397768 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T06:08:35.397983 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5358108672 [----] I, [2016-09-13T06:08:35.398090 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5138501632 [----] I, [2016-09-13T06:08:35.398201 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 219607040 [----] I, [2016-09-13T06:08:35.398295 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1319108608 [----] I, [2016-09-13T06:08:35.398371 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5084557312 [----] I, [2016-09-13T06:08:35.398479 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T06:08:35.398577 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T06:08:35.398656 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 540651520 [----] I, [2016-09-13T06:08:35.398731 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T06:08:35.398811 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8043343872 [----] I, [2016-09-13T06:08:35.398890 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T06:08:35.398966 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T06:08:35.399064 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T06:08:35.399161 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T06:08:35.399241 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T06:08:35.399337 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T06:08:35.399447 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T06:08:35.399544 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T06:08:35.399623 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T06:08:35.399699 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T06:08:35.399772 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273297408 [----] I, [2016-09-13T06:08:35.399855 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56635392 [----] I, [2016-09-13T06:08:35.399931 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216662016 [----] I, [2016-09-13T06:08:35.400005 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T06:08:35.400084 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141131776 [----] I, [2016-09-13T06:08:35.400178 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2583109632 [----] I, [2016-09-13T06:08:35.400258 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2268684288 [----] I, [2016-09-13T06:08:35.400336 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T06:08:35.400406 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T06:08:35.400520 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T06:08:35.400606 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37519360 [----] I, [2016-09-13T06:08:35.400680 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102277120 [----] I, [2016-09-13T06:08:35.400750 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53268480 [----] I, [2016-09-13T06:08:35.400828 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110604288 [----] I, [2016-09-13T06:08:35.400903 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155545600 [----] I, [2016-09-13T06:08:35.400976 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T06:08:35.401047 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T06:08:35.401143 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T06:08:35.401222 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T06:08:35.401300 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T06:08:35.401392 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T06:08:35.401510 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T06:08:35.401597 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T06:08:35.401677 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T06:08:35.413349 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77189], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.859325959] seconds [----] I, [2016-09-13T06:08:35.413569 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77189], Delivering... [----] I, [2016-09-13T06:08:35.438584 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T06:08:35.438826 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T06:08:35.443142 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T06:08:35.446241 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T06:08:35.449849 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T06:08:35.453363 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T06:08:35.456819 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T06:08:35.460313 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 841 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T06:08:35.463846 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T06:08:35.467565 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T06:08:35.471305 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T06:08:35.474741 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T06:08:35.476003 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77189], State: [ok], Delivered in [0.062419674] seconds [----] I, [2016-09-13T06:08:35.478246 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T06:08:35.481660 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T06:08:35.484565 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:08:35.484721 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:08:35.484841 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>3, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T06:08:35.489263 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [149791.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:08:35.489641 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77186], State: [ok], Delivered in [0.093227309] seconds [----] I, [2016-09-13T06:08:35.504663 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77191], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.916190377] seconds [----] I, [2016-09-13T06:08:35.504853 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77191], Delivering... [----] I, [2016-09-13T06:08:35.511147 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032830238342285156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00330352783203125, :pending_vm_jobs=>0.0007510185241699219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059092044830322266} [----] I, [2016-09-13T06:08:35.511497 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77191], State: [ok], Delivered in [0.006638428] seconds [----] I, [2016-09-13T06:08:36.224753 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77188], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.683785149] seconds [----] I, [2016-09-13T06:08:36.224952 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77188], Delivering... [----] I, [2016-09-13T06:08:36.230500 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77188], State: [ok], Delivered in [0.005504316] seconds [----] I, [2016-09-13T06:08:36.264885 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77190], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.699640772] seconds [----] I, [2016-09-13T06:08:36.265078 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77190], Delivering... [----] I, [2016-09-13T06:08:36.268460 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77190], State: [ok], Delivered in [0.003351244] seconds [----] I, [2016-09-13T06:08:39.637576 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:08:40.556677 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77187], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.026899512] seconds [----] I, [2016-09-13T06:08:40.556896 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77187], Delivering... [----] I, [2016-09-13T06:08:40.565349 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:08:29 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [149789.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:08:40.565919 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:08:29 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [148887.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:08:40.566520 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:08:19 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [237045.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T06:08:40.567046 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:08:18 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [103566.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T06:08:40.567562 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:08:27 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48398.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T06:08:40.568139 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:08:28 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162419000], Memory % [3.1], CPU Time [37511.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T06:08:40.568725 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:08:27 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [201483.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T06:08:40.569271 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:08:27 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [50897.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:08:40.572355 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:08:20 UTC], Process Info: Memory Usage [614141952], Memory Size [1059639296], Proportional Set Size: [448856000], Memory % [7.49], CPU Time [700.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:08:40.574605 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:08:21 UTC], Process Info: Memory Usage [588488704], Memory Size [931971072], Proportional Set Size: [425520000], Memory % [7.17], CPU Time [1152.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:08:40.576846 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:08:22 UTC], Process Info: Memory Usage [558555136], Memory Size [930201600], Proportional Set Size: [406106000], Memory % [6.81], CPU Time [4984.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T06:08:40.579038 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:08:24 UTC], Process Info: Memory Usage [580386816], Memory Size [936886272], Proportional Set Size: [419826000], Memory % [7.08], CPU Time [1609.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T06:08:40.579660 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:08:27 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [207169.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T06:08:40.580224 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:08:27 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [50934.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:08:40.580792 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:08:23 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165804000], Memory % [3.16], CPU Time [38414.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T06:08:40.581152 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77187], State: [ok], Delivered in [0.024258926] seconds [----] I, [2016-09-13T06:08:46.060340 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00406193733215332, :worker_monitor=>1.4015414714813232, :worker_dequeue=>0.010011672973632812, :total_time=>1.4159042835235596} [----] I, [2016-09-13T06:08:49.616219 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:08:49.636183 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77192], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:08:51.060918 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:08:51 UTC]... [----] I, [2016-09-13T06:08:51.083179 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:08:51 UTC]...Complete [----] I, [2016-09-13T06:08:51.094214 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:08:51.356487 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77192], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.734373254] seconds [----] I, [2016-09-13T06:08:51.356688 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77192], Delivering... [----] I, [2016-09-13T06:08:51.363714 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036461353302001953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003697633743286133, :pending_vm_jobs=>0.0008966922760009766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006608486175537109} [----] I, [2016-09-13T06:08:51.364063 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77192], State: [ok], Delivered in [0.007373121] seconds [----] I, [2016-09-13T06:09:02.421091 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006318330764770508, :worker_monitor=>1.2918665409088135, :worker_dequeue=>0.00615382194519043, :total_time=>1.304823637008667} [----] I, [2016-09-13T06:09:04.648794 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:09:04.664848 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77193], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:09:04.689310 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77194], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:09:07.491832 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:09:07.813678 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77194], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.142955623] seconds [----] I, [2016-09-13T06:09:07.813908 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77194], Delivering... [----] I, [2016-09-13T06:09:07.821240 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038564205169677734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003885984420776367, :pending_vm_jobs=>0.0008947849273681641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006857395172119141} [----] I, [2016-09-13T06:09:07.821623 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77194], State: [ok], Delivered in [0.00772056] seconds [----] I, [2016-09-13T06:09:09.430751 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77193], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.777163126] seconds [----] I, [2016-09-13T06:09:09.430971 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77193], Delivering... [----] I, [2016-09-13T06:09:09.436851 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77193], State: [ok], Delivered in [0.005873853] seconds [----] I, [2016-09-13T06:09:18.890856 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041692256927490234, :worker_monitor=>1.3645868301391602, :worker_dequeue=>0.007647037506103516, :total_time=>1.376765251159668} [----] I, [2016-09-13T06:09:19.702997 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:09:19.727200 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77195], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:09:23.891453 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:09:23 UTC]... [----] I, [2016-09-13T06:09:23.910072 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:09:23 UTC]...Complete [----] I, [2016-09-13T06:09:23.921304 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:09:23.973242 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77195], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.256376786] seconds [----] I, [2016-09-13T06:09:23.973470 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77195], Delivering... [----] I, [2016-09-13T06:09:23.980461 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036542415618896484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003681182861328125, :pending_vm_jobs=>0.0008449554443359375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006568431854248047} [----] I, [2016-09-13T06:09:23.980846 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77195], State: [ok], Delivered in [0.007390254] seconds [----] I, [2016-09-13T06:09:34.739094 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:09:34.755960 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77196], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:09:34.773116 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77197], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:09:34.813194 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77198], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:09:34.836018 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77199], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:09:35.552451 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:09:35.558747 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041239261627197266, :worker_monitor=>1.5993316173553467, :worker_dequeue=>0.011387825012207031, :total_time=>1.6151306629180908} [----] I, [2016-09-13T06:09:35.990900 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77197], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.230814811] seconds [----] I, [2016-09-13T06:09:35.991137 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77197], Delivering... [----] I, [2016-09-13T06:09:36.064597 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77197], State: [ok], Delivered in [0.073465616] seconds [----] I, [2016-09-13T06:09:36.076085 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77199], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.25498927] seconds [----] I, [2016-09-13T06:09:36.076283 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77199], Delivering... [----] I, [2016-09-13T06:09:36.082865 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032558441162109375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033800601959228516, :pending_vm_jobs=>0.0008502006530761719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006174325942993164} [----] I, [2016-09-13T06:09:36.083238 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77199], State: [ok], Delivered in [0.006936296] seconds [----] I, [2016-09-13T06:09:36.493244 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77196], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.749529622] seconds [----] I, [2016-09-13T06:09:36.493469 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77196], Delivering... [----] I, [2016-09-13T06:09:36.498596 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77196], State: [ok], Delivered in [0.005161575] seconds [----] I, [2016-09-13T06:09:36.527678 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77198], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.748894472] seconds [----] I, [2016-09-13T06:09:36.527845 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77198], Delivering... [----] I, [2016-09-13T06:09:36.531231 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77198], State: [ok], Delivered in [0.003380074] seconds [----] I, [2016-09-13T06:09:49.847620 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:09:49.864730 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77200], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:09:52.108196 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:09:52.115122 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005421638488769531, :worker_monitor=>1.5067651271820068, :worker_dequeue=>0.01220703125, :total_time=>1.524799108505249} [----] I, [2016-09-13T06:09:52.213806 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77200], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.360189655] seconds [----] I, [2016-09-13T06:09:52.214117 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77200], Delivering... [----] I, [2016-09-13T06:09:52.221737 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037124156951904297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003765583038330078, :pending_vm_jobs=>0.00101470947265625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0069561004638671875} [----] I, [2016-09-13T06:09:52.222087 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77200], State: [ok], Delivered in [0.008021435] seconds [----] I, [2016-09-13T06:09:57.115564 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:09:57 UTC]... [----] I, [2016-09-13T06:09:57.163120 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:09:57 UTC]...Complete [----] I, [2016-09-13T06:10:04.876235 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:10:04.893399 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77201], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:10:04.904724 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77202], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:10:04.916167 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77203], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:10:04.927644 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77204], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:10:04.938946 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77205], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:10:08.611515 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:10:08.618342 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038781166076660156, :worker_monitor=>1.398838996887207, :worker_dequeue=>0.01234579086303711, :total_time=>1.415341854095459} [----] I, [2016-09-13T06:10:09.350847 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77205], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.418169093] seconds [----] I, [2016-09-13T06:10:09.351034 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77205], Delivering... [----] I, [2016-09-13T06:10:09.357555 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035321712493896484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035529136657714844, :pending_vm_jobs=>0.0008144378662109375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0061244964599609375} [----] I, [2016-09-13T06:10:09.357857 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77205], State: [ok], Delivered in [0.006817054] seconds [----] I, [2016-09-13T06:10:09.648205 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77201], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.766493525] seconds [----] I, [2016-09-13T06:10:09.648411 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77201], Delivering... [----] I, [2016-09-13T06:10:09.651003 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77201], State: [ok], Delivered in [0.002594432] seconds [----] I, [2016-09-13T06:10:09.682205 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77202], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.784117625] seconds [----] I, [2016-09-13T06:10:09.682406 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77202], Delivering... [----] I, [2016-09-13T06:10:09.697566 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77202], State: [ok], Delivered in [0.015152376] seconds [----] I, [2016-09-13T06:10:09.716582 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77203], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.80726781] seconds [----] I, [2016-09-13T06:10:09.716938 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77203], Delivering... [----] I, [2016-09-13T06:10:09.723938 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77203], State: [ok], Delivered in [0.007000463] seconds [----] I, [2016-09-13T06:10:09.727850 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77204], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.80806465] seconds [----] I, [2016-09-13T06:10:09.728029 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77204], Delivering... [----] I, [2016-09-13T06:10:09.733223 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77204], State: [ok], Delivered in [0.005185206] seconds [----] I, [2016-09-13T06:10:19.949886 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:10:19.962153 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77206], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:10:24.981377 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:10:24.987895 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00393986701965332, :worker_monitor=>1.2274422645568848, :worker_dequeue=>0.011466741561889648, :total_time=>1.2431225776672363} [----] I, [2016-09-13T06:10:25.438526 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77206], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.482942322] seconds [----] I, [2016-09-13T06:10:25.438743 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77206], Delivering... [----] I, [2016-09-13T06:10:25.445388 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003484010696411133, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035066604614257812, :pending_vm_jobs=>0.0007779598236083984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062334537506103516} [----] I, [2016-09-13T06:10:25.445755 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77206], State: [ok], Delivered in [0.007017524] seconds [----] I, [2016-09-13T06:10:29.988411 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:10:29 UTC]... [----] I, [2016-09-13T06:10:30.007933 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:10:29 UTC]...Complete [----] I, [2016-09-13T06:10:34.973724 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:10:34.991034 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77207], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:10:35.002408 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77208], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:10:35.013746 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77209], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:10:35.031182 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77210], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:10:35.034642 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:10:35.528320 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77208], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.533141423] seconds [----] I, [2016-09-13T06:10:35.528524 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77208], Delivering... [----] I, [2016-09-13T06:10:35.534336 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77210], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.511607681] seconds [----] I, [2016-09-13T06:10:35.534553 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77210], Delivering... [----] I, [2016-09-13T06:10:35.541532 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003664731979370117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036928653717041016, :pending_vm_jobs=>0.0008196830749511719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006548881530761719} [----] I, [2016-09-13T06:10:35.541891 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77210], State: [ok], Delivered in [0.00733222] seconds [----] I, [2016-09-13T06:10:35.579684 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77208], State: [ok], Delivered in [0.05113729] seconds [----] I, [2016-09-13T06:10:36.796715 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77207], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.818471292] seconds [----] I, [2016-09-13T06:10:36.796895 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77207], Delivering... [----] I, [2016-09-13T06:10:36.802013 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77207], State: [ok], Delivered in [0.005108424] seconds [----] I, [2016-09-13T06:10:36.808546 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77209], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.800545366] seconds [----] I, [2016-09-13T06:10:36.808723 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77209], Delivering... [----] I, [2016-09-13T06:10:36.811892 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77209], State: [ok], Delivered in [0.003161095] seconds [----] I, [2016-09-13T06:10:41.440385 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004000186920166016, :worker_monitor=>1.3836545944213867, :worker_dequeue=>0.011002540588378906, :total_time=>1.398970603942871} [----] I, [2016-09-13T06:10:50.043832 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:10:50.060687 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77211], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:10:51.465740 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:10:51.708611 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77211], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.658240776] seconds [----] I, [2016-09-13T06:10:51.708818 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77211], Delivering... [----] I, [2016-09-13T06:10:51.716065 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038700103759765625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038933753967285156, :pending_vm_jobs=>0.0008685588836669922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006838560104370117} [----] I, [2016-09-13T06:10:51.716448 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77211], State: [ok], Delivered in [0.007603525] seconds [----] I, [2016-09-13T06:10:57.594746 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003909587860107422, :worker_monitor=>1.111340045928955, :worker_dequeue=>0.0068013668060302734, :total_time=>1.1223981380462646} [----] I, [2016-09-13T06:11:02.595340 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:11:02 UTC]... [----] I, [2016-09-13T06:11:02.615282 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:11:02 UTC]...Complete [----] I, [2016-09-13T06:11:05.074154 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:11:05.089677 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77212], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:11:05.118062 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77213], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:11:07.646571 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:11:07.792211 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77213], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.696740439] seconds [----] I, [2016-09-13T06:11:07.792369 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77213], Delivering... [----] I, [2016-09-13T06:11:07.797673 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027446746826171875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027620792388916016, :pending_vm_jobs=>0.0006639957427978516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004953145980834961} [----] I, [2016-09-13T06:11:07.797983 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77213], State: [ok], Delivered in [0.005612797] seconds [----] I, [2016-09-13T06:11:09.964352 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77212], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.885964301] seconds [----] I, [2016-09-13T06:11:09.964641 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77212], Delivering... [----] I, [2016-09-13T06:11:09.970220 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77212], State: [ok], Delivered in [0.005601915] seconds [----] I, [2016-09-13T06:11:13.983236 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0043218135833740234, :worker_monitor=>1.3145532608032227, :worker_dequeue=>0.010602712631225586, :total_time=>1.3297934532165527} [----] I, [2016-09-13T06:11:20.131369 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:11:20.170311 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77214], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:11:24.136776 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:11:24.924550 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77214], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.78709671] seconds [----] I, [2016-09-13T06:11:24.924721 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77214], Delivering... [----] I, [2016-09-13T06:11:24.930774 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031588077545166016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031795501708984375, :pending_vm_jobs=>0.0007424354553222656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00569915771484375} [----] I, [2016-09-13T06:11:24.931155 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77214], State: [ok], Delivered in [0.006382338] seconds [----] I, [2016-09-13T06:11:30.130051 #2763:34713c] INFO -- : MIQ(MiqServer#validate_worker) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit [----] I, [2016-09-13T06:11:30.147331 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77215], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_uptime_exceeded", {:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T06:11:30.147567 #2763:34713c] INFO -- : MIQ(MiqServer#stop_worker) Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3], status [started]... [----] I, [2016-09-13T06:11:30.158631 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77216], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T06:11:30.170226 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3] is being requested to exit [----] I, [2016-09-13T06:11:30.390054 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:11:30.396624 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038590431213378906, :worker_monitor=>1.2372980117797852, :worker_dequeue=>0.011609792709350586, :total_time=>1.253054141998291} [----] I, [2016-09-13T06:11:31.041337 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77215], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_uptime_exceeded", {:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [0.909857639] seconds [----] I, [2016-09-13T06:11:31.041735 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77215], Delivering... [----] I, [2016-09-13T06:11:31.068471 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_uptime_exceeded"> inputs=<{:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1078, :miq_event_id=>1078, "EventStream::event_stream"=>1078, :event_stream_id=>1078}> [----] I, [2016-09-13T06:11:31.074751 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77216], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [0.925853592] seconds [----] I, [2016-09-13T06:11:31.074969 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77216], Delivering... [----] I, [2016-09-13T06:11:31.091399 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_stop"> inputs=<{:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1079, :miq_event_id=>1079, "EventStream::event_stream"=>1079, :event_stream_id=>1079}> [----] I, [2016-09-13T06:11:31.122398 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77217], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1078, :miq_event_id=>1078, "EventStream::event_stream"=>1078, :event_stream_id=>1078}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T06:11:31.122970 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77215], State: [ok], Delivered in [0.081252018] seconds [----] I, [2016-09-13T06:11:31.127451 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77218], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1079, :miq_event_id=>1079, "EventStream::event_stream"=>1079, :event_stream_id=>1079}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T06:11:31.127892 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77216], State: [ok], Delivered in [0.05292013] seconds [----] I, [2016-09-13T06:11:31.919310 #30088:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [97], PID [30088], GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:11:21 UTC], Process Info: Memory Usage [588488704], Memory Size [931971072], Proportional Set Size: [425547000], Memory % [7.17], CPU Time [1159.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:11:31.919944 #30088:34713c] INFO -- : EMS [10.16.23.206] as [jdoe] ID [97] PID [30088] GUID [aa80abf2-7989-11e6-87c1-fa163e7d01a3] Exit request received. Worker exiting. [----] I, [2016-09-13T06:11:35.186084 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:11:35.207263 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77219], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:11:35.222966 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77220], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:11:35.234280 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77221], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:11:35.251394 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77222], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:11:35.397264 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:11:35 UTC]... [----] I, [2016-09-13T06:11:35.417116 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:11:35 UTC]...Complete [----] I, [2016-09-13T06:11:35.427827 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:11:35.995989 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77217], MiqWorker id: [16], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1078, :miq_event_id=>1078, "EventStream::event_stream"=>1078, :event_stream_id=>1078}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [4.89420569] seconds [----] I, [2016-09-13T06:11:35.996193 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77217], Delivering... [----] I, [2016-09-13T06:11:35.998470 #2957:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1078, :miq_event_id=>1078, "EventStream::event_stream"=>1078, :event_stream_id=>1078} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T06:11:36.004116 #2957:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1078&MiqEvent%3A%3Amiq_event=1078&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B97%5D%2C%20PID%3A%20%5B30088%5D%2C%20GUID%3A%20%5Baa80abf2-7989-11e6-87c1-fa163e7d01a3%5D%20uptime%20has%20reached%20the%20interval%20of%207200%20seconds%2C%20requesting%20worker%20to%20exit&event_stream_id=1078&event_type=evm_worker_uptime_exceeded&miq_event_id=1078&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T06:11:36.035649 #2957:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1078&MiqEvent%3A%3Amiq_event=1078&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B97%5D%2C%20PID%3A%20%5B30088%5D%2C%20GUID%3A%20%5Baa80abf2-7989-11e6-87c1-fa163e7d01a3%5D%20uptime%20has%20reached%20the%20interval%20of%207200%20seconds%2C%20requesting%20worker%20to%20exit&event_stream_id=1078&event_type=evm_worker_uptime_exceeded&miq_event_id=1078&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T06:11:36.052785 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77218], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1079, :miq_event_id=>1079, "EventStream::event_stream"=>1079, :event_stream_id=>1079}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [4.943824962] seconds [----] I, [2016-09-13T06:11:36.052956 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77218], Delivering... [----] I, [2016-09-13T06:11:36.054951 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1079, :miq_event_id=>1079, "EventStream::event_stream"=>1079, :event_stream_id=>1079} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T06:11:36.060610 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1079&MiqEvent%3A%3Amiq_event=1079&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B97%5D%2C%20PID%3A%20%5B30088%5D%2C%20GUID%3A%20%5Baa80abf2-7989-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1079&event_type=evm_worker_stop&miq_event_id=1079&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T06:11:36.092267 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1079&MiqEvent%3A%3Amiq_event=1079&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B97%5D%2C%20PID%3A%20%5B30088%5D%2C%20GUID%3A%20%5Baa80abf2-7989-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1079&event_type=evm_worker_stop&miq_event_id=1079&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T06:11:36.127016 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create] [----] I, [2016-09-13T06:11:36.147958 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T06:11:36.168909 #2957:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T06:11:36.178913 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T06:11:36.189543 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T06:11:36.194962 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T06:11:36.200629 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T06:11:36.211600 #2957:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T06:11:36.220157 #2957:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T06:11:36.221719 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_stop] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T06:11:36.224776 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 10:11:35", os_priority: 21, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 275689472, memory_size: 574287872, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 200501000, has_active_websocket: true>] [----] I, [2016-09-13T06:11:36.225022 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_uptime_exceeded] [----] I, [2016-09-13T06:11:36.241537 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T06:11:36.246717 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_uptime_exceeded] [----] I, [2016-09-13T06:11:36.246971 #2957:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_uptime_exceeded] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T06:11:36.247220 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T06:11:36.255256 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T06:11:36.255886 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create] [----] I, [2016-09-13T06:11:36.256724 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77217], State: [ok], Delivered in [0.260520013] seconds [----] I, [2016-09-13T06:11:36.264122 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T06:11:36.272521 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T06:11:36.277209 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 10:11:35", os_priority: 21, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 275689472, memory_size: 574287872, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 200501000, has_active_websocket: true>] [----] I, [2016-09-13T06:11:36.277475 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_stop] [----] I, [2016-09-13T06:11:36.291906 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77220], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.080483927] seconds [----] I, [2016-09-13T06:11:36.292073 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77220], Delivering... [----] I, [2016-09-13T06:11:36.296863 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_stop] [----] I, [2016-09-13T06:11:36.297125 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_stop] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T06:11:36.305791 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T06:11:36.306397 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T06:11:36.307227 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77218], State: [ok], Delivered in [0.254256383] seconds [----] I, [2016-09-13T06:11:36.331494 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77222], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.085695669] seconds [----] I, [2016-09-13T06:11:36.331669 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77222], Delivering... [----] I, [2016-09-13T06:11:36.338078 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036160945892333984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003633260726928711, :pending_vm_jobs=>0.0007386207580566406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006088972091674805} [----] I, [2016-09-13T06:11:36.338448 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77222], State: [ok], Delivered in [0.006750161] seconds [----] I, [2016-09-13T06:11:36.343001 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77220], State: [ok], Delivered in [0.050894212] seconds [----] I, [2016-09-13T06:11:37.177603 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77219], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.985058033] seconds [----] I, [2016-09-13T06:11:37.177830 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77219], Delivering... [----] I, [2016-09-13T06:11:37.183350 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77219], State: [ok], Delivered in [0.005523615] seconds [----] I, [2016-09-13T06:11:37.200540 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77221], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.972109653] seconds [----] I, [2016-09-13T06:11:37.200862 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77221], Delivering... [----] I, [2016-09-13T06:11:37.206339 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77221], State: [ok], Delivered in [0.005492472] seconds [----] I, [2016-09-13T06:11:45.553972 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker.sync_workers) Workers are being synchronized: Current: ["ems_16"], Desired: ["ems_15", "ems_16"] [----] I, [2016-09-13T06:11:45.647076 #2763:34713c] INFO -- : :kill_algorithm: [----] I, [2016-09-13T06:11:45.647211 #2763:34713c] INFO -- : :name: :used_swap_percent_gt_value [----] I, [2016-09-13T06:11:45.647260 #2763:34713c] INFO -- : :value: 80 [----] I, [2016-09-13T06:11:45.647297 #2763:34713c] INFO -- : :miq_server_time_threshold: 120 [----] I, [2016-09-13T06:11:45.647365 #2763:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T06:11:45.647401 #2763:34713c] INFO -- : :poll: 2 [----] I, [2016-09-13T06:11:45.647472 #2763:34713c] INFO -- : :start_algorithm: [----] I, [2016-09-13T06:11:45.647513 #2763:34713c] INFO -- : :name: :used_swap_percent_lt_value [----] I, [2016-09-13T06:11:45.647546 #2763:34713c] INFO -- : :value: 60 [----] I, [2016-09-13T06:11:45.647576 #2763:34713c] INFO -- : :sync_interval: 1800 [----] I, [2016-09-13T06:11:45.647606 #2763:34713c] INFO -- : :wait_for_started_timeout: 600 [----] I, [2016-09-13T06:11:45.963779 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker.close_pg_sockets_inherited_from_parent) Closing socket: 21 [----] I, [2016-09-13T06:11:46.110531 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77223], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T06:11:46.110737 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#start) Worker started: ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3] [----] I, [2016-09-13T06:11:46.432230 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:11:46.433510 #5369:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T06:11:46.433608 #5369:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:11:46.433660 #5369:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:11:46.433723 #5369:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:11:46.433763 #5369:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T06:11:46.433800 #5369:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T06:11:46.433837 #5369:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:11:46.433871 #5369:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T06:11:46.433907 #5369:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:11:46.433945 #5369:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:11:46.433981 #5369:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T06:11:46.434015 #5369:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:11:46.434050 #5369:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T06:11:46.434082 #5369:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:11:46.434144 #5369:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T06:11:46.434182 #5369:34713c] INFO -- : --- [----] I, [2016-09-13T06:11:46.434629 #5369:34713c] INFO -- : :guid: 79c8c984-799a-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:11:46.434704 #5369:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T06:11:46.775540 #5369:34713c] INFO -- : MIQ(AuthUseridPassword#validation_successful) [ExtManagementSystem] [15], previously valid/invalid on: [2016-09-13 08:11:27 UTC]/[], previous status: [Valid] [----] I, [2016-09-13T06:11:46.812883 #5369:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77224], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 15], "ems_auth_valid", {}] [----] I, [2016-09-13T06:11:47.159508 #2763:34713c] INFO -- : MIQ(MiqServer#clean_worker_records) SQL Record for Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [97], PID: [30088], GUID: [aa80abf2-7989-11e6-87c1-fa163e7d01a3], Status: [stopped] is being deleted [----] I, [2016-09-13T06:11:47.308880 #5369:34713c] INFO -- : ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner started. ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Zone [default], Role [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket] [----] I, [2016-09-13T06:11:47.309316 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_wait_for_worker_monitor) EMS [10.16.23.206] as [jdoe] Checking that worker monitor has started before doing work [----] I, [2016-09-13T06:11:47.312900 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_wait_for_worker_monitor) EMS [10.16.23.206] as [jdoe] Starting work since worker monitor has started [----] I, [2016-09-13T06:11:47.313021 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_before_work_loop) EMS [10.16.23.206] as [jdoe] Queueing initial refresh for EMS. [----] I, [2016-09-13T06:11:47.343252 #5369:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77225], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T06:11:47.346555 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#worker_monitor_drb) EMS [10.16.23.206] as [jdoe] Initializing DRb Connection to MiqServer with ID=[1], NAME=[EVM], PID=[2763], GUID=[36647afc-71a3-11e6-838a-fa163e68952f] DRb URI=[druby://127.0.0.1:41718] [----] I, [2016-09-13T06:11:47.399056 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:11:47.401284 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T06:11:47.402399 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004004240036010742, :worker_monitor=>1.9466445446014404, :worker_dequeue=>0.0062084197998046875, :total_time=>1.9571433067321777} [----] I, [2016-09-13T06:11:49.235141 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77223], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [3.197490844] seconds [----] I, [2016-09-13T06:11:49.235318 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77223], Delivering... [----] I, [2016-09-13T06:11:49.251636 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_start"> inputs=<{:event_details=>"Worker started: ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1080, :miq_event_id=>1080, "EventStream::event_stream"=>1080, :event_stream_id=>1080}> [----] I, [2016-09-13T06:11:49.259075 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77224], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 15], "ems_auth_valid", {}], Dequeued in: [2.463908756] seconds [----] I, [2016-09-13T06:11:49.259238 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77224], Delivering... [----] I, [2016-09-13T06:11:49.274297 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"ems_auth_valid"> inputs=<{"MiqEvent::miq_event"=>1081, :miq_event_id=>1081, "EventStream::event_stream"=>1081, :event_stream_id=>1081}> [----] I, [2016-09-13T06:11:49.281228 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77226], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1080, :miq_event_id=>1080, "EventStream::event_stream"=>1080, :event_stream_id=>1080}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T06:11:49.281647 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77223], State: [ok], Delivered in [0.046309437] seconds [----] I, [2016-09-13T06:11:49.298439 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77227], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>15, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1081, :miq_event_id=>1081, "EventStream::event_stream"=>1081, :event_stream_id=>1081}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T06:11:49.298835 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77224], State: [ok], Delivered in [0.039578197] seconds [----] I, [2016-09-13T06:11:50.262023 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:11:50.280266 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77228], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:11:52.412518 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:11:52.416895 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T06:11:52.489980 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77226], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1080, :miq_event_id=>1080, "EventStream::event_stream"=>1080, :event_stream_id=>1080}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [3.228150059] seconds [----] I, [2016-09-13T06:11:52.490217 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77226], Delivering... [----] I, [2016-09-13T06:11:52.492615 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1080, :miq_event_id=>1080, "EventStream::event_stream"=>1080, :event_stream_id=>1080} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T06:11:52.493984 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77227], MiqWorker id: [16], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>15, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1081, :miq_event_id=>1081, "EventStream::event_stream"=>1081, :event_stream_id=>1081}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [3.210059651] seconds [----] I, [2016-09-13T06:11:52.494277 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77227], Delivering... [----] I, [2016-09-13T06:11:52.496455 #2957:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1081, :miq_event_id=>1081, "EventStream::event_stream"=>1081, :event_stream_id=>1081} for object [ManageIQ::Providers::Hawkular::MiddlewareManager.15] with state [] to Automate [----] I, [2016-09-13T06:11:52.498240 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1080&MiqEvent%3A%3Amiq_event=1080&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B99%5D%2C%20PID%20%5B5369%5D%2C%20GUID%20%5B79c8c984-799a-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1080&event_type=evm_worker_start&miq_event_id=1080&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T06:11:52.502211 #2957:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1081&ExtManagementSystem%3A%3Aext_management_system=15&MiqEvent%3A%3Amiq_event=1081&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1081&event_type=ems_auth_valid&miq_event_id=1081&object_name=Event&vmdb_object_type=ext_management_system] [----] I, [2016-09-13T06:11:52.529590 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1080&MiqEvent%3A%3Amiq_event=1080&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B99%5D%2C%20PID%20%5B5369%5D%2C%20GUID%20%5B79c8c984-799a-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1080&event_type=evm_worker_start&miq_event_id=1080&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T06:11:52.533827 #2957:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1081&ExtManagementSystem%3A%3Aext_management_system=15&MiqEvent%3A%3Amiq_event=1081&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1081&event_type=ems_auth_valid&miq_event_id=1081&object_name=Event&vmdb_object_type=ext_management_system ManageIQ/System] [----] I, [2016-09-13T06:11:52.617808 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T06:11:52.625824 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T06:11:52.640801 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T06:11:52.648789 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T06:11:52.664049 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_start] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T06:11:52.672143 #2957:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/ems_auth_valid] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T06:11:52.685498 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T06:11:52.691388 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T06:11:52.698946 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T06:11:52.708718 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T06:11:52.710193 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T06:11:52.719462 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T06:11:52.724748 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 10:11:35", os_priority: 21, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 277401600, memory_size: 578035712, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 202326000, has_active_websocket: true>] [----] I, [2016-09-13T06:11:52.725017 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_start] [----] I, [2016-09-13T06:11:52.728605 #2957:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T06:11:52.737979 #2957:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T06:11:52.743741 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#] [----] I, [2016-09-13T06:11:52.744334 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [ems_auth_valid] [----] I, [2016-09-13T06:11:52.772696 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_start] [----] I, [2016-09-13T06:11:52.773033 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_start] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T06:11:52.778600 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T06:11:52.779251 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T06:11:52.780229 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77226], State: [ok], Delivered in [0.289995376] seconds [----] I, [2016-09-13T06:11:52.783192 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [ems_auth_valid] [----] I, [2016-09-13T06:11:52.783548 #2957:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [ems_auth_valid] Target: ManageIQ::Providers::Hawkular::MiddlewareManager Name: [TT], Id: [15] [----] I, [2016-09-13T06:11:52.789052 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T06:11:52.789718 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T06:11:52.790636 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77227], State: [ok], Delivered in [0.296390595] seconds [----] I, [2016-09-13T06:11:52.806852 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77228], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.538899881] seconds [----] I, [2016-09-13T06:11:52.807028 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77228], Delivering... [----] I, [2016-09-13T06:11:52.813277 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032477378845214844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003269672393798828, :pending_vm_jobs=>0.0007884502410888672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005878925323486328} [----] I, [2016-09-13T06:11:52.813678 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77228], State: [ok], Delivered in [0.006625886] seconds [----] I, [2016-09-13T06:11:57.431590 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T06:11:57.778714 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [77225], MiqWorker id: [99], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [10.453690198] seconds [----] I, [2016-09-13T06:11:57.779063 #5369:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77225], Delivering... [----] I, [2016-09-13T06:11:57.795209 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T06:11:57.795521 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T06:11:57.795699 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T06:11:57.795927 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T06:11:57.801614 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:11:58.086552 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:11:58.293915 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:11:58.294111 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:11:58.877627 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:11:58.972728 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:11:59.063356 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:11:59.382341 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:11:59.484635 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:11:59.577311 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:11:59.671759 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:11:59.764673 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:11:59.857961 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:11:59.951361 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:12:00.043889 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:12:00.138182 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:12:00.232545 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:12:00.325509 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:12:00.417175 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:12:00.509004 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:12:00.601370 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:12:00.693438 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:12:00.795180 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:12:00.888786 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:12:01.378017 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T06:12:01.378271 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004004240036010742, :collect_inventory_for_targets=>1.0013580322265625e-05, :parse_legacy_inventory=>3.2017550468444824, :parse_targeted_inventory=>3.201777696609497, :save_inventory=>0.3801124095916748, :ems_refresh=>3.5823473930358887} [----] I, [2016-09-13T06:12:01.436136 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T06:12:01.436675 #5369:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77225], State: [ok], Delivered in [3.657665887] seconds [----] I, [2016-09-13T06:12:03.712574 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0034172534942626953, :worker_monitor=>1.2641544342041016, :worker_dequeue=>0.01070261001586914, :total_time=>1.2785530090332031} [----] I, [2016-09-13T06:12:05.291177 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:12:05.310226 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77229], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:12:05.321790 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77230], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:12:08.713115 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:12:08 UTC]... [----] I, [2016-09-13T06:12:08.732966 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:12:08 UTC]...Complete [----] I, [2016-09-13T06:12:08.743573 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:12:08.898992 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77230], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.583276192] seconds [----] I, [2016-09-13T06:12:08.899184 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77230], Delivering... [----] I, [2016-09-13T06:12:08.905454 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033168792724609375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003334522247314453, :pending_vm_jobs=>0.0007607936859130859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00585174560546875} [----] I, [2016-09-13T06:12:08.905848 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77230], State: [ok], Delivered in [0.006658865] seconds [----] I, [2016-09-13T06:12:10.384934 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77229], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.08931878] seconds [----] I, [2016-09-13T06:12:10.385237 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77229], Delivering... [----] I, [2016-09-13T06:12:10.392379 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77229], State: [ok], Delivered in [0.007154028] seconds [----] I, [2016-09-13T06:12:20.300804 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004547595977783203, :worker_monitor=>1.5245227813720703, :worker_dequeue=>0.006251335144042969, :total_time=>1.5356707572937012} [----] I, [2016-09-13T06:12:20.332695 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:12:20.345236 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77231], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:12:25.393052 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:12:25.431214 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77231], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.091876469] seconds [----] I, [2016-09-13T06:12:25.431499 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77231], Delivering... [----] I, [2016-09-13T06:12:25.439168 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0040738582611083984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004097938537597656, :pending_vm_jobs=>0.0009343624114990234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007168769836425781} [----] I, [2016-09-13T06:12:25.439570 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77231], State: [ok], Delivered in [0.008124844] seconds [----] I, [2016-09-13T06:12:35.354770 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:12:35.373692 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77232], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:12:35.389695 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77233], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:12:35.406894 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77234], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:12:35.429881 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77235], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:12:36.695185 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:12:36.702133 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036249160766601562, :worker_monitor=>1.2525994777679443, :worker_dequeue=>0.012368917465209961, :total_time=>1.2688837051391602} [----] I, [2016-09-13T06:12:37.116035 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77233], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.738952718] seconds [----] I, [2016-09-13T06:12:37.116264 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77233], Delivering... [----] I, [2016-09-13T06:12:37.121507 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77235], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.707467791] seconds [----] I, [2016-09-13T06:12:37.121694 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77235], Delivering... [----] I, [2016-09-13T06:12:37.127961 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003319263458251953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003338336944580078, :pending_vm_jobs=>0.0007722377777099609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005914211273193359} [----] I, [2016-09-13T06:12:37.128331 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77235], State: [ok], Delivered in [0.006626687] seconds [----] I, [2016-09-13T06:12:37.172575 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77233], State: [ok], Delivered in [0.056278366] seconds [----] I, [2016-09-13T06:12:37.498815 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77232], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.140298939] seconds [----] I, [2016-09-13T06:12:37.499002 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77232], Delivering... [----] I, [2016-09-13T06:12:37.504082 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77232], State: [ok], Delivered in [0.005069072] seconds [----] I, [2016-09-13T06:12:37.504222 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77234], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.110132038] seconds [----] I, [2016-09-13T06:12:37.504450 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77234], Delivering... [----] I, [2016-09-13T06:12:37.507690 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77234], State: [ok], Delivered in [0.003268412] seconds [----] I, [2016-09-13T06:12:41.702752 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:12:41 UTC]... [----] I, [2016-09-13T06:12:41.727172 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:12:41 UTC]...Complete [----] I, [2016-09-13T06:12:46.765238 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T06:12:50.440015 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:12:50.459816 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77236], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:12:53.553506 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:12:53.559958 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00428318977355957, :worker_monitor=>1.7650070190429688, :worker_dequeue=>0.011844873428344727, :total_time=>1.7815110683441162} [----] I, [2016-09-13T06:12:54.288258 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77236], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.842303004] seconds [----] I, [2016-09-13T06:12:54.288497 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77236], Delivering... [----] I, [2016-09-13T06:12:54.295134 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003506898880004883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035288333892822266, :pending_vm_jobs=>0.0008046627044677734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006218910217285156} [----] I, [2016-09-13T06:12:54.295524 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77236], State: [ok], Delivered in [0.007059258] seconds [----] I, [2016-09-13T06:13:05.471572 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:13:05.487858 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77237], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:13:05.499311 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77238], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:13:09.914459 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:13:09.920715 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004027128219604492, :worker_monitor=>1.3144805431365967, :worker_dequeue=>0.011347532272338867, :total_time=>1.3301565647125244} [----] I, [2016-09-13T06:13:10.442773 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77238], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.949382122] seconds [----] I, [2016-09-13T06:13:10.442951 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77238], Delivering... [----] I, [2016-09-13T06:13:10.449232 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033516883850097656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033724308013916016, :pending_vm_jobs=>0.0007550716400146484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005910158157348633} [----] I, [2016-09-13T06:13:10.449590 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77238], State: [ok], Delivered in [0.006632531] seconds [----] I, [2016-09-13T06:13:10.637218 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77237], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.161161032] seconds [----] I, [2016-09-13T06:13:10.637495 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77237], Delivering... [----] I, [2016-09-13T06:13:10.643878 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77237], State: [ok], Delivered in [0.00642446] seconds [----] I, [2016-09-13T06:13:14.921300 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:13:14 UTC]... [----] I, [2016-09-13T06:13:14.939762 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:13:14 UTC]...Complete [----] I, [2016-09-13T06:13:20.510710 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:13:20.528556 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77239], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:13:20.539743 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77240], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:13:20.551136 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77241], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:13:26.153515 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:13:26.159965 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00410151481628418, :worker_monitor=>1.1708412170410156, :worker_dequeue=>0.011547088623046875, :total_time=>1.1867902278900146} [----] I, [2016-09-13T06:13:26.546139 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77239], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.029073976] seconds [----] I, [2016-09-13T06:13:26.546338 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77239], Delivering... [----] I, [2016-09-13T06:13:26.552822 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003442525863647461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034852027893066406, :pending_vm_jobs=>0.0008046627044677734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060956478118896484} [----] I, [2016-09-13T06:13:26.553206 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77239], State: [ok], Delivered in [0.006873457] seconds [----] I, [2016-09-13T06:13:26.570230 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77240], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.03759451] seconds [----] I, [2016-09-13T06:13:26.570381 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77240], Delivering... [----] I, [2016-09-13T06:13:26.571119 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T06:13:26.571251 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5355925504 [----] I, [2016-09-13T06:13:26.571316 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5136064512 [----] I, [2016-09-13T06:13:26.571371 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 219860992 [----] I, [2016-09-13T06:13:26.571444 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T06:13:26.571510 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5082099712 [----] I, [2016-09-13T06:13:26.571563 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T06:13:26.571614 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T06:13:26.571663 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 540872704 [----] I, [2016-09-13T06:13:26.571722 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T06:13:26.571780 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7976706048 [----] I, [2016-09-13T06:13:26.571827 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T06:13:26.571874 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T06:13:26.571972 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T06:13:26.572028 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 24576 [----] I, [2016-09-13T06:13:26.572077 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T06:13:26.572141 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T06:13:26.572193 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T06:13:26.572239 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T06:13:26.572288 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T06:13:26.572336 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T06:13:26.572385 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273248256 [----] I, [2016-09-13T06:13:26.572455 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56590336 [----] I, [2016-09-13T06:13:26.572528 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216657920 [----] I, [2016-09-13T06:13:26.572586 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T06:13:26.572636 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140480512 [----] I, [2016-09-13T06:13:26.572683 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2585907200 [----] I, [2016-09-13T06:13:26.572755 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2271232000 [----] I, [2016-09-13T06:13:26.572809 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T06:13:26.572860 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T06:13:26.572907 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T06:13:26.572953 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37163008 [----] I, [2016-09-13T06:13:26.572998 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102277120 [----] I, [2016-09-13T06:13:26.573045 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53321728 [----] I, [2016-09-13T06:13:26.573117 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110571520 [----] I, [2016-09-13T06:13:26.573172 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155598848 [----] I, [2016-09-13T06:13:26.573221 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T06:13:26.573270 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T06:13:26.573325 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T06:13:26.573376 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T06:13:26.573445 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T06:13:26.573508 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T06:13:26.573561 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T06:13:26.573607 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T06:13:26.573659 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T06:13:26.604297 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T06:13:26.604515 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T06:13:26.607996 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T06:13:26.610508 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T06:13:26.613350 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T06:13:26.616352 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T06:13:26.619172 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T06:13:26.622041 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 841 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T06:13:26.624911 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T06:13:26.628643 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T06:13:26.632912 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.6 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T06:13:26.635667 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T06:13:26.638524 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T06:13:26.641384 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T06:13:26.643933 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:13:26.644066 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:13:26.644196 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T06:13:26.648842 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [200500000], Memory % [3.38], CPU Time [149897.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:13:26.649217 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77240], State: [ok], Delivered in [0.078810083] seconds [----] I, [2016-09-13T06:13:31.299213 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:13:31.626250 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77241], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [11.082696922] seconds [----] I, [2016-09-13T06:13:31.626459 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77241], Delivering... [----] I, [2016-09-13T06:13:31.633716 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:13:25 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [149907.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:13:31.634232 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:13:20 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [237163.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T06:13:31.634678 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:13:19 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347151000], Memory % [5.04], CPU Time [103621.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T06:13:31.635172 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:13:25 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202018000], Memory % [3.38], CPU Time [149004.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:13:31.635616 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:13:16 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212542000], Memory % [3.5], CPU Time [48431.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T06:13:31.636296 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:13:23 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162416000], Memory % [3.1], CPU Time [37546.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T06:13:31.636811 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:13:25 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358685000], Memory % [5.28], CPU Time [201526.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T06:13:31.637313 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:13:25 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50949.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:13:31.639911 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:13:21 UTC], Process Info: Memory Usage [614141952], Memory Size [1059639296], Proportional Set Size: [448667000], Memory % [7.49], CPU Time [710.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:13:31.641855 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:13:21 UTC], Process Info: Memory Usage [591835136], Memory Size [935665664], Proportional Set Size: [426682000], Memory % [7.22], CPU Time [221.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:13:31.643854 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:13:25 UTC], Process Info: Memory Usage [579964928], Memory Size [907837440], Proportional Set Size: [419475000], Memory % [7.07], CPU Time [1659.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T06:13:31.645784 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:13:22 UTC], Process Info: Memory Usage [557555712], Memory Size [894844928], Proportional Set Size: [405255000], Memory % [6.8], CPU Time [5040.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T06:13:31.646294 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:13:25 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [207213.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T06:13:31.646782 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:13:25 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [50949.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:13:31.647212 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:13:24 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38447.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T06:13:31.647557 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77241], State: [ok], Delivered in [0.021127239] seconds [----] I, [2016-09-13T06:13:35.564598 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:13:35.580455 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77242], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:13:35.592046 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77243], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:13:35.603007 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77244], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:13:35.632035 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77245], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:13:36.317933 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:13:36.729391 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77243], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.146583274] seconds [----] I, [2016-09-13T06:13:36.729604 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77243], Delivering... [----] I, [2016-09-13T06:13:36.740817 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77245], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.129098342] seconds [----] I, [2016-09-13T06:13:36.741026 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77245], Delivering... [----] I, [2016-09-13T06:13:36.747712 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036253929138183594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036437511444091797, :pending_vm_jobs=>0.0008127689361572266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006309986114501953} [----] I, [2016-09-13T06:13:36.748065 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77245], State: [ok], Delivered in [0.007042319] seconds [----] I, [2016-09-13T06:13:36.792898 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77243], State: [ok], Delivered in [0.063256033] seconds [----] I, [2016-09-13T06:13:37.700565 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77242], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.132314972] seconds [----] I, [2016-09-13T06:13:37.700772 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77242], Delivering... [----] I, [2016-09-13T06:13:37.706268 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77242], State: [ok], Delivered in [0.005492105] seconds [----] I, [2016-09-13T06:13:37.728944 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77244], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.131575958] seconds [----] I, [2016-09-13T06:13:37.729139 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77244], Delivering... [----] I, [2016-09-13T06:13:37.732437 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77244], State: [ok], Delivered in [0.003288388] seconds [----] I, [2016-09-13T06:13:42.895947 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004592180252075195, :worker_monitor=>1.5509536266326904, :worker_dequeue=>0.014755725860595703, :total_time=>1.5706088542938232} [----] I, [2016-09-13T06:13:47.896564 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:13:47 UTC]... [----] I, [2016-09-13T06:13:47.917606 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:13:47 UTC]...Complete [----] I, [2016-09-13T06:13:50.644822 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:13:50.660466 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77246], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:13:52.946833 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:13:52.975067 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77246], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.324517701] seconds [----] I, [2016-09-13T06:13:52.975326 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77246], Delivering... [----] I, [2016-09-13T06:13:52.982308 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003793478012084961, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003815889358520508, :pending_vm_jobs=>0.0008425712585449219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065402984619140625} [----] I, [2016-09-13T06:13:52.982698 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77246], State: [ok], Delivered in [0.00737753] seconds [----] I, [2016-09-13T06:13:59.257683 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004651546478271484, :worker_monitor=>1.282409429550171, :worker_dequeue=>0.011292457580566406, :total_time=>1.2986857891082764} [----] I, [2016-09-13T06:14:05.672107 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:14:05.689314 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77247], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:14:05.706228 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77248], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:14:09.285451 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:14:09.999613 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77248], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.302329621] seconds [----] I, [2016-09-13T06:14:09.999810 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77248], Delivering... [----] I, [2016-09-13T06:14:10.006044 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003219127655029297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032372474670410156, :pending_vm_jobs=>0.0008003711700439453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005837678909301758} [----] I, [2016-09-13T06:14:10.006461 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77248], State: [ok], Delivered in [0.006615731] seconds [----] I, [2016-09-13T06:14:10.883594 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77247], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.206833052] seconds [----] I, [2016-09-13T06:14:10.883817 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77247], Delivering... [----] I, [2016-09-13T06:14:10.889297 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77247], State: [ok], Delivered in [0.00547941] seconds [----] I, [2016-09-13T06:14:15.509706 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003818988800048828, :worker_monitor=>1.202531337738037, :worker_dequeue=>0.010880708694458008, :total_time=>1.2175168991088867} [----] I, [2016-09-13T06:14:20.510256 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:14:20 UTC]... [----] I, [2016-09-13T06:14:20.530668 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:14:20 UTC]...Complete [----] I, [2016-09-13T06:14:20.716307 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:14:20.734375 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77249], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:14:25.558531 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:14:25.917714 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77249], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.196527801] seconds [----] I, [2016-09-13T06:14:25.917933 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77249], Delivering... [----] I, [2016-09-13T06:14:25.925754 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003913402557373047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0039408206939697266, :pending_vm_jobs=>0.0009686946868896484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007263660430908203} [----] I, [2016-09-13T06:14:25.926276 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77249], State: [ok], Delivered in [0.008325984] seconds [----] I, [2016-09-13T06:14:31.853753 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004221677780151367, :worker_monitor=>1.272087812423706, :worker_dequeue=>0.011506319046020508, :total_time=>1.2881596088409424} [----] I, [2016-09-13T06:14:35.743340 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:14:35.764065 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77250], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:14:35.775313 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77251], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:14:35.786852 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77252], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:14:35.809683 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77253], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:14:36.970600 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:14:37.215501 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77251], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.447142315] seconds [----] I, [2016-09-13T06:14:37.215666 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77251], Delivering... [----] I, [2016-09-13T06:14:37.255363 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77251], State: [ok], Delivered in [0.039682581] seconds [----] I, [2016-09-13T06:14:37.289769 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77253], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.493428445] seconds [----] I, [2016-09-13T06:14:37.289975 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77253], Delivering... [----] I, [2016-09-13T06:14:37.296572 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033745765686035156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033943653106689453, :pending_vm_jobs=>0.0008327960968017578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006217241287231445} [----] I, [2016-09-13T06:14:37.296993 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77253], State: [ok], Delivered in [0.007007681] seconds [----] I, [2016-09-13T06:14:37.981103 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77250], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.233140984] seconds [----] I, [2016-09-13T06:14:37.981284 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77250], Delivering... [----] I, [2016-09-13T06:14:37.986614 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77250], State: [ok], Delivered in [0.005325305] seconds [----] I, [2016-09-13T06:14:37.986862 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77252], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.206173068] seconds [----] I, [2016-09-13T06:14:37.987024 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77252], Delivering... [----] I, [2016-09-13T06:14:37.990912 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77252], State: [ok], Delivered in [0.003864301] seconds [----] I, [2016-09-13T06:14:48.389406 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038251876831054688, :worker_monitor=>1.369964838027954, :worker_dequeue=>0.011038541793823242, :total_time=>1.3851158618927002} [----] I, [2016-09-13T06:14:50.825913 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:14:50.844003 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77254], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:14:53.389972 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:14:53 UTC]... [----] I, [2016-09-13T06:14:53.416684 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:14:53 UTC]...Complete [----] I, [2016-09-13T06:14:53.428123 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:14:53.467040 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77254], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.633538543] seconds [----] I, [2016-09-13T06:14:53.467262 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77254], Delivering... [----] I, [2016-09-13T06:14:53.473904 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035660266876220703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035860538482666016, :pending_vm_jobs=>0.0007917881011962891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006224632263183594} [----] I, [2016-09-13T06:14:53.474285 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77254], State: [ok], Delivered in [0.007022402] seconds [----] I, [2016-09-13T06:15:04.823543 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0042877197265625, :worker_monitor=>1.3522672653198242, :worker_dequeue=>0.010807991027832031, :total_time=>1.3676793575286865} [----] I, [2016-09-13T06:15:06.187733 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:15:06.209955 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77255], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:15:06.255992 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77256], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:15:09.834592 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:15:10.541801 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77256], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.32472028] seconds [----] I, [2016-09-13T06:15:10.542005 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77256], Delivering... [----] I, [2016-09-13T06:15:10.548457 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034172534942626953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003440380096435547, :pending_vm_jobs=>0.0007975101470947266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006028175354003906} [----] I, [2016-09-13T06:15:10.548817 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77256], State: [ok], Delivered in [0.006811412] seconds [----] I, [2016-09-13T06:15:11.124037 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77255], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.929264052] seconds [----] I, [2016-09-13T06:15:11.124294 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77255], Delivering... [----] I, [2016-09-13T06:15:11.128464 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77255], State: [ok], Delivered in [0.004167551] seconds [----] I, [2016-09-13T06:15:21.164239 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038509368896484375, :worker_monitor=>1.28678297996521, :worker_dequeue=>0.014018774032592773, :total_time=>1.3049602508544922} [----] I, [2016-09-13T06:15:21.268618 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:15:21.284270 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77257], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:15:26.167142 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:15:26 UTC]... [----] I, [2016-09-13T06:15:26.192816 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:15:26 UTC]...Complete [----] I, [2016-09-13T06:15:26.209041 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:15:26.667366 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77257], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.392320635] seconds [----] I, [2016-09-13T06:15:26.667587 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77257], Delivering... [----] I, [2016-09-13T06:15:26.674022 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034186840057373047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034379959106445312, :pending_vm_jobs=>0.0008716583251953125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060846805572509766} [----] I, [2016-09-13T06:15:26.674401 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77257], State: [ok], Delivered in [0.006809142] seconds [----] I, [2016-09-13T06:15:36.297497 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:15:36.312903 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77258], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:15:36.324181 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77259], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:15:36.336519 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77260], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:15:36.352828 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77261], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:15:37.640733 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:15:37.647371 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004293680191040039, :worker_monitor=>1.3977670669555664, :worker_dequeue=>0.011860370635986328, :total_time=>1.4142494201660156} [----] I, [2016-09-13T06:15:37.753026 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77259], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.435773316] seconds [----] I, [2016-09-13T06:15:37.753211 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77259], Delivering... [----] I, [2016-09-13T06:15:37.758669 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77261], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.412373665] seconds [----] I, [2016-09-13T06:15:37.758830 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77261], Delivering... [----] I, [2016-09-13T06:15:37.764877 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032091140747070312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032274723052978516, :pending_vm_jobs=>0.0007295608520507812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005715847015380859} [----] I, [2016-09-13T06:15:37.765194 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77261], State: [ok], Delivered in [0.006357356] seconds [----] I, [2016-09-13T06:15:37.798502 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77259], State: [ok], Delivered in [0.0452695] seconds [----] I, [2016-09-13T06:15:38.187538 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77258], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.885215187] seconds [----] I, [2016-09-13T06:15:38.187730 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77258], Delivering... [----] I, [2016-09-13T06:15:38.192993 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77258], State: [ok], Delivered in [0.00525809] seconds [----] I, [2016-09-13T06:15:38.215842 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77260], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.886365172] seconds [----] I, [2016-09-13T06:15:38.216026 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77260], Delivering... [----] I, [2016-09-13T06:15:38.223446 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77260], State: [ok], Delivered in [0.007379262] seconds [----] I, [2016-09-13T06:15:51.365374 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:15:51.381757 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77262], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:15:54.371617 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:15:54.377070 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038971900939941406, :worker_monitor=>1.4765746593475342, :worker_dequeue=>0.009559392929077148, :total_time=>1.4903037548065186} [----] I, [2016-09-13T06:15:54.971969 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77262], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.600487523] seconds [----] I, [2016-09-13T06:15:54.972230 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77262], Delivering... [----] I, [2016-09-13T06:15:54.979697 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003964662551879883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003989458084106445, :pending_vm_jobs=>0.0008680820465087891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006994962692260742} [----] I, [2016-09-13T06:15:54.980146 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77262], State: [ok], Delivered in [0.007903462] seconds [----] I, [2016-09-13T06:15:59.377617 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:15:59 UTC]... [----] I, [2016-09-13T06:15:59.405412 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:15:59 UTC]...Complete [----] I, [2016-09-13T06:16:06.394386 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:16:06.411212 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77263], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:16:06.451118 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77264], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:16:11.054868 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:16:11.061681 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006534576416015625, :worker_monitor=>1.600757360458374, :worker_dequeue=>0.012519359588623047, :total_time=>1.6202492713928223} [----] I, [2016-09-13T06:16:11.110343 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77264], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.693405798] seconds [----] I, [2016-09-13T06:16:11.110591 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77264], Delivering... [----] I, [2016-09-13T06:16:11.117134 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003461599349975586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034813880920410156, :pending_vm_jobs=>0.0008459091186523438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006130695343017578} [----] I, [2016-09-13T06:16:11.117535 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77264], State: [ok], Delivered in [0.00695497] seconds [----] I, [2016-09-13T06:16:11.337513 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77263], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.937905592] seconds [----] I, [2016-09-13T06:16:11.337735 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77263], Delivering... [----] I, [2016-09-13T06:16:11.342996 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77263], State: [ok], Delivered in [0.005266947] seconds [----] I, [2016-09-13T06:16:21.464021 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:16:21.487615 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77265], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:16:27.698600 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:16:27.703291 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036211013793945312, :worker_monitor=>1.5899903774261475, :worker_dequeue=>0.009270906448364258, :total_time=>1.603170394897461} [----] I, [2016-09-13T06:16:28.137508 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77265], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.666978001] seconds [----] I, [2016-09-13T06:16:28.137704 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77265], Delivering... [----] I, [2016-09-13T06:16:28.143837 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00311279296875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031371116638183594, :pending_vm_jobs=>0.0007703304290771484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005739450454711914} [----] I, [2016-09-13T06:16:28.144196 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77265], State: [ok], Delivered in [0.006492463] seconds [----] I, [2016-09-13T06:16:32.703762 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:16:32 UTC]... [----] I, [2016-09-13T06:16:32.727646 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:16:32 UTC]...Complete [----] I, [2016-09-13T06:16:36.499613 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:16:36.514484 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77266], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:16:36.525703 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77267], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:16:36.537064 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77268], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:16:36.554311 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77269], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:16:37.763467 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:16:38.217481 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77267], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.699091998] seconds [----] I, [2016-09-13T06:16:38.217654 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77267], Delivering... [----] I, [2016-09-13T06:16:38.270919 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77267], State: [ok], Delivered in [0.053232047] seconds [----] I, [2016-09-13T06:16:38.302968 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77269], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.756777616] seconds [----] I, [2016-09-13T06:16:38.303144 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77269], Delivering... [----] I, [2016-09-13T06:16:38.308717 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002817392349243164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028340816497802734, :pending_vm_jobs=>0.0007121562957763672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005253791809082031} [----] I, [2016-09-13T06:16:38.309039 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77269], State: [ok], Delivered in [0.005886982] seconds [----] I, [2016-09-13T06:16:38.411716 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77266], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.907619525] seconds [----] I, [2016-09-13T06:16:38.411930 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77266], Delivering... [----] I, [2016-09-13T06:16:38.417128 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77266], State: [ok], Delivered in [0.005185477] seconds [----] I, [2016-09-13T06:16:38.434529 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77268], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.903535064] seconds [----] I, [2016-09-13T06:16:38.434708 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77268], Delivering... [----] I, [2016-09-13T06:16:38.442893 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77268], State: [ok], Delivered in [0.008163997] seconds [----] I, [2016-09-13T06:16:44.352743 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003047466278076172, :server_monitor=>0.12882256507873535, :worker_monitor=>1.4362006187438965, :worker_dequeue=>0.0134124755859375, :total_time=>1.5823140144348145} [----] I, [2016-09-13T06:16:51.566641 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:16:51.584542 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77270], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:16:54.378817 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:16:54.441963 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77270], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.867539727] seconds [----] I, [2016-09-13T06:16:54.442209 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77270], Delivering... [----] I, [2016-09-13T06:16:54.448949 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036842823028564453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037081241607666016, :pending_vm_jobs=>0.0007619857788085938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006327152252197266} [----] I, [2016-09-13T06:16:54.449332 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77270], State: [ok], Delivered in [0.007120078] seconds [----] I, [2016-09-13T06:17:00.464704 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0047872066497802734, :worker_monitor=>1.0676333904266357, :worker_dequeue=>0.005940437316894531, :total_time=>1.0786819458007812} [----] I, [2016-09-13T06:17:05.465220 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:17:05 UTC]... [----] I, [2016-09-13T06:17:05.489372 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:17:05 UTC]...Complete [----] I, [2016-09-13T06:17:06.597295 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:17:06.613398 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77271], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:17:06.630371 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77272], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:17:10.519194 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:17:10.579361 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77272], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.9601293] seconds [----] I, [2016-09-13T06:17:10.579558 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77272], Delivering... [----] I, [2016-09-13T06:17:10.585393 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030133724212646484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003030538558959961, :pending_vm_jobs=>0.0007486343383789062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055081844329833984} [----] I, [2016-09-13T06:17:10.585762 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77272], State: [ok], Delivered in [0.006201896] seconds [----] I, [2016-09-13T06:17:11.539255 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77271], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.937014442] seconds [----] I, [2016-09-13T06:17:11.539508 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77271], Delivering... [----] I, [2016-09-13T06:17:11.545100 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77271], State: [ok], Delivered in [0.005565366] seconds [----] I, [2016-09-13T06:17:16.932995 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003480672836303711, :worker_monitor=>1.3899922370910645, :worker_dequeue=>0.013245344161987305, :total_time=>1.4070007801055908} [----] I, [2016-09-13T06:17:21.643288 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:17:21.659901 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77273], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:17:21.943708 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:17:22.602309 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77273], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.952932488] seconds [----] I, [2016-09-13T06:17:22.602556 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77273], Delivering... [----] I, [2016-09-13T06:17:22.608663 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003167390823364258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031871795654296875, :pending_vm_jobs=>0.0007727146148681641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00571751594543457} [----] I, [2016-09-13T06:17:22.608970 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77273], State: [ok], Delivered in [0.006420827] seconds [----] I, [2016-09-13T06:17:33.313442 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039556026458740234, :worker_monitor=>1.3326752185821533, :worker_dequeue=>0.01054239273071289, :total_time=>1.3474435806274414} [----] I, [2016-09-13T06:17:36.671737 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:17:36.689122 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77274], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:17:36.699255 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77275], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:17:36.710600 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77276], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:17:36.728034 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77277], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:17:38.314002 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:17:38 UTC]... [----] I, [2016-09-13T06:17:38.340004 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:17:38 UTC]...Complete [----] I, [2016-09-13T06:17:38.355822 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:17:38.624931 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77275], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.931709726] seconds [----] I, [2016-09-13T06:17:38.625165 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77275], Delivering... [----] I, [2016-09-13T06:17:38.647744 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77277], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.928511008] seconds [----] I, [2016-09-13T06:17:38.647948 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77277], Delivering... [----] I, [2016-09-13T06:17:38.654830 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003596067428588867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036468505859375, :pending_vm_jobs=>0.0008680820465087891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006487369537353516} [----] I, [2016-09-13T06:17:38.655182 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77277], State: [ok], Delivered in [0.007224279] seconds [----] I, [2016-09-13T06:17:38.699370 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77274], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.022908907] seconds [----] I, [2016-09-13T06:17:38.699630 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77274], Delivering... [----] I, [2016-09-13T06:17:38.704442 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77275], State: [ok], Delivered in [0.07923986] seconds [----] I, [2016-09-13T06:17:38.705852 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77274], State: [ok], Delivered in [0.006187556] seconds [----] I, [2016-09-13T06:17:38.750618 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77276], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.046387418] seconds [----] I, [2016-09-13T06:17:38.750822 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77276], Delivering... [----] I, [2016-09-13T06:17:38.754009 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77276], State: [ok], Delivered in [0.003170705] seconds [----] I, [2016-09-13T06:17:48.497316 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T06:17:51.742015 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:17:51.774910 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77278], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:17:54.273942 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:17:54.900584 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77278], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.152644438] seconds [----] I, [2016-09-13T06:17:54.900764 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77278], Delivering... [----] I, [2016-09-13T06:17:54.906749 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030291080474853516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030481815338134766, :pending_vm_jobs=>0.0007596015930175781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005621433258056641} [----] I, [2016-09-13T06:17:54.907042 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77278], State: [ok], Delivered in [0.006272354] seconds [----] I, [2016-09-13T06:18:05.445905 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004004001617431641, :worker_monitor=>1.135843276977539, :worker_dequeue=>0.01090860366821289, :total_time=>1.1511123180389404} [----] I, [2016-09-13T06:18:06.787117 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T06:18:06.809725 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77279], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [3600] [----] I, [2016-09-13T06:18:06.820654 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77280], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:18:06.831920 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77281], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:18:10.446479 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:18:10 UTC]... [----] I, [2016-09-13T06:18:10.467699 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:18:10 UTC]...Complete [----] I, [2016-09-13T06:18:10.478845 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:18:11.022267 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77281], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.196132] seconds [----] I, [2016-09-13T06:18:11.022490 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77281], Delivering... [----] I, [2016-09-13T06:18:11.028532 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003157377243041992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003175020217895508, :pending_vm_jobs=>0.0007419586181640625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005632638931274414} [----] I, [2016-09-13T06:18:11.028875 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77281], State: [ok], Delivered in [0.006415279] seconds [----] I, [2016-09-13T06:18:11.826721 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77279], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [3600], Dequeued in: [5.033452596] seconds [----] I, [2016-09-13T06:18:11.826875 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77279], Delivering... [----] I, [2016-09-13T06:18:11.835961 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77279], State: [ok], Delivered in [0.009076629] seconds [----] I, [2016-09-13T06:18:11.860849 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77280], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.045052173] seconds [----] I, [2016-09-13T06:18:11.861011 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77280], Delivering... [----] I, [2016-09-13T06:18:11.864672 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77280], State: [ok], Delivered in [0.00365864] seconds [----] I, [2016-09-13T06:18:21.843687 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:18:21.900578 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77282], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:18:21.912998 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77283], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:18:21.922898 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77284], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:18:26.485569 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:18:26.906244 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77282], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.056381609] seconds [----] I, [2016-09-13T06:18:26.906509 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77282], Delivering... [----] I, [2016-09-13T06:18:26.913512 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003865480422973633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003885984420776367, :pending_vm_jobs=>0.0008273124694824219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006553173065185547} [----] I, [2016-09-13T06:18:26.913898 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77282], State: [ok], Delivered in [0.007392353] seconds [----] I, [2016-09-13T06:18:26.940596 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77283], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.035497596] seconds [----] I, [2016-09-13T06:18:26.940796 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77283], Delivering... [----] I, [2016-09-13T06:18:26.942100 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T06:18:26.942300 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5333069824 [----] I, [2016-09-13T06:18:26.942392 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5113024512 [----] I, [2016-09-13T06:18:26.942523 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 220045312 [----] I, [2016-09-13T06:18:26.942612 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T06:18:26.942697 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5059026944 [----] I, [2016-09-13T06:18:26.942768 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T06:18:26.942841 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T06:18:26.942921 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 541052928 [----] I, [2016-09-13T06:18:26.942996 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T06:18:26.943066 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7867039744 [----] I, [2016-09-13T06:18:26.943160 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T06:18:26.943231 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T06:18:26.943302 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T06:18:26.943371 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 28672 [----] I, [2016-09-13T06:18:26.943465 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T06:18:26.943553 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T06:18:26.943629 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T06:18:26.943706 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T06:18:26.943777 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T06:18:26.943846 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T06:18:26.943919 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273231872 [----] I, [2016-09-13T06:18:26.943990 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56573952 [----] I, [2016-09-13T06:18:26.944063 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216657920 [----] I, [2016-09-13T06:18:26.944165 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T06:18:26.944239 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140480512 [----] I, [2016-09-13T06:18:26.944305 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2609074176 [----] I, [2016-09-13T06:18:26.944371 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2294214656 [----] I, [2016-09-13T06:18:26.944470 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T06:18:26.944558 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T06:18:26.944627 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T06:18:26.944697 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36945920 [----] I, [2016-09-13T06:18:26.944765 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102277120 [----] I, [2016-09-13T06:18:26.944841 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53354496 [----] I, [2016-09-13T06:18:26.944911 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110571520 [----] I, [2016-09-13T06:18:26.944978 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155631616 [----] I, [2016-09-13T06:18:26.945045 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T06:18:26.945134 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T06:18:26.945215 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T06:18:26.945286 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T06:18:26.945355 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T06:18:26.945459 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T06:18:26.945551 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T06:18:26.945622 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T06:18:26.945692 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T06:18:26.957846 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77284], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.040468197] seconds [----] I, [2016-09-13T06:18:26.958048 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77284], Delivering... [----] I, [2016-09-13T06:18:26.966772 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:18:20 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50965.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:18:26.967403 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:18:06 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [237313.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T06:18:26.967977 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:18:19 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347151000], Memory % [5.04], CPU Time [103637.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T06:18:26.968456 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:18:16 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212542000], Memory % [3.5], CPU Time [48438.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T06:18:26.969012 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:18:20 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358685000], Memory % [5.28], CPU Time [201558.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T06:18:26.969574 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:18:21 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162416000], Memory % [3.1], CPU Time [37554.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T06:18:26.970096 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:18:21 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [149964.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:18:26.970569 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:18:21 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202018000], Memory % [3.38], CPU Time [149070.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:18:26.973743 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:18:11 UTC], Process Info: Memory Usage [591835136], Memory Size [935665664], Proportional Set Size: [426746000], Memory % [7.22], CPU Time [232.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:18:26.975787 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:18:12 UTC], Process Info: Memory Usage [591142912], Memory Size [920719360], Proportional Set Size: [426207000], Memory % [7.21], CPU Time [793.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:18:26.977838 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:18:15 UTC], Process Info: Memory Usage [580186112], Memory Size [921993216], Proportional Set Size: [419691000], Memory % [7.07], CPU Time [1670.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T06:18:26.979825 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:18:12 UTC], Process Info: Memory Usage [557826048], Memory Size [910049280], Proportional Set Size: [405487000], Memory % [6.8], CPU Time [5051.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T06:18:26.980356 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:18:20 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [207248.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T06:18:26.980880 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:18:20 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [50964.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:18:26.981345 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:18:12 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38457.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T06:18:26.981706 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77284], State: [ok], Delivered in [0.023654484] seconds [----] I, [2016-09-13T06:18:27.003606 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T06:18:27.003910 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T06:18:27.008264 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T06:18:27.011298 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T06:18:27.014288 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T06:18:27.017515 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T06:18:27.020616 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T06:18:27.023478 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 841 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T06:18:27.026598 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T06:18:27.029635 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T06:18:27.032711 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T06:18:27.035544 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T06:18:27.038710 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T06:18:27.041712 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T06:18:27.044353 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:18:27.044524 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:18:27.044628 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T06:18:27.048831 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [207239.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T06:18:27.049259 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77283], State: [ok], Delivered in [0.108446422] seconds [----] I, [2016-09-13T06:18:36.949951 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:18:36.974716 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77285], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:18:36.997356 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77286], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:18:37.037642 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77287], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:18:37.066347 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77288], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:18:37.715310 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:18:37.722170 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004909038543701172, :worker_monitor=>1.1963086128234863, :worker_dequeue=>0.012468576431274414, :total_time=>1.2140896320343018} [----] I, [2016-09-13T06:18:38.192993 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77286], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.213890438] seconds [----] I, [2016-09-13T06:18:38.193184 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77286], Delivering... [----] I, [2016-09-13T06:18:38.210154 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77288], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.162842139] seconds [----] I, [2016-09-13T06:18:38.210329 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77288], Delivering... [----] I, [2016-09-13T06:18:38.216750 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003572702407836914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035898685455322266, :pending_vm_jobs=>0.0007219314575195312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060727596282958984} [----] I, [2016-09-13T06:18:38.217122 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77288], State: [ok], Delivered in [0.006772052] seconds [----] I, [2016-09-13T06:18:38.244107 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77286], State: [ok], Delivered in [0.050884257] seconds [----] I, [2016-09-13T06:18:39.050234 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77285], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.095550805] seconds [----] I, [2016-09-13T06:18:39.050478 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77285], Delivering... [----] I, [2016-09-13T06:18:39.056351 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77285], State: [ok], Delivered in [0.005895488] seconds [----] I, [2016-09-13T06:18:39.084319 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77287], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.081855092] seconds [----] I, [2016-09-13T06:18:39.084549 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77287], Delivering... [----] I, [2016-09-13T06:18:39.087861 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77287], State: [ok], Delivered in [0.003301507] seconds [----] I, [2016-09-13T06:18:42.722705 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:18:42 UTC]... [----] I, [2016-09-13T06:18:42.741043 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:18:42 UTC]...Complete [----] I, [2016-09-13T06:18:52.078156 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:18:52.095557 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77289], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:18:54.418106 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:18:54.424024 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006460666656494141, :worker_monitor=>1.5052969455718994, :worker_dequeue=>0.010663747787475586, :total_time=>1.5227184295654297} [----] I, [2016-09-13T06:18:55.404665 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77289], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.321105992] seconds [----] I, [2016-09-13T06:18:55.404861 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77289], Delivering... [----] I, [2016-09-13T06:18:55.413032 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003656148910522461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036809444427490234, :pending_vm_jobs=>0.0012447834014892578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0077021121978759766} [----] I, [2016-09-13T06:18:55.413566 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77289], State: [ok], Delivered in [0.008683975] seconds [----] I, [2016-09-13T06:19:07.106806 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 11. [----] I, [2016-09-13T06:19:07.135719 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77290], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:19:07.160165 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77291], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:19:07.175721 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77292], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:19:10.661943 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:19:10.668971 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007497549057006836, :worker_monitor=>1.1923222541809082, :worker_dequeue=>0.013258934020996094, :total_time=>1.2134850025177002} [----] I, [2016-09-13T06:19:11.496192 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77292], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.329387101] seconds [----] I, [2016-09-13T06:19:11.496394 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77292], Delivering... [----] I, [2016-09-13T06:19:11.502768 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033376216888427734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033614635467529297, :pending_vm_jobs=>0.0007722377777099609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005911111831665039} [----] I, [2016-09-13T06:19:11.503129 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77292], State: [ok], Delivered in [0.006725145] seconds [----] I, [2016-09-13T06:19:12.193321 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77290], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.06717371] seconds [----] I, [2016-09-13T06:19:12.193554 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77290], Delivering... [----] I, [2016-09-13T06:19:12.221879 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77291], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.078607767] seconds [----] I, [2016-09-13T06:19:12.222165 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77291], Delivering... [----] I, [2016-09-13T06:19:12.228029 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77291], State: [ok], Delivered in [0.005895845] seconds [----] I, [2016-09-13T06:19:12.233665 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77293], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T06:19:12.250725 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77294], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T06:19:12.251166 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77290], State: [ok], Delivered in [0.057594254] seconds [----] I, [2016-09-13T06:19:15.669639 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:19:15 UTC]... [----] I, [2016-09-13T06:19:15.701798 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:19:15 UTC]...Complete [----] I, [2016-09-13T06:19:15.722139 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T06:19:15.724903 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T06:19:20.739855 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T06:19:20.742359 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T06:19:22.044975 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [77294], MiqWorker id: [99], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [9.801792707] seconds [----] I, [2016-09-13T06:19:22.045228 #5369:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77294], Delivering... [----] I, [2016-09-13T06:19:22.049177 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T06:19:22.049342 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T06:19:22.049477 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T06:19:22.049645 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T06:19:22.049817 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:22.188801 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:19:22.210494 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77295], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:19:22.233225 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77296], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:19:22.330333 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:22.421877 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [77293], MiqWorker id: [98], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [10.203301396] seconds [----] I, [2016-09-13T06:19:22.422039 #3290:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77293], Delivering... [----] I, [2016-09-13T06:19:22.425121 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T06:19:22.425272 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T06:19:22.425405 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T06:19:22.425598 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T06:19:22.425781 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:22.528008 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:22.528185 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:22.851347 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:22.851729 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:22.944171 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:23.033554 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:23.146736 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:23.146909 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:23.637271 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:23.762039 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:23.864321 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:23.938832 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:23.939037 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:23.958593 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:24.050187 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:24.142791 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:24.235869 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:24.328950 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:24.423557 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:24.448261 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:24.515745 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:24.608113 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:24.699713 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:24.751510 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:24.751707 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:24.793730 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:24.888658 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:24.980552 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:25.073115 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:25.165263 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:25.237273 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:25.256215 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:19:25.480809 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T06:19:25.481031 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004004240036010742, :collect_inventory_for_targets=>1.5497207641601562e-05, :parse_legacy_inventory=>6.51850438117981, :parse_targeted_inventory=>6.518544435501099, :save_inventory=>0.49431586265563965, :ems_refresh=>7.01370906829834} [----] I, [2016-09-13T06:19:25.501297 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T06:19:25.501705 #5369:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77294], State: [ok], Delivered in [3.456477515] seconds [----] I, [2016-09-13T06:19:25.543668 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:25.543796 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:26.031219 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:26.330472 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:26.330652 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:26.830901 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:26.982705 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:19:26.986193 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039119720458984375, :worker_monitor=>1.2328522205352783, :worker_dequeue=>0.006379604339599609, :total_time=>1.2433695793151855} [----] I, [2016-09-13T06:19:27.148001 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:27.148206 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:27.290892 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77296], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.074677584] seconds [----] I, [2016-09-13T06:19:27.291061 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77296], Delivering... [----] I, [2016-09-13T06:19:27.296251 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77295], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.098460937] seconds [----] I, [2016-09-13T06:19:27.296354 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77295], Delivering... [----] I, [2016-09-13T06:19:27.297169 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031213760375976562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031402111053466797, :pending_vm_jobs=>0.0007488727569580078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005717754364013672} [----] I, [2016-09-13T06:19:27.297538 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77296], State: [ok], Delivered in [0.006466382] seconds [----] I, [2016-09-13T06:19:27.348701 #2937:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 10:19:26 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_16' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 10:19:26.985091') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2927,,2016-09-13 10:19:27 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2936,2016-09-13 10:19:27 UTC,2016-09-13 10:19:27 UTC,BEGIN,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2946,2016-09-13 10:19:27 UTC,2016-09-13 10:19:27 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 10:19:26 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 10:19:26 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 10:19:26 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2986,,2016-09-13 10:19:26 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2997,,2016-09-13 10:19:22 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 10:19:07.182618')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5, 3011,,2016-09-13 09:54:11 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1516, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,504122, 3030,,2016-09-13 09:54:17 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1509, 3054,,2016-09-13 09:24:13 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3313, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,504120, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,504120, 3160,,2016-09-13 09:24:16 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3311, 3298,,2016-09-13 10:19:22 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,4, 703,,2016-09-13 09:54:11 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1516, 27056,,2016-09-13 09:54:15 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1512, 28888,,2016-09-13 08:54:02 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5125, 5377,,2016-09-13 10:19:25 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 20394,,2016-09-13 09:54:14 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1513, ACTIVITY_STATS_CSV [----] I, [2016-09-13T06:19:27.348966 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77295], State: [ok], Delivered in [0.052593258] seconds [----] I, [2016-09-13T06:19:27.632398 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:27.921835 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:27.922016 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:28.410112 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:28.713812 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:28.713987 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:29.194197 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:29.496447 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:29.496608 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:29.970591 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:30.279444 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:30.279625 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:30.744856 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:31.050753 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:31.050927 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:31.537799 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:31.856695 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:31.856893 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:32.355411 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:32.652498 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:32.652670 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:33.134287 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:33.292586 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:33.433956 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:33.572659 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:33.705944 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:33.856462 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:33.994938 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:34.130661 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:34.266254 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:34.405683 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:34.539319 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:34.733581 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:34.876818 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:35.010455 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:35.157711 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:35.668270 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:35.819766 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:35.956238 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:36.096836 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:36.438329 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:36.576491 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:36.737663 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:37.246882 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:19:37.268181 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77297], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:19:37.279486 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77298], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:19:37.290901 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77299], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:19:37.307887 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77300], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:19:42.898366 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:43.037288 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:43.176758 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:43.212007 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:19:43.218920 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0049479007720947266, :worker_monitor=>1.1795697212219238, :worker_dequeue=>0.012276172637939453, :total_time=>1.1972875595092773} [----] I, [2016-09-13T06:19:43.322524 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:43.461020 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:43.601781 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:43.702541 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77298], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.430181614] seconds [----] I, [2016-09-13T06:19:43.702706 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77298], Delivering... [----] I, [2016-09-13T06:19:43.731285 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77300], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.431737057] seconds [----] I, [2016-09-13T06:19:43.731526 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77300], Delivering... [----] I, [2016-09-13T06:19:43.740262 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004435300827026367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0044634342193603516, :pending_vm_jobs=>0.0010690689086914062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008263587951660156} [----] I, [2016-09-13T06:19:43.740686 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77300], State: [ok], Delivered in [0.00914955] seconds [----] I, [2016-09-13T06:19:43.750550 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:43.765305 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77298], State: [ok], Delivered in [0.062581709] seconds [----] I, [2016-09-13T06:19:43.895140 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:44.038790 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:44.185090 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:44.617024 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:44.769219 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:44.906571 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:45.046347 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:45.191375 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:45.324788 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:45.365498 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77297], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.112956696] seconds [----] I, [2016-09-13T06:19:45.365694 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77297], Delivering... [----] I, [2016-09-13T06:19:45.370196 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77297], State: [ok], Delivered in [0.004499987] seconds [----] I, [2016-09-13T06:19:45.399869 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77299], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.11501512] seconds [----] I, [2016-09-13T06:19:45.400044 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77299], Delivering... [----] I, [2016-09-13T06:19:45.402980 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77299], State: [ok], Delivered in [0.002923843] seconds [----] I, [2016-09-13T06:19:45.464601 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:45.602266 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:45.741145 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:45.885288 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:46.028712 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:46.165158 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:46.318812 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:46.457780 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:46.607347 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:46.754626 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:46.893353 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:47.260999 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:47.412020 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:47.549857 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:47.694643 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:47.827343 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:48.004961 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:48.150732 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:48.219410 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:19:48 UTC]... [----] I, [2016-09-13T06:19:48.280855 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:19:48 UTC]...Complete [----] I, [2016-09-13T06:19:48.296988 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:48.438585 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:48.579593 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:48.720109 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:48.852086 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:48.991176 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:49.135305 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:49.272606 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:49.410100 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:49.549615 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:49.892109 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:50.051848 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:50.193982 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:50.326243 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:50.461786 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:50.603858 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:50.743892 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:50.882556 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:51.028587 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:51.168475 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:51.313729 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:51.455585 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:51.592587 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:51.726562 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:51.865091 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:52.007626 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:52.140604 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:52.320044 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:19:52.356302 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77301], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:19:52.708403 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:52.865160 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:53.005048 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:53.145023 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:53.288581 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:53.408011 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:19:53.425271 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:53.569822 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:53.711112 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:53.852583 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77301], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.525680009] seconds [----] I, [2016-09-13T06:19:53.852774 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77301], Delivering... [----] I, [2016-09-13T06:19:53.854225 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:53.859388 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003731966018676758, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037505626678466797, :pending_vm_jobs=>0.0007643699645996094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062596797943115234} [----] I, [2016-09-13T06:19:53.859751 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77301], State: [ok], Delivered in [0.006970609] seconds [----] I, [2016-09-13T06:19:53.996328 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:54.135734 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:54.275441 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:54.414699 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:54.554581 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:54.703060 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:54.839679 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:54.976389 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:55.367313 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:55.532312 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:55.666856 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:55.811005 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:55.946192 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:56.084826 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:56.231262 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:56.377490 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:56.517903 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:56.658384 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:56.801459 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:56.945485 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:57.084564 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:57.229529 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:57.375698 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:57.518563 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:57.658781 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:58.143445 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:58.292821 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:58.451204 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:58.594014 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:58.740320 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:58.880042 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:59.025735 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:59.164290 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:59.306468 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:59.444771 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:59.582101 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:59.720684 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:59.772841 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039055347442626953, :worker_monitor=>1.3430089950561523, :worker_dequeue=>0.010832548141479492, :total_time=>1.3580200672149658} [----] I, [2016-09-13T06:19:59.863353 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:19:59.997687 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:00.140482 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:00.286790 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:00.426378 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:00.941935 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:01.098228 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:01.236809 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:01.379511 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:01.518262 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:01.662193 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:01.800863 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:01.948597 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:02.092870 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:02.229876 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:02.370121 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:02.507710 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:02.644276 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:02.784153 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:02.924264 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:03.063685 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:03.205217 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:03.600493 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:03.752808 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:03.891827 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:04.031482 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:04.174451 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:04.309055 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:04.448669 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:04.585270 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:04.809907 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:04.964859 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:05.112718 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:05.250351 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:05.392330 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:05.531709 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:05.668993 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:05.799980 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:05.939570 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:06.420143 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:06.575247 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:06.718583 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:06.866839 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:07.007598 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:07.154437 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:07.294222 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:07.369523 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:20:07.408507 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77302], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:20:07.425827 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77303], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:20:07.442170 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77304], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:20:07.459397 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77305], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:20:07.476172 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77306], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:20:07.542168 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:07.708062 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:07.850601 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:07.990454 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:08.133031 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:08.272156 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:08.419181 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:08.556309 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:08.697538 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:08.844257 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:09.299918 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:09.460752 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:09.603155 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:09.744851 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:09.798341 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:20:09.883210 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:09.973704 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77306], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.506297971] seconds [----] I, [2016-09-13T06:20:09.973916 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77306], Delivering... [----] I, [2016-09-13T06:20:09.980006 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003329753875732422, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003346681594848633, :pending_vm_jobs=>0.0006997585296630859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005726337432861328} [----] I, [2016-09-13T06:20:09.980344 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77306], State: [ok], Delivered in [0.006428688] seconds [----] I, [2016-09-13T06:20:10.024120 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:10.163951 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:10.300050 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:10.441492 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:10.577692 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:10.718232 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:12.493459 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77302], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.117920804] seconds [----] I, [2016-09-13T06:20:12.493662 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77302], Delivering... [----] I, [2016-09-13T06:20:12.496587 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77302], State: [ok], Delivered in [0.002904951] seconds [----] I, [2016-09-13T06:20:12.499538 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77303], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.085210675] seconds [----] I, [2016-09-13T06:20:12.499828 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77303], Delivering... [----] I, [2016-09-13T06:20:12.514232 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77303], State: [ok], Delivered in [0.014381273] seconds [----] I, [2016-09-13T06:20:12.596728 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77304], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.165002282] seconds [----] I, [2016-09-13T06:20:12.596907 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77304], Delivering... [----] I, [2016-09-13T06:20:12.602139 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77305], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.154499249] seconds [----] I, [2016-09-13T06:20:12.602374 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77305], Delivering... [----] I, [2016-09-13T06:20:12.603140 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77304], State: [ok], Delivered in [0.006186395] seconds [----] I, [2016-09-13T06:20:12.608441 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77305], State: [ok], Delivered in [0.006038401] seconds [----] I, [2016-09-13T06:20:16.219289 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003927946090698242, :worker_monitor=>1.4032092094421387, :worker_dequeue=>0.006553173065185547, :total_time=>1.413949728012085} [----] I, [2016-09-13T06:20:16.896741 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:17.044580 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:17.191532 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:17.335693 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:17.488249 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:17.623953 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:18.083668 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:18.239831 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:18.385334 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:18.519319 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:18.705678 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:18.848651 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:18.983620 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:19.124571 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:19.268292 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:19.407013 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:19.557636 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:19.697507 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:19.846792 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:19.982478 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:20.125039 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:20.276322 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:20.420983 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:20.863686 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:21.016504 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:21.160957 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:21.219760 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:20:21 UTC]... [----] I, [2016-09-13T06:20:21.264935 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:20:21 UTC]...Complete [----] I, [2016-09-13T06:20:21.301850 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:21.447867 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:21.588739 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:21.729018 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:21.868446 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:22.016731 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:22.161230 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:22.297371 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:22.436752 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:22.489955 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:20:22.511744 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77307], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:20:22.581378 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:22.722204 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:22.869222 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:23.009582 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:20:23.154105 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T06:20:23.352162 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T06:20:23.352627 #3290:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T06:20:23.352927 #3290:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T06:20:23.353029 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T06:20:23.353160 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T06:20:23.379279 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T06:20:23.379809 #3290:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [77293], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T06:20:23.380055 #3290:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T06:20:23.380304 #3290:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T06:20:23.380519 #3290:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77293], State: [error], Delivered in [60.958460972] seconds [----] I, [2016-09-13T06:20:26.290640 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:20:27.071936 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77307], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.573013186] seconds [----] I, [2016-09-13T06:20:27.072183 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77307], Delivering... [----] I, [2016-09-13T06:20:27.078327 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003318309783935547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033359527587890625, :pending_vm_jobs=>0.0007207393646240234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005773782730102539} [----] I, [2016-09-13T06:20:27.078690 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77307], State: [ok], Delivered in [0.006518897] seconds [----] I, [2016-09-13T06:20:32.587683 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006150722503662109, :worker_monitor=>1.278660535812378, :worker_dequeue=>0.006649017333984375, :total_time=>1.291813611984253} [----] I, [2016-09-13T06:20:37.524674 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:20:37.539264 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77308], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:20:37.551960 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77309], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:20:37.567747 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77310], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:20:37.584896 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77311], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:20:37.597849 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:20:38.168412 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77309], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.624968863] seconds [----] I, [2016-09-13T06:20:38.168669 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77309], Delivering... [----] I, [2016-09-13T06:20:38.202464 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77311], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.625344505] seconds [----] I, [2016-09-13T06:20:38.202719 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77311], Delivering... [----] I, [2016-09-13T06:20:38.212220 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0047760009765625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004804134368896484, :pending_vm_jobs=>0.0012445449829101562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008948802947998047} [----] I, [2016-09-13T06:20:38.212747 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77311], State: [ok], Delivered in [0.010027115] seconds [----] I, [2016-09-13T06:20:38.253585 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77309], State: [ok], Delivered in [0.08488538] seconds [----] I, [2016-09-13T06:20:39.705293 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77308], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.175803277] seconds [----] I, [2016-09-13T06:20:39.705492 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77308], Delivering... [----] I, [2016-09-13T06:20:39.710261 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77308], State: [ok], Delivered in [0.004763208] seconds [----] I, [2016-09-13T06:20:39.710814 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77310], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.153382287] seconds [----] I, [2016-09-13T06:20:39.711013 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77310], Delivering... [----] I, [2016-09-13T06:20:39.714231 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77310], State: [ok], Delivered in [0.003194099] seconds [----] I, [2016-09-13T06:20:48.920433 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006990671157836914, :worker_monitor=>1.2896902561187744, :worker_dequeue=>0.006512641906738281, :total_time=>1.3035061359405518} [----] I, [2016-09-13T06:20:52.596719 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:20:52.614818 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77312], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:20:53.920972 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:20:53 UTC]... [----] I, [2016-09-13T06:20:53.953690 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:20:53 UTC]...Complete [----] I, [2016-09-13T06:20:54.059897 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:20:54.341773 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77312], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.739040265] seconds [----] I, [2016-09-13T06:20:54.341960 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77312], Delivering... [----] I, [2016-09-13T06:20:54.347900 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031576156616210938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003199338912963867, :pending_vm_jobs=>0.0006897449493408203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005563497543334961} [----] I, [2016-09-13T06:20:54.348245 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77312], State: [ok], Delivered in [0.006287472] seconds [----] I, [2016-09-13T06:21:05.315201 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004006862640380859, :worker_monitor=>1.2197635173797607, :worker_dequeue=>0.0068323612213134766, :total_time=>1.2309584617614746} [----] I, [2016-09-13T06:21:07.626917 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:21:07.643616 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77313], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:21:07.660782 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77314], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:21:10.328942 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:21:10.506752 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77314], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.857421858] seconds [----] I, [2016-09-13T06:21:10.506941 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77314], Delivering... [----] I, [2016-09-13T06:21:10.513575 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034766197204589844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034949779510498047, :pending_vm_jobs=>0.0007698535919189453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00622105598449707} [----] I, [2016-09-13T06:21:10.513907 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77314], State: [ok], Delivered in [0.006964622] seconds [----] I, [2016-09-13T06:21:12.844972 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77313], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.21317508] seconds [----] I, [2016-09-13T06:21:12.845206 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77313], Delivering... [----] I, [2016-09-13T06:21:12.850482 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77313], State: [ok], Delivered in [0.005250712] seconds [----] I, [2016-09-13T06:21:21.670934 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004171609878540039, :worker_monitor=>1.3007102012634277, :worker_dequeue=>0.01115274429321289, :total_time=>1.316319227218628} [----] I, [2016-09-13T06:21:22.672901 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:21:22.690380 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77315], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:21:26.671506 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:21:26 UTC]... [----] I, [2016-09-13T06:21:26.690293 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:21:26 UTC]...Complete [----] I, [2016-09-13T06:21:26.701012 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:21:27.599462 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77315], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.920895233] seconds [----] I, [2016-09-13T06:21:27.599641 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77315], Delivering... [----] I, [2016-09-13T06:21:27.605712 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003184080123901367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003208637237548828, :pending_vm_jobs=>0.0007908344268798828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005718231201171875} [----] I, [2016-09-13T06:21:27.606050 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77315], State: [ok], Delivered in [0.00640166] seconds [----] I, [2016-09-13T06:21:37.702110 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:21:37.713305 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77316], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:21:37.724899 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77317], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:21:37.736142 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77318], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:21:37.753238 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77319], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:21:38.044292 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:21:38.048719 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005286455154418945, :worker_monitor=>1.3115363121032715, :worker_dequeue=>0.007867574691772461, :total_time=>1.3250603675842285} [----] I, [2016-09-13T06:21:38.691497 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77317], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.974623352] seconds [----] I, [2016-09-13T06:21:38.691685 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77317], Delivering... [----] I, [2016-09-13T06:21:38.713933 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77319], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.968909177] seconds [----] I, [2016-09-13T06:21:38.714142 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77319], Delivering... [----] I, [2016-09-13T06:21:38.720122 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031871795654296875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032050609588623047, :pending_vm_jobs=>0.0007274150848388672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005637168884277344} [----] I, [2016-09-13T06:21:38.720500 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77319], State: [ok], Delivered in [0.006369016] seconds [----] I, [2016-09-13T06:21:38.742055 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77317], State: [ok], Delivered in [0.050344433] seconds [----] I, [2016-09-13T06:21:39.919527 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77316], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.212856843] seconds [----] I, [2016-09-13T06:21:39.919732 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77316], Delivering... [----] I, [2016-09-13T06:21:39.924507 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77316], State: [ok], Delivered in [0.004767997] seconds [----] I, [2016-09-13T06:21:39.930819 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77318], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.200967165] seconds [----] I, [2016-09-13T06:21:39.931021 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77318], Delivering... [----] I, [2016-09-13T06:21:39.938760 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77318], State: [ok], Delivered in [0.007719556] seconds [----] I, [2016-09-13T06:21:52.763856 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:21:52.776389 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77320], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:21:54.465820 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:21:54.472247 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0044977664947509766, :worker_monitor=>1.3770594596862793, :worker_dequeue=>0.011445999145507812, :total_time=>1.393293857574463} [----] I, [2016-09-13T06:21:54.896788 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77320], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.128514097] seconds [----] I, [2016-09-13T06:21:54.896974 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77320], Delivering... [----] I, [2016-09-13T06:21:54.902711 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002896547317504883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002912759780883789, :pending_vm_jobs=>0.0007250308990478516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005370616912841797} [----] I, [2016-09-13T06:21:54.903031 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77320], State: [ok], Delivered in [0.006070694] seconds [----] I, [2016-09-13T06:21:59.472726 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:21:59 UTC]... [----] I, [2016-09-13T06:21:59.491807 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:21:59 UTC]...Complete [----] I, [2016-09-13T06:22:07.785869 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:22:07.805352 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77321], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:22:07.822572 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77322], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:22:10.860861 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:22:10.864971 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0067119598388671875, :worker_monitor=>1.233064889907837, :worker_dequeue=>0.0069332122802734375, :total_time=>1.247147798538208} [----] I, [2016-09-13T06:22:10.994197 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77322], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.183155614] seconds [----] I, [2016-09-13T06:22:10.994390 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77322], Delivering... [----] I, [2016-09-13T06:22:11.000563 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003180980682373047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031998157501220703, :pending_vm_jobs=>0.0007650852203369141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005754232406616211} [----] I, [2016-09-13T06:22:11.000935 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77322], State: [ok], Delivered in [0.006548811] seconds [----] I, [2016-09-13T06:22:13.455276 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77321], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.664343123] seconds [----] I, [2016-09-13T06:22:13.455495 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77321], Delivering... [----] I, [2016-09-13T06:22:13.459587 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77321], State: [ok], Delivered in [0.004093747] seconds [----] I, [2016-09-13T06:22:22.832795 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:22:22.849599 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77323], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:22:27.083583 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:22:27.087258 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004048824310302734, :worker_monitor=>1.1808784008026123, :worker_dequeue=>0.006594657897949219, :total_time=>1.1918869018554688} [----] I, [2016-09-13T06:22:27.479142 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77323], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.642602909] seconds [----] I, [2016-09-13T06:22:27.479302 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77323], Delivering... [----] I, [2016-09-13T06:22:27.484955 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028760433197021484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028944015502929688, :pending_vm_jobs=>0.0006880760192871094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0052983760833740234} [----] I, [2016-09-13T06:22:27.485294 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77323], State: [ok], Delivered in [0.005987381] seconds [----] I, [2016-09-13T06:22:32.087758 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:22:32 UTC]... [----] I, [2016-09-13T06:22:32.113119 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:22:32 UTC]...Complete [----] I, [2016-09-13T06:22:37.862172 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:22:37.879054 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77324], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:22:37.896404 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77325], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:22:37.907622 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77326], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:22:37.924887 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77327], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:22:43.664459 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:22:43.670964 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004686594009399414, :worker_monitor=>1.5080251693725586, :worker_dequeue=>0.011866569519042969, :total_time=>1.5248899459838867} [----] I, [2016-09-13T06:22:44.622181 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77325], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.738925349] seconds [----] I, [2016-09-13T06:22:44.622358 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77325], Delivering... [----] I, [2016-09-13T06:22:44.639487 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77327], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.722346344] seconds [----] I, [2016-09-13T06:22:44.639669 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77327], Delivering... [----] I, [2016-09-13T06:22:44.645814 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003265380859375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003284931182861328, :pending_vm_jobs=>0.00075531005859375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005812644958496094} [----] I, [2016-09-13T06:22:44.646192 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77327], State: [ok], Delivered in [0.006512829] seconds [----] I, [2016-09-13T06:22:44.667750 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77325], State: [ok], Delivered in [0.045369817] seconds [----] I, [2016-09-13T06:22:46.525264 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77324], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.658128512] seconds [----] I, [2016-09-13T06:22:46.525517 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77324], Delivering... [----] I, [2016-09-13T06:22:46.531410 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77324], State: [ok], Delivered in [0.005886447] seconds [----] I, [2016-09-13T06:22:46.547872 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77326], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.645940187] seconds [----] I, [2016-09-13T06:22:46.548079 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77326], Delivering... [----] I, [2016-09-13T06:22:46.551267 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77326], State: [ok], Delivered in [0.003176502] seconds [----] I, [2016-09-13T06:22:48.707500 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T06:22:52.941361 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:22:52.961007 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77328], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:22:53.733549 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:22:53.767467 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77328], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.820051639] seconds [----] I, [2016-09-13T06:22:53.767757 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77328], Delivering... [----] I, [2016-09-13T06:22:53.775999 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004613161087036133, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004640817642211914, :pending_vm_jobs=>0.0009205341339111328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007622718811035156} [----] I, [2016-09-13T06:22:53.776392 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77328], State: [ok], Delivered in [0.008661599] seconds [----] I, [2016-09-13T06:22:59.834570 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0050547122955322266, :worker_monitor=>1.0806338787078857, :worker_dequeue=>0.006948232650756836, :total_time=>1.092958688735962} [----] I, [2016-09-13T06:23:04.835135 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:23:04 UTC]... [----] I, [2016-09-13T06:23:04.865799 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:23:04 UTC]...Complete [----] I, [2016-09-13T06:23:07.973212 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T06:23:07.991812 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77329], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:23:08.002961 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77330], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:23:08.014710 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77331], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:23:10.024944 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:23:10.643538 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77331], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.635347061] seconds [----] I, [2016-09-13T06:23:10.643816 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77331], Delivering... [----] I, [2016-09-13T06:23:10.654736 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005403995513916016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005494117736816406, :pending_vm_jobs=>0.0014281272888183594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010293006896972656} [----] I, [2016-09-13T06:23:10.655124 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77329], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.676243568] seconds [----] I, [2016-09-13T06:23:10.655265 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77331], State: [ok], Delivered in [0.011454554] seconds [----] I, [2016-09-13T06:23:10.655325 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77329], Delivering... [----] I, [2016-09-13T06:23:10.655718 #2937:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Starting [----] I, [2016-09-13T06:23:10.661642 #2937:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Complete [----] I, [2016-09-13T06:23:10.661941 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77329], State: [ok], Delivered in [0.006611701] seconds [----] I, [2016-09-13T06:23:10.689011 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77330], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.693159864] seconds [----] I, [2016-09-13T06:23:10.689229 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77330], Delivering... [----] I, [2016-09-13T06:23:10.694505 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77330], State: [ok], Delivered in [0.005271119] seconds [----] I, [2016-09-13T06:23:16.509322 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038771629333496094, :worker_monitor=>1.457146167755127, :worker_dequeue=>0.011366844177246094, :total_time=>1.4726636409759521} [----] I, [2016-09-13T06:23:23.028273 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:23:23.049334 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77332], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:23:23.060547 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77333], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:23:23.071988 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77334], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:23:26.534140 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:23:26.952111 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77332], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.918014827] seconds [----] I, [2016-09-13T06:23:26.952323 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77332], Delivering... [----] I, [2016-09-13T06:23:26.959069 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034482479095458984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034720897674560547, :pending_vm_jobs=>0.0008406639099121094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006289958953857422} [----] I, [2016-09-13T06:23:26.959491 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77332], State: [ok], Delivered in [0.007154418] seconds [----] I, [2016-09-13T06:23:26.980592 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77333], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.927138446] seconds [----] I, [2016-09-13T06:23:26.980777 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77333], Delivering... [----] I, [2016-09-13T06:23:26.982239 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T06:23:26.982487 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5348569088 [----] I, [2016-09-13T06:23:26.982604 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5128245248 [----] I, [2016-09-13T06:23:26.982692 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 220323840 [----] I, [2016-09-13T06:23:26.982774 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T06:23:26.982859 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5074280448 [----] I, [2016-09-13T06:23:26.982941 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T06:23:26.983019 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T06:23:26.983113 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 541343744 [----] I, [2016-09-13T06:23:26.983195 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T06:23:26.983271 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8035540992 [----] I, [2016-09-13T06:23:26.983364 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T06:23:26.983620 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T06:23:26.983795 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T06:23:26.983908 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 28672 [----] I, [2016-09-13T06:23:26.984013 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T06:23:26.984121 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T06:23:26.984206 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T06:23:26.984287 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T06:23:26.984361 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T06:23:26.984497 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T06:23:26.984601 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273244160 [----] I, [2016-09-13T06:23:26.984679 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56573952 [----] I, [2016-09-13T06:23:26.984759 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216670208 [----] I, [2016-09-13T06:23:26.984834 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T06:23:26.984913 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140480512 [----] I, [2016-09-13T06:23:26.984987 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2592215040 [----] I, [2016-09-13T06:23:26.985082 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2277064704 [----] I, [2016-09-13T06:23:26.985166 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T06:23:26.985243 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T06:23:26.985319 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T06:23:26.985392 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37191680 [----] I, [2016-09-13T06:23:26.985508 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102277120 [----] I, [2016-09-13T06:23:26.985591 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53567488 [----] I, [2016-09-13T06:23:26.985668 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110571520 [----] I, [2016-09-13T06:23:26.985745 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155844608 [----] I, [2016-09-13T06:23:26.985832 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T06:23:26.985913 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T06:23:26.985988 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T06:23:26.986077 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T06:23:26.986161 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T06:23:26.986244 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T06:23:26.986253 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77334], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.92173067] seconds [----] I, [2016-09-13T06:23:26.986318 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T06:23:26.986396 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T06:23:26.986409 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77334], Delivering... [----] I, [2016-09-13T06:23:26.986514 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T06:23:26.994012 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:23:15 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [150059.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:23:26.994656 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:23:15 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [50980.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:23:26.995130 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:23:07 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347151000], Memory % [5.04], CPU Time [103652.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T06:23:26.995723 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:23:07 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [237437.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T06:23:26.996187 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:23:04 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212543000], Memory % [3.5], CPU Time [48447.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T06:23:26.996754 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:23:15 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162417000], Memory % [3.1], CPU Time [37565.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T06:23:26.997289 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:23:13 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358685000], Memory % [5.28], CPU Time [201642.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T06:23:26.997820 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:23:15 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202018000], Memory % [3.38], CPU Time [149175.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:23:27.000717 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:23:15 UTC], Process Info: Memory Usage [593838080], Memory Size [963252224], Proportional Set Size: [428739000], Memory % [7.24], CPU Time [265.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:23:27.003002 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:23:13 UTC], Process Info: Memory Usage [601919488], Memory Size [1026465792], Proportional Set Size: [436814000], Memory % [7.34], CPU Time [940.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:23:27.005210 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:23:15 UTC], Process Info: Memory Usage [580407296], Memory Size [936148992], Proportional Set Size: [419910000], Memory % [7.08], CPU Time [1682.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T06:23:27.007372 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:23:13 UTC], Process Info: Memory Usage [558366720], Memory Size [929464320], Proportional Set Size: [406078000], Memory % [6.81], CPU Time [5064.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T06:23:27.007962 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:23:13 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [207327.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T06:23:27.008575 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:23:15 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [50980.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:23:27.009083 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:23:12 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38468.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T06:23:27.009407 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77334], State: [ok], Delivered in [0.022994589] seconds [----] I, [2016-09-13T06:23:27.022564 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T06:23:27.022839 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T06:23:27.028407 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T06:23:27.032677 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T06:23:27.038039 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T06:23:27.043601 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T06:23:27.049102 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T06:23:27.054755 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 841 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T06:23:27.060108 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T06:23:27.065471 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T06:23:27.070852 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T06:23:27.076174 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T06:23:27.081632 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T06:23:27.086810 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T06:23:27.090908 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:23:27.091139 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:23:27.091302 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T06:23:27.098098 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [149165.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:23:27.098585 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77333], State: [ok], Delivered in [0.117775522] seconds [----] I, [2016-09-13T06:23:32.924401 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0061151981353759766, :worker_monitor=>1.368058681488037, :worker_dequeue=>0.00920414924621582, :total_time=>1.3836567401885986} [----] I, [2016-09-13T06:23:37.924890 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:23:37 UTC]... [----] I, [2016-09-13T06:23:37.941591 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:23:37 UTC]...Complete [----] I, [2016-09-13T06:23:38.082888 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:23:38.101531 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77335], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:23:38.111952 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77336], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:23:38.127289 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77337], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:23:38.146476 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77338], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:23:42.969841 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:23:43.139614 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77336], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.03387302] seconds [----] I, [2016-09-13T06:23:43.139920 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77336], Delivering... [----] I, [2016-09-13T06:23:43.214470 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77336], State: [ok], Delivered in [0.07451777] seconds [----] I, [2016-09-13T06:23:43.255410 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77338], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.119111542] seconds [----] I, [2016-09-13T06:23:43.255640 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77338], Delivering... [----] I, [2016-09-13T06:23:43.262658 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037245750427246094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003751993179321289, :pending_vm_jobs=>0.0009126663208007812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006627082824707031} [----] I, [2016-09-13T06:23:43.263007 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77338], State: [ok], Delivered in [0.007361825] seconds [----] I, [2016-09-13T06:23:43.767864 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77335], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.680473606] seconds [----] I, [2016-09-13T06:23:43.768140 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77335], Delivering... [----] I, [2016-09-13T06:23:43.774721 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77335], State: [ok], Delivered in [0.006582667] seconds [----] I, [2016-09-13T06:23:43.807476 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77337], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.690362978] seconds [----] I, [2016-09-13T06:23:43.807608 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77337], Delivering... [----] I, [2016-09-13T06:23:43.809971 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77337], State: [ok], Delivered in [0.002355619] seconds [----] I, [2016-09-13T06:23:49.461517 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004214048385620117, :worker_monitor=>1.4684576988220215, :worker_dequeue=>0.011125326156616211, :total_time=>1.4841325283050537} [----] I, [2016-09-13T06:23:53.158294 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:23:53.184797 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77339], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:23:54.471483 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:23:55.350467 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77339], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.18554585] seconds [----] I, [2016-09-13T06:23:55.350677 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77339], Delivering... [----] I, [2016-09-13T06:23:55.357730 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037097930908203125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037631988525390625, :pending_vm_jobs=>0.0008742809295654297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006630897521972656} [----] I, [2016-09-13T06:23:55.358112 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77339], State: [ok], Delivered in [0.007422993] seconds [----] I, [2016-09-13T06:24:05.555103 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0045948028564453125, :worker_monitor=>1.0484473705291748, :worker_dequeue=>0.007551908493041992, :total_time=>1.0610833168029785} [----] I, [2016-09-13T06:24:08.196978 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:24:08.213103 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77340], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:24:08.224440 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77341], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:24:10.555782 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:24:10 UTC]... [----] I, [2016-09-13T06:24:10.572926 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:24:10 UTC]...Complete [----] I, [2016-09-13T06:24:10.688746 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:24:10.904690 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77341], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.686305832] seconds [----] I, [2016-09-13T06:24:10.904896 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77341], Delivering... [----] I, [2016-09-13T06:24:10.912247 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003797292709350586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038483142852783203, :pending_vm_jobs=>0.0008678436279296875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068607330322265625} [----] I, [2016-09-13T06:24:10.912615 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77341], State: [ok], Delivered in [0.007712461] seconds [----] I, [2016-09-13T06:24:10.950936 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77340], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.749541013] seconds [----] I, [2016-09-13T06:24:10.951188 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77340], Delivering... [----] I, [2016-09-13T06:24:10.956919 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77340], State: [ok], Delivered in [0.005717543] seconds [----] I, [2016-09-13T06:24:21.887849 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:24:21.888050 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:24:21.916476 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:24:21.916625 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:24:21.933232 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:24:21.933369 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:24:21.944570 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:24:21.944698 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:24:21.956073 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:24:21.956220 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:24:21.967559 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:24:21.967696 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:24:21.978886 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:24:21.979027 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:24:21.990238 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:24:21.990370 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:24:22.047847 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:24:22.048032 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:24:22.064802 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:24:22.064972 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:24:22.081910 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:24:22.082108 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:24:22.099029 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:24:22.099319 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:24:22.116256 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:24:22.116463 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:24:22.127654 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:24:22.127821 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:24:22.145268 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:24:22.145556 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:24:22.161662 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004082918167114258, :worker_monitor=>1.4314537048339844, :worker_dequeue=>0.012245416641235352, :total_time=>1.4482653141021729} [----] I, [2016-09-13T06:24:23.116794 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T06:24:23.116931 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T06:24:23.117002 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T06:24:23.233975 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:24:23.234099 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:24:23.234145 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:24:23.301942 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:24:23.302656 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T06:24:23.302699 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:24:23.302722 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:24:23.302739 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:24:23.302757 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T06:24:23.302773 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T06:24:23.302789 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:24:23.302805 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T06:24:23.302821 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:24:23.302850 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:24:23.302882 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:24:23.302902 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:24:23.302919 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T06:24:23.302935 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T06:24:23.302950 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T06:24:23.302966 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T06:24:23.302981 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T06:24:23.302997 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T06:24:23.303013 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T06:24:23.303030 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T06:24:23.303045 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T06:24:23.303072 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T06:24:23.303089 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T06:24:23.303114 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T06:24:23.303132 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T06:24:23.303148 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T06:24:23.303163 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T06:24:23.303179 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T06:24:23.303194 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T06:24:23.303209 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T06:24:23.303225 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T06:24:23.303240 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T06:24:23.303255 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T06:24:23.303270 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T06:24:23.303285 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T06:24:23.303300 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T06:24:23.303315 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T06:24:23.303332 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T06:24:23.303347 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T06:24:23.303513 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:24:23.303604 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:24:23.303644 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:24:23.310019 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:24:23.311030 #684:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T06:24:23.311132 #684:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:24:23.311179 #684:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:24:23.311218 #684:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:24:23.311253 #684:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T06:24:23.311294 #684:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T06:24:23.311328 #684:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:24:23.311361 #684:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T06:24:23.311393 #684:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:24:23.311463 #684:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:24:23.311507 #684:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:24:23.311541 #684:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:24:23.311574 #684:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T06:24:23.311607 #684:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T06:24:23.311640 #684:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T06:24:23.311672 #684:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T06:24:23.311702 #684:34713c] INFO -- : --- [----] I, [2016-09-13T06:24:23.312042 #684:34713c] INFO -- : :guid: c253e5f6-7924-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:24:23.312130 #684:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T06:24:23.312249 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T06:24:23.321644 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77342], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:24:23.560133 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:24:23.560288 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:24:23.560377 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:24:23.715005 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:24:23.715863 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T06:24:23.715951 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:24:23.715998 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:24:23.716035 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:24:23.716099 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T06:24:23.716147 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T06:24:23.716184 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:24:23.716218 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T06:24:23.716257 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:24:23.716290 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:24:23.716323 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:24:23.716357 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:24:23.716391 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T06:24:23.716461 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:24:23.716510 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T06:24:23.716547 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T06:24:23.716843 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:24:23.717029 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:24:23.742788 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T06:24:23.742958 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T06:24:23.743074 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T06:24:23.929035 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:24:23.929952 #3290:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T06:24:23.930042 #3290:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:24:23.930115 #3290:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:24:23.930157 #3290:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:24:23.930192 #3290:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T06:24:23.930230 #3290:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T06:24:23.930267 #3290:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:24:23.930303 #3290:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T06:24:23.930337 #3290:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:24:23.930370 #3290:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:24:23.930402 #3290:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T06:24:23.930478 #3290:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:24:23.930522 #3290:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T06:24:23.930558 #3290:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:24:23.930590 #3290:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T06:24:23.930734 #3290:34713c] INFO -- : --- [----] I, [2016-09-13T06:24:23.931169 #3290:34713c] INFO -- : :guid: 8b41dc22-7996-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:24:23.931239 #3290:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T06:24:23.931394 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T06:24:24.429605 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:24:24.429747 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:24:24.429817 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:24:24.573622 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:24:24.574318 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T06:24:24.574391 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:24:24.574474 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:24:24.574523 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:24:24.574561 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T06:24:24.574595 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T06:24:24.574630 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:24:24.574677 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T06:24:24.574717 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:24:24.574751 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:24:24.574784 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:24:24.574817 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:24:24.574849 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T06:24:24.574880 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T06:24:24.575160 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:24:24.575406 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:24:25.857995 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T06:24:25.858155 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T06:24:25.858230 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T06:24:25.915234 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T06:24:25.915399 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T06:24:25.915555 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T06:24:26.001946 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:24:26.002812 #20386:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T06:24:26.002895 #20386:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:24:26.002940 #20386:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:24:26.002978 #20386:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:24:26.003015 #20386:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T06:24:26.003078 #20386:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T06:24:26.003121 #20386:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:24:26.003157 #20386:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T06:24:26.003191 #20386:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:24:26.003224 #20386:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:24:26.003257 #20386:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:24:26.003291 #20386:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:24:26.003324 #20386:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T06:24:26.003356 #20386:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T06:24:26.003403 #20386:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T06:24:26.003481 #20386:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T06:24:26.003522 #20386:34713c] INFO -- : --- [----] I, [2016-09-13T06:24:26.003850 #20386:34713c] INFO -- : :guid: e5930efc-7974-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:24:26.003915 #20386:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T06:24:26.004036 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T06:24:26.058679 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:24:26.059561 #5369:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T06:24:26.059643 #5369:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:24:26.059693 #5369:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:24:26.059731 #5369:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:24:26.059764 #5369:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T06:24:26.059797 #5369:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T06:24:26.059831 #5369:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:24:26.059862 #5369:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T06:24:26.059894 #5369:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:24:26.059925 #5369:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:24:26.059956 #5369:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T06:24:26.059986 #5369:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:24:26.060020 #5369:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T06:24:26.060065 #5369:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:24:26.060107 #5369:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T06:24:26.060140 #5369:34713c] INFO -- : --- [----] I, [2016-09-13T06:24:26.060551 #5369:34713c] INFO -- : :guid: 79c8c984-799a-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:24:26.060623 #5369:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T06:24:26.060791 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T06:24:27.172560 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:24:27.451034 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:24:27.451217 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:24:27.451318 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:24:27.630928 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77342], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.323847159] seconds [----] I, [2016-09-13T06:24:27.631243 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77342], Delivering... [----] I, [2016-09-13T06:24:27.639719 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:24:27.641267 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T06:24:27.641396 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:24:27.641533 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:24:27.641620 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:24:27.641599 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005327701568603516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005358457565307617, :pending_vm_jobs=>0.0012044906616210938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00973200798034668} [----] I, [2016-09-13T06:24:27.641704 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T06:24:27.641786 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T06:24:27.641870 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:24:27.641946 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T06:24:27.641963 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77342], State: [ok], Delivered in [0.010734347] seconds [----] I, [2016-09-13T06:24:27.642035 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:24:27.642144 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:24:27.642222 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:24:27.642299 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:24:27.642382 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T06:24:27.642509 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:24:27.642597 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T06:24:27.642670 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T06:24:27.643210 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:24:27.643465 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:24:27.933903 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:24:27.934037 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:24:27.934130 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:24:28.068320 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:24:28.069123 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T06:24:28.069206 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:24:28.069249 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:24:28.069285 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:24:28.069318 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T06:24:28.069350 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T06:24:28.069384 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:24:28.069464 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T06:24:28.069522 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:24:28.069558 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:24:28.069590 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:24:28.069620 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:24:28.069652 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T06:24:28.069683 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:24:28.069714 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T06:24:28.069743 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T06:24:28.070013 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:24:28.070173 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:24:28.584981 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:24:28.585145 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:24:28.585240 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:24:28.740352 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:24:28.741159 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T06:24:28.741239 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:24:28.741283 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:24:28.741321 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:24:28.741356 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T06:24:28.741389 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T06:24:28.741457 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:24:28.741511 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T06:24:28.741548 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:24:28.741582 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:24:28.741616 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:24:28.741648 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:24:28.741681 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T06:24:28.741712 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T06:24:28.742016 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:24:28.742324 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:24:28.964372 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:24:28.964570 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:24:28.964667 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:24:29.134103 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:24:29.134870 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T06:24:29.134946 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:24:29.134989 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:24:29.135023 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:24:29.135080 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T06:24:29.135123 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T06:24:29.135157 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:24:29.135188 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T06:24:29.135229 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:24:29.135260 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:24:29.135291 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:24:29.135321 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:24:29.135351 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T06:24:29.135382 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:24:29.135436 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T06:24:29.135484 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T06:24:29.135766 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:24:29.135934 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:24:29.666617 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:24:29.666767 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:24:29.666853 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:24:29.827299 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:24:29.828121 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T06:24:29.828201 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:24:29.828261 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:24:29.828304 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:24:29.828338 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T06:24:29.828371 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T06:24:29.828406 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:24:29.828482 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T06:24:29.828523 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:24:29.828556 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:24:29.828590 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:24:29.828621 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:24:29.828653 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T06:24:29.828687 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:24:29.828717 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T06:24:29.828745 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T06:24:29.829032 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:24:29.829227 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:24:31.575739 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:24:31.575891 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:24:31.575984 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:24:31.730657 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:24:31.731394 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T06:24:31.731514 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:24:31.731566 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:24:31.731607 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:24:31.731645 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T06:24:31.731680 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T06:24:31.731714 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:24:31.731749 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T06:24:31.731784 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:24:31.731817 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:24:31.731851 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:24:31.731883 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:24:31.731918 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T06:24:31.731950 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T06:24:31.732251 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:24:31.732543 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:24:32.010218 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:24:32.010476 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:24:32.010613 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:24:32.196777 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:24:32.197661 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T06:24:32.197733 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:24:32.197784 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:24:32.197835 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:24:32.197882 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T06:24:32.197925 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T06:24:32.197974 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:24:32.198023 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T06:24:32.198085 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:24:32.198133 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:24:32.198180 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:24:32.198222 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:24:32.198269 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T06:24:32.198310 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:24:32.198354 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T06:24:32.198397 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T06:24:32.198723 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:24:32.198889 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:24:33.544901 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:24:33.545130 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:24:33.545264 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:24:33.726362 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:24:33.727336 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T06:24:33.727445 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:24:33.727524 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:24:33.727573 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:24:33.727621 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T06:24:33.727682 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T06:24:33.727730 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:24:33.727768 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T06:24:33.727809 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:24:33.727844 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:24:33.727880 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:24:33.727915 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:24:33.727953 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T06:24:33.727990 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:24:33.728025 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T06:24:33.728082 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T06:24:33.728458 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:24:33.728646 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:24:38.346358 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:24:38.361785 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77343], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:24:38.372969 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77344], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:24:38.384526 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77345], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:24:38.395897 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77346], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:24:38.604821 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:24:38.611685 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038814544677734375, :worker_monitor=>1.3981962203979492, :worker_dequeue=>0.012485265731811523, :total_time=>1.4148592948913574} [----] I, [2016-09-13T06:24:38.819493 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77344], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.45344848] seconds [----] I, [2016-09-13T06:24:38.819723 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77344], Delivering... [----] I, [2016-09-13T06:24:38.870554 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77344], State: [ok], Delivered in [0.050822953] seconds [----] I, [2016-09-13T06:24:38.893770 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77346], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.501871761] seconds [----] I, [2016-09-13T06:24:38.893973 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77346], Delivering... [----] I, [2016-09-13T06:24:38.900765 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003473997116088867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034971237182617188, :pending_vm_jobs=>0.0009016990661621094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006410837173461914} [----] I, [2016-09-13T06:24:38.901169 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77346], State: [ok], Delivered in [0.007184683] seconds [----] I, [2016-09-13T06:24:41.190930 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77343], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.839397149] seconds [----] I, [2016-09-13T06:24:41.191153 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77343], Delivering... [----] I, [2016-09-13T06:24:41.195880 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77343], State: [ok], Delivered in [0.004726799] seconds [----] I, [2016-09-13T06:24:41.230949 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77345], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.853947014] seconds [----] I, [2016-09-13T06:24:41.231182 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77345], Delivering... [----] I, [2016-09-13T06:24:41.234367 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77345], State: [ok], Delivered in [0.003194483] seconds [----] I, [2016-09-13T06:24:43.612251 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:24:43 UTC]... [----] I, [2016-09-13T06:24:43.624526 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:24:43 UTC]...Complete [----] I, [2016-09-13T06:24:53.405941 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:24:53.425909 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77347], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:24:55.439269 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:24:55.444676 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004268646240234375, :worker_monitor=>1.7685034275054932, :worker_dequeue=>0.010330915451049805, :total_time=>1.7835140228271484} [----] I, [2016-09-13T06:24:56.013600 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77347], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.601773523] seconds [----] I, [2016-09-13T06:24:56.013819 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77347], Delivering... [----] I, [2016-09-13T06:24:56.019103 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033910274505615234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034084320068359375, :pending_vm_jobs=>0.0004801750183105469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004946470260620117} [----] I, [2016-09-13T06:24:56.019349 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77347], State: [ok], Delivered in [0.005560661] seconds [----] I, [2016-09-13T06:25:08.435699 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:25:08.471660 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77348], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:25:08.484042 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77349], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:25:11.250453 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:25:11.358803 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77348], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.920378607] seconds [----] I, [2016-09-13T06:25:11.358972 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77348], Delivering... [----] I, [2016-09-13T06:25:11.362724 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77348], State: [ok], Delivered in [0.003759781] seconds [----] I, [2016-09-13T06:25:11.364464 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77349], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.887910513] seconds [----] I, [2016-09-13T06:25:11.364601 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77349], Delivering... [----] I, [2016-09-13T06:25:11.370074 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002543210983276367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002556324005126953, :pending_vm_jobs=>0.0006535053253173828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004693031311035156} [----] I, [2016-09-13T06:25:11.370382 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77349], State: [ok], Delivered in [0.005776121] seconds [----] I, [2016-09-13T06:25:16.255273 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:25:16 UTC]... [----] I, [2016-09-13T06:25:16.272736 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:25:16 UTC]...Complete [----] I, [2016-09-13T06:25:23.493693 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:25:23.513197 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77350], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:25:27.687118 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:25:27.692483 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004156351089477539, :worker_monitor=>1.2783117294311523, :worker_dequeue=>0.009413003921508789, :total_time=>1.2921850681304932} [----] I, [2016-09-13T06:25:28.258473 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77350], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.758300591] seconds [----] I, [2016-09-13T06:25:28.258669 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77350], Delivering... [----] I, [2016-09-13T06:25:28.265074 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003387928009033203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003410816192626953, :pending_vm_jobs=>0.0007863044738769531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006029844284057617} [----] I, [2016-09-13T06:25:28.265461 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77350], State: [ok], Delivered in [0.006759134] seconds [----] I, [2016-09-13T06:25:38.529405 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:25:38.550034 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77351], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:25:38.561131 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77352], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:25:38.572630 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77353], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:25:38.589738 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77354], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:25:44.055743 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:25:44.062645 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003901243209838867, :worker_monitor=>1.3221826553344727, :worker_dequeue=>0.012415170669555664, :total_time=>1.3387694358825684} [----] I, [2016-09-13T06:25:44.390264 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77352], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.834674826] seconds [----] I, [2016-09-13T06:25:44.390507 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77352], Delivering... [----] I, [2016-09-13T06:25:44.416106 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77354], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.83365584] seconds [----] I, [2016-09-13T06:25:44.416288 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77354], Delivering... [----] I, [2016-09-13T06:25:44.425315 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003873586654663086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005838632583618164, :pending_vm_jobs=>0.0008280277252197266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008638858795166016} [----] I, [2016-09-13T06:25:44.425656 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77354], State: [ok], Delivered in [0.009359366] seconds [----] I, [2016-09-13T06:25:44.476043 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77352], State: [ok], Delivered in [0.085507856] seconds [----] I, [2016-09-13T06:25:44.493190 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77353], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.926166207] seconds [----] I, [2016-09-13T06:25:44.493270 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77351], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.958857615] seconds [----] I, [2016-09-13T06:25:44.493395 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77353], Delivering... [----] I, [2016-09-13T06:25:44.493485 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77351], Delivering... [----] I, [2016-09-13T06:25:44.497252 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77353], State: [ok], Delivered in [0.003847449] seconds [----] I, [2016-09-13T06:25:44.500114 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77351], State: [ok], Delivered in [0.006624656] seconds [----] I, [2016-09-13T06:25:49.063184 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:25:49 UTC]... [----] I, [2016-09-13T06:25:49.075281 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:25:49 UTC]...Complete [----] I, [2016-09-13T06:25:53.601873 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:25:53.624337 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77355], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:25:54.100580 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:25:54.561595 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77355], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.953543801] seconds [----] I, [2016-09-13T06:25:54.561812 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77355], Delivering... [----] I, [2016-09-13T06:25:54.568738 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035665035247802734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035858154296875, :pending_vm_jobs=>0.0009143352508544922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006498098373413086} [----] I, [2016-09-13T06:25:54.569148 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77355], State: [ok], Delivered in [0.007338194] seconds [----] I, [2016-09-13T06:26:00.512464 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004208803176879883, :worker_monitor=>1.3922672271728516, :worker_dequeue=>0.00904536247253418, :total_time=>1.405815601348877} [----] I, [2016-09-13T06:26:08.636796 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:26:08.655842 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77356], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:26:08.678745 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77357], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:26:10.545622 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:26:10.707460 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77357], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.045908189] seconds [----] I, [2016-09-13T06:26:10.707650 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77357], Delivering... [----] I, [2016-09-13T06:26:10.714611 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003559112548828125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003580331802368164, :pending_vm_jobs=>0.0008900165557861328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006601810455322266} [----] I, [2016-09-13T06:26:10.714987 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77357], State: [ok], Delivered in [0.00732647] seconds [----] I, [2016-09-13T06:26:11.620135 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77356], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.977069363] seconds [----] I, [2016-09-13T06:26:11.620393 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77356], Delivering... [----] I, [2016-09-13T06:26:11.625646 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77356], State: [ok], Delivered in [0.005262376] seconds [----] I, [2016-09-13T06:26:16.850827 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0048122406005859375, :worker_monitor=>1.2818925380706787, :worker_dequeue=>0.011002779006958008, :total_time=>1.2979893684387207} [----] I, [2016-09-13T06:26:21.851383 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:26:21 UTC]... [----] I, [2016-09-13T06:26:21.870121 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:26:21 UTC]...Complete [----] I, [2016-09-13T06:26:23.689340 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:26:23.704366 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77358], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:26:27.017948 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:26:27.801972 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77358], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.108386607] seconds [----] I, [2016-09-13T06:26:27.802187 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77358], Delivering... [----] I, [2016-09-13T06:26:27.808686 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033483505249023438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003367185592651367, :pending_vm_jobs=>0.0008094310760498047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006040096282958984} [----] I, [2016-09-13T06:26:27.809081 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77358], State: [ok], Delivered in [0.006866808] seconds [----] I, [2016-09-13T06:26:33.324088 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004303932189941406, :worker_monitor=>1.2873294353485107, :worker_dequeue=>0.006852388381958008, :total_time=>1.2988815307617188} [----] I, [2016-09-13T06:26:38.713190 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:26:38.727580 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77359], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:26:38.739020 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77360], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:26:38.750179 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77361], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:26:38.767521 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77362], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:26:43.351296 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:26:43.990772 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77360], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.258975809] seconds [----] I, [2016-09-13T06:26:43.990956 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77360], Delivering... [----] I, [2016-09-13T06:26:44.004097 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77362], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.245286172] seconds [----] I, [2016-09-13T06:26:44.004310 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77362], Delivering... [----] I, [2016-09-13T06:26:44.010984 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034928321838378906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035114288330078125, :pending_vm_jobs=>0.0008299350738525391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006243228912353516} [----] I, [2016-09-13T06:26:44.011322 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77362], State: [ok], Delivered in [0.007019306] seconds [----] I, [2016-09-13T06:26:44.047673 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77360], State: [ok], Delivered in [0.056685086] seconds [----] I, [2016-09-13T06:26:44.682068 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77359], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.964157749] seconds [----] I, [2016-09-13T06:26:44.682278 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77359], Delivering... [----] I, [2016-09-13T06:26:44.687192 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77359], State: [ok], Delivered in [0.004908553] seconds [----] I, [2016-09-13T06:26:44.710512 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77361], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.965135613] seconds [----] I, [2016-09-13T06:26:44.710706 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77361], Delivering... [----] I, [2016-09-13T06:26:44.713763 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77361], State: [ok], Delivered in [0.003041563] seconds [----] I, [2016-09-13T06:26:49.570529 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003341197967529297, :worker_monitor=>1.1963481903076172, :worker_dequeue=>0.011736631393432617, :total_time=>1.2116894721984863} [----] I, [2016-09-13T06:26:53.779282 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:26:53.794210 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77363], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:26:54.571177 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:26:54 UTC]... [----] I, [2016-09-13T06:26:54.588213 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:26:54 UTC]...Complete [----] I, [2016-09-13T06:26:54.599652 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:26:55.119916 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77363], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.334867762] seconds [----] I, [2016-09-13T06:26:55.120126 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77363], Delivering... [----] I, [2016-09-13T06:26:55.126545 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033233165740966797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033731460571289062, :pending_vm_jobs=>0.0007998943328857422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060045719146728516} [----] I, [2016-09-13T06:26:55.126893 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77363], State: [ok], Delivered in [0.006768355] seconds [----] I, [2016-09-13T06:27:06.342906 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004917144775390625, :worker_monitor=>1.7032415866851807, :worker_dequeue=>0.012288093566894531, :total_time=>1.7209110260009766} [----] I, [2016-09-13T06:27:08.806899 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:27:08.828726 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77364], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:27:08.845706 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77365], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:27:11.352457 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:27:11.811749 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77365], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.975268775] seconds [----] I, [2016-09-13T06:27:11.811974 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77365], Delivering... [----] I, [2016-09-13T06:27:11.819092 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003766298294067383, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037889480590820312, :pending_vm_jobs=>0.000873565673828125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006643533706665039} [----] I, [2016-09-13T06:27:11.819542 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77365], State: [ok], Delivered in [0.007565227] seconds [----] I, [2016-09-13T06:27:11.824267 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77364], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.01099209] seconds [----] I, [2016-09-13T06:27:11.824499 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77364], Delivering... [----] I, [2016-09-13T06:27:11.829683 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77364], State: [ok], Delivered in [0.005214377] seconds [----] I, [2016-09-13T06:27:22.725939 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004787445068359375, :worker_monitor=>1.3417143821716309, :worker_dequeue=>0.010909795761108398, :total_time=>1.3577229976654053} [----] I, [2016-09-13T06:27:23.861150 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:27:23.879889 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77366], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:27:27.726531 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:27:27 UTC]... [----] I, [2016-09-13T06:27:27.742508 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:27:27 UTC]...Complete [----] I, [2016-09-13T06:27:27.857238 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:27:28.434670 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77366], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.567188282] seconds [----] I, [2016-09-13T06:27:28.434859 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77366], Delivering... [----] I, [2016-09-13T06:27:28.441450 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003500223159790039, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035495758056640625, :pending_vm_jobs=>0.0008194446563720703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006206989288330078} [----] I, [2016-09-13T06:27:28.441794 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77366], State: [ok], Delivered in [0.006907035] seconds [----] I, [2016-09-13T06:27:38.889942 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:27:38.909479 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77367], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:27:38.931242 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77368], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:27:38.948578 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77369], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:27:38.959622 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77370], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:27:39.372269 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:27:39.376792 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004204511642456055, :worker_monitor=>1.4731829166412354, :worker_dequeue=>0.008517980575561523, :total_time=>1.4862339496612549} [----] I, [2016-09-13T06:27:39.494238 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77368], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.576241341] seconds [----] I, [2016-09-13T06:27:39.494604 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77368], Delivering... [----] I, [2016-09-13T06:27:39.537374 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77370], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.581469823] seconds [----] I, [2016-09-13T06:27:39.537548 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77370], Delivering... [----] I, [2016-09-13T06:27:39.542714 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027923583984375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028111934661865234, :pending_vm_jobs=>0.00060272216796875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004879474639892578} [----] I, [2016-09-13T06:27:39.543358 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77370], State: [ok], Delivered in [0.005802584] seconds [----] I, [2016-09-13T06:27:39.583161 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77368], State: [ok], Delivered in [0.088590029] seconds [----] I, [2016-09-13T06:27:41.957152 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77367], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.064036462] seconds [----] I, [2016-09-13T06:27:41.957337 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77367], Delivering... [----] I, [2016-09-13T06:27:41.962485 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77367], State: [ok], Delivered in [0.005111911] seconds [----] I, [2016-09-13T06:27:41.965905 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77369], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.031399938] seconds [----] I, [2016-09-13T06:27:41.966078 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77369], Delivering... [----] I, [2016-09-13T06:27:41.969156 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77369], State: [ok], Delivered in [0.003089435] seconds [----] I, [2016-09-13T06:27:49.412893 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T06:27:53.970642 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:27:53.998308 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77371], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:27:55.913764 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:27:55.920838 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038487911224365234, :worker_monitor=>1.476243257522583, :worker_dequeue=>0.012542724609375, :total_time=>1.4929206371307373} [----] I, [2016-09-13T06:27:56.722231 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77371], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.745612519] seconds [----] I, [2016-09-13T06:27:56.722509 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77371], Delivering... [----] I, [2016-09-13T06:27:56.730704 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004282712936401367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0043179988861083984, :pending_vm_jobs=>0.0011696815490722656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0076944828033447266} [----] I, [2016-09-13T06:27:56.731161 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77371], State: [ok], Delivered in [0.008692291] seconds [----] I, [2016-09-13T06:28:00.921340 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:28:00 UTC]... [----] I, [2016-09-13T06:28:00.938159 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:28:00 UTC]...Complete [----] I, [2016-09-13T06:28:09.009509 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:28:09.030384 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77372], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:28:09.047128 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77373], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:28:11.940163 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:28:12.078960 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77373], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.04220888] seconds [----] I, [2016-09-13T06:28:12.079208 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77373], Delivering... [----] I, [2016-09-13T06:28:12.084532 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77372], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.070429233] seconds [----] I, [2016-09-13T06:28:12.084726 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77372], Delivering... [----] I, [2016-09-13T06:28:12.086000 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035822391510009766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036034584045410156, :pending_vm_jobs=>0.0008211135864257812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00635528564453125} [----] I, [2016-09-13T06:28:12.086352 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77373], State: [ok], Delivered in [0.007151292] seconds [----] I, [2016-09-13T06:28:12.089557 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77372], State: [ok], Delivered in [0.004824002] seconds [----] I, [2016-09-13T06:28:24.059513 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:28:24.080151 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77374], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:28:24.101909 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77375], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:28:24.112765 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77376], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:28:28.105323 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:28:28.111893 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038421154022216797, :worker_monitor=>1.1189801692962646, :worker_dequeue=>0.011789083480834961, :total_time=>1.1349685192108154} [----] I, [2016-09-13T06:28:28.964718 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77375], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.879309634] seconds [----] I, [2016-09-13T06:28:28.964834 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77375], Delivering... [----] I, [2016-09-13T06:28:28.968763 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:28:20 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347151000], Memory % [5.04], CPU Time [103725.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T06:28:28.969107 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:28:27 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [150142.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:28:28.969393 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:28:25 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [51046.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:28:28.969647 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:28:17 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212543000], Memory % [3.5], CPU Time [48497.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T06:28:28.969902 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:28:24 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [237563.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T06:28:28.970179 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:28:25 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162417000], Memory % [3.1], CPU Time [37613.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T06:28:28.970460 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:28:27 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358685000], Memory % [5.28], CPU Time [201692.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T06:28:28.970603 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77374], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.905491024] seconds [----] I, [2016-09-13T06:28:28.970715 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:28:27 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [149265.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:28:28.970759 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77374], Delivering... [----] I, [2016-09-13T06:28:28.971775 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T06:28:28.971980 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5349236736 [----] I, [2016-09-13T06:28:28.972089 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5128691712 [----] I, [2016-09-13T06:28:28.972168 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:28:24 UTC], Process Info: Memory Usage [602263552], Memory Size [1002348544], Proportional Set Size: [437150000], Memory % [7.34], CPU Time [969.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:28:28.972173 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 220545024 [----] I, [2016-09-13T06:28:28.972243 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T06:28:28.972314 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5074710528 [----] I, [2016-09-13T06:28:28.972380 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T06:28:28.972484 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T06:28:28.972559 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 541577216 [----] I, [2016-09-13T06:28:28.972628 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T06:28:28.972694 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7922249728 [----] I, [2016-09-13T06:28:28.972766 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T06:28:28.972830 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T06:28:28.972895 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T06:28:28.972957 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T06:28:28.973020 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T06:28:28.973107 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T06:28:28.973174 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T06:28:28.973200 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:28:26 UTC], Process Info: Memory Usage [594178048], Memory Size [935235584], Proportional Set Size: [429121000], Memory % [7.24], CPU Time [343.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:28:28.973249 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T06:28:28.973328 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T06:28:28.973403 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T06:28:28.973510 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273252352 [----] I, [2016-09-13T06:28:28.973582 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56573952 [----] I, [2016-09-13T06:28:28.973650 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216678400 [----] I, [2016-09-13T06:28:28.973716 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6160384 [----] I, [2016-09-13T06:28:28.973789 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140480512 [----] I, [2016-09-13T06:28:28.973903 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2592985088 [----] I, [2016-09-13T06:28:28.974020 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2277605376 [----] I, [2016-09-13T06:28:28.974170 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T06:28:28.974261 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:28:23 UTC], Process Info: Memory Usage [557760512], Memory Size [895877120], Proportional Set Size: [405383000], Memory % [6.8], CPU Time [5135.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T06:28:28.974288 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T06:28:28.974406 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T06:28:28.974575 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37109760 [----] I, [2016-09-13T06:28:28.974703 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102273024 [----] I, [2016-09-13T06:28:28.974844 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53202944 [----] I, [2016-09-13T06:28:28.974985 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110571520 [----] I, [2016-09-13T06:28:28.975147 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155475968 [----] I, [2016-09-13T06:28:28.975286 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:28:26 UTC], Process Info: Memory Usage [580747264], Memory Size [909225984], Proportional Set Size: [420243000], Memory % [7.08], CPU Time [1748.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T06:28:28.975274 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T06:28:28.975383 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T06:28:28.975541 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T06:28:28.975576 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:28:27 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [207374.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T06:28:28.975654 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T06:28:28.975768 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T06:28:28.975837 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:28:25 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51039.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:28:28.975895 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T06:28:28.976077 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:28:24 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38514.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T06:28:28.976020 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T06:28:28.976177 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T06:28:28.976321 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77375], State: [ok], Delivered in [0.011487758] seconds [----] I, [2016-09-13T06:28:28.976308 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T06:28:28.993209 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77376], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.88481392] seconds [----] I, [2016-09-13T06:28:28.993312 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77376], Delivering... [----] I, [2016-09-13T06:28:28.996646 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0017559528350830078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0017676353454589844, :pending_vm_jobs=>0.00042819976806640625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003118753433227539} [----] I, [2016-09-13T06:28:28.996861 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77376], State: [ok], Delivered in [0.003547191] seconds [----] I, [2016-09-13T06:28:29.014139 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T06:28:29.014332 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T06:28:29.017995 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T06:28:29.020705 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T06:28:29.023929 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T06:28:29.027085 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T06:28:29.030335 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T06:28:29.033510 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 842 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T06:28:29.036599 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T06:28:29.039674 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T06:28:29.042728 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T06:28:29.045598 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T06:28:29.048442 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T06:28:29.051386 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T06:28:29.054024 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:28:29.054189 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:28:29.054292 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T06:28:29.058479 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [149253.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:28:29.058802 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77374], State: [ok], Delivered in [0.088019793] seconds [----] I, [2016-09-13T06:28:33.112356 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:28:33 UTC]... [----] I, [2016-09-13T06:28:33.124642 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:28:33 UTC]...Complete [----] I, [2016-09-13T06:28:39.124215 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:28:39.142543 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77377], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:28:39.165069 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77378], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:28:39.188032 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77379], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:28:39.222457 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77380], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:28:44.673918 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:28:44.678977 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004037618637084961, :worker_monitor=>1.4014532566070557, :worker_dequeue=>0.009125947952270508, :total_time=>1.4149045944213867} [----] I, [2016-09-13T06:28:45.182365 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77378], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.035638359] seconds [----] I, [2016-09-13T06:28:45.182594 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77378], Delivering... [----] I, [2016-09-13T06:28:45.194003 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77380], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.996503828] seconds [----] I, [2016-09-13T06:28:45.194212 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77380], Delivering... [----] I, [2016-09-13T06:28:45.200268 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77377], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.071639191] seconds [----] I, [2016-09-13T06:28:45.200470 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77377], Delivering... [----] I, [2016-09-13T06:28:45.200922 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003409147262573242, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034301280975341797, :pending_vm_jobs=>0.0008559226989746094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062291622161865234} [----] I, [2016-09-13T06:28:45.201257 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77380], State: [ok], Delivered in [0.007040172] seconds [----] I, [2016-09-13T06:28:45.205314 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77379], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.034627767] seconds [----] I, [2016-09-13T06:28:45.205505 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77379], Delivering... [----] I, [2016-09-13T06:28:45.205919 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77377], State: [ok], Delivered in [0.005476864] seconds [----] I, [2016-09-13T06:28:45.208984 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77379], State: [ok], Delivered in [0.003460094] seconds [----] I, [2016-09-13T06:28:45.222065 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77378], State: [ok], Delivered in [0.039462594] seconds [----] I, [2016-09-13T06:28:54.234256 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:28:54.250798 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77381], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:28:54.697084 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:28:55.302515 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77381], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.06253514] seconds [----] I, [2016-09-13T06:28:55.302746 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77381], Delivering... [----] I, [2016-09-13T06:28:55.309105 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032896995544433594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003308534622192383, :pending_vm_jobs=>0.0008182525634765625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005959272384643555} [----] I, [2016-09-13T06:28:55.309475 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77381], State: [ok], Delivered in [0.006709898] seconds [----] I, [2016-09-13T06:29:01.028365 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039463043212890625, :worker_monitor=>1.3119890689849854, :worker_dequeue=>0.008224964141845703, :total_time=>1.324439525604248} [----] I, [2016-09-13T06:29:06.028953 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:29:06 UTC]... [----] I, [2016-09-13T06:29:06.062517 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:29:06 UTC]...Complete [----] I, [2016-09-13T06:29:09.263777 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:29:09.285492 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77382], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:29:09.296608 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77383], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:29:11.093814 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:29:11.400154 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77383], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.10884611] seconds [----] I, [2016-09-13T06:29:11.400470 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77383], Delivering... [----] I, [2016-09-13T06:29:11.406771 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033235549926757812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033407211303710938, :pending_vm_jobs=>0.0007517337799072266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00585484504699707} [----] I, [2016-09-13T06:29:11.407147 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77383], State: [ok], Delivered in [0.006754539] seconds [----] I, [2016-09-13T06:29:12.325869 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77382], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.055903197] seconds [----] I, [2016-09-13T06:29:12.326106 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77382], Delivering... [----] I, [2016-09-13T06:29:12.330797 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77382], State: [ok], Delivered in [0.004726652] seconds [----] I, [2016-09-13T06:29:17.698683 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004282951354980469, :worker_monitor=>1.58400297164917, :worker_dequeue=>0.008337736129760742, :total_time=>1.596937894821167} [----] I, [2016-09-13T06:29:24.310767 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:29:24.339524 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77384], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:29:27.719679 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:29:28.539592 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77384], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.215468464] seconds [----] I, [2016-09-13T06:29:28.539770 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77384], Delivering... [----] I, [2016-09-13T06:29:28.546157 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034008026123046875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003464937210083008, :pending_vm_jobs=>0.0007481575012207031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006038665771484375} [----] I, [2016-09-13T06:29:28.546531 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77384], State: [ok], Delivered in [0.006749045] seconds [----] I, [2016-09-13T06:29:34.197134 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0043125152587890625, :worker_monitor=>1.457087516784668, :worker_dequeue=>0.009015083312988281, :total_time=>1.4707508087158203} [----] I, [2016-09-13T06:29:39.197709 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:29:39 UTC]... [----] I, [2016-09-13T06:29:39.214323 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:29:39 UTC]...Complete [----] I, [2016-09-13T06:29:39.356477 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:29:39.374184 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77385], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:29:39.394902 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77386], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:29:39.406138 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77387], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:29:39.423556 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77388], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:29:44.350820 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:29:44.658371 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77386], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.277375354] seconds [----] I, [2016-09-13T06:29:44.658652 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77386], Delivering... [----] I, [2016-09-13T06:29:44.692655 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77388], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.277089493] seconds [----] I, [2016-09-13T06:29:44.692901 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77388], Delivering... [----] I, [2016-09-13T06:29:44.701865 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004643678665161133, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004674673080444336, :pending_vm_jobs=>0.0011692047119140625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00846409797668457} [----] I, [2016-09-13T06:29:44.703562 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77388], State: [ok], Delivered in [0.010638918] seconds [----] I, [2016-09-13T06:29:44.752133 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77386], State: [ok], Delivered in [0.093432817] seconds [----] I, [2016-09-13T06:29:45.480947 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77385], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.119801785] seconds [----] I, [2016-09-13T06:29:45.481152 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77385], Delivering... [----] I, [2016-09-13T06:29:45.485281 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77385], State: [ok], Delivered in [0.004118379] seconds [----] I, [2016-09-13T06:29:45.498236 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77387], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.097463075] seconds [----] I, [2016-09-13T06:29:45.498457 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77387], Delivering... [----] I, [2016-09-13T06:29:45.506027 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77387], State: [ok], Delivered in [0.007589862] seconds [----] I, [2016-09-13T06:29:51.078592 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00500178337097168, :worker_monitor=>1.7090020179748535, :worker_dequeue=>0.005837202072143555, :total_time=>1.7202239036560059} [----] I, [2016-09-13T06:29:54.436770 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:29:54.459679 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77389], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:29:56.088264 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:29:56.854717 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77389], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.410561899] seconds [----] I, [2016-09-13T06:29:56.855057 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77389], Delivering... [----] I, [2016-09-13T06:29:56.862540 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004033565521240234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004058361053466797, :pending_vm_jobs=>0.0008363723754882812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006905555725097656} [----] I, [2016-09-13T06:29:56.862900 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77389], State: [ok], Delivered in [0.007889289] seconds [----] I, [2016-09-13T06:30:08.584260 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006026029586791992, :worker_monitor=>2.451235771179199, :worker_dequeue=>0.011349916458129883, :total_time=>2.469050645828247} [----] I, [2016-09-13T06:30:09.798857 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:30:09.831206 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77390], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:30:09.854230 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77391], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:30:09.865402 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77392], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:30:09.876766 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77393], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:30:09.888115 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77394], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:30:13.584981 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:30:13 UTC]... [----] I, [2016-09-13T06:30:13.608791 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:30:13 UTC]...Complete [----] I, [2016-09-13T06:30:13.626635 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:30:14.003208 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77394], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.121014823] seconds [----] I, [2016-09-13T06:30:14.003467 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77394], Delivering... [----] I, [2016-09-13T06:30:14.012948 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004774570465087891, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004802227020263672, :pending_vm_jobs=>0.0011332035064697266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008863210678100586} [----] I, [2016-09-13T06:30:14.013382 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77394], State: [ok], Delivered in [0.009932733] seconds [----] I, [2016-09-13T06:30:15.660345 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77390], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.844510603] seconds [----] I, [2016-09-13T06:30:15.660602 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77390], Delivering... [----] I, [2016-09-13T06:30:15.663375 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77390], State: [ok], Delivered in [0.002781976] seconds [----] I, [2016-09-13T06:30:15.684307 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77391], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.848319323] seconds [----] I, [2016-09-13T06:30:15.684532 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77391], Delivering... [----] I, [2016-09-13T06:30:15.695054 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77391], State: [ok], Delivered in [0.01050258] seconds [----] I, [2016-09-13T06:30:15.757556 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77392], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.898491432] seconds [----] I, [2016-09-13T06:30:15.757760 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77392], Delivering... [----] I, [2016-09-13T06:30:15.769175 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77392], State: [ok], Delivered in [0.011404714] seconds [----] I, [2016-09-13T06:30:15.774400 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77393], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.904374297] seconds [----] I, [2016-09-13T06:30:15.774597 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77393], Delivering... [----] I, [2016-09-13T06:30:15.779256 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77393], State: [ok], Delivered in [0.004635697] seconds [----] I, [2016-09-13T06:30:24.903158 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:30:24.922927 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77395], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:30:25.498931 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:30:25.505323 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004054546356201172, :worker_monitor=>1.8357763290405273, :worker_dequeue=>0.012262582778930664, :total_time=>1.8523850440979004} [----] I, [2016-09-13T06:30:26.077520 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77395], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.167624933] seconds [----] I, [2016-09-13T06:30:26.077710 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77395], Delivering... [----] I, [2016-09-13T06:30:26.084052 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003504037857055664, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035216808319091797, :pending_vm_jobs=>0.0007214546203613281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005963325500488281} [----] I, [2016-09-13T06:30:26.084383 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77395], State: [ok], Delivered in [0.006673963] seconds [----] I, [2016-09-13T06:30:39.935963 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:30:39.957114 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77396], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:30:39.992390 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77397], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:30:40.008571 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77398], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:30:40.048736 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77399], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:30:42.205300 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:30:42.210409 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0042018890380859375, :server_monitor=>0.10479474067687988, :worker_monitor=>1.5457172393798828, :worker_dequeue=>0.010393142700195312, :total_time=>1.665471076965332} [----] I, [2016-09-13T06:30:42.913304 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77397], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.950559876] seconds [----] I, [2016-09-13T06:30:42.913530 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77397], Delivering... [----] I, [2016-09-13T06:30:42.957858 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77399], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.935937024] seconds [----] I, [2016-09-13T06:30:42.958052 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77399], Delivering... [----] I, [2016-09-13T06:30:42.964565 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034635066986083984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034821033477783203, :pending_vm_jobs=>0.0008292198181152344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006129026412963867} [----] I, [2016-09-13T06:30:42.964896 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77399], State: [ok], Delivered in [0.006852449] seconds [----] I, [2016-09-13T06:30:42.991932 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77397], State: [ok], Delivered in [0.078387506] seconds [----] I, [2016-09-13T06:30:43.153252 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77396], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.210831407] seconds [----] I, [2016-09-13T06:30:43.153470 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77396], Delivering... [----] I, [2016-09-13T06:30:43.158059 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77396], State: [ok], Delivered in [0.004595407] seconds [----] I, [2016-09-13T06:30:43.204356 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77398], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.204052213] seconds [----] I, [2016-09-13T06:30:43.204547 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77398], Delivering... [----] I, [2016-09-13T06:30:43.207582 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77398], State: [ok], Delivered in [0.00303238] seconds [----] I, [2016-09-13T06:30:47.210941 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:30:47 UTC]... [----] I, [2016-09-13T06:30:47.234739 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:30:47 UTC]...Complete [----] I, [2016-09-13T06:30:55.064442 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:30:55.103877 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77400], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:30:59.398405 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:30:59.405880 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003872394561767578, :worker_monitor=>2.116867780685425, :worker_dequeue=>0.013936281204223633, :total_time=>2.1349949836730957} [----] I, [2016-09-13T06:31:00.383016 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77400], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.312718785] seconds [----] I, [2016-09-13T06:31:00.383310 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77400], Delivering... [----] I, [2016-09-13T06:31:00.393210 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005484342575073242, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005509376525878906, :pending_vm_jobs=>0.0010838508605957031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009349822998046875} [----] I, [2016-09-13T06:31:00.393666 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77400], State: [ok], Delivered in [0.010355972] seconds [----] I, [2016-09-13T06:31:10.117886 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:31:10.143016 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77401], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:31:10.159532 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77402], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:31:15.756943 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:31:15.762540 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038297176361083984, :worker_monitor=>1.3097164630889893, :worker_dequeue=>0.010055065155029297, :total_time=>1.3238816261291504} [----] I, [2016-09-13T06:31:16.344576 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77402], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.19426281] seconds [----] I, [2016-09-13T06:31:16.344794 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77402], Delivering... [----] I, [2016-09-13T06:31:16.351585 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034127235412597656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003432750701904297, :pending_vm_jobs=>0.0008380413055419922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062024593353271484} [----] I, [2016-09-13T06:31:16.351967 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77402], State: [ok], Delivered in [0.007184256] seconds [----] I, [2016-09-13T06:31:16.394276 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77401], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.269484097] seconds [----] I, [2016-09-13T06:31:16.394515 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77401], Delivering... [----] I, [2016-09-13T06:31:16.399524 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77401], State: [ok], Delivered in [0.005009086] seconds [----] I, [2016-09-13T06:31:20.762997 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:31:20 UTC]... [----] I, [2016-09-13T06:31:20.782192 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:31:20 UTC]...Complete [----] I, [2016-09-13T06:31:25.171995 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:31:25.188014 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77403], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:31:25.812232 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:31:26.538229 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77403], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.360009953] seconds [----] I, [2016-09-13T06:31:26.538457 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77403], Delivering... [----] I, [2016-09-13T06:31:26.546135 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037605762481689453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038650035858154297, :pending_vm_jobs=>0.0008335113525390625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007166862487792969} [----] I, [2016-09-13T06:31:26.546599 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77403], State: [ok], Delivered in [0.008144487] seconds [----] I, [2016-09-13T06:31:32.596878 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004616737365722656, :worker_monitor=>1.7551307678222656, :worker_dequeue=>0.012416601181030273, :total_time=>1.7726283073425293} [----] I, [2016-09-13T06:31:40.201092 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:31:40.253666 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77404], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:31:40.293297 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77405], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:31:40.338212 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77406], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:31:40.403999 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77407], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:31:42.744823 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:31:43.483170 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77405], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.224599458] seconds [----] I, [2016-09-13T06:31:43.483384 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77405], Delivering... [----] I, [2016-09-13T06:31:43.529246 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77407], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.180684105] seconds [----] I, [2016-09-13T06:31:43.529405 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77407], Delivering... [----] I, [2016-09-13T06:31:43.534136 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027031898498535156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027179718017578125, :pending_vm_jobs=>0.0005636215209960938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004410982131958008} [----] I, [2016-09-13T06:31:43.534449 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77407], State: [ok], Delivered in [0.005022179] seconds [----] I, [2016-09-13T06:31:43.551957 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77405], State: [ok], Delivered in [0.068540117] seconds [----] I, [2016-09-13T06:31:43.580809 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77404], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.374607187] seconds [----] I, [2016-09-13T06:31:43.581009 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77404], Delivering... [----] I, [2016-09-13T06:31:43.585959 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77404], State: [ok], Delivered in [0.00494044] seconds [----] I, [2016-09-13T06:31:43.592005 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77406], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.292842806] seconds [----] I, [2016-09-13T06:31:43.592206 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77406], Delivering... [----] I, [2016-09-13T06:31:43.595396 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77406], State: [ok], Delivered in [0.003170058] seconds [----] I, [2016-09-13T06:31:49.213745 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006440162658691406, :worker_monitor=>1.4462933540344238, :worker_dequeue=>0.009026288986206055, :total_time=>1.4620392322540283} [----] I, [2016-09-13T06:31:54.214452 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:31:54 UTC]... [----] I, [2016-09-13T06:31:54.265500 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:31:54 UTC]...Complete [----] I, [2016-09-13T06:31:55.417626 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:31:55.436339 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77408], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:31:59.293474 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:31:59.836809 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77408], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.413082956] seconds [----] I, [2016-09-13T06:31:59.837054 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77408], Delivering... [----] I, [2016-09-13T06:31:59.844272 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037877559661865234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003839731216430664, :pending_vm_jobs=>0.0008695125579833984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006779193878173828} [----] I, [2016-09-13T06:31:59.844674 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77408], State: [ok], Delivered in [0.007644151] seconds [----] I, [2016-09-13T06:32:05.677012 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0067136287689208984, :worker_monitor=>1.3595983982086182, :worker_dequeue=>0.009926557540893555, :total_time=>1.3767356872558594} [----] I, [2016-09-13T06:32:10.450763 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:32:10.470461 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77409], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:32:10.499475 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77410], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:32:10.687087 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:32:10.723586 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77410], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.24495584] seconds [----] I, [2016-09-13T06:32:10.723802 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77410], Delivering... [----] I, [2016-09-13T06:32:10.727857 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77409], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.270549585] seconds [----] I, [2016-09-13T06:32:10.728067 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77409], Delivering... [----] I, [2016-09-13T06:32:10.730400 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035543441772460938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003572225570678711, :pending_vm_jobs=>0.0008347034454345703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006209373474121094} [----] I, [2016-09-13T06:32:10.730866 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77410], State: [ok], Delivered in [0.007040276] seconds [----] I, [2016-09-13T06:32:10.732640 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77409], State: [ok], Delivered in [0.00459469] seconds [----] I, [2016-09-13T06:32:22.089251 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036475658416748047, :worker_monitor=>1.3676609992980957, :worker_dequeue=>0.008530139923095703, :total_time=>1.3801536560058594} [----] I, [2016-09-13T06:32:25.516186 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:32:25.534003 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77411], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:32:27.089763 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:32:27 UTC]... [----] I, [2016-09-13T06:32:27.106590 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:32:27 UTC]...Complete [----] I, [2016-09-13T06:32:27.119837 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:32:28.025739 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77411], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.503416892] seconds [----] I, [2016-09-13T06:32:28.025924 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77411], Delivering... [----] I, [2016-09-13T06:32:28.032082 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032978057861328125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033164024353027344, :pending_vm_jobs=>0.0007143020629882812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005743980407714844} [----] I, [2016-09-13T06:32:28.032475 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77411], State: [ok], Delivered in [0.006513086] seconds [----] I, [2016-09-13T06:32:38.777210 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004052877426147461, :worker_monitor=>1.619309663772583, :worker_dequeue=>0.011472702026367188, :total_time=>1.6351709365844727} [----] I, [2016-09-13T06:32:40.546200 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:32:40.568752 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77412], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:32:40.586052 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77413], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:32:40.602993 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77414], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:32:40.619931 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77415], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:32:43.900155 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:32:44.123238 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77413], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.550527375] seconds [----] I, [2016-09-13T06:32:44.123458 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77413], Delivering... [----] I, [2016-09-13T06:32:44.169432 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77415], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.557600883] seconds [----] I, [2016-09-13T06:32:44.169578 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77415], Delivering... [----] I, [2016-09-13T06:32:44.173744 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002292156219482422, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023069381713867188, :pending_vm_jobs=>0.0005323886871337891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00390934944152832} [----] I, [2016-09-13T06:32:44.173998 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77415], State: [ok], Delivered in [0.004415568] seconds [----] I, [2016-09-13T06:32:44.180276 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77413], State: [ok], Delivered in [0.056816872] seconds [----] I, [2016-09-13T06:32:46.854258 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77412], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.303632782] seconds [----] I, [2016-09-13T06:32:46.854511 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77412], Delivering... [----] I, [2016-09-13T06:32:46.859643 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77412], State: [ok], Delivered in [0.00512492] seconds [----] I, [2016-09-13T06:32:46.861068 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77414], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.269618544] seconds [----] I, [2016-09-13T06:32:46.861257 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77414], Delivering... [----] I, [2016-09-13T06:32:46.864602 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77414], State: [ok], Delivered in [0.00335378] seconds [----] I, [2016-09-13T06:32:53.941777 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T06:32:55.363191 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004464387893676758, :log_active_servers=>0.011595726013183594, :worker_monitor=>1.4117133617401123, :worker_dequeue=>0.009342432022094727, :total_time=>1.4374961853027344} [----] I, [2016-09-13T06:32:55.631324 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:32:55.648120 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77416], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:33:00.363705 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:33:00 UTC]... [----] I, [2016-09-13T06:33:00.385572 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:33:00 UTC]...Complete [----] I, [2016-09-13T06:33:00.396851 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:33:01.334284 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77416], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.696796953] seconds [----] I, [2016-09-13T06:33:01.334519 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77416], Delivering... [----] I, [2016-09-13T06:33:01.340597 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003184795379638672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003201723098754883, :pending_vm_jobs=>0.0007517337799072266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005692481994628906} [----] I, [2016-09-13T06:33:01.340880 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77416], State: [ok], Delivered in [0.006382532] seconds [----] I, [2016-09-13T06:33:10.660705 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:33:10.676816 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77417], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:33:10.711522 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77418], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:33:11.604335 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:33:11.607816 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005577802658081055, :worker_monitor=>1.1755659580230713, :worker_dequeue=>0.006396770477294922, :total_time=>1.1879005432128906} [----] I, [2016-09-13T06:33:12.427244 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77418], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.745017421] seconds [----] I, [2016-09-13T06:33:12.427461 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77418], Delivering... [----] I, [2016-09-13T06:33:12.433712 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032761096954345703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003309965133666992, :pending_vm_jobs=>0.0007731914520263672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005869865417480469} [----] I, [2016-09-13T06:33:12.434036 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77418], State: [ok], Delivered in [0.006587475] seconds [----] I, [2016-09-13T06:33:13.987213 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77417], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.319978885] seconds [----] I, [2016-09-13T06:33:13.987454 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77417], Delivering... [----] I, [2016-09-13T06:33:13.992676 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77417], State: [ok], Delivered in [0.005244908] seconds [----] I, [2016-09-13T06:33:25.723588 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:33:25.746599 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77419], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:33:25.757905 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77420], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:33:25.769243 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77421], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:33:27.643217 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:33:27.649661 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004665374755859375, :worker_monitor=>0.9932277202606201, :worker_dequeue=>0.01216888427734375, :total_time=>1.0104670524597168} [----] I, [2016-09-13T06:33:28.518200 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77419], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.789825953] seconds [----] I, [2016-09-13T06:33:28.518384 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77419], Delivering... [----] I, [2016-09-13T06:33:28.519349 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T06:33:28.519569 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5341470720 [----] I, [2016-09-13T06:33:28.519661 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5120724992 [----] I, [2016-09-13T06:33:28.519733 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 220745728 [----] I, [2016-09-13T06:33:28.519806 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T06:33:28.519875 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5066706944 [----] I, [2016-09-13T06:33:28.519941 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T06:33:28.520011 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T06:33:28.520104 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 541806592 [----] I, [2016-09-13T06:33:28.520170 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T06:33:28.520239 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7877263360 [----] I, [2016-09-13T06:33:28.520303 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T06:33:28.520365 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T06:33:28.520461 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T06:33:28.520546 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T06:33:28.520615 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T06:33:28.520681 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T06:33:28.520765 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T06:33:28.520834 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T06:33:28.520899 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T06:33:28.520963 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T06:33:28.521042 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273264640 [----] I, [2016-09-13T06:33:28.521118 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56586240 [----] I, [2016-09-13T06:33:28.521185 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216678400 [----] I, [2016-09-13T06:33:28.521250 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T06:33:28.521312 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141135872 [----] I, [2016-09-13T06:33:28.521376 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2601009152 [----] I, [2016-09-13T06:33:28.521495 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2285428736 [----] I, [2016-09-13T06:33:28.521572 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T06:33:28.521634 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T06:33:28.521698 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T06:33:28.521760 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37298176 [----] I, [2016-09-13T06:33:28.521868 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102273024 [----] I, [2016-09-13T06:33:28.521951 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53272576 [----] I, [2016-09-13T06:33:28.522017 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110604288 [----] I, [2016-09-13T06:33:28.522105 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155545600 [----] I, [2016-09-13T06:33:28.522171 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T06:33:28.522240 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T06:33:28.522304 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T06:33:28.522373 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T06:33:28.522465 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T06:33:28.522550 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T06:33:28.522632 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T06:33:28.522697 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T06:33:28.522759 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T06:33:28.563178 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T06:33:28.563376 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T06:33:28.563885 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77421], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.800530493] seconds [----] I, [2016-09-13T06:33:28.564061 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77421], Delivering... [----] I, [2016-09-13T06:33:28.566851 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T06:33:28.569274 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T06:33:28.570514 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003366231918334961, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033845901489257812, :pending_vm_jobs=>0.0008194446563720703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006072282791137695} [----] I, [2016-09-13T06:33:28.570851 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77421], State: [ok], Delivered in [0.006799277] seconds [----] I, [2016-09-13T06:33:28.572310 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T06:33:28.575106 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T06:33:28.577913 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T06:33:28.582187 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 842 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T06:33:28.586267 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T06:33:28.589165 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T06:33:28.592014 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.6 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T06:33:28.594950 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T06:33:28.597788 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T06:33:28.601919 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T06:33:28.604615 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:33:28.604752 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:33:28.604847 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T06:33:28.609799 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [150194.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T06:33:28.610182 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77419], State: [ok], Delivered in [0.091779056] seconds [----] I, [2016-09-13T06:33:32.652131 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:33:32 UTC]... [----] I, [2016-09-13T06:33:32.672239 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:33:32 UTC]...Complete [----] I, [2016-09-13T06:33:32.683016 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:33:33.626598 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77420], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.875882231] seconds [----] I, [2016-09-13T06:33:33.626750 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77420], Delivering... [----] I, [2016-09-13T06:33:33.633408 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:33:17 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48504.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T06:33:33.633943 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:33:26 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [51061.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:33:33.634391 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:33:25 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [237724.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T06:33:33.634868 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:33:26 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162417000], Memory % [3.1], CPU Time [37622.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T06:33:33.635322 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:33:26 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [201732.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T06:33:33.635721 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:33:20 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [103740.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T06:33:33.636182 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:33:26 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [150206.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:33:33.636597 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:33:27 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [149319.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:33:33.636998 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:33:25 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [207413.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T06:33:33.637430 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:33:25 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51054.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:33:33.637820 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:33:25 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165802000], Memory % [3.16], CPU Time [38524.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T06:33:33.640010 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:33:25 UTC], Process Info: Memory Usage [592486400], Memory Size [923025408], Proportional Set Size: [427599000], Memory % [7.22], CPU Time [1038.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:33:33.641613 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:33:27 UTC], Process Info: Memory Usage [594178048], Memory Size [935235584], Proportional Set Size: [429125000], Memory % [7.24], CPU Time [354.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:33:33.643258 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:33:24 UTC], Process Info: Memory Usage [558030848], Memory Size [911605760], Proportional Set Size: [405623000], Memory % [6.8], CPU Time [5146.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T06:33:33.644846 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:33:26 UTC], Process Info: Memory Usage [580968448], Memory Size [923381760], Proportional Set Size: [420456000], Memory % [7.08], CPU Time [1760.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T06:33:33.645141 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77420], State: [ok], Delivered in [0.018389647] seconds [----] I, [2016-09-13T06:33:40.780151 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:33:40.792165 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77422], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:33:40.809622 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77423], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:33:40.820902 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77424], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:33:40.838094 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77425], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:33:44.213618 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:33:44.216885 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0063741207122802734, :worker_monitor=>1.4935531616210938, :worker_dequeue=>0.005859375, :total_time=>1.5060310363769531} [----] I, [2016-09-13T06:33:44.787512 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77423], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.989942993] seconds [----] I, [2016-09-13T06:33:44.787717 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77423], Delivering... [----] I, [2016-09-13T06:33:44.804489 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77425], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.975152912] seconds [----] I, [2016-09-13T06:33:44.804689 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77425], Delivering... [----] I, [2016-09-13T06:33:44.811445 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003698587417602539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037178993225097656, :pending_vm_jobs=>0.0008361339569091797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063703060150146484} [----] I, [2016-09-13T06:33:44.811803 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77425], State: [ok], Delivered in [0.007109961] seconds [----] I, [2016-09-13T06:33:44.851249 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77423], State: [ok], Delivered in [0.063504287] seconds [----] I, [2016-09-13T06:33:47.063062 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77422], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.278730419] seconds [----] I, [2016-09-13T06:33:47.063299 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77422], Delivering... [----] I, [2016-09-13T06:33:47.068350 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77422], State: [ok], Delivered in [0.005046903] seconds [----] I, [2016-09-13T06:33:47.138242 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77424], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.323334157] seconds [----] I, [2016-09-13T06:33:47.138537 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77424], Delivering... [----] I, [2016-09-13T06:33:47.143111 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77424], State: [ok], Delivered in [0.004543353] seconds [----] I, [2016-09-13T06:33:55.849908 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:33:55.868225 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77426], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:34:00.693698 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:34:00.700192 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004275321960449219, :worker_monitor=>1.3937633037567139, :worker_dequeue=>0.011600732803344727, :total_time=>1.409961462020874} [----] I, [2016-09-13T06:34:00.971493 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77426], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.11553947] seconds [----] I, [2016-09-13T06:34:00.971655 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77426], Delivering... [----] I, [2016-09-13T06:34:00.976679 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002735137939453125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027496814727783203, :pending_vm_jobs=>0.0006012916564941406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0047113895416259766} [----] I, [2016-09-13T06:34:00.976992 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77426], State: [ok], Delivered in [0.005316484] seconds [----] I, [2016-09-13T06:34:05.700713 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:34:05 UTC]... [----] I, [2016-09-13T06:34:05.719507 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:34:05 UTC]...Complete [----] I, [2016-09-13T06:34:10.877616 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 11. [----] I, [2016-09-13T06:34:10.902918 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77427], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:34:10.938948 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77428], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:34:10.966872 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77429], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:34:17.362087 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:34:17.368828 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006975650787353516, :worker_monitor=>1.5900657176971436, :worker_dequeue=>0.01200413703918457, :total_time=>1.6095426082611084} [----] I, [2016-09-13T06:34:18.120165 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77429], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.174892445] seconds [----] I, [2016-09-13T06:34:18.120359 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77429], Delivering... [----] I, [2016-09-13T06:34:18.126898 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003278017044067383, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032987594604492188, :pending_vm_jobs=>0.0008537769317626953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00610804557800293} [----] I, [2016-09-13T06:34:18.127296 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77429], State: [ok], Delivered in [0.006909675] seconds [----] I, [2016-09-13T06:34:20.234697 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77427], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [9.345150937] seconds [----] I, [2016-09-13T06:34:20.234924 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77427], Delivering... [----] I, [2016-09-13T06:34:20.281665 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77430], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T06:34:20.298863 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77428], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [9.387834074] seconds [----] I, [2016-09-13T06:34:20.299207 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77428], Delivering... [----] I, [2016-09-13T06:34:20.305360 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77431], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T06:34:20.305907 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77427], State: [ok], Delivered in [0.070972645] seconds [----] I, [2016-09-13T06:34:20.306782 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77428], State: [ok], Delivered in [0.007561913] seconds [----] I, [2016-09-13T06:34:22.383233 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T06:34:22.385728 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T06:34:25.356510 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [77431], MiqWorker id: [98], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [5.068329675] seconds [----] I, [2016-09-13T06:34:25.356867 #3290:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77431], Delivering... [----] I, [2016-09-13T06:34:25.363255 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T06:34:25.363610 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T06:34:25.363847 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T06:34:25.364113 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T06:34:25.364340 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:25.812318 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:25.979155 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:34:26.002356 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77432], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:34:26.128205 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:26.128392 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:26.636015 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:26.926331 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:26.926547 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:27.395765 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:34:27.400435 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T06:34:27.433708 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:27.515942 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [77430], MiqWorker id: [99], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [7.259068922] seconds [----] I, [2016-09-13T06:34:27.516193 #5369:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77430], Delivering... [----] I, [2016-09-13T06:34:27.519005 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T06:34:27.519128 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T06:34:27.519248 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T06:34:27.519390 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T06:34:27.519529 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:27.742818 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:27.743069 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:27.798741 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:28.001217 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:28.001491 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:28.196525 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77432], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.209143029] seconds [----] I, [2016-09-13T06:34:28.196699 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77432], Delivering... [----] I, [2016-09-13T06:34:28.201854 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002808094024658203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002822399139404297, :pending_vm_jobs=>0.0006039142608642578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0048482418060302734} [----] I, [2016-09-13T06:34:28.202180 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77432], State: [ok], Delivered in [0.00549006] seconds [----] I, [2016-09-13T06:34:28.210403 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:28.420676 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:28.515061 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:28.535521 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:28.535713 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:28.605885 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:28.910214 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:29.002183 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:29.016122 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:29.109528 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:29.202697 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:29.296532 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:29.307334 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:29.307525 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:29.391806 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:29.484157 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:29.579166 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:29.672374 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:29.765182 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:29.789268 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:29.858627 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:29.951303 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:30.043996 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:30.100799 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:30.101119 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:30.136364 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:30.235064 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:30.327599 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:30.420093 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:34:30.577247 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:30.663342 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T06:34:30.663603 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004004240036010742, :collect_inventory_for_targets=>2.002716064453125e-05, :parse_legacy_inventory=>9.522140502929688, :parse_targeted_inventory=>9.52220892906189, :save_inventory=>0.6343894004821777, :ems_refresh=>10.157879829406738} [----] I, [2016-09-13T06:34:30.686741 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T06:34:30.687163 #5369:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77430], State: [ok], Delivered in [3.170980963] seconds [----] I, [2016-09-13T06:34:30.886158 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:30.886336 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:31.414230 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:31.726110 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:31.726227 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:32.204930 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:32.512838 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:32.513000 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:32.975617 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:33.262210 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:33.262376 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:33.710732 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:34.013177 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:34.013412 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:34.052695 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004247426986694336, :worker_monitor=>1.6335499286651611, :worker_dequeue=>0.011489152908325195, :total_time=>1.649627447128296} [----] I, [2016-09-13T06:34:34.506436 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:34.787259 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:34.787462 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:35.241975 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:35.539773 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:35.539952 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:36.027605 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:36.188947 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:36.325395 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:36.467325 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:36.603209 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:36.737707 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:36.876141 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:37.011202 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:37.146394 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:37.286532 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:37.419677 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:37.554201 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:37.691745 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:37.830663 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:37.962563 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:38.275151 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:38.425768 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:38.566850 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:38.703513 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:38.845965 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:38.986479 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:39.053254 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:34:39 UTC]... [----] I, [2016-09-13T06:34:39.080704 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:34:39 UTC]...Complete [----] I, [2016-09-13T06:34:39.125940 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:39.264075 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:39.410586 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:39.554897 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:39.702233 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:41.014722 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:34:41.040556 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77433], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:34:41.057603 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77434], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:34:41.086384 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77435], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:34:41.120508 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77436], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:34:44.112658 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:34:44.300198 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77434], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.255734279] seconds [----] I, [2016-09-13T06:34:44.300355 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77434], Delivering... [----] I, [2016-09-13T06:34:44.332560 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77436], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.232446084] seconds [----] I, [2016-09-13T06:34:44.332813 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77436], Delivering... [----] I, [2016-09-13T06:34:44.340513 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037813186645507812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038688182830810547, :pending_vm_jobs=>0.0010120868682861328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00726628303527832} [----] I, [2016-09-13T06:34:44.340940 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77436], State: [ok], Delivered in [0.008118852] seconds [----] I, [2016-09-13T06:34:44.343321 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77434], State: [ok], Delivered in [0.042934684] seconds [----] I, [2016-09-13T06:34:44.395385 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77433], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.375978378] seconds [----] I, [2016-09-13T06:34:44.395542 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77433], Delivering... [----] I, [2016-09-13T06:34:44.400678 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77433], State: [ok], Delivered in [0.005095414] seconds [----] I, [2016-09-13T06:34:44.406465 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77435], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.340937499] seconds [----] I, [2016-09-13T06:34:44.406708 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77435], Delivering... [----] I, [2016-09-13T06:34:44.415699 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77435], State: [ok], Delivered in [0.00891311] seconds [----] I, [2016-09-13T06:34:45.856247 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:45.989538 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:46.133958 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:46.273307 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:46.412195 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:46.555434 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:47.010977 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:47.164595 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:47.301708 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:47.446456 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:47.580669 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:47.739959 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:47.894695 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:48.040736 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:48.174803 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:48.319137 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:48.461868 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:48.595811 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:48.731476 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:48.866232 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:49.001770 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:49.136965 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:49.275486 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:49.735894 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:49.882359 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:50.064387 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:50.227821 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:50.364520 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:50.504463 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:50.636999 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:50.780643 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004309415817260742, :worker_monitor=>1.6502466201782227, :worker_dequeue=>0.008135795593261719, :total_time=>1.6630425453186035} [----] I, [2016-09-13T06:34:50.784156 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:50.919800 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:51.063354 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:51.201946 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:51.342099 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:51.490749 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:51.628390 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:51.770769 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:51.909410 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:52.048238 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:52.485472 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:52.643669 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:52.788348 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:52.921475 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:53.054745 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:53.194261 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:53.343835 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:53.484321 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:53.630706 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:53.767477 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:53.908050 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:54.044847 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:54.179792 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:54.314586 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:54.460594 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:54.594112 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:54.728573 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:55.261110 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:55.412083 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:55.552530 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:55.700687 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:55.841568 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:55.983044 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:56.119248 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:56.138831 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:34:56.173218 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77437], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:34:56.253614 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:56.394551 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:56.537052 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:34:56.688744 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:00.939572 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:35:01.521569 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77437], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.373683365] seconds [----] I, [2016-09-13T06:35:01.521763 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77437], Delivering... [----] I, [2016-09-13T06:35:01.527164 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031294822692871094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003149747848510742, :pending_vm_jobs=>0.0006175041198730469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005064964294433594} [----] I, [2016-09-13T06:35:01.527526 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77437], State: [ok], Delivered in [0.005762045] seconds [----] I, [2016-09-13T06:35:02.837356 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:02.980525 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:03.129949 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:03.272038 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:03.416975 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:03.555353 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:03.918689 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:04.063675 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:04.203654 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:04.341970 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:04.483247 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:04.617719 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:04.753619 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:04.902798 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:05.041279 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:05.186387 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:05.323588 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:05.467741 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:05.636315 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:05.770723 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:05.909630 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:06.051165 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:06.193873 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:06.484610 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:06.637866 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:06.781379 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:06.919222 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:07.059263 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:07.197486 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:07.337393 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:07.481634 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:07.611915 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004096508026123047, :worker_monitor=>1.6528947353363037, :worker_dequeue=>0.006136655807495117, :total_time=>1.6634557247161865} [----] I, [2016-09-13T06:35:07.624884 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:07.758758 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:07.898257 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:08.036874 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:08.171701 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:08.319705 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:08.460954 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:08.599790 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:08.745746 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:09.091730 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:09.250989 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:09.397860 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:09.540735 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:09.682007 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:09.824182 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:09.962520 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:10.109936 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:10.253921 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:10.396662 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:10.542173 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:10.678911 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:10.819404 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:10.961287 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:11.109355 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:11.189330 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:35:11.207246 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77438], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:35:11.218344 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77439], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:35:11.249346 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:11.396876 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:11.720109 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:11.861758 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:12.000226 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:12.141309 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:12.283333 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:12.423363 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:12.564369 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:12.612405 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:35:12 UTC]... [----] I, [2016-09-13T06:35:12.629754 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:35:12 UTC]...Complete [----] I, [2016-09-13T06:35:12.636688 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:35:12.705447 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:12.847866 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:12.992496 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:13.137723 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:13.279475 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:13.413713 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:13.552508 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:13.579722 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77439], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.36687947] seconds [----] I, [2016-09-13T06:35:13.579921 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77439], Delivering... [----] I, [2016-09-13T06:35:13.585647 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003027200698852539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003045320510864258, :pending_vm_jobs=>0.0007023811340332031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005365610122680664} [----] I, [2016-09-13T06:35:13.586001 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77439], State: [ok], Delivered in [0.006092389] seconds [----] I, [2016-09-13T06:35:13.685859 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:14.534211 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77438], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.340155117] seconds [----] I, [2016-09-13T06:35:14.534445 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77438], Delivering... [----] I, [2016-09-13T06:35:14.539173 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77438], State: [ok], Delivered in [0.004740634] seconds [----] I, [2016-09-13T06:35:19.845880 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:19.991989 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:20.391641 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:20.548592 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:20.682734 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:20.820888 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:21.007758 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:21.157255 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:21.297746 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:21.448055 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:21.591797 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:21.727908 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:21.872333 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:22.007767 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:22.142448 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:22.278053 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:22.415456 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:22.560551 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:22.707402 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:23.242863 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:23.416618 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:23.555143 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:23.694466 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:23.845012 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:23.982797 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:24.129231 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:24.266925 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:24.401138 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004323244094848633, :worker_monitor=>1.7258527278900146, :worker_dequeue=>0.010988473892211914, :total_time=>1.741457462310791} [----] I, [2016-09-13T06:35:24.413291 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:24.553187 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:24.696477 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:24.835236 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:24.986034 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:25.123465 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:25.261406 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:25.407116 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:25.549729 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:25.937538 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:26.090197 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:26.228809 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:35:26.232368 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:26.252765 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77440], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:35:26.370921 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:26.516456 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:26.707551 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:26.850125 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:26.991332 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:27.133562 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:27.272445 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:27.408908 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:27.549508 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:27.686304 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:27.828692 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:27.965810 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:28.109081 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:28.243856 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:28.752759 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:28.916497 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:29.059129 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:29.203348 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:29.348262 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:29.414706 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:35:29.483721 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:29.607438 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77440], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.374349441] seconds [----] I, [2016-09-13T06:35:29.607651 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77440], Delivering... [----] I, [2016-09-13T06:35:29.614315 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003526926040649414, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00354766845703125, :pending_vm_jobs=>0.0007741451263427734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006210803985595703} [----] I, [2016-09-13T06:35:29.614808 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77440], State: [ok], Delivered in [0.007135209] seconds [----] I, [2016-09-13T06:35:29.632150 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:29.768336 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:29.906468 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:30.054584 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:30.202732 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:30.339876 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:30.480600 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:30.628225 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:30.784379 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:36.947906 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:35:37.094033 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T06:35:37.289930 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T06:35:37.290382 #3290:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T06:35:37.290839 #3290:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T06:35:37.290988 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T06:35:37.291169 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T06:35:37.303980 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T06:35:37.304290 #3290:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [77431], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T06:35:37.304497 #3290:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T06:35:37.304699 #3290:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T06:35:37.304838 #3290:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77431], State: [error], Delivered in [71.948053155] seconds [----] I, [2016-09-13T06:35:41.056816 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0031991004943847656, :worker_monitor=>1.5894653797149658, :worker_dequeue=>0.01179051399230957, :total_time=>1.6047565937042236} [----] I, [2016-09-13T06:35:41.261749 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:35:41.281368 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77441], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:35:41.314113 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77442], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:35:41.342846 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77443], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:35:41.371876 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77444], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:35:46.057352 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:35:46 UTC]... [----] I, [2016-09-13T06:35:46.080877 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:35:46 UTC]...Complete [----] I, [2016-09-13T06:35:46.089931 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:35:46.800094 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77442], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.514247134] seconds [----] I, [2016-09-13T06:35:46.800318 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77442], Delivering... [----] I, [2016-09-13T06:35:46.845325 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77444], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.492768716] seconds [----] I, [2016-09-13T06:35:46.845460 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77444], Delivering... [----] I, [2016-09-13T06:35:46.849331 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002102375030517578, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002115011215209961, :pending_vm_jobs=>0.0004532337188720703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003625154495239258} [----] I, [2016-09-13T06:35:46.849583 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77444], State: [ok], Delivered in [0.004136334] seconds [----] I, [2016-09-13T06:35:46.851045 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77442], State: [ok], Delivered in [0.050714853] seconds [----] I, [2016-09-13T06:35:47.691672 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77441], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.425410009] seconds [----] I, [2016-09-13T06:35:47.691864 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77441], Delivering... [----] I, [2016-09-13T06:35:47.696887 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77441], State: [ok], Delivered in [0.005015828] seconds [----] I, [2016-09-13T06:35:47.696913 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77443], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.377298355] seconds [----] I, [2016-09-13T06:35:47.697046 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77443], Delivering... [----] I, [2016-09-13T06:35:47.702203 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77443], State: [ok], Delivered in [0.005138193] seconds [----] I, [2016-09-13T06:35:56.387254 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:35:56.428350 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77445], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:35:57.620469 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:35:57.627871 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003952741622924805, :server_monitor=>0.08958172798156738, :worker_monitor=>1.4029054641723633, :worker_dequeue=>0.013291597366333008, :total_time=>1.5102274417877197} [----] I, [2016-09-13T06:35:58.006361 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77445], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.612096796] seconds [----] I, [2016-09-13T06:35:58.006518 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77445], Delivering... [----] I, [2016-09-13T06:35:58.010533 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002247333526611328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022597312927246094, :pending_vm_jobs=>0.00048828125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0037643909454345703} [----] I, [2016-09-13T06:35:58.010776 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77445], State: [ok], Delivered in [0.004261893] seconds [----] I, [2016-09-13T06:36:11.443916 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:36:11.469457 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77446], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:36:11.490714 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77447], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:36:13.958768 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:36:13.962332 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003857851028442383, :worker_monitor=>1.2917461395263672, :worker_dequeue=>0.0065593719482421875, :total_time=>1.3024516105651855} [----] I, [2016-09-13T06:36:14.102349 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77447], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.623489579] seconds [----] I, [2016-09-13T06:36:14.102504 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77447], Delivering... [----] I, [2016-09-13T06:36:14.106184 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002035856246948242, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002046823501586914, :pending_vm_jobs=>0.0004730224609375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0034384727478027344} [----] I, [2016-09-13T06:36:14.106444 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77447], State: [ok], Delivered in [0.003920196] seconds [----] I, [2016-09-13T06:36:14.817222 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77446], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.366220246] seconds [----] I, [2016-09-13T06:36:14.817395 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77446], Delivering... [----] I, [2016-09-13T06:36:14.821272 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77446], State: [ok], Delivered in [0.003857513] seconds [----] I, [2016-09-13T06:36:18.962886 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:36:18 UTC]... [----] I, [2016-09-13T06:36:18.982175 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:36:18 UTC]...Complete [----] I, [2016-09-13T06:36:26.507882 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:36:26.530712 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77448], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:36:30.554435 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:36:30.558849 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038747787475585938, :worker_monitor=>1.5303411483764648, :worker_dequeue=>0.008080482482910156, :total_time=>1.5425620079040527} [----] I, [2016-09-13T06:36:31.251293 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77448], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.735110693] seconds [----] I, [2016-09-13T06:36:31.251511 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77448], Delivering... [----] I, [2016-09-13T06:36:31.257762 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033299922943115234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003349781036376953, :pending_vm_jobs=>0.0007677078247070312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005902528762817383} [----] I, [2016-09-13T06:36:31.258140 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77448], State: [ok], Delivered in [0.006604592] seconds [----] I, [2016-09-13T06:36:41.541992 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:36:41.567034 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77449], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:36:41.612748 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77450], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:36:41.647352 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77451], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:36:41.675865 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77452], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:36:47.063938 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:36:47.068646 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004509449005126953, :worker_monitor=>1.4578566551208496, :worker_dequeue=>0.00751948356628418, :total_time=>1.4702033996582031} [----] I, [2016-09-13T06:36:47.361194 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77450], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.790297927] seconds [----] I, [2016-09-13T06:36:47.361321 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77450], Delivering... [----] I, [2016-09-13T06:36:47.384035 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77452], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.727432845] seconds [----] I, [2016-09-13T06:36:47.384195 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77452], Delivering... [----] I, [2016-09-13T06:36:47.389060 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024755001068115234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024912357330322266, :pending_vm_jobs=>0.0006556510925292969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0045642852783203125} [----] I, [2016-09-13T06:36:47.389338 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77452], State: [ok], Delivered in [0.005154008] seconds [----] I, [2016-09-13T06:36:47.395261 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77450], State: [ok], Delivered in [0.033932174] seconds [----] I, [2016-09-13T06:36:47.944836 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77449], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.398348821] seconds [----] I, [2016-09-13T06:36:47.945059 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77449], Delivering... [----] I, [2016-09-13T06:36:47.949747 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77449], State: [ok], Delivered in [0.004696207] seconds [----] I, [2016-09-13T06:36:47.978760 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77451], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.360773365] seconds [----] I, [2016-09-13T06:36:47.978954 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77451], Delivering... [----] I, [2016-09-13T06:36:47.982271 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77451], State: [ok], Delivered in [0.003287323] seconds [----] I, [2016-09-13T06:36:52.069040 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:36:52 UTC]... [----] I, [2016-09-13T06:36:52.086766 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:36:52 UTC]...Complete [----] I, [2016-09-13T06:36:56.688732 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:36:56.710242 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77453], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:36:57.201194 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:36:57.401928 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77453], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.70766928] seconds [----] I, [2016-09-13T06:36:57.402160 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77453], Delivering... [----] I, [2016-09-13T06:36:57.409388 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003449678421020508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034673213958740234, :pending_vm_jobs=>0.0008566379547119141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006796121597290039} [----] I, [2016-09-13T06:36:57.409805 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77453], State: [ok], Delivered in [0.007639096] seconds [----] I, [2016-09-13T06:37:03.754087 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006581783294677734, :worker_monitor=>1.5313146114349365, :worker_dequeue=>0.007673740386962891, :total_time=>1.5458617210388184} [----] I, [2016-09-13T06:37:11.722641 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:37:11.739375 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77454], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:37:11.755833 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77455], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:37:13.782799 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:37:13.990488 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77455], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.247663154] seconds [----] I, [2016-09-13T06:37:13.990699 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77455], Delivering... [----] I, [2016-09-13T06:37:13.996925 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033109188079833984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033359527587890625, :pending_vm_jobs=>0.0007612705230712891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005857229232788086} [----] I, [2016-09-13T06:37:13.997284 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77455], State: [ok], Delivered in [0.006570459] seconds [----] I, [2016-09-13T06:37:15.476089 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77454], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.749013455] seconds [----] I, [2016-09-13T06:37:15.476285 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77454], Delivering... [----] I, [2016-09-13T06:37:15.480452 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77454], State: [ok], Delivered in [0.004142776] seconds [----] I, [2016-09-13T06:37:20.007483 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0042154788970947266, :worker_monitor=>1.1953399181365967, :worker_dequeue=>0.012575626373291016, :total_time=>1.212615728378296} [----] I, [2016-09-13T06:37:25.008101 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:37:25 UTC]... [----] I, [2016-09-13T06:37:25.054118 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:37:25 UTC]...Complete [----] I, [2016-09-13T06:37:26.765946 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:37:26.784772 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77456], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:37:30.086180 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:37:30.122282 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77456], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.349841986] seconds [----] I, [2016-09-13T06:37:30.122493 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77456], Delivering... [----] I, [2016-09-13T06:37:30.128312 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030870437622070312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031049251556396484, :pending_vm_jobs=>0.0007128715515136719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005491971969604492} [----] I, [2016-09-13T06:37:30.128631 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77456], State: [ok], Delivered in [0.006140455] seconds [----] I, [2016-09-13T06:37:36.230353 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041120052337646484, :worker_monitor=>1.123795747756958, :worker_dequeue=>0.009134531021118164, :total_time=>1.1373488903045654} [----] I, [2016-09-13T06:37:41.797411 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:37:41.813138 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77457], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:37:41.836265 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77458], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:37:41.847598 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77459], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:37:41.862454 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77460], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:37:46.253374 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:37:46.345270 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77458], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.529757662] seconds [----] I, [2016-09-13T06:37:46.345475 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77458], Delivering... [----] I, [2016-09-13T06:37:46.399855 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77458], State: [ok], Delivered in [0.05438394] seconds [----] I, [2016-09-13T06:37:46.436944 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77460], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.584207517] seconds [----] I, [2016-09-13T06:37:46.437136 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77460], Delivering... [----] I, [2016-09-13T06:37:46.443271 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030901432037353516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031082630157470703, :pending_vm_jobs=>0.0006928443908691406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005795478820800781} [----] I, [2016-09-13T06:37:46.443612 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77460], State: [ok], Delivered in [0.006474382] seconds [----] I, [2016-09-13T06:37:48.603526 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77459], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.763976832] seconds [----] I, [2016-09-13T06:37:48.603579 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77457], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.802497878] seconds [----] I, [2016-09-13T06:37:48.603742 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77459], Delivering... [----] I, [2016-09-13T06:37:48.603764 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77457], Delivering... [----] I, [2016-09-13T06:37:48.606920 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77459], State: [ok], Delivered in [0.003175758] seconds [----] I, [2016-09-13T06:37:48.608741 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77457], State: [ok], Delivered in [0.004996255] seconds [----] I, [2016-09-13T06:37:52.396258 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003945589065551758, :worker_monitor=>1.11961030960083, :worker_dequeue=>0.012286901473999023, :total_time=>1.1362652778625488} [----] I, [2016-09-13T06:37:56.876700 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:37:56.905785 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77461], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:37:57.396958 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:37:57 UTC]... [----] I, [2016-09-13T06:37:57.419867 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:37:57 UTC]...Complete [----] I, [2016-09-13T06:37:57.551689 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T06:37:57.557215 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:37:57.688831 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77461], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.804862091] seconds [----] I, [2016-09-13T06:37:57.689108 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77461], Delivering... [----] I, [2016-09-13T06:37:57.696464 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038597583770751953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038843154907226562, :pending_vm_jobs=>0.0008821487426757812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068607330322265625} [----] I, [2016-09-13T06:37:57.696825 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77461], State: [ok], Delivered in [0.007733849] seconds [----] I, [2016-09-13T06:38:08.802673 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004558563232421875, :worker_monitor=>1.2046985626220703, :worker_dequeue=>0.014473199844360352, :total_time=>1.2240183353424072} [----] I, [2016-09-13T06:38:11.923378 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:38:11.940355 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77462], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:38:11.957194 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77463], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:38:13.818161 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:38:14.432170 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77463], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.485319732] seconds [----] I, [2016-09-13T06:38:14.432525 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77463], Delivering... [----] I, [2016-09-13T06:38:14.443540 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005720376968383789, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005759477615356445, :pending_vm_jobs=>0.001422882080078125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010362863540649414} [----] I, [2016-09-13T06:38:14.444026 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77463], State: [ok], Delivered in [0.011539342] seconds [----] I, [2016-09-13T06:38:15.723157 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77462], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.794538181] seconds [----] I, [2016-09-13T06:38:15.723477 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77462], Delivering... [----] I, [2016-09-13T06:38:15.729194 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77462], State: [ok], Delivered in [0.005763983] seconds [----] I, [2016-09-13T06:38:25.363834 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040531158447265625, :worker_monitor=>1.502173900604248, :worker_dequeue=>0.012627124786376953, :total_time=>1.5191361904144287} [----] I, [2016-09-13T06:38:26.968926 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:38:27.010188 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77464], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:38:27.019937 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77465], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:38:27.031707 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77466], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:38:30.364462 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:38:30 UTC]... [----] I, [2016-09-13T06:38:30.385847 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:38:30 UTC]...Complete [----] I, [2016-09-13T06:38:30.396700 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:38:30.563409 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77464], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.5906061] seconds [----] I, [2016-09-13T06:38:30.563672 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77464], Delivering... [----] I, [2016-09-13T06:38:30.565249 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T06:38:30.565488 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5355024384 [----] I, [2016-09-13T06:38:30.565601 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5133996032 [----] I, [2016-09-13T06:38:30.565685 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 221028352 [----] I, [2016-09-13T06:38:30.565768 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T06:38:30.565855 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5079977984 [----] I, [2016-09-13T06:38:30.565935 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T06:38:30.566030 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T06:38:30.566125 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 542101504 [----] I, [2016-09-13T06:38:30.566210 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T06:38:30.566287 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8062816256 [----] I, [2016-09-13T06:38:30.566363 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T06:38:30.566466 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T06:38:30.566565 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T06:38:30.566645 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 131072 [----] I, [2016-09-13T06:38:30.566725 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T06:38:30.566820 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T06:38:30.566898 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T06:38:30.566968 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T06:38:30.567056 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T06:38:30.567141 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T06:38:30.567214 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273276928 [----] I, [2016-09-13T06:38:30.567292 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56586240 [----] I, [2016-09-13T06:38:30.567363 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216690688 [----] I, [2016-09-13T06:38:30.567461 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6225920 [----] I, [2016-09-13T06:38:30.567560 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141148160 [----] I, [2016-09-13T06:38:30.567639 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2586660864 [----] I, [2016-09-13T06:38:30.567733 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2270785536 [----] I, [2016-09-13T06:38:30.567825 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T06:38:30.567912 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T06:38:30.567983 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T06:38:30.568073 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37552128 [----] I, [2016-09-13T06:38:30.568150 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102273024 [----] I, [2016-09-13T06:38:30.568226 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53567488 [----] I, [2016-09-13T06:38:30.568294 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110604288 [----] I, [2016-09-13T06:38:30.568370 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155840512 [----] I, [2016-09-13T06:38:30.568476 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T06:38:30.568572 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T06:38:30.568654 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T06:38:30.568731 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T06:38:30.568804 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T06:38:30.568887 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T06:38:30.568966 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T06:38:30.569054 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T06:38:30.569136 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T06:38:30.613600 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T06:38:30.613889 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T06:38:30.618245 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T06:38:30.621401 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T06:38:30.625112 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T06:38:30.628649 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T06:38:30.632207 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T06:38:30.635813 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 843 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T06:38:30.639405 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T06:38:30.643148 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T06:38:30.646797 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.7 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T06:38:30.650291 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T06:38:30.653712 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T06:38:30.657143 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T06:38:30.660118 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:38:30.660271 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:38:30.660392 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T06:38:30.665081 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [149429.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:38:30.665476 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77464], State: [ok], Delivered in [0.101789552] seconds [----] I, [2016-09-13T06:38:30.700526 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77465], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.686753344] seconds [----] I, [2016-09-13T06:38:30.700723 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77465], Delivering... [----] I, [2016-09-13T06:38:30.708436 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:38:17 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48512.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T06:38:30.708995 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:38:23 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [51076.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:38:30.709738 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:38:24 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [201802.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T06:38:30.710323 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:38:11 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [237844.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T06:38:30.710815 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:38:20 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [103755.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T06:38:30.711447 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:38:24 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162417000], Memory % [3.1], CPU Time [37632.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T06:38:30.712001 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:38:24 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [149440.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:38:30.712515 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:38:24 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [150309.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:38:30.715261 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:38:21 UTC], Process Info: Memory Usage [594866176], Memory Size [949915648], Proportional Set Size: [429841000], Memory % [7.25], CPU Time [394.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:38:30.717349 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:38:17 UTC], Process Info: Memory Usage [603205632], Memory Size [1060630528], Proportional Set Size: [438096000], Memory % [7.35], CPU Time [1183.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:38:30.719535 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:38:16 UTC], Process Info: Memory Usage [581181440], Memory Size [937013248], Proportional Set Size: [420664000], Memory % [7.09], CPU Time [1770.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T06:38:30.722549 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:38:24 UTC], Process Info: Memory Usage [558571520], Memory Size [929497088], Proportional Set Size: [406151000], Memory % [6.81], CPU Time [5157.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T06:38:30.723478 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:38:24 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [207490.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T06:38:30.724354 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:38:23 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51069.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:38:30.725144 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:38:25 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38534.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T06:38:30.725597 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77465], State: [ok], Delivered in [0.024853351] seconds [----] I, [2016-09-13T06:38:30.751703 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77466], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.727784606] seconds [----] I, [2016-09-13T06:38:30.751866 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77466], Delivering... [----] I, [2016-09-13T06:38:30.758298 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032765865325927734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033049583435058594, :pending_vm_jobs=>0.0008122920989990234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006034135818481445} [----] I, [2016-09-13T06:38:30.758661 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77466], State: [ok], Delivered in [0.00678682] seconds [----] I, [2016-09-13T06:38:41.685658 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003879070281982422, :worker_monitor=>1.2488117218017578, :worker_dequeue=>0.011392354965209961, :total_time=>1.2643704414367676} [----] I, [2016-09-13T06:38:42.043495 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:38:42.061387 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77467], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:38:42.077733 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77468], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:38:42.100395 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77469], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:38:42.118231 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77470], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:38:46.699342 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:38:46.884587 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77468], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.81912654] seconds [----] I, [2016-09-13T06:38:46.884793 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77468], Delivering... [----] I, [2016-09-13T06:38:46.889858 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77470], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.780656237] seconds [----] I, [2016-09-13T06:38:46.890082 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77470], Delivering... [----] I, [2016-09-13T06:38:46.898724 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003826141357421875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003881216049194336, :pending_vm_jobs=>0.0010051727294921875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008136272430419922} [----] I, [2016-09-13T06:38:46.899208 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77470], State: [ok], Delivered in [0.009119742] seconds [----] I, [2016-09-13T06:38:46.941001 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77468], State: [ok], Delivered in [0.056205895] seconds [----] I, [2016-09-13T06:38:48.811281 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77467], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.763524604] seconds [----] I, [2016-09-13T06:38:48.811524 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77467], Delivering... [----] I, [2016-09-13T06:38:48.816534 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77467], State: [ok], Delivered in [0.005021911] seconds [----] I, [2016-09-13T06:38:48.826963 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77469], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.744044982] seconds [----] I, [2016-09-13T06:38:48.827164 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77469], Delivering... [----] I, [2016-09-13T06:38:48.830375 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77469], State: [ok], Delivered in [0.003210892] seconds [----] I, [2016-09-13T06:38:57.129939 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:38:57.154452 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77471], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:38:58.140769 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:38:58.147365 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0060422420501708984, :worker_monitor=>1.4099462032318115, :worker_dequeue=>0.011732816696166992, :total_time=>1.428145170211792} [----] I, [2016-09-13T06:38:59.021609 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77471], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.885110441] seconds [----] I, [2016-09-13T06:38:59.021897 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77471], Delivering... [----] I, [2016-09-13T06:38:59.031396 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005651712417602539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005686759948730469, :pending_vm_jobs=>0.0010197162628173828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008736848831176758} [----] I, [2016-09-13T06:38:59.031894 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77471], State: [ok], Delivered in [0.010019063] seconds [----] I, [2016-09-13T06:39:03.147895 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:39:03 UTC]... [----] I, [2016-09-13T06:39:03.170105 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:39:03 UTC]...Complete [----] I, [2016-09-13T06:39:12.166249 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:39:12.181267 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77472], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:39:12.198534 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77473], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:39:14.791208 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:39:14.794690 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004156351089477539, :worker_monitor=>1.4623591899871826, :worker_dequeue=>0.0061054229736328125, :total_time=>1.4730770587921143} [----] I, [2016-09-13T06:39:15.146976 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77473], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.960185098] seconds [----] I, [2016-09-13T06:39:15.147132 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77473], Delivering... [----] I, [2016-09-13T06:39:15.153741 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033028125762939453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033223628997802734, :pending_vm_jobs=>0.0009157657623291016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006288051605224609} [----] I, [2016-09-13T06:39:15.154076 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77473], State: [ok], Delivered in [0.006926625] seconds [----] I, [2016-09-13T06:39:15.937067 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77472], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.76630811] seconds [----] I, [2016-09-13T06:39:15.937273 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77472], Delivering... [----] I, [2016-09-13T06:39:15.942830 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77472], State: [ok], Delivered in [0.005556737] seconds [----] I, [2016-09-13T06:39:27.210770 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:39:27.232863 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77474], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:39:30.929017 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:39:30.932978 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0029947757720947266, :worker_monitor=>1.0998775959014893, :worker_dequeue=>0.007124662399291992, :total_time=>1.1102619171142578} [----] I, [2016-09-13T06:39:30.958368 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77474], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.737528473] seconds [----] I, [2016-09-13T06:39:30.958519 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77474], Delivering... [----] I, [2016-09-13T06:39:30.962931 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002313375473022461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023262500762939453, :pending_vm_jobs=>0.0005614757537841797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0041162967681884766} [----] I, [2016-09-13T06:39:30.963254 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77474], State: [ok], Delivered in [0.00472426] seconds [----] I, [2016-09-13T06:39:35.933588 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:39:35 UTC]... [----] I, [2016-09-13T06:39:35.952890 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:39:35 UTC]...Complete [----] I, [2016-09-13T06:39:42.247239 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:39:42.261501 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77475], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:39:42.278865 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77476], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:39:42.301659 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77477], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:39:42.324596 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77478], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:39:47.602873 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:39:47.610146 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004214048385620117, :worker_monitor=>1.599163293838501, :worker_dequeue=>0.013207197189331055, :total_time=>1.616896152496338} [----] I, [2016-09-13T06:39:48.399926 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77476], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.134533558] seconds [----] I, [2016-09-13T06:39:48.400135 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77476], Delivering... [----] I, [2016-09-13T06:39:48.421927 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77478], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.111862322] seconds [----] I, [2016-09-13T06:39:48.422153 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77478], Delivering... [----] I, [2016-09-13T06:39:48.429107 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003646373748779297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00373077392578125, :pending_vm_jobs=>0.0008592605590820312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006510257720947266} [----] I, [2016-09-13T06:39:48.429461 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77478], State: [ok], Delivered in [0.007272402] seconds [----] I, [2016-09-13T06:39:48.461513 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77476], State: [ok], Delivered in [0.061365722] seconds [----] I, [2016-09-13T06:39:49.038848 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77475], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.787329801] seconds [----] I, [2016-09-13T06:39:49.039058 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77475], Delivering... [----] I, [2016-09-13T06:39:49.044458 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77475], State: [ok], Delivered in [0.005387647] seconds [----] I, [2016-09-13T06:39:49.057149 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77477], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.773237126] seconds [----] I, [2016-09-13T06:39:49.057339 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77477], Delivering... [----] I, [2016-09-13T06:39:49.060723 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77477], State: [ok], Delivered in [0.003379314] seconds [----] I, [2016-09-13T06:39:57.335729 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:39:57.354116 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77479], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:39:57.643766 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:39:58.171296 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77479], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.829071949] seconds [----] I, [2016-09-13T06:39:58.171531 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77479], Delivering... [----] I, [2016-09-13T06:39:58.178722 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036842823028564453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003708362579345703, :pending_vm_jobs=>0.0009069442749023438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006699800491333008} [----] I, [2016-09-13T06:39:58.179113 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77479], State: [ok], Delivered in [0.007581305] seconds [----] I, [2016-09-13T06:40:04.469035 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004743337631225586, :worker_monitor=>1.7872397899627686, :worker_dequeue=>0.02283644676208496, :total_time=>1.8151795864105225} [----] I, [2016-09-13T06:40:09.469682 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:40:09 UTC]... [----] I, [2016-09-13T06:40:09.490986 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:40:09 UTC]...Complete [----] I, [2016-09-13T06:40:12.366599 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:40:12.382799 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77480], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:40:12.399886 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77481], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:40:12.411303 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77482], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:40:12.422640 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77483], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:40:12.434069 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77484], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:40:14.616520 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:40:14.663062 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77484], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.234855998] seconds [----] I, [2016-09-13T06:40:14.663262 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77484], Delivering... [----] I, [2016-09-13T06:40:14.670033 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003520488739013672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035436153411865234, :pending_vm_jobs=>0.0008456707000732422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006330013275146484} [----] I, [2016-09-13T06:40:14.670384 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77484], State: [ok], Delivered in [0.007129606] seconds [----] I, [2016-09-13T06:40:16.234874 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77480], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.862740667] seconds [----] I, [2016-09-13T06:40:16.235140 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77480], Delivering... [----] I, [2016-09-13T06:40:16.237838 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77480], State: [ok], Delivered in [0.002712548] seconds [----] I, [2016-09-13T06:40:16.268936 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77481], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.880493946] seconds [----] I, [2016-09-13T06:40:16.269162 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77481], Delivering... [----] I, [2016-09-13T06:40:16.280950 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77481], State: [ok], Delivered in [0.0117646] seconds [----] I, [2016-09-13T06:40:16.308947 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77482], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.904843995] seconds [----] I, [2016-09-13T06:40:16.309154 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77482], Delivering... [----] I, [2016-09-13T06:40:16.315850 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77482], State: [ok], Delivered in [0.006689013] seconds [----] I, [2016-09-13T06:40:16.326184 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77483], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.910816821] seconds [----] I, [2016-09-13T06:40:16.326397 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77483], Delivering... [----] I, [2016-09-13T06:40:16.332510 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77483], State: [ok], Delivered in [0.006056404] seconds [----] I, [2016-09-13T06:40:21.174794 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0048503875732421875, :worker_monitor=>1.5343873500823975, :worker_dequeue=>0.01195383071899414, :total_time=>1.5515317916870117} [----] I, [2016-09-13T06:40:27.446603 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:40:27.491832 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77485], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:40:31.205285 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:40:31.400078 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77485], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.947240591] seconds [----] I, [2016-09-13T06:40:31.400255 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77485], Delivering... [----] I, [2016-09-13T06:40:31.406972 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003510713577270508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035352706909179688, :pending_vm_jobs=>0.0008304119110107422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006326198577880859} [----] I, [2016-09-13T06:40:31.407346 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77485], State: [ok], Delivered in [0.007087771] seconds [----] I, [2016-09-13T06:40:37.591526 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004024028778076172, :worker_monitor=>1.3638341426849365, :worker_dequeue=>0.010966062545776367, :total_time=>1.379204511642456} [----] I, [2016-09-13T06:40:42.503292 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:40:42.520217 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77486], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:40:42.537918 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77487], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:40:42.554073 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77488], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:40:42.577111 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77489], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:40:42.592035 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:40:42 UTC]... [----] I, [2016-09-13T06:40:42.611118 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:40:42 UTC]...Complete [----] I, [2016-09-13T06:40:42.622085 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:40:42.903624 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77487], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.379318312] seconds [----] I, [2016-09-13T06:40:42.903843 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77487], Delivering... [----] I, [2016-09-13T06:40:42.925545 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77489], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.362604447] seconds [----] I, [2016-09-13T06:40:42.925730 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77489], Delivering... [----] I, [2016-09-13T06:40:42.932168 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033311843872070312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003351449966430664, :pending_vm_jobs=>0.0008120536804199219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006090641021728516} [----] I, [2016-09-13T06:40:42.932569 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77489], State: [ok], Delivered in [0.006824927] seconds [----] I, [2016-09-13T06:40:42.965794 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77487], State: [ok], Delivered in [0.061943517] seconds [----] I, [2016-09-13T06:40:43.446735 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77486], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.939213767] seconds [----] I, [2016-09-13T06:40:43.446918 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77486], Delivering... [----] I, [2016-09-13T06:40:43.451963 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77486], State: [ok], Delivered in [0.00503847] seconds [----] I, [2016-09-13T06:40:43.458670 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77488], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.915387238] seconds [----] I, [2016-09-13T06:40:43.458856 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77488], Delivering... [----] I, [2016-09-13T06:40:43.462059 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77488], State: [ok], Delivered in [0.00318333] seconds [----] I, [2016-09-13T06:40:53.945221 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005000114440917969, :worker_monitor=>1.288022756576538, :worker_dequeue=>0.006524324417114258, :total_time=>1.2998452186584473} [----] I, [2016-09-13T06:40:57.588790 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:40:57.605676 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77490], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:40:58.956192 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:40:59.068738 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77490], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.474198611] seconds [----] I, [2016-09-13T06:40:59.068953 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77490], Delivering... [----] I, [2016-09-13T06:40:59.075662 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035343170166015625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003555774688720703, :pending_vm_jobs=>0.0008261203765869141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062944889068603516} [----] I, [2016-09-13T06:40:59.076032 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77490], State: [ok], Delivered in [0.007070557] seconds [----] I, [2016-09-13T06:41:10.244045 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039637088775634766, :worker_monitor=>1.1875200271606445, :worker_dequeue=>0.01135706901550293, :total_time=>1.2031302452087402} [----] I, [2016-09-13T06:41:12.616818 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:41:12.634922 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77491], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:41:12.646346 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77492], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:41:15.244536 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:41:15 UTC]... [----] I, [2016-09-13T06:41:15.263777 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:41:15 UTC]...Complete [----] I, [2016-09-13T06:41:15.381817 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:41:16.212592 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77492], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.57295448] seconds [----] I, [2016-09-13T06:41:16.212818 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77492], Delivering... [----] I, [2016-09-13T06:41:16.219918 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036773681640625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003702402114868164, :pending_vm_jobs=>0.0008909702301025391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006664752960205078} [----] I, [2016-09-13T06:41:16.220334 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77492], State: [ok], Delivered in [0.007507193] seconds [----] I, [2016-09-13T06:41:16.572389 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77491], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.951263066] seconds [----] I, [2016-09-13T06:41:16.572615 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77491], Delivering... [----] I, [2016-09-13T06:41:16.577762 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77491], State: [ok], Delivered in [0.005147062] seconds [----] I, [2016-09-13T06:41:26.812788 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039212703704833984, :worker_monitor=>1.3952674865722656, :worker_dequeue=>0.005361318588256836, :total_time=>1.404850721359253} [----] I, [2016-09-13T06:41:27.656647 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:41:27.680820 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77493], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:41:31.822463 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:41:32.304945 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77493], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.642640683] seconds [----] I, [2016-09-13T06:41:32.305180 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77493], Delivering... [----] I, [2016-09-13T06:41:32.311752 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034646987915039062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034852027893066406, :pending_vm_jobs=>0.0008263587951660156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006203174591064453} [----] I, [2016-09-13T06:41:32.312136 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77493], State: [ok], Delivered in [0.00695386] seconds [----] I, [2016-09-13T06:41:42.740752 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:41:42.755128 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77494], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:41:42.766335 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77495], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:41:42.777789 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77496], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:41:42.806773 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77497], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:41:43.296317 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:41:43.303113 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041887760162353516, :worker_monitor=>1.4418981075286865, :worker_dequeue=>0.012171030044555664, :total_time=>1.4585704803466797} [----] I, [2016-09-13T06:41:43.429907 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77495], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.670645874] seconds [----] I, [2016-09-13T06:41:43.430104 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77495], Delivering... [----] I, [2016-09-13T06:41:43.446846 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77497], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.656515725] seconds [----] I, [2016-09-13T06:41:43.446974 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77497], Delivering... [----] I, [2016-09-13T06:41:43.452925 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030939579010009766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003116130828857422, :pending_vm_jobs=>0.000804901123046875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005669832229614258} [----] I, [2016-09-13T06:41:43.453277 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77497], State: [ok], Delivered in [0.006282529] seconds [----] I, [2016-09-13T06:41:43.509760 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77495], State: [ok], Delivered in [0.079624879] seconds [----] I, [2016-09-13T06:41:43.629710 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77494], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.884232288] seconds [----] I, [2016-09-13T06:41:43.629947 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77494], Delivering... [----] I, [2016-09-13T06:41:43.635535 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77494], State: [ok], Delivered in [0.005599879] seconds [----] I, [2016-09-13T06:41:43.652040 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77496], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.880432348] seconds [----] I, [2016-09-13T06:41:43.652152 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77496], Delivering... [----] I, [2016-09-13T06:41:43.654058 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77496], State: [ok], Delivered in [0.001898674] seconds [----] I, [2016-09-13T06:41:48.303667 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:41:48 UTC]... [----] I, [2016-09-13T06:41:48.326531 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:41:48 UTC]...Complete [----] I, [2016-09-13T06:41:57.817407 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:41:57.835057 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77498], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:41:59.934230 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:41:59.940756 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003980875015258789, :worker_monitor=>1.5649988651275635, :worker_dequeue=>0.011492013931274414, :total_time=>1.580765724182129} [----] I, [2016-09-13T06:42:00.635712 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77498], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.812356876] seconds [----] I, [2016-09-13T06:42:00.635920 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77498], Delivering... [----] I, [2016-09-13T06:42:00.643240 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038299560546875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038514137268066406, :pending_vm_jobs=>0.0008444786071777344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00690150260925293} [----] I, [2016-09-13T06:42:00.643654 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77498], State: [ok], Delivered in [0.0077083] seconds [----] I, [2016-09-13T06:42:12.847077 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:42:12.863853 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77499], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:42:12.886625 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77500], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:42:16.292694 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:42:16.296828 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039615631103515625, :worker_monitor=>1.310570478439331, :worker_dequeue=>0.007485389709472656, :total_time=>1.3222804069519043} [----] I, [2016-09-13T06:42:16.738651 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77500], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.869580455] seconds [----] I, [2016-09-13T06:42:16.738776 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77500], Delivering... [----] I, [2016-09-13T06:42:16.742535 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020699501037597656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020825862884521484, :pending_vm_jobs=>0.0004639625549316406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003519773483276367} [----] I, [2016-09-13T06:42:16.742741 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77500], State: [ok], Delivered in [0.003962948] seconds [----] I, [2016-09-13T06:42:16.755679 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77499], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.903744949] seconds [----] I, [2016-09-13T06:42:16.755878 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77499], Delivering... [----] I, [2016-09-13T06:42:16.761606 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77499], State: [ok], Delivered in [0.005705502] seconds [----] I, [2016-09-13T06:42:21.297313 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:42:21 UTC]... [----] I, [2016-09-13T06:42:21.321250 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:42:21 UTC]...Complete [----] I, [2016-09-13T06:42:27.896680 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:42:27.915911 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77501], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:42:32.760648 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:42:32.764719 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0034651756286621094, :worker_monitor=>1.286278486251831, :worker_dequeue=>0.007279872894287109, :total_time=>1.2977871894836426} [----] I, [2016-09-13T06:42:32.864804 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77501], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.964341532] seconds [----] I, [2016-09-13T06:42:32.864976 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77501], Delivering... [----] I, [2016-09-13T06:42:32.871333 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033249855041503906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033426284790039062, :pending_vm_jobs=>0.0008001327514648438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005956888198852539} [----] I, [2016-09-13T06:42:32.871678 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77501], State: [ok], Delivered in [0.006692707] seconds [----] I, [2016-09-13T06:42:42.928542 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:42:42.944865 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77502], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:42:42.962066 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77503], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:42:42.985367 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77504], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:42:43.007612 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77505], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:42:49.089900 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:42:49.095895 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005843162536621094, :worker_monitor=>1.2771894931793213, :worker_dequeue=>0.010531187057495117, :total_time=>1.2939248085021973} [----] I, [2016-09-13T06:42:49.877201 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77503], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.92575044] seconds [----] I, [2016-09-13T06:42:49.877455 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77503], Delivering... [----] I, [2016-09-13T06:42:49.911160 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77505], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.911432813] seconds [----] I, [2016-09-13T06:42:49.911364 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77505], Delivering... [----] I, [2016-09-13T06:42:49.918228 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035614967346191406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003584623336791992, :pending_vm_jobs=>0.0012509822845458984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006444692611694336} [----] I, [2016-09-13T06:42:49.918551 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77505], State: [ok], Delivered in [0.007204006] seconds [----] I, [2016-09-13T06:42:49.939533 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77502], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.006542713] seconds [----] I, [2016-09-13T06:42:49.939681 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77502], Delivering... [----] I, [2016-09-13T06:42:49.944163 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77502], State: [ok], Delivered in [0.004471534] seconds [----] I, [2016-09-13T06:42:49.945783 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77503], State: [ok], Delivered in [0.068300733] seconds [----] I, [2016-09-13T06:42:49.962326 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77504], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.994700761] seconds [----] I, [2016-09-13T06:42:49.962493 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77504], Delivering... [----] I, [2016-09-13T06:42:49.965150 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77504], State: [ok], Delivered in [0.00265138] seconds [----] I, [2016-09-13T06:42:54.096380 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:42:54 UTC]... [----] I, [2016-09-13T06:42:54.116737 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:42:54 UTC]...Complete [----] I, [2016-09-13T06:42:58.018982 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:42:58.036697 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77506], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:42:59.148567 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T06:42:59.154722 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:43:00.036884 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77506], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.012216421] seconds [----] I, [2016-09-13T06:43:00.037106 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77506], Delivering... [----] I, [2016-09-13T06:43:00.043479 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033216476440429688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033407211303710938, :pending_vm_jobs=>0.0008399486541748047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005974769592285156} [----] I, [2016-09-13T06:43:00.043858 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77506], State: [ok], Delivered in [0.006754882] seconds [----] I, [2016-09-13T06:43:05.642342 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005837678909301758, :worker_monitor=>1.4653208255767822, :worker_dequeue=>0.009289979934692383, :total_time=>1.4808180332183838} [----] I, [2016-09-13T06:43:13.047263 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:43:13.059620 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77507], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:43:13.075738 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77508], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:43:15.668644 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:43:16.162333 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77508], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.097364488] seconds [----] I, [2016-09-13T06:43:16.162549 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77508], Delivering... [----] I, [2016-09-13T06:43:16.168900 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003346681594848633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003365039825439453, :pending_vm_jobs=>0.0008096694946289062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005988121032714844} [----] I, [2016-09-13T06:43:16.169232 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77508], State: [ok], Delivered in [0.006675381] seconds [----] I, [2016-09-13T06:43:17.054361 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77507], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.003347276] seconds [----] I, [2016-09-13T06:43:17.054576 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77507], Delivering... [----] I, [2016-09-13T06:43:17.059236 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77507], State: [ok], Delivered in [0.004651405] seconds [----] I, [2016-09-13T06:43:22.165129 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0061168670654296875, :worker_monitor=>1.471947193145752, :worker_dequeue=>0.011053323745727539, :total_time=>1.4895336627960205} [----] I, [2016-09-13T06:43:27.165599 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:43:27 UTC]... [----] I, [2016-09-13T06:43:27.185391 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:43:27 UTC]...Complete [----] I, [2016-09-13T06:43:28.085741 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:43:28.100851 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77509], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:43:28.110204 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77510], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:43:28.121632 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77511], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:43:32.304333 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:43:33.270389 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77509], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.180049361] seconds [----] I, [2016-09-13T06:43:33.270602 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77509], Delivering... [----] I, [2016-09-13T06:43:33.271782 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T06:43:33.271983 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5349568512 [----] I, [2016-09-13T06:43:33.272095 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5128355840 [----] I, [2016-09-13T06:43:33.272179 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 221212672 [----] I, [2016-09-13T06:43:33.272251 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T06:43:33.272324 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5074345984 [----] I, [2016-09-13T06:43:33.272395 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T06:43:33.272505 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T06:43:33.272585 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 542285824 [----] I, [2016-09-13T06:43:33.272654 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T06:43:33.272723 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7967948800 [----] I, [2016-09-13T06:43:33.272804 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T06:43:33.272875 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T06:43:33.272982 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T06:43:33.273080 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T06:43:33.273158 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T06:43:33.273230 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T06:43:33.273301 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T06:43:33.273373 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T06:43:33.273471 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T06:43:33.273557 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T06:43:33.273631 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273276928 [----] I, [2016-09-13T06:43:33.273698 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56586240 [----] I, [2016-09-13T06:43:33.273774 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216690688 [----] I, [2016-09-13T06:43:33.273854 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T06:43:33.273923 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141148160 [----] I, [2016-09-13T06:43:33.273990 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2593718272 [----] I, [2016-09-13T06:43:33.274086 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2277658624 [----] I, [2016-09-13T06:43:33.274165 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T06:43:33.274233 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T06:43:33.274301 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T06:43:33.274389 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37474304 [----] I, [2016-09-13T06:43:33.274499 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102273024 [----] I, [2016-09-13T06:43:33.274584 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53260288 [----] I, [2016-09-13T06:43:33.274661 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110604288 [----] I, [2016-09-13T06:43:33.274738 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155533312 [----] I, [2016-09-13T06:43:33.274804 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T06:43:33.274872 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T06:43:33.274949 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T06:43:33.275042 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T06:43:33.275118 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T06:43:33.275185 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T06:43:33.275254 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T06:43:33.275325 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T06:43:33.275387 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T06:43:33.306458 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77511], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.191041667] seconds [----] I, [2016-09-13T06:43:33.306642 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77511], Delivering... [----] I, [2016-09-13T06:43:33.309354 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T06:43:33.309572 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T06:43:33.313099 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034339427947998047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034542083740234375, :pending_vm_jobs=>0.0008358955383300781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006094455718994141} [----] I, [2016-09-13T06:43:33.313393 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T06:43:33.313446 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77511], State: [ok], Delivered in [0.00678189] seconds [----] I, [2016-09-13T06:43:33.316249 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T06:43:33.319582 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T06:43:33.322883 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T06:43:33.326180 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T06:43:33.329299 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 843 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T06:43:33.332166 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T06:43:33.334985 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T06:43:33.337952 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T06:43:33.341035 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T06:43:33.343882 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T06:43:33.346814 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T06:43:33.349369 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:43:33.349535 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:43:33.349652 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T06:43:33.353793 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [201832.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T06:43:33.354161 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77509], State: [ok], Delivered in [0.08354077] seconds [----] I, [2016-09-13T06:43:38.466344 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:43:38.472860 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003922462463378906, :worker_monitor=>1.1460483074188232, :worker_dequeue=>0.011435508728027344, :total_time=>1.1617190837860107} [----] I, [2016-09-13T06:43:39.378953 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77510], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [11.273986834] seconds [----] I, [2016-09-13T06:43:39.379108 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77510], Delivering... [----] I, [2016-09-13T06:43:39.384725 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:43:28 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [237964.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T06:43:39.385180 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:43:33 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [103807.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T06:43:39.385524 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:43:29 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48546.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T06:43:39.385884 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:43:37 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162417000], Memory % [3.1], CPU Time [37673.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T06:43:39.386237 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:43:38 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [150390.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:43:39.386601 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:43:38 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [201842.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T06:43:39.386918 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:43:37 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [149504.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:43:39.387256 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:43:36 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [51123.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:43:39.389060 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:43:34 UTC], Process Info: Memory Usage [557506560], Memory Size [894828544], Proportional Set Size: [405255000], Memory % [6.8], CPU Time [5220.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T06:43:39.389412 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:43:38 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [207524.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T06:43:39.389755 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:43:36 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51110.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:43:39.390065 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:43:37 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38568.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T06:43:39.391509 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:43:38 UTC], Process Info: Memory Usage [603205632], Memory Size [1060630528], Proportional Set Size: [438096000], Memory % [7.35], CPU Time [1193.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:43:39.392837 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:43:31 UTC], Process Info: Memory Usage [591470592], Memory Size [919052288], Proportional Set Size: [426525000], Memory % [7.21], CPU Time [448.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:43:39.394227 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:43:37 UTC], Process Info: Memory Usage [580808704], Memory Size [909852672], Proportional Set Size: [420300000], Memory % [7.08], CPU Time [1820.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T06:43:39.394532 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77510], State: [ok], Delivered in [0.015401128] seconds [----] I, [2016-09-13T06:43:43.133269 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:43:43.150487 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77512], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:43:43.163181 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77513], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:43:43.179314 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77514], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:43:43.207760 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77515], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:43:43.482741 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:43:44.099599 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77513], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.944697232] seconds [----] I, [2016-09-13T06:43:44.099842 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77513], Delivering... [----] I, [2016-09-13T06:43:44.150957 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77515], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.958862898] seconds [----] I, [2016-09-13T06:43:44.151161 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77515], Delivering... [----] I, [2016-09-13T06:43:44.157810 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003495931625366211, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003537893295288086, :pending_vm_jobs=>0.0008366107940673828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006295919418334961} [----] I, [2016-09-13T06:43:44.158341 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77515], State: [ok], Delivered in [0.007154502] seconds [----] I, [2016-09-13T06:43:44.196352 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77512], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.058299581] seconds [----] I, [2016-09-13T06:43:44.196560 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77512], Delivering... [----] I, [2016-09-13T06:43:44.201020 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77512], State: [ok], Delivered in [0.004429548] seconds [----] I, [2016-09-13T06:43:44.201973 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77513], State: [ok], Delivered in [0.102100355] seconds [----] I, [2016-09-13T06:43:44.225121 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77514], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.055672199] seconds [----] I, [2016-09-13T06:43:44.225369 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77514], Delivering... [----] I, [2016-09-13T06:43:44.229801 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77514], State: [ok], Delivered in [0.004398499] seconds [----] I, [2016-09-13T06:43:54.683862 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007213592529296875, :worker_monitor=>1.1649620532989502, :worker_dequeue=>0.005987882614135742, :total_time=>1.1785552501678467} [----] I, [2016-09-13T06:43:58.219679 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:43:58.259115 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77516], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:43:59.684473 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:43:59 UTC]... [----] I, [2016-09-13T06:43:59.706018 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:43:59 UTC]...Complete [----] I, [2016-09-13T06:43:59.717942 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:44:00.568086 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77516], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.343733816] seconds [----] I, [2016-09-13T06:44:00.568296 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77516], Delivering... [----] I, [2016-09-13T06:44:00.576218 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003845691680908203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003868579864501953, :pending_vm_jobs=>0.0011115074157714844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007375240325927734} [----] I, [2016-09-13T06:44:00.576634 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77516], State: [ok], Delivered in [0.008332705] seconds [----] I, [2016-09-13T06:44:11.169204 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004365444183349609, :worker_monitor=>1.413205623626709, :worker_dequeue=>0.010297775268554688, :total_time=>1.4282917976379395} [----] I, [2016-09-13T06:44:13.269844 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:44:13.287780 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77517], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:44:13.299101 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77518], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:44:16.179014 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:44:16.688331 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77518], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.394445754] seconds [----] I, [2016-09-13T06:44:16.688599 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77518], Delivering... [----] I, [2016-09-13T06:44:16.695790 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003834962844848633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038597583770751953, :pending_vm_jobs=>0.0009090900421142578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006738185882568359} [----] I, [2016-09-13T06:44:16.696209 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77518], State: [ok], Delivered in [0.007615185] seconds [----] I, [2016-09-13T06:44:17.339823 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77517], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.065308981] seconds [----] I, [2016-09-13T06:44:17.340147 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77517], Delivering... [----] I, [2016-09-13T06:44:17.349412 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77517], State: [ok], Delivered in [0.009256404] seconds [----] I, [2016-09-13T06:44:27.645500 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005428314208984375, :worker_monitor=>1.4321751594543457, :worker_dequeue=>0.006575107574462891, :total_time=>1.4445395469665527} [----] I, [2016-09-13T06:44:28.313087 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:44:28.334543 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77519], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:44:32.646104 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:44:32 UTC]... [----] I, [2016-09-13T06:44:32.670970 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:44:32 UTC]...Complete [----] I, [2016-09-13T06:44:32.786776 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:44:32.865216 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77519], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.543136768] seconds [----] I, [2016-09-13T06:44:32.865364 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77519], Delivering... [----] I, [2016-09-13T06:44:32.871634 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033659934997558594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003403186798095703, :pending_vm_jobs=>0.0009412765502929688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005941867828369141} [----] I, [2016-09-13T06:44:32.872060 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77519], State: [ok], Delivered in [0.006651585] seconds [----] I, [2016-09-13T06:44:43.395399 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:44:43.414135 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77520], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:44:43.443440 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77521], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:44:43.470823 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77522], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:44:43.493330 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77523], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:44:44.310714 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:44:44.314875 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0056896209716796875, :worker_monitor=>1.4855124950408936, :worker_dequeue=>0.007687807083129883, :total_time=>1.4992117881774902} [----] I, [2016-09-13T06:44:44.402532 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77521], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.983824958] seconds [----] I, [2016-09-13T06:44:44.402671 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77521], Delivering... [----] I, [2016-09-13T06:44:44.448566 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77523], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.970893155] seconds [----] I, [2016-09-13T06:44:44.448746 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77523], Delivering... [----] I, [2016-09-13T06:44:44.455917 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00368499755859375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003755807876586914, :pending_vm_jobs=>0.0009267330169677734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00677037239074707} [----] I, [2016-09-13T06:44:44.456366 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77523], State: [ok], Delivered in [0.007604679] seconds [----] I, [2016-09-13T06:44:44.465405 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77521], State: [ok], Delivered in [0.06268345] seconds [----] I, [2016-09-13T06:44:44.517209 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77520], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.118273872] seconds [----] I, [2016-09-13T06:44:44.517394 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77520], Delivering... [----] I, [2016-09-13T06:44:44.522230 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77520], State: [ok], Delivered in [0.004816059] seconds [----] I, [2016-09-13T06:44:44.534657 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77522], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.086010106] seconds [----] I, [2016-09-13T06:44:44.534881 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77522], Delivering... [----] I, [2016-09-13T06:44:44.539652 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77522], State: [ok], Delivered in [0.004724713] seconds [----] I, [2016-09-13T06:44:58.504455 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:44:58.529668 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77524], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:45:00.657810 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:45:00.663441 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003137826919555664, :worker_monitor=>1.304469347000122, :worker_dequeue=>0.010183334350585938, :total_time=>1.3180665969848633} [----] I, [2016-09-13T06:45:01.094983 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77524], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.582994148] seconds [----] I, [2016-09-13T06:45:01.095128 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77524], Delivering... [----] I, [2016-09-13T06:45:01.099006 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020303726196289062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002042531967163086, :pending_vm_jobs=>0.0005359649658203125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0036153793334960938} [----] I, [2016-09-13T06:45:01.099227 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77524], State: [ok], Delivered in [0.004101379] seconds [----] I, [2016-09-13T06:45:05.663957 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:45:05 UTC]... [----] I, [2016-09-13T06:45:05.684629 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:45:05 UTC]...Complete [----] I, [2016-09-13T06:45:13.959668 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:45:14.009158 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77525], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:45:14.032467 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77526], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:45:16.953111 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:45:16.961446 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025179386138916016, :worker_monitor=>1.2231454849243164, :worker_dequeue=>0.012363433837890625, :total_time=>1.2382328510284424} [----] I, [2016-09-13T06:45:17.188114 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77526], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.173795312] seconds [----] I, [2016-09-13T06:45:17.188311 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77526], Delivering... [----] I, [2016-09-13T06:45:17.196145 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035746097564697266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035910606384277344, :pending_vm_jobs=>0.0007865428924560547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007322788238525391} [----] I, [2016-09-13T06:45:17.196614 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77526], State: [ok], Delivered in [0.008275005] seconds [----] I, [2016-09-13T06:45:17.655712 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77525], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.661316093] seconds [----] I, [2016-09-13T06:45:17.655939 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77525], Delivering... [----] I, [2016-09-13T06:45:17.661746 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77525], State: [ok], Delivered in [0.005788912] seconds [----] I, [2016-09-13T06:45:29.046603 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:45:29.072296 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77527], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:45:33.523520 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:45:33.530125 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003762483596801758, :worker_monitor=>1.5222492218017578, :worker_dequeue=>0.012228965759277344, :total_time=>1.538581132888794} [----] I, [2016-09-13T06:45:34.324332 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77527], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.271442175] seconds [----] I, [2016-09-13T06:45:34.324579 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77527], Delivering... [----] I, [2016-09-13T06:45:34.328298 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0019452571868896484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002020120620727539, :pending_vm_jobs=>0.00039839744567871094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0032906532287597656} [----] I, [2016-09-13T06:45:34.328531 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77527], State: [ok], Delivered in [0.003982988] seconds [----] I, [2016-09-13T06:45:38.530734 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:45:38 UTC]... [----] I, [2016-09-13T06:45:38.552550 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:45:38 UTC]...Complete [----] I, [2016-09-13T06:45:44.083906 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:45:44.101147 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77528], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:45:44.112272 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77529], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:45:44.129800 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77530], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:45:44.146718 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77531], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:45:50.015004 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:45:50.018783 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003767251968383789, :worker_monitor=>1.2916302680969238, :worker_dequeue=>0.00693202018737793, :total_time=>1.3025894165039062} [----] I, [2016-09-13T06:45:50.467395 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77530], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.34938623] seconds [----] I, [2016-09-13T06:45:50.467670 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77530], Delivering... [----] I, [2016-09-13T06:45:50.473842 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77531], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.337467952] seconds [----] I, [2016-09-13T06:45:50.474048 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77531], Delivering... [----] I, [2016-09-13T06:45:50.479183 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026619434356689453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026824474334716797, :pending_vm_jobs=>0.0006482601165771484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0048067569732666016} [----] I, [2016-09-13T06:45:50.479501 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77531], State: [ok], Delivered in [0.005496509] seconds [----] I, [2016-09-13T06:45:50.541165 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77530], State: [ok], Delivered in [0.073483117] seconds [----] I, [2016-09-13T06:45:50.792921 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77529], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.687579895] seconds [----] I, [2016-09-13T06:45:50.793102 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77529], Delivering... [----] I, [2016-09-13T06:45:50.798586 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77528], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.710142672] seconds [----] I, [2016-09-13T06:45:50.798799 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77528], Delivering... [----] I, [2016-09-13T06:45:50.801883 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77529], State: [ok], Delivered in [0.008743053] seconds [----] I, [2016-09-13T06:45:50.804073 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77528], State: [ok], Delivered in [0.005269848] seconds [----] I, [2016-09-13T06:45:59.157189 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:45:59.181523 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77532], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:46:00.043212 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:46:00.564278 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77532], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.401294574] seconds [----] I, [2016-09-13T06:46:00.564393 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77532], Delivering... [----] I, [2016-09-13T06:46:00.568219 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0019898414611816406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020029544830322266, :pending_vm_jobs=>0.00046825408935546875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0036008358001708984} [----] I, [2016-09-13T06:46:00.568468 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77532], State: [ok], Delivered in [0.004064588] seconds [----] I, [2016-09-13T06:46:06.304007 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003347158432006836, :worker_monitor=>1.2416799068450928, :worker_dequeue=>0.006147146224975586, :total_time=>1.2514078617095947} [----] I, [2016-09-13T06:46:11.304598 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:46:11 UTC]... [----] I, [2016-09-13T06:46:11.324691 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:46:11 UTC]...Complete [----] I, [2016-09-13T06:46:14.192181 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:46:14.208401 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77533], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:46:14.225749 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77534], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:46:16.348202 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:46:16.740924 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77534], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.528510789] seconds [----] I, [2016-09-13T06:46:16.741214 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77534], Delivering... [----] I, [2016-09-13T06:46:16.752153 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005293607711791992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005322694778442383, :pending_vm_jobs=>0.0017287731170654297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010358572006225586} [----] I, [2016-09-13T06:46:16.752675 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77534], State: [ok], Delivered in [0.011461625] seconds [----] I, [2016-09-13T06:46:17.930698 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77533], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.734908121] seconds [----] I, [2016-09-13T06:46:17.930896 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77533], Delivering... [----] I, [2016-09-13T06:46:17.935647 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77533], State: [ok], Delivered in [0.004724012] seconds [----] I, [2016-09-13T06:46:22.827087 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005542278289794922, :worker_monitor=>1.4513919353485107, :worker_dequeue=>0.01476287841796875, :total_time=>1.4721643924713135} [----] I, [2016-09-13T06:46:29.234720 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:46:29.254354 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77535], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:46:32.852852 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:46:32.923550 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77535], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.683024639] seconds [----] I, [2016-09-13T06:46:32.923866 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77535], Delivering... [----] I, [2016-09-13T06:46:32.931753 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004506111145019531, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004527091979980469, :pending_vm_jobs=>0.0009107589721679688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00741124153137207} [----] I, [2016-09-13T06:46:32.932121 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77535], State: [ok], Delivered in [0.008273046] seconds [----] I, [2016-09-13T06:46:39.253885 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003912925720214844, :worker_monitor=>1.3818089962005615, :worker_dequeue=>0.0072438716888427734, :total_time=>1.3932301998138428} [----] I, [2016-09-13T06:46:44.254365 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:46:44 UTC]... [----] I, [2016-09-13T06:46:44.263373 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:46:44.305978 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:46:44 UTC]...Complete [----] I, [2016-09-13T06:46:44.334633 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77536], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:46:44.420470 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77537], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:46:44.446286 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:46:44.460266 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77538], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:46:44.500331 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77539], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:46:44.946730 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77537], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.608450932] seconds [----] I, [2016-09-13T06:46:44.946975 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77537], Delivering... [----] I, [2016-09-13T06:46:45.016175 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77536], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.749936107] seconds [----] I, [2016-09-13T06:46:45.016370 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77536], Delivering... [----] I, [2016-09-13T06:46:45.021408 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77536], State: [ok], Delivered in [0.005016244] seconds [----] I, [2016-09-13T06:46:45.068136 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77537], State: [ok], Delivered in [0.121131173] seconds [----] I, [2016-09-13T06:46:49.461370 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:46:50.136939 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77539], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.664570477] seconds [----] I, [2016-09-13T06:46:50.137232 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77539], Delivering... [----] I, [2016-09-13T06:46:50.147806 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005220651626586914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0052530765533447266, :pending_vm_jobs=>0.00147247314453125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010031461715698242} [----] I, [2016-09-13T06:46:50.148323 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77539], State: [ok], Delivered in [0.01108757] seconds [----] I, [2016-09-13T06:46:51.085004 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77538], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.655706568] seconds [----] I, [2016-09-13T06:46:51.085209 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77538], Delivering... [----] I, [2016-09-13T06:46:51.088469 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77538], State: [ok], Delivered in [0.003217513] seconds [----] I, [2016-09-13T06:46:55.917590 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004033803939819336, :worker_monitor=>1.4378068447113037, :worker_dequeue=>0.007637500762939453, :total_time=>1.4497535228729248} [----] I, [2016-09-13T06:46:59.515258 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:46:59.554996 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77540], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:47:00.928670 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:47:01.251029 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77540], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.725074504] seconds [----] I, [2016-09-13T06:47:01.251252 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77540], Delivering... [----] I, [2016-09-13T06:47:01.257854 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035588741302490234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035772323608398438, :pending_vm_jobs=>0.0007860660552978516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006204366683959961} [----] I, [2016-09-13T06:47:01.258203 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77540], State: [ok], Delivered in [0.006951611] seconds [----] I, [2016-09-13T06:47:12.619279 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005333900451660156, :worker_monitor=>1.6521012783050537, :worker_dequeue=>0.010933876037597656, :total_time=>1.6687321662902832} [----] I, [2016-09-13T06:47:14.567179 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:47:14.582096 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77541], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:47:14.593480 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77542], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:47:17.619764 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:47:17 UTC]... [----] I, [2016-09-13T06:47:17.634231 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:47:17 UTC]...Complete [----] I, [2016-09-13T06:47:17.639538 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:47:18.215362 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77542], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.627465992] seconds [----] I, [2016-09-13T06:47:18.215586 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77542], Delivering... [----] I, [2016-09-13T06:47:18.222014 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033550262451171875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003373384475708008, :pending_vm_jobs=>0.0007753372192382812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060272216796875} [----] I, [2016-09-13T06:47:18.222348 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77542], State: [ok], Delivered in [0.006760863] seconds [----] I, [2016-09-13T06:47:18.255529 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77541], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.683568501] seconds [----] I, [2016-09-13T06:47:18.255726 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77541], Delivering... [----] I, [2016-09-13T06:47:18.260828 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77541], State: [ok], Delivered in [0.005083291] seconds [----] I, [2016-09-13T06:47:28.933567 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038313865661621094, :worker_monitor=>1.263770341873169, :worker_dequeue=>0.00684666633605957, :total_time=>1.2747161388397217} [----] I, [2016-09-13T06:47:29.605052 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:47:29.620917 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77543], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:47:33.945949 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:47:34.472637 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77543], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.862626659] seconds [----] I, [2016-09-13T06:47:34.472823 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77543], Delivering... [----] I, [2016-09-13T06:47:34.479506 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003564596176147461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035843849182128906, :pending_vm_jobs=>0.0007786750793457031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062868595123291016} [----] I, [2016-09-13T06:47:34.479843 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77543], State: [ok], Delivered in [0.00701424] seconds [----] I, [2016-09-13T06:47:44.630584 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:47:44.637741 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77544], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:47:44.651375 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77545], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:47:44.672464 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77546], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:47:44.701100 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77547], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:47:45.234518 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:47:45.240223 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040264129638671875, :worker_monitor=>1.2602977752685547, :worker_dequeue=>0.010127544403076172, :total_time=>1.2748234272003174} [----] I, [2016-09-13T06:47:45.318667 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77545], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.677973039] seconds [----] I, [2016-09-13T06:47:45.318897 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77545], Delivering... [----] I, [2016-09-13T06:47:45.340844 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77547], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.661742356] seconds [----] I, [2016-09-13T06:47:45.341004 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77547], Delivering... [----] I, [2016-09-13T06:47:45.345518 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023353099822998047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024802684783935547, :pending_vm_jobs=>0.0005490779876708984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004239320755004883} [----] I, [2016-09-13T06:47:45.345780 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77547], State: [ok], Delivered in [0.004782462] seconds [----] I, [2016-09-13T06:47:45.392814 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77545], State: [ok], Delivered in [0.073916087] seconds [----] I, [2016-09-13T06:47:45.410822 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77544], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.776842024] seconds [----] I, [2016-09-13T06:47:45.411015 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77544], Delivering... [----] I, [2016-09-13T06:47:45.415503 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77544], State: [ok], Delivered in [0.004495222] seconds [----] I, [2016-09-13T06:47:45.449520 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77546], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.794345586] seconds [----] I, [2016-09-13T06:47:45.449638 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77546], Delivering... [----] I, [2016-09-13T06:47:45.452027 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77546], State: [ok], Delivered in [0.002358388] seconds [----] I, [2016-09-13T06:47:50.240731 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:47:50 UTC]... [----] I, [2016-09-13T06:47:50.312684 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:47:50 UTC]...Complete [----] I, [2016-09-13T06:47:59.714114 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:47:59.732703 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77548], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:48:00.482547 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T06:48:01.776443 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:48:01.780172 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004029512405395508, :log_active_servers=>0.011819839477539062, :worker_monitor=>1.2906584739685059, :worker_dequeue=>0.0066645145416259766, :total_time=>1.3136000633239746} [----] I, [2016-09-13T06:48:02.691833 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77548], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.97178816] seconds [----] I, [2016-09-13T06:48:02.692009 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77548], Delivering... [----] I, [2016-09-13T06:48:02.697033 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027153491973876953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027303695678710938, :pending_vm_jobs=>0.0006110668182373047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004699230194091797} [----] I, [2016-09-13T06:48:02.697356 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77548], State: [ok], Delivered in [0.005359253] seconds [----] I, [2016-09-13T06:48:14.743612 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:48:14.783295 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77549], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:48:14.800793 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77550], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:48:17.900385 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:48:17.906654 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037796497344970703, :worker_monitor=>1.079756259918213, :worker_dequeue=>0.011171817779541016, :total_time=>1.0949814319610596} [----] I, [2016-09-13T06:48:18.554942 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77550], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.767437903] seconds [----] I, [2016-09-13T06:48:18.555189 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77550], Delivering... [----] I, [2016-09-13T06:48:18.560840 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77549], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.813725231] seconds [----] I, [2016-09-13T06:48:18.561116 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77549], Delivering... [----] I, [2016-09-13T06:48:18.561862 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034961700439453125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003517627716064453, :pending_vm_jobs=>0.0008337497711181641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062580108642578125} [----] I, [2016-09-13T06:48:18.562202 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77550], State: [ok], Delivered in [0.007016716] seconds [----] I, [2016-09-13T06:48:18.566665 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77549], State: [ok], Delivered in [0.005558441] seconds [----] I, [2016-09-13T06:48:22.907121 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:48:22 UTC]... [----] I, [2016-09-13T06:48:22.920501 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:48:22 UTC]...Complete [----] I, [2016-09-13T06:48:29.811335 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:48:29.823159 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77551], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:48:29.834466 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77552], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:48:29.845886 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77553], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:48:34.254355 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:48:34.264712 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002855062484741211, :worker_monitor=>1.2854743003845215, :worker_dequeue=>0.018453121185302734, :total_time=>1.3070788383483887} [----] I, [2016-09-13T06:48:34.909720 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77551], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.095249649] seconds [----] I, [2016-09-13T06:48:34.909962 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77551], Delivering... [----] I, [2016-09-13T06:48:34.911587 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T06:48:34.911791 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5338824704 [----] I, [2016-09-13T06:48:34.911883 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5117431808 [----] I, [2016-09-13T06:48:34.911955 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 221392896 [----] I, [2016-09-13T06:48:34.912050 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T06:48:34.912124 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5063430144 [----] I, [2016-09-13T06:48:34.912191 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T06:48:34.912267 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T06:48:34.912332 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 542466048 [----] I, [2016-09-13T06:48:34.912406 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T06:48:34.912518 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7858774016 [----] I, [2016-09-13T06:48:34.912589 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T06:48:34.912658 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T06:48:34.912722 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T06:48:34.912787 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T06:48:34.912851 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T06:48:34.912914 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T06:48:34.912993 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T06:48:34.913067 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T06:48:34.913133 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T06:48:34.913202 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T06:48:34.913270 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273276928 [----] I, [2016-09-13T06:48:34.913339 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56586240 [----] I, [2016-09-13T06:48:34.913403 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216690688 [----] I, [2016-09-13T06:48:34.913517 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T06:48:34.913604 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141148160 [----] I, [2016-09-13T06:48:34.913675 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2605088768 [----] I, [2016-09-13T06:48:34.913744 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2288848896 [----] I, [2016-09-13T06:48:34.913810 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T06:48:34.913879 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T06:48:34.913943 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T06:48:34.914035 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37257216 [----] I, [2016-09-13T06:48:34.914153 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102273024 [----] I, [2016-09-13T06:48:34.914232 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53141504 [----] I, [2016-09-13T06:48:34.914351 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110604288 [----] I, [2016-09-13T06:48:34.914491 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155414528 [----] I, [2016-09-13T06:48:34.914575 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T06:48:34.914642 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T06:48:34.914708 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T06:48:34.914774 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T06:48:34.914839 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T06:48:34.914902 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T06:48:34.914965 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T06:48:34.915052 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T06:48:34.915047 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77552], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.088934985] seconds [----] I, [2016-09-13T06:48:34.915121 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T06:48:34.915192 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77552], Delivering... [----] I, [2016-09-13T06:48:34.923253 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:48:29 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [238122.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T06:48:34.923765 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:48:33 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [103821.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T06:48:34.924270 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:48:33 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [149551.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:48:34.924762 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:48:31 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162417000], Memory % [3.1], CPU Time [37682.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T06:48:34.925231 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:48:33 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [150446.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:48:34.925713 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:48:33 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [201880.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T06:48:34.926178 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:48:31 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [51138.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:48:34.926569 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:48:29 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48554.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T06:48:34.929196 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:48:32 UTC], Process Info: Memory Usage [591470592], Memory Size [919052288], Proportional Set Size: [426525000], Memory % [7.21], CPU Time [458.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:48:34.931035 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:48:28 UTC], Process Info: Memory Usage [591515648], Memory Size [920719360], Proportional Set Size: [426680000], Memory % [7.21], CPU Time [1254.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:48:34.933538 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:48:25 UTC], Process Info: Memory Usage [557776896], Memory Size [910032896], Proportional Set Size: [405487000], Memory % [6.8], CPU Time [5230.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T06:48:34.935560 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:48:27 UTC], Process Info: Memory Usage [581029888], Memory Size [924008448], Proportional Set Size: [420516000], Memory % [7.08], CPU Time [1831.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T06:48:34.936097 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:48:33 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [207570.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T06:48:34.936591 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:48:31 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51125.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:48:34.937073 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:48:25 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38577.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T06:48:34.937399 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77552], State: [ok], Delivered in [0.022192456] seconds [----] I, [2016-09-13T06:48:34.954357 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T06:48:34.954546 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T06:48:34.957757 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T06:48:34.959939 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T06:48:34.962657 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T06:48:34.965223 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T06:48:34.967798 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T06:48:34.970342 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 843 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T06:48:34.972893 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T06:48:34.976657 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T06:48:34.981199 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T06:48:34.985764 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T06:48:34.990438 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T06:48:34.992940 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77553], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.154799647] seconds [----] I, [2016-09-13T06:48:34.993121 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77553], Delivering... [----] I, [2016-09-13T06:48:34.994962 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T06:48:34.998388 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1, "smartstate"=>1}} [----] I, [2016-09-13T06:48:34.998604 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:48:34.998755 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T06:48:34.999589 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003422260284423828, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003440380096435547, :pending_vm_jobs=>0.0008537769317626953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006127119064331055} [----] I, [2016-09-13T06:48:34.999954 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77553], State: [ok], Delivered in [0.006818349] seconds [----] I, [2016-09-13T06:48:35.004565 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [201870.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T06:48:35.005054 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77551], State: [ok], Delivered in [0.095057929] seconds [----] I, [2016-09-13T06:48:44.854716 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:48:44.872646 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77554], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:48:44.886210 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77555], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:48:44.897724 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77556], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:48:44.926288 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77557], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:48:50.623717 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:48:50.630274 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038025379180908203, :worker_monitor=>1.3188438415527344, :worker_dequeue=>0.011690616607666016, :total_time=>1.3347949981689453} [----] I, [2016-09-13T06:48:51.158736 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77555], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.282260539] seconds [----] I, [2016-09-13T06:48:51.158930 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77555], Delivering... [----] I, [2016-09-13T06:48:51.176380 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77557], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.269663071] seconds [----] I, [2016-09-13T06:48:51.176688 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77557], Delivering... [----] I, [2016-09-13T06:48:51.186089 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004889011383056641, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00491642951965332, :pending_vm_jobs=>0.0011379718780517578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008809804916381836} [----] I, [2016-09-13T06:48:51.186757 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77557], State: [ok], Delivered in [0.010070069] seconds [----] I, [2016-09-13T06:48:51.215662 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77555], State: [ok], Delivered in [0.056706474] seconds [----] I, [2016-09-13T06:48:51.695948 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77554], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.836725675] seconds [----] I, [2016-09-13T06:48:51.696152 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77554], Delivering... [----] I, [2016-09-13T06:48:51.700586 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77554], State: [ok], Delivered in [0.004432849] seconds [----] I, [2016-09-13T06:48:51.761268 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77556], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.869893236] seconds [----] I, [2016-09-13T06:48:51.761558 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77556], Delivering... [----] I, [2016-09-13T06:48:51.765635 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77556], State: [ok], Delivered in [0.004078923] seconds [----] I, [2016-09-13T06:48:55.630796 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:48:55 UTC]... [----] I, [2016-09-13T06:48:55.644037 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:48:55 UTC]...Complete [----] I, [2016-09-13T06:48:59.938389 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:48:59.952760 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77558], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:49:00.775598 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:49:00.816118 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77558], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.871869314] seconds [----] I, [2016-09-13T06:49:00.816284 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77558], Delivering... [----] I, [2016-09-13T06:49:00.822553 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003125905990600586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032052993774414062, :pending_vm_jobs=>0.0007951259613037109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058710575103759766} [----] I, [2016-09-13T06:49:00.822861 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77558], State: [ok], Delivered in [0.006566714] seconds [----] I, [2016-09-13T06:49:07.292222 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038738250732421875, :worker_monitor=>1.5000922679901123, :worker_dequeue=>0.005959510803222656, :total_time=>1.5102078914642334} [----] I, [2016-09-13T06:49:14.964141 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 11. [----] I, [2016-09-13T06:49:15.004688 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77559], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:49:15.021492 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77560], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:49:15.032687 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77561], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:49:17.318532 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:49:17.370227 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77561], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.343004665] seconds [----] I, [2016-09-13T06:49:17.370390 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77561], Delivering... [----] I, [2016-09-13T06:49:17.376695 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030193328857421875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030388832092285156, :pending_vm_jobs=>0.0009417533874511719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059375762939453125} [----] I, [2016-09-13T06:49:17.377024 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77561], State: [ok], Delivered in [0.006607108] seconds [----] I, [2016-09-13T06:49:18.804547 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77559], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.82157195] seconds [----] I, [2016-09-13T06:49:18.804716 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77559], Delivering... [----] I, [2016-09-13T06:49:18.839085 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77562], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T06:49:18.856195 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77563], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T06:49:18.856609 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77559], State: [ok], Delivered in [0.051882059] seconds [----] I, [2016-09-13T06:49:18.885164 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77560], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.872759528] seconds [----] I, [2016-09-13T06:49:18.885344 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77560], Delivering... [----] I, [2016-09-13T06:49:18.889607 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77560], State: [ok], Delivered in [0.004255331] seconds [----] I, [2016-09-13T06:49:23.823626 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T06:49:23.826046 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T06:49:23.826241 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004226207733154297, :worker_monitor=>1.4839973449707031, :worker_dequeue=>0.012006998062133789, :total_time=>1.5005161762237549} [----] I, [2016-09-13T06:49:28.826917 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:49:28 UTC]... [----] I, [2016-09-13T06:49:28.850619 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:49:28 UTC]...Complete [----] I, [2016-09-13T06:49:28.867541 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T06:49:28.870154 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T06:49:29.080000 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [77563], MiqWorker id: [98], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [10.234830483] seconds [----] I, [2016-09-13T06:49:29.080244 #3290:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77563], Delivering... [----] I, [2016-09-13T06:49:29.084755 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T06:49:29.084991 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T06:49:29.085156 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T06:49:29.085328 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T06:49:29.085539 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:29.518081 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:29.832119 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:29.832319 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:30.043835 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:49:30.062214 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77564], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:49:30.085136 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77565], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:49:30.302016 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:30.600677 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:30.600875 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:31.106136 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:31.425076 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:31.425261 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:31.905145 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:32.202768 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:32.202952 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:32.428482 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [77562], MiqWorker id: [99], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [13.603457601] seconds [----] I, [2016-09-13T06:49:32.428686 #5369:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77562], Delivering... [----] I, [2016-09-13T06:49:32.432469 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T06:49:32.432641 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T06:49:32.432755 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T06:49:32.432902 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T06:49:32.433068 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:32.675377 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:32.718512 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:32.924965 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:32.925293 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:32.998155 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:32.998450 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:33.474620 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:33.584544 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:33.689243 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:33.788751 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:33.793909 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:33.794163 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:33.879994 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:49:33.931150 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77565], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.863457998] seconds [----] I, [2016-09-13T06:49:33.931351 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77565], Delivering... [----] I, [2016-09-13T06:49:33.938586 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003962039947509766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0039806365966796875, :pending_vm_jobs=>0.0008602142333984375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00681757926940918} [----] I, [2016-09-13T06:49:33.938998 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77565], State: [ok], Delivered in [0.007608764] seconds [----] I, [2016-09-13T06:49:33.954068 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77564], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.899944745] seconds [----] I, [2016-09-13T06:49:33.954239 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77564], Delivering... [----] I, [2016-09-13T06:49:34.082933 #2937:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 10:49:33 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_16' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 10:49:33.884528') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2927,,2016-09-13 10:49:31 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2936,2016-09-13 10:49:33 UTC,2016-09-13 10:49:33 UTC,COMMIT,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2946,2016-09-13 10:49:33 UTC,2016-09-13 10:49:33 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 10:49:33 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 10:49:33 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 10:49:31 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2986,,2016-09-13 10:49:31 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2997,,2016-09-13 10:49:30 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 10:49:15.037945')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3, 3011,,2016-09-13 10:24:24 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1509, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,505929, 3030,,2016-09-13 09:54:17 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3316, 3054,,2016-09-13 10:24:28 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1505, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,505927, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,505926, 3160,,2016-09-13 09:24:16 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5118, 3298,,2016-09-13 10:49:29 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,4, 703,,2016-09-13 10:24:23 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1510, 27056,,2016-09-13 09:54:15 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3319, 28888,,2016-09-13 10:24:31 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1502, 5377,,2016-09-13 10:49:33 UTC,"SELECT ""vms"".* FROM ""vms"" WHERE ""vms"".""type"" IN ('Vm', 'ManageIQ::Providers::CloudManager::Vm', 'ManageIQ::Providers::InfraManager::Vm', 'VmServer', 'ManageIQ::Providers::Azure::CloudManager::Vm', 'ManageIQ::Providers::Google::CloudManager::Vm', 'ManageIQ::Providers::Openstack::CloudManager::Vm', 'ManageIQ::Providers::Vmware::CloudManager::Vm', 'ManageIQ::Providers::Amazon::CloudManager::Vm', 'ManageIQ::Providers::Microsoft::InfraManager::Vm', 'ManageIQ::Providers::Redhat::InfraManager::Vm', 'ManageIQ::Providers::Vmware::InfraManager::Vm', 'VmXen') AND ""vms"".""template"" = $1 AND ""vms"".""uid_ems"" = $2 AND ""vms"".""type"" = $3 LIMIT $4",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 20394,,2016-09-13 10:24:26 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1508, ACTIVITY_STATS_CSV [----] I, [2016-09-13T06:49:34.083306 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77564], State: [ok], Delivered in [0.129053858] seconds [----] I, [2016-09-13T06:49:34.169386 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:34.291715 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:34.293061 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:34.384955 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:34.477185 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:34.569672 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:34.583776 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:34.584024 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:34.664261 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:34.759143 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:34.850710 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:34.942070 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:35.034606 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:35.075091 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:35.129530 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:35.221837 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:35.313594 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:35.387668 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:35.387864 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:35.406786 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:35.499726 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:35.591621 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:35.688577 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T06:49:35.882520 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:35.935964 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T06:49:35.936196 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004004240036010742, :collect_inventory_for_targets=>2.5987625122070312e-05, :parse_legacy_inventory=>12.90321969985962, :parse_targeted_inventory=>12.90330958366394, :save_inventory=>0.7561795711517334, :ems_refresh=>13.661160945892334} [----] I, [2016-09-13T06:49:35.953756 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T06:49:35.954215 #5369:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77562], State: [ok], Delivered in [3.525515549] seconds [----] I, [2016-09-13T06:49:36.177121 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:36.177318 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:36.662559 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:36.968486 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:36.968645 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:37.454792 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:37.749014 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:37.749200 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:38.237635 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:38.539687 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:38.539895 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:39.030623 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:39.331303 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:39.331517 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:39.826332 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:39.993374 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:40.133383 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:40.266265 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:40.404369 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:40.535517 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:40.542558 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00263214111328125, :worker_monitor=>1.6408309936523438, :worker_dequeue=>0.011941909790039062, :total_time=>1.6557011604309082} [----] I, [2016-09-13T06:49:40.674299 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:40.816124 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:40.950071 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:41.088815 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:41.227779 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:41.362370 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:41.500061 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:41.639362 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:41.779003 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:42.136076 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:42.285482 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:42.430952 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:42.572824 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:42.716710 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:42.859264 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:43.034679 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:43.170464 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:43.309320 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:43.445680 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:43.589986 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:43.730993 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:43.880843 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:44.018453 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:44.158012 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:44.296715 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:44.435600 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:44.808519 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:45.098642 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:49:45.142114 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77566], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:49:45.154624 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77567], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:49:45.165149 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77568], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:49:45.181950 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77569], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:49:45.552067 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:49:45.577915 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77567], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.431619747] seconds [----] I, [2016-09-13T06:49:45.578117 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77567], Delivering... [----] I, [2016-09-13T06:49:45.633705 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77567], State: [ok], Delivered in [0.055547289] seconds [----] I, [2016-09-13T06:49:45.656472 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77569], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.482652578] seconds [----] I, [2016-09-13T06:49:45.656628 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77569], Delivering... [----] I, [2016-09-13T06:49:45.662359 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028502941131591797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028696060180664062, :pending_vm_jobs=>0.0007765293121337891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005404472351074219} [----] I, [2016-09-13T06:49:45.662723 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77569], State: [ok], Delivered in [0.006084166] seconds [----] I, [2016-09-13T06:49:46.022279 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77566], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.919095551] seconds [----] I, [2016-09-13T06:49:46.022487 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77566], Delivering... [----] I, [2016-09-13T06:49:46.027294 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77566], State: [ok], Delivered in [0.004832942] seconds [----] I, [2016-09-13T06:49:46.050750 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77568], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.89111642] seconds [----] I, [2016-09-13T06:49:46.050897 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77568], Delivering... [----] I, [2016-09-13T06:49:46.053540 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77568], State: [ok], Delivered in [0.002631958] seconds [----] I, [2016-09-13T06:49:50.984584 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:51.130579 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:51.270305 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:51.414379 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:51.554608 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:51.695601 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:51.842067 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:51.985838 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:52.127678 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:52.276661 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:52.419760 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:52.557080 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:52.699411 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:52.839825 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:52.978407 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:53.117655 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:53.583478 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:53.742663 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:53.882030 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:54.025184 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:54.167660 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:54.342188 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:54.475783 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:54.613272 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:54.753699 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:54.904334 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:55.042655 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:55.183304 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:55.317832 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:55.456737 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:55.601562 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:55.741018 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:55.879177 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:56.265744 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:56.409525 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:56.550242 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:56.690096 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:56.806997 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038132667541503906, :worker_monitor=>1.2110280990600586, :worker_dequeue=>0.007866859436035156, :total_time=>1.2230122089385986} [----] I, [2016-09-13T06:49:56.829966 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:56.964896 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:57.102897 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:57.242132 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:57.380274 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:57.518774 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:57.652263 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:57.798535 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:57.937649 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:58.082360 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:58.224535 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:58.370268 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:58.510126 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:58.819590 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:58.972554 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:59.106660 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:59.249017 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:59.384449 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:59.522809 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:59.696088 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:59.839808 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:49:59.983686 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:00.125235 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:00.193171 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:50:00.228014 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77570], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:50:00.253085 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77571], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:50:00.264323 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:00.281956 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77572], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:50:00.376585 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77573], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:50:00.402409 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:00.405176 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77574], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:50:00.433829 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77575], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:50:00.556190 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:00.695044 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:00.829569 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:00.969850 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:01.113308 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:01.597641 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:01.758904 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:01.807563 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:50:01 UTC]... [----] I, [2016-09-13T06:50:01.824558 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:50:01 UTC]...Complete [----] I, [2016-09-13T06:50:01.954322 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:50:02.664693 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77570], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.465722322] seconds [----] I, [2016-09-13T06:50:02.664854 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77570], Delivering... [----] I, [2016-09-13T06:50:02.668502 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020258426666259766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020389556884765625, :pending_vm_jobs=>0.0004258155822753906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003389120101928711} [----] I, [2016-09-13T06:50:02.668720 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77570], State: [ok], Delivered in [0.003866354] seconds [----] I, [2016-09-13T06:50:04.179613 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77571], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.946558702] seconds [----] I, [2016-09-13T06:50:04.179864 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77571], Delivering... [----] I, [2016-09-13T06:50:04.182944 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77571], State: [ok], Delivered in [0.003056419] seconds [----] I, [2016-09-13T06:50:04.224829 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77572], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.96686109] seconds [----] I, [2016-09-13T06:50:04.224950 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77572], Delivering... [----] I, [2016-09-13T06:50:04.230769 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77572], State: [ok], Delivered in [0.00580172] seconds [----] I, [2016-09-13T06:50:04.253873 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77573], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.96649178] seconds [----] I, [2016-09-13T06:50:04.254115 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77573], Delivering... [----] I, [2016-09-13T06:50:04.261124 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77573], State: [ok], Delivered in [0.006991948] seconds [----] I, [2016-09-13T06:50:04.282118 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77574], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.901363169] seconds [----] I, [2016-09-13T06:50:04.282319 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77574], Delivering... [----] I, [2016-09-13T06:50:04.299338 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77575], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.890152523] seconds [----] I, [2016-09-13T06:50:04.299589 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77575], Delivering... [----] I, [2016-09-13T06:50:04.316845 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77576], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 10:50:04 UTC] [----] I, [2016-09-13T06:50:04.328301 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77577], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 10:50:04 UTC] [----] I, [2016-09-13T06:50:04.339579 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77578], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 10:50:04 UTC] [----] I, [2016-09-13T06:50:04.340025 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77574], State: [ok], Delivered in [0.057702064] seconds [----] I, [2016-09-13T06:50:04.362676 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77579], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 10:50:04 UTC] [----] I, [2016-09-13T06:50:04.363125 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77575], State: [ok], Delivered in [0.063524178] seconds [----] I, [2016-09-13T06:50:06.979361 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:50:07.379900 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77576], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 10:50:04 UTC], Dequeued in: [3.09233378] seconds [----] I, [2016-09-13T06:50:07.380082 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77576], Delivering... [----] I, [2016-09-13T06:50:07.380457 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 10:50:04 UTC]... [----] I, [2016-09-13T06:50:07.383032 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T06:50:07.385217 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 10:50:04 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T06:50:07.385553 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77576], State: [ok], Delivered in [0.005446346] seconds [----] I, [2016-09-13T06:50:07.450532 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77577], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 10:50:04 UTC], Dequeued in: [3.141700973] seconds [----] I, [2016-09-13T06:50:07.450764 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77577], Delivering... [----] I, [2016-09-13T06:50:07.451180 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 10:50:04 UTC]... [----] I, [2016-09-13T06:50:07.455295 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T06:50:07.500270 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77578], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 10:50:04 UTC], Dequeued in: [3.176178621] seconds [----] I, [2016-09-13T06:50:07.500509 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77578], Delivering... [----] I, [2016-09-13T06:50:07.500838 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 10:50:04 UTC]... [----] I, [2016-09-13T06:50:07.504204 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T06:50:07.507026 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 10:50:04 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T06:50:07.507401 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77578], State: [ok], Delivered in [0.00689011] seconds [----] I, [2016-09-13T06:50:07.539834 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77579], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 10:50:04 UTC], Dequeued in: [3.203267067] seconds [----] I, [2016-09-13T06:50:07.540066 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77579], Delivering... [----] I, [2016-09-13T06:50:07.540398 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 10:50:04 UTC]... [----] I, [2016-09-13T06:50:07.543841 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T06:50:07.547660 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 10:50:04 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T06:50:07.548008 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77577], State: [ok], Delivered in [0.097234378] seconds [----] I, [2016-09-13T06:50:07.620905 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 10:50:04 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T06:50:07.621271 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77579], State: [ok], Delivered in [0.081204934] seconds [----] I, [2016-09-13T06:50:07.914241 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:08.070901 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:08.212347 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:08.355528 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:08.500778 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:08.665691 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:08.803868 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:08.949047 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:09.091476 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:09.228911 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:09.369408 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:09.506687 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:09.642652 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:09.782946 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:09.923286 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:10.333629 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:10.499269 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:10.641611 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:10.782162 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:10.920907 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:11.066520 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:11.214867 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:11.357928 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:11.496885 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:11.634086 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:11.774535 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:11.916454 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:12.063854 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:12.203206 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:12.337007 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:12.482606 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:12.619866 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:13.031957 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:13.196463 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:13.331401 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:13.468934 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:13.470332 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003988981246948242, :worker_monitor=>1.4687864780426025, :worker_dequeue=>0.010081052780151367, :total_time=>1.4831128120422363} [----] I, [2016-09-13T06:50:13.605715 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:13.740059 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:13.885352 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:14.034756 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:14.178847 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:14.317760 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:14.462039 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:14.601023 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:14.736729 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:14.874790 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:15.015581 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:15.152629 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:15.289365 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:15.446572 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:50:15.465557 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77580], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:50:15.488212 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77581], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:50:15.751238 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:15.902546 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:16.051238 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:16.186486 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:16.328211 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:16.473907 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:16.611189 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:16.754204 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:16.894835 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:17.033542 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:17.171594 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:17.314943 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:17.455593 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:17.595626 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:17.735828 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:17.875959 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:18.019479 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:18.480440 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:50:18.490505 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:18.644882 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:18.789890 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:18.797230 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77581], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.325501786] seconds [----] I, [2016-09-13T06:50:18.797448 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77581], Delivering... [----] I, [2016-09-13T06:50:18.803878 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003275156021118164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033159255981445312, :pending_vm_jobs=>0.0009217262268066406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006093502044677734} [----] I, [2016-09-13T06:50:18.804223 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77581], State: [ok], Delivered in [0.006783188] seconds [----] I, [2016-09-13T06:50:19.631533 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77580], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.179837487] seconds [----] I, [2016-09-13T06:50:19.631713 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77580], Delivering... [----] I, [2016-09-13T06:50:19.636164 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77580], State: [ok], Delivered in [0.004418843] seconds [----] I, [2016-09-13T06:50:24.944797 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:25.081875 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:25.220517 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:25.361878 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:25.544222 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:25.698657 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:25.849789 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:25.984104 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:26.121701 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:26.265678 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:26.410007 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:26.566610 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:26.703030 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:26.842827 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:27.148224 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:27.300734 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:27.445276 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:27.586918 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:27.730462 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:27.868806 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:28.018493 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:28.159071 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:28.292721 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:28.434212 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:28.574500 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:28.712676 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:28.853343 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:28.994863 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:29.138610 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:29.278528 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:29.423002 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:29.801450 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:29.956436 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:30.091467 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:30.091625 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033769607543945312, :worker_monitor=>1.569556713104248, :worker_dequeue=>0.014297962188720703, :total_time=>1.5874745845794678} [----] I, [2016-09-13T06:50:30.235449 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:30.370888 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:30.496459 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:50:30.507006 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:30.514931 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77582], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:50:30.646583 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:30.788868 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:30.927626 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:31.074453 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:31.213096 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:31.353310 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:31.486604 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:31.622040 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:31.789659 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:31.929782 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:32.064786 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:32.415296 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:32.574759 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:32.707621 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:32.852667 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:32.991552 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:33.141470 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:33.279076 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:33.418581 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:33.564325 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:33.712661 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:33.849806 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:33.991580 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:34.128000 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:34.268696 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:34.412932 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:34.547282 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T06:50:34.688632 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T06:50:34.881485 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T06:50:34.881780 #3290:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T06:50:34.882059 #3290:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T06:50:34.882144 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T06:50:34.882259 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T06:50:34.914677 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T06:50:34.914987 #3290:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [77563], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T06:50:34.915180 #3290:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T06:50:34.915389 #3290:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T06:50:34.915558 #3290:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77563], State: [error], Delivered in [65.835341306] seconds [----] I, [2016-09-13T06:50:35.093024 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:50:35 UTC]... [----] I, [2016-09-13T06:50:35.137672 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:50:35 UTC]...Complete [----] I, [2016-09-13T06:50:35.154088 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:50:35.972583 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77582], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.470116653] seconds [----] I, [2016-09-13T06:50:35.972787 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77582], Delivering... [----] I, [2016-09-13T06:50:35.979777 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034942626953125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035147666931152344, :pending_vm_jobs=>0.0007767677307128906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006433725357055664} [----] I, [2016-09-13T06:50:35.980250 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77582], State: [ok], Delivered in [0.007434769] seconds [----] I, [2016-09-13T06:50:45.527727 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:50:45.549270 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77583], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:50:45.566232 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77584], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:50:45.606591 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77585], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:50:45.629245 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77586], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:50:46.882870 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:50:46.889311 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004852294921875, :worker_monitor=>1.6897609233856201, :worker_dequeue=>0.011467695236206055, :total_time=>1.707617998123169} [----] I, [2016-09-13T06:50:47.075022 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77584], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.521679585] seconds [----] I, [2016-09-13T06:50:47.075190 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77584], Delivering... [----] I, [2016-09-13T06:50:47.081830 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77586], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.465669506] seconds [----] I, [2016-09-13T06:50:47.082036 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77586], Delivering... [----] I, [2016-09-13T06:50:47.087745 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003111600875854492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031273365020751953, :pending_vm_jobs=>0.0006532669067382812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005372047424316406} [----] I, [2016-09-13T06:50:47.088099 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77586], State: [ok], Delivered in [0.006080753] seconds [----] I, [2016-09-13T06:50:47.120520 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77584], State: [ok], Delivered in [0.045306273] seconds [----] I, [2016-09-13T06:50:49.749494 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77583], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.215716326] seconds [----] I, [2016-09-13T06:50:49.749733 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77583], Delivering... [----] I, [2016-09-13T06:50:49.754564 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77583], State: [ok], Delivered in [0.004861682] seconds [----] I, [2016-09-13T06:50:49.772335 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77585], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.200644006] seconds [----] I, [2016-09-13T06:50:49.772550 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77585], Delivering... [----] I, [2016-09-13T06:50:49.775906 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77585], State: [ok], Delivered in [0.003354758] seconds [----] I, [2016-09-13T06:51:00.640889 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:51:00.659144 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77587], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:51:03.306675 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:51:03.313003 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004713296890258789, :server_monitor=>0.12666773796081543, :worker_monitor=>1.249769926071167, :worker_dequeue=>0.011129617691040039, :total_time=>1.3926806449890137} [----] I, [2016-09-13T06:51:04.229532 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77587], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.582805022] seconds [----] I, [2016-09-13T06:51:04.229725 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77587], Delivering... [----] I, [2016-09-13T06:51:04.235852 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031528472900390625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003172636032104492, :pending_vm_jobs=>0.0007798671722412109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005747795104980469} [----] I, [2016-09-13T06:51:04.236222 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77587], State: [ok], Delivered in [0.006496544] seconds [----] I, [2016-09-13T06:51:08.313518 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:51:08 UTC]... [----] I, [2016-09-13T06:51:08.331952 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:51:08 UTC]...Complete [----] I, [2016-09-13T06:51:15.671409 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:51:15.692361 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77588], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:51:15.715115 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77589], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:51:19.739731 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:51:19.746102 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00405573844909668, :worker_monitor=>1.366368293762207, :worker_dequeue=>0.011408567428588867, :total_time=>1.3821265697479248} [----] I, [2016-09-13T06:51:19.852688 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77589], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.154693303] seconds [----] I, [2016-09-13T06:51:19.852956 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77589], Delivering... [----] I, [2016-09-13T06:51:19.862179 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004855155944824219, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004882097244262695, :pending_vm_jobs=>0.0011069774627685547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0086822509765625} [----] I, [2016-09-13T06:51:19.862634 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77589], State: [ok], Delivered in [0.009696136] seconds [----] I, [2016-09-13T06:51:19.863752 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77588], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.187712487] seconds [----] I, [2016-09-13T06:51:19.863925 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77588], Delivering... [----] I, [2016-09-13T06:51:19.868528 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77588], State: [ok], Delivered in [0.00458922] seconds [----] I, [2016-09-13T06:51:30.727300 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:51:30.745203 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77590], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:51:36.022277 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:51:36.027353 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003895998001098633, :worker_monitor=>1.2500309944152832, :worker_dequeue=>0.008992433547973633, :total_time=>1.2632155418395996} [----] I, [2016-09-13T06:51:36.432152 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77590], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.698632973] seconds [----] I, [2016-09-13T06:51:36.432333 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77590], Delivering... [----] I, [2016-09-13T06:51:36.438107 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003000497817993164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003021240234375, :pending_vm_jobs=>0.0006928443908691406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005397796630859375} [----] I, [2016-09-13T06:51:36.438406 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77590], State: [ok], Delivered in [0.00608381] seconds [----] I, [2016-09-13T06:51:41.027873 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:51:41 UTC]... [----] I, [2016-09-13T06:51:41.049168 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:51:41 UTC]...Complete [----] I, [2016-09-13T06:51:45.757601 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:51:45.780900 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77591], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:51:45.797749 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77592], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:51:45.814926 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77593], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:51:45.831898 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77594], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:51:46.075644 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:51:46.489487 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77592], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.704371052] seconds [----] I, [2016-09-13T06:51:46.489657 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77592], Delivering... [----] I, [2016-09-13T06:51:46.523746 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77594], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.699863192] seconds [----] I, [2016-09-13T06:51:46.523910 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77594], Delivering... [----] I, [2016-09-13T06:51:46.530007 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00304412841796875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030651092529296875, :pending_vm_jobs=>0.000713348388671875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005748748779296875} [----] I, [2016-09-13T06:51:46.530285 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77594], State: [ok], Delivered in [0.006370561] seconds [----] I, [2016-09-13T06:51:46.541961 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77592], State: [ok], Delivered in [0.052263864] seconds [----] I, [2016-09-13T06:51:46.952210 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77591], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.189999444] seconds [----] I, [2016-09-13T06:51:46.952386 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77591], Delivering... [----] I, [2016-09-13T06:51:46.956469 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77591], State: [ok], Delivered in [0.004054047] seconds [----] I, [2016-09-13T06:51:46.992267 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77593], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.189021147] seconds [----] I, [2016-09-13T06:51:46.992479 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77593], Delivering... [----] I, [2016-09-13T06:51:46.999367 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77593], State: [ok], Delivered in [0.006914093] seconds [----] I, [2016-09-13T06:51:52.388165 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004093647003173828, :worker_monitor=>1.2872397899627686, :worker_dequeue=>0.01398158073425293, :total_time=>1.3056614398956299} [----] I, [2016-09-13T06:52:00.844275 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:52:00.861127 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77595], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:52:02.547132 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:52:02.691310 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77595], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.841172996] seconds [----] I, [2016-09-13T06:52:02.691581 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77595], Delivering... [----] I, [2016-09-13T06:52:02.699128 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004155397415161133, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004178762435913086, :pending_vm_jobs=>0.0009057521820068359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0071146488189697266} [----] I, [2016-09-13T06:52:02.699515 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77595], State: [ok], Delivered in [0.007932602] seconds [----] I, [2016-09-13T06:52:09.126646 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004927635192871094, :worker_monitor=>1.4844329357147217, :worker_dequeue=>0.010989904403686523, :total_time=>1.5006139278411865} [----] I, [2016-09-13T06:52:14.127210 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:52:14 UTC]... [----] I, [2016-09-13T06:52:14.141196 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:52:14 UTC]...Complete [----] I, [2016-09-13T06:52:15.872255 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:52:15.889985 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77596], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:52:15.907119 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77597], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:52:19.167165 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:52:19.227811 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77597], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.329649095] seconds [----] I, [2016-09-13T06:52:19.228030 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77597], Delivering... [----] I, [2016-09-13T06:52:19.234041 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031921863555908203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032112598419189453, :pending_vm_jobs=>0.0006897449493408203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005645751953125} [----] I, [2016-09-13T06:52:19.234373 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77597], State: [ok], Delivered in [0.006372561] seconds [----] I, [2016-09-13T06:52:20.404213 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77596], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.525737777] seconds [----] I, [2016-09-13T06:52:20.404329 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77596], Delivering... [----] I, [2016-09-13T06:52:20.407233 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77596], State: [ok], Delivered in [0.002903119] seconds [----] I, [2016-09-13T06:52:25.720017 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039708614349365234, :worker_monitor=>1.526235580444336, :worker_dequeue=>0.015339851379394531, :total_time=>1.5459208488464355} [----] I, [2016-09-13T06:52:30.922043 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:52:30.936644 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77598], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:52:35.743325 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:52:36.223128 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77598], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.296907452] seconds [----] I, [2016-09-13T06:52:36.223373 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77598], Delivering... [----] I, [2016-09-13T06:52:36.229749 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033490657806396484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003368854522705078, :pending_vm_jobs=>0.0007300376892089844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005834102630615234} [----] I, [2016-09-13T06:52:36.230133 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77598], State: [ok], Delivered in [0.006782251] seconds [----] I, [2016-09-13T06:52:42.002134 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036110877990722656, :worker_monitor=>1.2431344985961914, :worker_dequeue=>0.006738185882568359, :total_time=>1.2538063526153564} [----] I, [2016-09-13T06:52:45.948131 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:52:45.967661 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77599], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:52:45.981879 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77600], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:52:45.999042 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77601], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:52:46.021709 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77602], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:52:47.002673 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:52:47 UTC]... [----] I, [2016-09-13T06:52:47.022900 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:52:47 UTC]...Complete [----] I, [2016-09-13T06:52:47.034124 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:52:47.333119 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77600], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.359325028] seconds [----] I, [2016-09-13T06:52:47.333285 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77600], Delivering... [----] I, [2016-09-13T06:52:47.378608 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77600], State: [ok], Delivered in [0.045302893] seconds [----] I, [2016-09-13T06:52:47.399029 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77602], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.387631884] seconds [----] I, [2016-09-13T06:52:47.399182 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77602], Delivering... [----] I, [2016-09-13T06:52:47.404895 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002912282943725586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029299259185791016, :pending_vm_jobs=>0.0007283687591552734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005358457565307617} [----] I, [2016-09-13T06:52:47.405209 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77602], State: [ok], Delivered in [0.006019231] seconds [----] I, [2016-09-13T06:52:47.490603 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77599], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.536056584] seconds [----] I, [2016-09-13T06:52:47.490784 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77599], Delivering... [----] I, [2016-09-13T06:52:47.495084 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77599], State: [ok], Delivered in [0.004304457] seconds [----] I, [2016-09-13T06:52:47.519230 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77601], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.529395401] seconds [----] I, [2016-09-13T06:52:47.519407 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77601], Delivering... [----] I, [2016-09-13T06:52:47.522606 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77601], State: [ok], Delivered in [0.00319183] seconds [----] I, [2016-09-13T06:52:58.551165 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038034915924072266, :worker_monitor=>1.4792511463165283, :worker_dequeue=>0.01119542121887207, :total_time=>1.4945428371429443} [----] I, [2016-09-13T06:53:01.033940 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:53:01.050682 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77603], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:53:03.666572 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T06:53:03.672215 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:53:04.588115 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77603], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.547744563] seconds [----] I, [2016-09-13T06:53:04.588326 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77603], Delivering... [----] I, [2016-09-13T06:53:04.595476 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003673076629638672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003702878952026367, :pending_vm_jobs=>0.0009083747863769531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0066983699798583984} [----] I, [2016-09-13T06:53:04.595863 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77603], State: [ok], Delivered in [0.007541203] seconds [----] I, [2016-09-13T06:53:15.250499 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004369258880615234, :worker_monitor=>1.5324866771697998, :worker_dequeue=>0.013666152954101562, :total_time=>1.5508170127868652} [----] I, [2016-09-13T06:53:16.062717 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:53:16.079598 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77604], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:53:16.090692 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77605], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:53:20.251036 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:53:20 UTC]... [----] I, [2016-09-13T06:53:20.267882 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:53:20 UTC]...Complete [----] I, [2016-09-13T06:53:20.278338 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:53:20.679591 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77605], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.594246383] seconds [----] I, [2016-09-13T06:53:20.679782 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77605], Delivering... [----] I, [2016-09-13T06:53:20.685556 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77604], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.618191532] seconds [----] I, [2016-09-13T06:53:20.685834 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77604], Delivering... [----] I, [2016-09-13T06:53:20.686801 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034635066986083984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034868717193603516, :pending_vm_jobs=>0.0009453296661376953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065691471099853516} [----] I, [2016-09-13T06:53:20.687121 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77605], State: [ok], Delivered in [0.007336609] seconds [----] I, [2016-09-13T06:53:20.693263 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77604], State: [ok], Delivered in [0.007462261] seconds [----] I, [2016-09-13T06:53:31.101616 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:53:31.128026 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77606], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:53:31.156630 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77607], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:53:31.185094 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77608], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:53:31.769552 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:53:31.779740 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003967761993408203, :worker_monitor=>1.4574477672576904, :worker_dequeue=>0.018199920654296875, :total_time=>1.479912519454956} [----] I, [2016-09-13T06:53:32.745601 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77606], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.639099234] seconds [----] I, [2016-09-13T06:53:32.745779 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77606], Delivering... [----] I, [2016-09-13T06:53:32.747177 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T06:53:32.747384 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5353590784 [----] I, [2016-09-13T06:53:32.747517 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5131902976 [----] I, [2016-09-13T06:53:32.747610 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 221687808 [----] I, [2016-09-13T06:53:32.747693 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T06:53:32.747768 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5077884928 [----] I, [2016-09-13T06:53:32.747870 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T06:53:32.747957 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T06:53:32.748061 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 542769152 [----] I, [2016-09-13T06:53:32.748142 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T06:53:32.748219 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8050241536 [----] I, [2016-09-13T06:53:32.748297 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T06:53:32.748393 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T06:53:32.748527 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T06:53:32.748608 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T06:53:32.748684 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T06:53:32.748756 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T06:53:32.748836 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T06:53:32.748909 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T06:53:32.749004 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T06:53:32.749089 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T06:53:32.749159 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273285120 [----] I, [2016-09-13T06:53:32.749234 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56586240 [----] I, [2016-09-13T06:53:32.749306 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216698880 [----] I, [2016-09-13T06:53:32.749381 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T06:53:32.749487 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141148160 [----] I, [2016-09-13T06:53:32.749573 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2589491200 [----] I, [2016-09-13T06:53:32.749649 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2272948224 [----] I, [2016-09-13T06:53:32.749723 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T06:53:32.749799 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T06:53:32.749875 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T06:53:32.749949 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37539840 [----] I, [2016-09-13T06:53:32.750043 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102273024 [----] I, [2016-09-13T06:53:32.750122 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53374976 [----] I, [2016-09-13T06:53:32.750195 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110604288 [----] I, [2016-09-13T06:53:32.750274 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155648000 [----] I, [2016-09-13T06:53:32.750352 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T06:53:32.750464 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T06:53:32.750558 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T06:53:32.750640 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T06:53:32.750712 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T06:53:32.750808 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T06:53:32.750892 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T06:53:32.750983 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T06:53:32.751071 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T06:53:32.763170 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77607], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.628911799] seconds [----] I, [2016-09-13T06:53:32.763482 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77607], Delivering... [----] I, [2016-09-13T06:53:32.768619 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77608], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.603595638] seconds [----] I, [2016-09-13T06:53:32.768909 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77608], Delivering... [----] I, [2016-09-13T06:53:32.774907 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:53:30 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48562.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T06:53:32.775737 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:53:29 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [51154.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:53:32.776323 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:53:31 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [238242.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T06:53:32.776842 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:53:21 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [103837.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T06:53:32.777504 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:53:29 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [201969.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T06:53:32.778138 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:53:29 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162417000], Memory % [3.1], CPU Time [37691.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T06:53:32.778353 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005307674407958984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005466461181640625, :pending_vm_jobs=>0.0012469291687011719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00884246826171875} [----] I, [2016-09-13T06:53:32.778701 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77608], State: [ok], Delivered in [0.009817426] seconds [----] I, [2016-09-13T06:53:32.778739 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:53:30 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [149650.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:53:32.779303 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:53:30 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [150551.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:53:32.782336 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:53:25 UTC], Process Info: Memory Usage [602587136], Memory Size [1059696640], Proportional Set Size: [437495000], Memory % [7.35], CPU Time [1397.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:53:32.784675 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:53:26 UTC], Process Info: Memory Usage [591974400], Memory Size [935747584], Proportional Set Size: [427017000], Memory % [7.22], CPU Time [497.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:53:32.787665 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:53:25 UTC], Process Info: Memory Usage [558587904], Memory Size [930201600], Proportional Set Size: [406107000], Memory % [6.81], CPU Time [5240.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T06:53:32.791335 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:53:27 UTC], Process Info: Memory Usage [581251072], Memory Size [938164224], Proportional Set Size: [420732000], Memory % [7.09], CPU Time [1841.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T06:53:32.792348 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:53:29 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [207650.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T06:53:32.793216 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:53:28 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51168.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:53:32.793731 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:53:25 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38587.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T06:53:32.794095 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77607], State: [ok], Delivered in [0.030677873] seconds [----] I, [2016-09-13T06:53:32.801722 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T06:53:32.801952 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T06:53:32.806086 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T06:53:32.809510 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T06:53:32.813171 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T06:53:32.817070 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T06:53:32.820483 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T06:53:32.823955 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 843 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T06:53:32.827492 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T06:53:32.831068 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T06:53:32.835600 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T06:53:32.841142 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T06:53:32.844678 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T06:53:32.848038 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T06:53:32.850991 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:53:32.851151 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:53:32.851263 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T06:53:32.855773 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [149638.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:53:32.856202 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77606], State: [ok], Delivered in [0.110419698] seconds [----] I, [2016-09-13T06:53:46.197165 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:53:46.214142 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77609], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:53:46.231327 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77610], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:53:46.248536 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77611], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:53:46.271108 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77612], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:53:48.160819 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:53:48.167696 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025458335876464844, :worker_monitor=>1.3392186164855957, :worker_dequeue=>0.012348651885986328, :total_time=>1.3543541431427002} [----] I, [2016-09-13T06:53:48.865323 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77610], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.647318252] seconds [----] I, [2016-09-13T06:53:48.865468 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77610], Delivering... [----] I, [2016-09-13T06:53:48.906221 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77612], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.64844783] seconds [----] I, [2016-09-13T06:53:48.906490 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77612], Delivering... [----] I, [2016-09-13T06:53:48.911302 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77610], State: [ok], Delivered in [0.04577321] seconds [----] I, [2016-09-13T06:53:48.914988 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004409074783325195, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004438638687133789, :pending_vm_jobs=>0.0010673999786376953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007973670959472656} [----] I, [2016-09-13T06:53:48.915388 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77612], State: [ok], Delivered in [0.008922901] seconds [----] I, [2016-09-13T06:53:50.917052 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77609], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.715499832] seconds [----] I, [2016-09-13T06:53:50.917191 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77609], Delivering... [----] I, [2016-09-13T06:53:50.920784 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77609], State: [ok], Delivered in [0.003582615] seconds [----] I, [2016-09-13T06:53:50.939628 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77611], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.703010249] seconds [----] I, [2016-09-13T06:53:50.939738 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77611], Delivering... [----] I, [2016-09-13T06:53:50.941646 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77611], State: [ok], Delivered in [0.001904102] seconds [----] I, [2016-09-13T06:53:53.168228 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:53:53 UTC]... [----] I, [2016-09-13T06:53:53.185776 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:53:53 UTC]...Complete [----] I, [2016-09-13T06:54:01.280956 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:54:01.300002 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77613], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:54:04.654047 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:54:04.658446 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004194974899291992, :worker_monitor=>1.4280407428741455, :worker_dequeue=>0.007788658142089844, :total_time=>1.4404246807098389} [----] I, [2016-09-13T06:54:05.049680 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77613], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.762922395] seconds [----] I, [2016-09-13T06:54:05.049912 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77613], Delivering... [----] I, [2016-09-13T06:54:05.057237 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037622451782226562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037851333618164062, :pending_vm_jobs=>0.0009021759033203125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006806612014770508} [----] I, [2016-09-13T06:54:05.057643 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77613], State: [ok], Delivered in [0.007730455] seconds [----] I, [2016-09-13T06:54:16.313247 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:54:16.334272 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77614], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:54:16.357106 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77615], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:54:21.042677 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:54:21.049080 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003911733627319336, :worker_monitor=>1.217714786529541, :worker_dequeue=>0.011566162109375, :total_time=>1.2334682941436768} [----] I, [2016-09-13T06:54:21.149520 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77615], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.806974578] seconds [----] I, [2016-09-13T06:54:21.149815 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77615], Delivering... [----] I, [2016-09-13T06:54:21.159008 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005012035369873047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0050928592681884766, :pending_vm_jobs=>0.0011506080627441406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008586406707763672} [----] I, [2016-09-13T06:54:21.159500 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77615], State: [ok], Delivered in [0.00964509] seconds [----] I, [2016-09-13T06:54:24.018152 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77614], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.698216517] seconds [----] I, [2016-09-13T06:54:24.018361 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77614], Delivering... [----] I, [2016-09-13T06:54:24.024474 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77614], State: [ok], Delivered in [0.006077112] seconds [----] I, [2016-09-13T06:54:26.049614 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:54:26 UTC]... [----] I, [2016-09-13T06:54:26.063021 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:54:26 UTC]...Complete [----] I, [2016-09-13T06:54:31.374313 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:54:31.394644 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77616], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:54:37.379403 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:54:37.379661 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:54:37.401287 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:54:37.401506 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:54:37.429770 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:54:37.429999 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:54:37.452408 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:54:37.452587 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:54:37.475589 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:54:37.475777 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:54:37.504015 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:54:37.504207 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:54:37.544114 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:54:37.544330 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:54:37.567174 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:54:37.567505 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:54:37.589691 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:54:37.589887 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:54:37.612128 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:54:37.612317 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:54:37.635341 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:54:37.635564 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:54:37.652454 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:54:37.652644 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:54:37.669482 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:54:37.669680 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:54:37.686745 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:54:37.687018 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:54:37.709537 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T06:54:37.709659 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T06:54:37.716101 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:54:37.719920 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00400233268737793, :worker_monitor=>1.6137564182281494, :worker_dequeue=>0.007552385330200195, :total_time=>1.6256108283996582} [----] I, [2016-09-13T06:54:37.742686 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T06:54:37.742834 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T06:54:37.742927 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T06:54:37.885030 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:54:37.885886 #20386:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T06:54:37.885989 #20386:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:54:37.886039 #20386:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:54:37.886075 #20386:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:54:37.886109 #20386:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T06:54:37.886142 #20386:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T06:54:37.886176 #20386:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:54:37.886208 #20386:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T06:54:37.886241 #20386:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:54:37.886272 #20386:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:54:37.886312 #20386:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:54:37.886343 #20386:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:54:37.886388 #20386:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T06:54:37.886463 #20386:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T06:54:37.886509 #20386:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T06:54:37.886544 #20386:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T06:54:37.886575 #20386:34713c] INFO -- : --- [----] I, [2016-09-13T06:54:37.886896 #20386:34713c] INFO -- : :guid: e5930efc-7974-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:54:37.886974 #20386:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T06:54:37.887105 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T06:54:37.941917 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:54:37.942076 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:54:37.942146 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:54:38.088318 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:54:38.089109 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T06:54:38.089190 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:54:38.089234 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:54:38.089270 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:54:38.089304 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T06:54:38.089336 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T06:54:38.089370 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:54:38.089403 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T06:54:38.089490 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:54:38.089532 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:54:38.089566 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:54:38.089598 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:54:38.089630 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T06:54:38.089661 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T06:54:38.089926 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:54:38.090206 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:54:38.298817 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77616], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.911371279] seconds [----] I, [2016-09-13T06:54:38.298980 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77616], Delivering... [----] I, [2016-09-13T06:54:38.304159 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027229785919189453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027425289154052734, :pending_vm_jobs=>0.0006303787231445312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004863739013671875} [----] I, [2016-09-13T06:54:38.304504 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77616], State: [ok], Delivered in [0.005532451] seconds [----] I, [2016-09-13T06:54:38.817560 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:54:38.817706 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:54:38.817780 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:54:38.975971 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:54:38.976875 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T06:54:38.976974 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:54:38.977030 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:54:38.977072 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:54:38.977118 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T06:54:38.977152 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T06:54:38.977188 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:54:38.977226 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T06:54:38.977262 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:54:38.977297 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:54:38.977330 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:54:38.977367 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:54:38.977400 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T06:54:38.977471 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:54:38.977513 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T06:54:38.977545 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T06:54:38.977847 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:54:38.978020 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:54:39.038754 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:54:39.038915 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:54:39.039033 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:54:39.210200 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:54:39.211055 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T06:54:39.211135 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:54:39.211182 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:54:39.211221 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:54:39.211257 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T06:54:39.211288 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T06:54:39.211321 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:54:39.211353 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T06:54:39.211385 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:54:39.211444 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:54:39.211498 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:54:39.211532 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:54:39.211562 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T06:54:39.211595 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:54:39.211625 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T06:54:39.211653 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T06:54:39.211929 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:54:39.212117 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:54:40.332320 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:54:40.332496 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:54:40.332594 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:54:40.490046 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:54:40.490803 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T06:54:40.490887 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:54:40.490929 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:54:40.490983 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:54:40.491027 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T06:54:40.491059 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T06:54:40.491091 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:54:40.491126 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T06:54:40.491158 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:54:40.491200 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:54:40.491231 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:54:40.491263 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:54:40.491300 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T06:54:40.491347 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:54:40.491381 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T06:54:40.491410 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T06:54:40.491728 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:54:40.491870 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:54:42.071695 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:54:42.071810 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:54:42.071899 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:54:42.128562 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:54:42.128697 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:54:42.128768 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:54:42.183676 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:54:42.184257 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T06:54:42.184310 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:54:42.184338 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:54:42.184362 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:54:42.184387 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T06:54:42.184411 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T06:54:42.184471 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:54:42.184501 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T06:54:42.184526 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:54:42.184547 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:54:42.184570 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:54:42.184591 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:54:42.184614 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T06:54:42.184638 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:54:42.184658 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T06:54:42.184679 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T06:54:42.184877 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:54:42.185012 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:54:42.285162 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:54:42.285901 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T06:54:42.286017 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:54:42.286069 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:54:42.286107 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:54:42.286142 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T06:54:42.286176 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T06:54:42.286211 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:54:42.286244 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T06:54:42.286278 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:54:42.286310 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:54:42.286342 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:54:42.286374 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:54:42.286405 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T06:54:42.286477 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T06:54:42.286752 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:54:42.287039 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:54:44.396486 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:54:44.396650 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:54:44.396749 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:54:44.589049 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:54:44.589995 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T06:54:44.590086 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:54:44.590132 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:54:44.590173 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:54:44.590207 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T06:54:44.590245 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T06:54:44.590280 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:54:44.590318 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T06:54:44.590350 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:54:44.590384 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:54:44.590448 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:54:44.590500 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:54:44.590537 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T06:54:44.590576 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:54:44.590613 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T06:54:44.590657 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T06:54:44.590972 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:54:44.591122 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:54:44.666351 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:54:44.666510 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:54:44.666585 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:54:44.801823 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:54:44.802589 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T06:54:44.802666 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:54:44.802707 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:54:44.802742 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:54:44.802775 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T06:54:44.802806 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T06:54:44.802839 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:54:44.802871 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T06:54:44.802903 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:54:44.802935 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:54:44.802984 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:54:44.803023 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:54:44.803054 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T06:54:44.803084 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:54:44.803114 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T06:54:44.803142 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T06:54:44.803399 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:54:44.803566 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:54:45.215194 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T06:54:45.215330 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T06:54:45.215442 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T06:54:45.283023 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T06:54:45.283192 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T06:54:45.283314 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T06:54:45.356101 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:54:45.356954 #684:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T06:54:45.357052 #684:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:54:45.357098 #684:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:54:45.357135 #684:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:54:45.357169 #684:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T06:54:45.357203 #684:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T06:54:45.357236 #684:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:54:45.357269 #684:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T06:54:45.357301 #684:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:54:45.357333 #684:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:54:45.357364 #684:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:54:45.357395 #684:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:54:45.357462 #684:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T06:54:45.357505 #684:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T06:54:45.357538 #684:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T06:54:45.357570 #684:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T06:54:45.357600 #684:34713c] INFO -- : --- [----] I, [2016-09-13T06:54:45.357917 #684:34713c] INFO -- : :guid: c253e5f6-7924-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:54:45.357997 #684:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T06:54:45.358120 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T06:54:45.429218 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:54:45.429388 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:54:45.429508 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:54:45.461066 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:54:45.461881 #3290:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T06:54:45.461977 #3290:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:54:45.462040 #3290:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:54:45.462085 #3290:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:54:45.462120 #3290:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T06:54:45.462155 #3290:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T06:54:45.462186 #3290:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:54:45.462221 #3290:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T06:54:45.462255 #3290:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:54:45.462287 #3290:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:54:45.462321 #3290:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T06:54:45.462354 #3290:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:54:45.462410 #3290:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T06:54:45.462489 #3290:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:54:45.462528 #3290:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T06:54:45.462562 #3290:34713c] INFO -- : --- [----] I, [2016-09-13T06:54:45.462971 #3290:34713c] INFO -- : :guid: 8b41dc22-7996-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:54:45.463040 #3290:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T06:54:45.463199 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T06:54:45.586845 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:54:45.587576 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T06:54:45.587656 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:54:45.587700 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:54:45.587735 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:54:45.587769 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T06:54:45.587802 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T06:54:45.587835 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:54:45.587867 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T06:54:45.587899 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:54:45.587930 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:54:45.587980 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:54:45.588019 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:54:45.588054 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T06:54:45.588084 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T06:54:45.588340 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:54:45.588658 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:54:46.359981 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:54:46.360134 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:54:46.360215 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:54:46.410090 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T06:54:46.410264 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T06:54:46.410337 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T06:54:46.461211 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T06:54:46.461458 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T06:54:46.461668 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T06:54:46.546784 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:54:46.549311 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T06:54:46.549471 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:54:46.549568 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:54:46.549648 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:54:46.549720 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T06:54:46.549790 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T06:54:46.549861 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:54:46.549923 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T06:54:46.550011 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:54:46.550080 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:54:46.550148 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:54:46.550210 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:54:46.550270 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T06:54:46.550329 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T06:54:46.550390 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T06:54:46.550502 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T06:54:46.550576 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T06:54:46.550650 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T06:54:46.550718 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T06:54:46.550786 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T06:54:46.550847 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T06:54:46.550907 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T06:54:46.550986 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T06:54:46.551054 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T06:54:46.551183 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T06:54:46.551273 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T06:54:46.551334 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T06:54:46.551392 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T06:54:46.551499 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T06:54:46.551574 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T06:54:46.551649 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T06:54:46.551723 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T06:54:46.551798 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T06:54:46.551889 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T06:54:46.551978 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T06:54:46.552056 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T06:54:46.552159 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T06:54:46.552235 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T06:54:46.552304 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T06:54:46.552711 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:54:46.552890 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:54:46.552986 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:54:46.558040 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:54:46.558838 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T06:54:46.558916 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:54:46.558979 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:54:46.559023 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:54:46.559057 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T06:54:46.559091 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T06:54:46.559126 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:54:46.559158 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T06:54:46.559190 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:54:46.559222 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:54:46.559252 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T06:54:46.559282 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:54:46.559313 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T06:54:46.559343 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:54:46.559378 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T06:54:46.559408 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T06:54:46.559721 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:54:46.559898 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T06:54:46.571944 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77617], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:54:46.589161 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77618], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:54:46.606520 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T06:54:46.606968 #5369:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T06:54:46.607011 #5369:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T06:54:46.607037 #5369:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T06:54:46.607057 #5369:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T06:54:46.607079 #5369:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T06:54:46.607100 #5369:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T06:54:46.607119 #5369:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T06:54:46.607137 #5369:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T06:54:46.607156 #5369:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T06:54:46.607176 #5369:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T06:54:46.607195 #5369:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T06:54:46.607212 #5369:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T06:54:46.607230 #5369:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T06:54:46.607249 #5369:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T06:54:46.607266 #5369:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T06:54:46.607284 #5369:34713c] INFO -- : --- [----] I, [2016-09-13T06:54:46.607531 #5369:34713c] INFO -- : :guid: 79c8c984-799a-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T06:54:46.607573 #5369:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T06:54:46.607665 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T06:54:46.612065 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77619], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:54:46.628988 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77620], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:54:47.744530 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:54:48.212332 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77618], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.63608943] seconds [----] I, [2016-09-13T06:54:48.212569 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77618], Delivering... [----] I, [2016-09-13T06:54:48.252220 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77620], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.631148764] seconds [----] I, [2016-09-13T06:54:48.252476 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77620], Delivering... [----] I, [2016-09-13T06:54:48.259647 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004049777984619141, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004072427749633789, :pending_vm_jobs=>0.0008449554443359375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006717681884765625} [----] I, [2016-09-13T06:54:48.260022 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77620], State: [ok], Delivered in [0.007578733] seconds [----] I, [2016-09-13T06:54:48.274893 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77618], State: [ok], Delivered in [0.062316872] seconds [----] I, [2016-09-13T06:54:48.286731 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77617], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.729377711] seconds [----] I, [2016-09-13T06:54:48.286898 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77617], Delivering... [----] I, [2016-09-13T06:54:48.291140 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77617], State: [ok], Delivered in [0.004233171] seconds [----] I, [2016-09-13T06:54:48.303759 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77619], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.709232949] seconds [----] I, [2016-09-13T06:54:48.303911 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77619], Delivering... [----] I, [2016-09-13T06:54:48.306876 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77619], State: [ok], Delivered in [0.002952923] seconds [----] I, [2016-09-13T06:54:54.110336 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004591464996337891, :worker_monitor=>1.3423833847045898, :worker_dequeue=>0.011574745178222656, :total_time=>1.3589084148406982} [----] I, [2016-09-13T06:54:59.110925 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:54:59 UTC]... [----] I, [2016-09-13T06:54:59.128936 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:54:59 UTC]...Complete [----] I, [2016-09-13T06:55:01.639999 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:55:01.660241 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77621], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:55:04.212155 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:55:04.672627 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77621], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.026397321] seconds [----] I, [2016-09-13T06:55:04.672938 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77621], Delivering... [----] I, [2016-09-13T06:55:04.683409 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005551338195800781, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005604743957519531, :pending_vm_jobs=>0.00130462646484375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009871244430541992} [----] I, [2016-09-13T06:55:04.683929 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77621], State: [ok], Delivered in [0.011018706] seconds [----] I, [2016-09-13T06:55:10.758088 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004195213317871094, :worker_monitor=>1.523205041885376, :worker_dequeue=>0.011418819427490234, :total_time=>1.5391387939453125} [----] I, [2016-09-13T06:55:16.672396 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:55:16.689308 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77622], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:55:16.706453 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77623], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:55:20.894836 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:55:21.426377 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77623], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.730110975] seconds [----] I, [2016-09-13T06:55:21.426599 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77623], Delivering... [----] I, [2016-09-13T06:55:21.431828 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77622], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.754771981] seconds [----] I, [2016-09-13T06:55:21.431947 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77622], Delivering... [----] I, [2016-09-13T06:55:21.433132 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033576488494873047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003378152847290039, :pending_vm_jobs=>0.000904083251953125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0061533451080322266} [----] I, [2016-09-13T06:55:21.433516 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77623], State: [ok], Delivered in [0.00691641] seconds [----] I, [2016-09-13T06:55:21.434925 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77622], State: [ok], Delivered in [0.002964036] seconds [----] I, [2016-09-13T06:55:26.983068 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00548553466796875, :worker_monitor=>1.0695102214813232, :worker_dequeue=>0.00629734992980957, :total_time=>1.0816452503204346} [----] I, [2016-09-13T06:55:31.720756 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:55:31.741981 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77624], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:55:31.983676 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:55:31 UTC]... [----] I, [2016-09-13T06:55:32.009354 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:55:31 UTC]...Complete [----] I, [2016-09-13T06:55:32.020281 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:55:32.860931 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77624], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.134511281] seconds [----] I, [2016-09-13T06:55:32.861154 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77624], Delivering... [----] I, [2016-09-13T06:55:32.867536 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033240318298339844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033445358276367188, :pending_vm_jobs=>0.0007867813110351562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005956888198852539} [----] I, [2016-09-13T06:55:32.867924 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77624], State: [ok], Delivered in [0.006764874] seconds [----] I, [2016-09-13T06:55:43.461181 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005644321441650391, :worker_monitor=>1.3988239765167236, :worker_dequeue=>0.010920286178588867, :total_time=>1.4157724380493164} [----] I, [2016-09-13T06:55:46.758606 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:55:46.790208 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77625], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:55:46.807067 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77626], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:55:46.825847 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77627], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:55:46.853157 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77628], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:55:48.470622 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:55:48.516338 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77626], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.720435698] seconds [----] I, [2016-09-13T06:55:48.516539 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77626], Delivering... [----] I, [2016-09-13T06:55:48.555392 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77628], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.715873682] seconds [----] I, [2016-09-13T06:55:48.555526 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77628], Delivering... [----] I, [2016-09-13T06:55:48.559201 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020058155059814453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020341873168945312, :pending_vm_jobs=>0.0004429817199707031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003450632095336914} [----] I, [2016-09-13T06:55:48.559458 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77628], State: [ok], Delivered in [0.00392729] seconds [----] I, [2016-09-13T06:55:48.584010 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77626], State: [ok], Delivered in [0.067436306] seconds [----] I, [2016-09-13T06:55:48.589719 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77625], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.824456748] seconds [----] I, [2016-09-13T06:55:48.589826 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77625], Delivering... [----] I, [2016-09-13T06:55:48.592604 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77625], State: [ok], Delivered in [0.00277468] seconds [----] I, [2016-09-13T06:55:48.630077 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77627], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.817290643] seconds [----] I, [2016-09-13T06:55:48.630193 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77627], Delivering... [----] I, [2016-09-13T06:55:48.632077 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77627], State: [ok], Delivered in [0.001874489] seconds [----] I, [2016-09-13T06:55:59.759674 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003941535949707031, :worker_monitor=>1.255385160446167, :worker_dequeue=>0.00699162483215332, :total_time=>1.2665824890136719} [----] I, [2016-09-13T06:56:01.870898 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:56:01.887228 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77629], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:56:04.760169 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:56:04 UTC]... [----] I, [2016-09-13T06:56:04.784399 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:56:04 UTC]...Complete [----] I, [2016-09-13T06:56:04.793319 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:56:05.121533 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77629], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.24488897] seconds [----] I, [2016-09-13T06:56:05.121686 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77629], Delivering... [----] I, [2016-09-13T06:56:05.126411 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025060176849365234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002541065216064453, :pending_vm_jobs=>0.0005679130554199219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004427909851074219} [----] I, [2016-09-13T06:56:05.126673 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77629], State: [ok], Delivered in [0.004973573] seconds [----] I, [2016-09-13T06:56:16.429306 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004087686538696289, :worker_monitor=>1.5936253070831299, :worker_dequeue=>0.012781143188476562, :total_time=>1.6108968257904053} [----] I, [2016-09-13T06:56:16.897290 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:56:16.918375 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77630], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:56:16.941310 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77631], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:56:21.541112 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:56:21.752817 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77631], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.828595391] seconds [----] I, [2016-09-13T06:56:21.753055 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77631], Delivering... [----] I, [2016-09-13T06:56:21.758398 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77630], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.857429317] seconds [----] I, [2016-09-13T06:56:21.758623 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77630], Delivering... [----] I, [2016-09-13T06:56:21.759982 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037064552307128906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037276744842529297, :pending_vm_jobs=>0.0008563995361328125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006514310836791992} [----] I, [2016-09-13T06:56:21.760346 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77631], State: [ok], Delivered in [0.007294214] seconds [----] I, [2016-09-13T06:56:21.763389 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77630], State: [ok], Delivered in [0.004767326] seconds [----] I, [2016-09-13T06:56:31.955625 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:56:31.981024 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77632], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:56:33.129292 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:56:33.135167 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004014492034912109, :worker_monitor=>1.553576946258545, :worker_dequeue=>0.010499715805053711, :total_time=>1.5683717727661133} [----] I, [2016-09-13T06:56:33.322024 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77632], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.354088941] seconds [----] I, [2016-09-13T06:56:33.322174 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77632], Delivering... [----] I, [2016-09-13T06:56:33.327315 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031642913818359375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003178834915161133, :pending_vm_jobs=>0.0005028247833251953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004861593246459961} [----] I, [2016-09-13T06:56:33.327560 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77632], State: [ok], Delivered in [0.005388641] seconds [----] I, [2016-09-13T06:56:38.135676 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:56:38 UTC]... [----] I, [2016-09-13T06:56:38.156477 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:56:38 UTC]...Complete [----] I, [2016-09-13T06:56:46.990187 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:56:47.009786 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77633], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:56:47.025190 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77634], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:56:47.050707 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77635], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:56:47.077854 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77636], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:56:49.712061 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:56:49.717730 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003544330596923828, :worker_monitor=>1.520345687866211, :worker_dequeue=>0.010377883911132812, :total_time=>1.5345571041107178} [----] I, [2016-09-13T06:56:50.443048 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77634], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.427551309] seconds [----] I, [2016-09-13T06:56:50.443176 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77634], Delivering... [----] I, [2016-09-13T06:56:50.488108 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77634], State: [ok], Delivered in [0.044909419] seconds [----] I, [2016-09-13T06:56:50.535760 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77636], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.471417742] seconds [----] I, [2016-09-13T06:56:50.535933 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77636], Delivering... [----] I, [2016-09-13T06:56:50.541963 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030961036682128906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031173229217529297, :pending_vm_jobs=>0.0007686614990234375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005658388137817383} [----] I, [2016-09-13T06:56:50.542272 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77636], State: [ok], Delivered in [0.006335866] seconds [----] I, [2016-09-13T06:56:51.894611 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77633], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.900380442] seconds [----] I, [2016-09-13T06:56:51.894823 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77633], Delivering... [----] I, [2016-09-13T06:56:51.899031 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77633], State: [ok], Delivered in [0.004181821] seconds [----] I, [2016-09-13T06:56:51.910765 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77635], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.877942991] seconds [----] I, [2016-09-13T06:56:51.910891 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77635], Delivering... [----] I, [2016-09-13T06:56:51.912898 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77635], State: [ok], Delivered in [0.001992008] seconds [----] I, [2016-09-13T06:57:02.092603 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:57:02.116843 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77637], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:57:06.023258 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:57:06.028452 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025310516357421875, :worker_monitor=>1.2634525299072266, :worker_dequeue=>0.009259223937988281, :total_time=>1.275465488433838} [----] I, [2016-09-13T06:57:06.645701 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77637], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.547987383] seconds [----] I, [2016-09-13T06:57:06.645832 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77637], Delivering... [----] I, [2016-09-13T06:57:06.649498 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020265579223632812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020394325256347656, :pending_vm_jobs=>0.0004417896270751953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0034456253051757812} [----] I, [2016-09-13T06:57:06.649718 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77637], State: [ok], Delivered in [0.003889549] seconds [----] I, [2016-09-13T06:57:11.028882 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:57:11 UTC]... [----] I, [2016-09-13T06:57:11.056354 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:57:11 UTC]...Complete [----] I, [2016-09-13T06:57:17.125144 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:57:17.141972 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77638], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:57:17.164613 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77639], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:57:22.567559 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:57:22.574535 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003674745559692383, :worker_monitor=>1.47353196144104, :worker_dequeue=>0.012377500534057617, :total_time=>1.4898710250854492} [----] I, [2016-09-13T06:57:22.770907 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77639], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.62370153] seconds [----] I, [2016-09-13T06:57:22.771090 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77639], Delivering... [----] I, [2016-09-13T06:57:22.777154 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030558109283447266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030748844146728516, :pending_vm_jobs=>0.0008089542388916016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005751371383666992} [----] I, [2016-09-13T06:57:22.777584 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77639], State: [ok], Delivered in [0.006471974] seconds [----] I, [2016-09-13T06:57:24.998927 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77638], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.870894522] seconds [----] I, [2016-09-13T06:57:24.999058 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77638], Delivering... [----] I, [2016-09-13T06:57:25.001943 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77638], State: [ok], Delivered in [0.002873126] seconds [----] I, [2016-09-13T06:57:32.173509 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:57:32.193335 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77640], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:57:32.669534 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:57:32.827824 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77640], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.649529069] seconds [----] I, [2016-09-13T06:57:32.827935 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77640], Delivering... [----] I, [2016-09-13T06:57:32.831614 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002027273178100586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002038240432739258, :pending_vm_jobs=>0.0004456043243408203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003447294235229492} [----] I, [2016-09-13T06:57:32.831890 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77640], State: [ok], Delivered in [0.003937259] seconds [----] I, [2016-09-13T06:57:39.082796 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037631988525390625, :worker_monitor=>1.399461269378662, :worker_dequeue=>0.006121635437011719, :total_time=>1.4096200466156006} [----] I, [2016-09-13T06:57:44.083244 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:57:44 UTC]... [----] I, [2016-09-13T06:57:44.102064 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:57:44 UTC]...Complete [----] I, [2016-09-13T06:57:47.204290 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:57:47.233169 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77641], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:57:47.249677 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77642], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:57:47.266295 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77643], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:57:47.302203 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77644], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:57:49.126471 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:57:49.977537 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77642], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.7403475] seconds [----] I, [2016-09-13T06:57:49.977721 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77642], Delivering... [----] I, [2016-09-13T06:57:50.022547 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77644], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.746868925] seconds [----] I, [2016-09-13T06:57:50.022735 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77644], Delivering... [----] I, [2016-09-13T06:57:50.029665 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036144256591796875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036363601684570312, :pending_vm_jobs=>0.0008962154388427734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006518125534057617} [----] I, [2016-09-13T06:57:50.029987 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77644], State: [ok], Delivered in [0.007257625] seconds [----] I, [2016-09-13T06:57:50.039675 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77642], State: [ok], Delivered in [0.061938135] seconds [----] I, [2016-09-13T06:57:52.091144 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77641], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.882828654] seconds [----] I, [2016-09-13T06:57:52.091343 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77641], Delivering... [----] I, [2016-09-13T06:57:52.095667 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77641], State: [ok], Delivered in [0.00433013] seconds [----] I, [2016-09-13T06:57:52.108500 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77643], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.853631519] seconds [----] I, [2016-09-13T06:57:52.108683 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77643], Delivering... [----] I, [2016-09-13T06:57:52.111761 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77643], State: [ok], Delivered in [0.003067947] seconds [----] I, [2016-09-13T06:57:55.921177 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004767417907714844, :worker_monitor=>1.774362325668335, :worker_dequeue=>0.011081695556640625, :total_time=>1.790590763092041} [----] I, [2016-09-13T06:58:02.313527 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:58:02.340965 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77645], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:58:05.949127 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T06:58:05.955014 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:58:06.158378 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77645], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.839484473] seconds [----] I, [2016-09-13T06:58:06.158614 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77645], Delivering... [----] I, [2016-09-13T06:58:06.165255 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034198760986328125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034706592559814453, :pending_vm_jobs=>0.0008609294891357422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006291866302490234} [----] I, [2016-09-13T06:58:06.165649 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77645], State: [ok], Delivered in [0.007055267] seconds [----] I, [2016-09-13T06:58:12.073676 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030438899993896484, :worker_monitor=>1.100945234298706, :worker_dequeue=>0.008402109146118164, :total_time=>1.1126558780670166} [----] I, [2016-09-13T06:58:17.074102 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:58:17 UTC]... [----] I, [2016-09-13T06:58:17.095277 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:58:17 UTC]...Complete [----] I, [2016-09-13T06:58:17.351055 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:58:17.364197 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77646], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:58:17.381200 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77647], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:58:22.115009 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:58:22.192372 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77647], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.823843021] seconds [----] I, [2016-09-13T06:58:22.192532 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77647], Delivering... [----] I, [2016-09-13T06:58:22.197544 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027539730072021484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027785301208496094, :pending_vm_jobs=>0.0005846023559570312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004710674285888672} [----] I, [2016-09-13T06:58:22.197839 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77647], State: [ok], Delivered in [0.005300563] seconds [----] I, [2016-09-13T06:58:22.210989 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77646], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.856420648] seconds [----] I, [2016-09-13T06:58:22.211151 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77646], Delivering... [----] I, [2016-09-13T06:58:22.215489 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77646], State: [ok], Delivered in [0.00430362] seconds [----] I, [2016-09-13T06:58:28.441009 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025577545166015625, :worker_monitor=>1.3102412223815918, :worker_dequeue=>0.006398916244506836, :total_time=>1.319446325302124} [----] I, [2016-09-13T06:58:32.394941 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:58:32.421332 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77648], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:58:32.438600 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77649], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:58:32.455740 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77650], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:58:33.531492 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:58:34.263483 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77648], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.863513317] seconds [----] I, [2016-09-13T06:58:34.263681 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77648], Delivering... [----] I, [2016-09-13T06:58:34.265040 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T06:58:34.265252 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5351895040 [----] I, [2016-09-13T06:58:34.265344 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5129973760 [----] I, [2016-09-13T06:58:34.265450 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 221921280 [----] I, [2016-09-13T06:58:34.265548 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T06:58:34.265629 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5075972096 [----] I, [2016-09-13T06:58:34.265699 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T06:58:34.265800 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T06:58:34.265922 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 543002624 [----] I, [2016-09-13T06:58:34.266028 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T06:58:34.266109 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7972311040 [----] I, [2016-09-13T06:58:34.266183 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T06:58:34.266273 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T06:58:34.266348 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T06:58:34.266453 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T06:58:34.266548 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T06:58:34.266627 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T06:58:34.266692 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T06:58:34.266762 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T06:58:34.266830 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T06:58:34.266900 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T06:58:34.267003 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273285120 [----] I, [2016-09-13T06:58:34.267095 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56586240 [----] I, [2016-09-13T06:58:34.267169 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216698880 [----] I, [2016-09-13T06:58:34.267238 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T06:58:34.267311 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141148160 [----] I, [2016-09-13T06:58:34.267379 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2591055872 [----] I, [2016-09-13T06:58:34.267553 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2274279424 [----] I, [2016-09-13T06:58:34.267659 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T06:58:34.267734 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T06:58:34.267804 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T06:58:34.267877 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37490688 [----] I, [2016-09-13T06:58:34.267971 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102273024 [----] I, [2016-09-13T06:58:34.268066 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53399552 [----] I, [2016-09-13T06:58:34.268146 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110604288 [----] I, [2016-09-13T06:58:34.268217 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155672576 [----] I, [2016-09-13T06:58:34.268309 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T06:58:34.268402 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T06:58:34.268571 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T06:58:34.268658 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T06:58:34.268731 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T06:58:34.268830 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T06:58:34.268936 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T06:58:34.269036 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T06:58:34.269111 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T06:58:34.291534 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77649], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.866034825] seconds [----] I, [2016-09-13T06:58:34.291712 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77649], Delivering... [----] I, [2016-09-13T06:58:34.296554 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:58:18 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48615.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T06:58:34.296978 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:58:27 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [51211.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:58:34.297315 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:58:17 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [238375.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T06:58:34.297640 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:58:22 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [103903.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T06:58:34.297934 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:58:27 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162417000], Memory % [3.1], CPU Time [37740.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T06:58:34.298239 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:58:25 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [202018.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T06:58:34.298565 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:58:27 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [150623.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:58:34.298812 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:58:27 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [149714.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T06:58:34.300648 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:58:25 UTC], Process Info: Memory Usage [557719552], Memory Size [895729664], Proportional Set Size: [405371000], Memory % [6.8], CPU Time [5305.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T06:58:34.300938 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:58:25 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [207706.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T06:58:34.301233 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:58:27 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51200.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T06:58:34.301513 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:58:26 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38635.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T06:58:34.302830 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:58:27 UTC], Process Info: Memory Usage [592543744], Memory Size [922411008], Proportional Set Size: [427575000], Memory % [7.22], CPU Time [573.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:58:34.303994 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:58:25 UTC], Process Info: Memory Usage [603320320], Memory Size [1059696640], Proportional Set Size: [438211000], Memory % [7.36], CPU Time [1424.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T06:58:34.305159 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 10:58:18 UTC], Process Info: Memory Usage [580751360], Memory Size [909090816], Proportional Set Size: [420244000], Memory % [7.08], CPU Time [1896.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T06:58:34.305394 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77649], State: [ok], Delivered in [0.013692547] seconds [----] I, [2016-09-13T06:58:34.336450 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T06:58:34.336764 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T06:58:34.340962 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T06:58:34.345698 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T06:58:34.351374 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T06:58:34.356927 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T06:58:34.360067 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77650], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.915201269] seconds [----] I, [2016-09-13T06:58:34.360180 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77650], Delivering... [----] I, [2016-09-13T06:58:34.362197 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T06:58:34.364189 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002270936965942383, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002283334732055664, :pending_vm_jobs=>0.00045418739318847656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003780364990234375} [----] I, [2016-09-13T06:58:34.364373 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77650], State: [ok], Delivered in [0.004189456] seconds [----] I, [2016-09-13T06:58:34.367263 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 843 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T06:58:34.372786 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T06:58:34.378228 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T06:58:34.383742 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T06:58:34.389196 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T06:58:34.394049 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T06:58:34.397190 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T06:58:34.399959 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:58:34.400118 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T06:58:34.400224 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T06:58:34.404794 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [149706.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T06:58:34.405149 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77648], State: [ok], Delivered in [0.141449562] seconds [----] I, [2016-09-13T06:58:45.346022 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003938198089599609, :worker_monitor=>1.7774627208709717, :worker_dequeue=>0.011255741119384766, :total_time=>1.7929644584655762} [----] I, [2016-09-13T06:58:47.472275 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:58:47.492375 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77651], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:58:47.514314 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77652], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:58:47.525564 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77653], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:58:47.548656 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77654], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:58:50.346515 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:58:50 UTC]... [----] I, [2016-09-13T06:58:50.549446 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:58:50 UTC]...Complete [----] I, [2016-09-13T06:58:50.558368 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:58:51.491971 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77652], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.995630314] seconds [----] I, [2016-09-13T06:58:51.492176 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77652], Delivering... [----] I, [2016-09-13T06:58:51.503656 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77654], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.969728739] seconds [----] I, [2016-09-13T06:58:51.503938 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77654], Delivering... [----] I, [2016-09-13T06:58:51.510844 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036232471466064453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003693819046020508, :pending_vm_jobs=>0.0008206367492675781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006389617919921875} [----] I, [2016-09-13T06:58:51.511225 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77654], State: [ok], Delivered in [0.007303965] seconds [----] I, [2016-09-13T06:58:51.548914 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77652], State: [ok], Delivered in [0.056706044] seconds [----] I, [2016-09-13T06:58:52.469034 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77651], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.992585643] seconds [----] I, [2016-09-13T06:58:52.469269 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77651], Delivering... [----] I, [2016-09-13T06:58:52.474569 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77651], State: [ok], Delivered in [0.005273249] seconds [----] I, [2016-09-13T06:58:52.503216 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77653], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.984176708] seconds [----] I, [2016-09-13T06:58:52.503407 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77653], Delivering... [----] I, [2016-09-13T06:58:52.506630 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77653], State: [ok], Delivered in [0.003188573] seconds [----] I, [2016-09-13T06:59:01.964294 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033943653106689453, :worker_monitor=>1.3673765659332275, :worker_dequeue=>0.012274026870727539, :total_time=>1.383326530456543} [----] I, [2016-09-13T06:59:02.560453 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:59:02.583801 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77655], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:59:06.973069 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:59:07.577374 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77655], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.010312145] seconds [----] I, [2016-09-13T06:59:07.577581 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77655], Delivering... [----] I, [2016-09-13T06:59:07.584037 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003301858901977539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003324747085571289, :pending_vm_jobs=>0.0008580684661865234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006068706512451172} [----] I, [2016-09-13T06:59:07.584362 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77655], State: [ok], Delivered in [0.00678302] seconds [----] I, [2016-09-13T06:59:17.599081 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T06:59:17.634355 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77656], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:59:17.657162 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77657], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:59:18.362992 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:59:18.367120 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004354953765869141, :worker_monitor=>1.3586814403533936, :worker_dequeue=>0.00844430923461914, :total_time=>1.371807336807251} [----] I, [2016-09-13T06:59:18.742997 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77657], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.103664317] seconds [----] I, [2016-09-13T06:59:18.743117 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77657], Delivering... [----] I, [2016-09-13T06:59:18.746822 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002027750015258789, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002039670944213867, :pending_vm_jobs=>0.0004317760467529297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0034737586975097656} [----] I, [2016-09-13T06:59:18.747068 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77657], State: [ok], Delivered in [0.003942414] seconds [----] I, [2016-09-13T06:59:19.600355 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77656], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.997181127] seconds [----] I, [2016-09-13T06:59:19.600487 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77656], Delivering... [----] I, [2016-09-13T06:59:19.603152 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77656], State: [ok], Delivered in [0.002658348] seconds [----] I, [2016-09-13T06:59:23.367637 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:59:23 UTC]... [----] I, [2016-09-13T06:59:23.388932 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:59:23 UTC]...Complete [----] I, [2016-09-13T06:59:32.666790 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T06:59:32.686174 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77658], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:59:34.842548 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:59:34.850468 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005815267562866211, :worker_monitor=>1.407930612564087, :worker_dequeue=>0.014119386672973633, :total_time=>1.4282588958740234} [----] I, [2016-09-13T06:59:34.896555 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77658], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.22366789] seconds [----] I, [2016-09-13T06:59:34.896749 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77658], Delivering... [----] I, [2016-09-13T06:59:34.905014 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004116058349609375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004141807556152344, :pending_vm_jobs=>0.0011649131774902344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007804393768310547} [----] I, [2016-09-13T06:59:34.905399 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77658], State: [ok], Delivered in [0.008636001] seconds [----] I, [2016-09-13T06:59:47.696962 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T06:59:47.736486 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77659], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:59:47.759232 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77660], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:59:47.775999 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77661], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:59:47.793304 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77662], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T06:59:51.290212 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T06:59:51.295324 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002683877944946289, :worker_monitor=>1.2300050258636475, :worker_dequeue=>0.008478403091430664, :total_time=>1.241389274597168} [----] I, [2016-09-13T06:59:52.034229 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77660], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.293590514] seconds [----] I, [2016-09-13T06:59:52.034561 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77660], Delivering... [----] I, [2016-09-13T06:59:52.073883 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77662], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.292481414] seconds [----] I, [2016-09-13T06:59:52.074106 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77662], Delivering... [----] I, [2016-09-13T06:59:52.082439 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036687850952148438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036978721618652344, :pending_vm_jobs=>0.0013110637664794922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007884979248046875} [----] I, [2016-09-13T06:59:52.082915 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77662], State: [ok], Delivered in [0.008781017] seconds [----] I, [2016-09-13T06:59:52.125042 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77660], State: [ok], Delivered in [0.090445823] seconds [----] I, [2016-09-13T06:59:52.732152 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77659], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.027573592] seconds [----] I, [2016-09-13T06:59:52.732354 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77659], Delivering... [----] I, [2016-09-13T06:59:52.737296 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77659], State: [ok], Delivered in [0.004912524] seconds [----] I, [2016-09-13T06:59:52.875178 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77661], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.110865441] seconds [----] I, [2016-09-13T06:59:52.875359 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77661], Delivering... [----] I, [2016-09-13T06:59:52.881030 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77661], State: [ok], Delivered in [0.005645187] seconds [----] I, [2016-09-13T06:59:56.295872 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:59:56 UTC]... [----] I, [2016-09-13T06:59:56.320708 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 10:59:56 UTC]...Complete [----] I, [2016-09-13T07:00:02.804582 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T07:00:02.829546 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77663], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:00:02.852467 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77664], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:00:02.886668 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77665], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:00:02.909615 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77666], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:00:02.911271 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget] [----] I, [2016-09-13T07:00:02.926829 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77667], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473768000] [----] I, [2016-09-13T07:00:02.927017 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T07:00:02.928651 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget] [----] I, [2016-09-13T07:00:02.961651 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77668], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473768000] [----] I, [2016-09-13T07:00:02.961818 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T07:00:08.060819 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:00:08.070735 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007091522216796875, :worker_monitor=>1.67262864112854, :worker_dequeue=>0.01912856101989746, :total_time=>1.6991803646087646} [----] I, [2016-09-13T07:00:08.200905 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77663], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.390507904] seconds [----] I, [2016-09-13T07:00:08.201034 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77663], Delivering... [----] I, [2016-09-13T07:00:08.205240 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020575523376464844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002068758010864258, :pending_vm_jobs=>0.00044035911560058594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003958702087402344} [----] I, [2016-09-13T07:00:08.205547 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77663], State: [ok], Delivered in [0.004484652] seconds [----] I, [2016-09-13T07:00:10.960606 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77664], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.125586618] seconds [----] I, [2016-09-13T07:00:10.961114 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77664], Delivering... [----] I, [2016-09-13T07:00:10.963308 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77664], State: [ok], Delivered in [0.002573117] seconds [----] I, [2016-09-13T07:00:10.989787 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77665], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.130511881] seconds [----] I, [2016-09-13T07:00:10.990059 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77665], Delivering... [----] I, [2016-09-13T07:00:11.003624 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77665], State: [ok], Delivered in [0.013569845] seconds [----] I, [2016-09-13T07:00:11.006601 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77666], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.114519998] seconds [----] I, [2016-09-13T07:00:11.006722 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77666], Delivering... [----] I, [2016-09-13T07:00:11.010831 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77666], State: [ok], Delivered in [0.004101146] seconds [----] I, [2016-09-13T07:00:11.035372 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77667], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473768000], Dequeued in: [8.122636969] seconds [----] I, [2016-09-13T07:00:11.035578 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77667], Delivering... [----] I, [2016-09-13T07:00:11.044234 #2928:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered VMs] invoking action: [generate_widget] for target: [rss_newest_vms] [----] I, [2016-09-13T07:00:11.053476 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77668], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473768000], Dequeued in: [8.123178106] seconds [----] I, [2016-09-13T07:00:11.053722 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77668], Delivering... [----] I, [2016-09-13T07:00:11.068518 #2937:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered Hosts] invoking action: [generate_widget] for target: [rss_newest_hosts] [----] I, [2016-09-13T07:00:11.165409 #2928:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [215], Name: [Generate Widget: 'EVM: Recently Discovered VMs'] for: [1] groups [----] I, [2016-09-13T07:00:11.176689 #2937:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [216], Name: [Generate Widget: 'EVM: Recently Discovered Hosts'] for: [1] groups [----] I, [2016-09-13T07:00:11.235630 #2928:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered VMs] ID: [19] Queueing Content Generation [----] I, [2016-09-13T07:00:11.246756 #2937:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered Hosts] ID: [18] Queueing Content Generation [----] I, [2016-09-13T07:00:11.264448 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77669], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T07:00:11.264688 #2928:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered VMs] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered VMs] [----] I, [2016-09-13T07:00:11.275887 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77670], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T07:00:11.276145 #2937:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered Hosts] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered Hosts] [----] I, [2016-09-13T07:00:11.287332 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77667], State: [ok], Delivered in [0.251690187] seconds [----] I, [2016-09-13T07:00:11.319967 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77668], State: [ok], Delivered in [0.266214095] seconds [----] I, [2016-09-13T07:00:13.084772 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=reporting, wcount=2, priority=200 [----] I, [2016-09-13T07:00:15.440334 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [77669], MiqWorker id: [17], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [4.193360875] seconds [----] I, [2016-09-13T07:00:15.440540 #2967:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77669], Delivering... [----] I, [2016-09-13T07:00:15.470042 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T07:00:15.634270 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T07:00:15.634712 #2967:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77669], State: [ok], Delivered in [0.194161574] seconds [----] I, [2016-09-13T07:00:15.637261 #2967:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [77669], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T07:00:15.637443 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [19], MiqTask ID: [215], Status: [ok] [----] I, [2016-09-13T07:00:15.643555 #2967:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [215] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T07:00:15.790355 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [77670], MiqWorker id: [17], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [4.535850709] seconds [----] I, [2016-09-13T07:00:15.790558 #2967:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77670], Delivering... [----] I, [2016-09-13T07:00:15.823959 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T07:00:15.862989 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T07:00:15.863464 #2967:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77670], State: [ok], Delivered in [0.07285502] seconds [----] I, [2016-09-13T07:00:15.866906 #2967:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [77670], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T07:00:15.867140 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [18], MiqTask ID: [216], Status: [ok] [----] I, [2016-09-13T07:00:15.874121 #2967:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [216] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T07:00:18.373019 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:00:18.422875 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77671], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:00:18.453457 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77672], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:00:18.463127 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered Hosts] with id: [18] [----] I, [2016-09-13T07:00:18.463315 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_18 [----] I, [2016-09-13T07:00:18.467900 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T07:00:18.468715 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 12:00:00 UTC [----] I, [2016-09-13T07:00:18.472267 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered Hosts] schedule updated to run at 2016-09-13 12:00:00 UTC with interval 3600 [----] I, [2016-09-13T07:00:18.472783 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered VMs] with id: [19] [----] I, [2016-09-13T07:00:18.473027 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_19 [----] I, [2016-09-13T07:00:18.476907 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T07:00:18.477357 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 12:00:00 UTC [----] I, [2016-09-13T07:00:18.479594 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered VMs] schedule updated to run at 2016-09-13 12:00:00 UTC with interval 3600 [----] I, [2016-09-13T07:00:24.593980 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:00:24.597456 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037398338317871094, :worker_monitor=>1.4761700630187988, :worker_dequeue=>0.0064585208892822266, :total_time=>1.486654281616211} [----] I, [2016-09-13T07:00:25.337024 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77672], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.905545017] seconds [----] I, [2016-09-13T07:00:25.337135 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77672], Delivering... [----] I, [2016-09-13T07:00:25.340832 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020368099212646484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020499229431152344, :pending_vm_jobs=>0.00044274330139160156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0034973621368408203} [----] I, [2016-09-13T07:00:25.341072 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77672], State: [ok], Delivered in [0.003927748] seconds [----] I, [2016-09-13T07:00:26.360746 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77671], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.954823737] seconds [----] I, [2016-09-13T07:00:26.361007 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77671], Delivering... [----] I, [2016-09-13T07:00:26.366800 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77671], State: [ok], Delivered in [0.005787712] seconds [----] I, [2016-09-13T07:00:29.597900 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:00:29 UTC]... [----] I, [2016-09-13T07:00:29.634336 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:00:29 UTC]...Complete [----] I, [2016-09-13T07:00:33.484232 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:00:33.514959 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77673], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:00:34.663659 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:00:35.412107 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77673], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.921742734] seconds [----] I, [2016-09-13T07:00:35.412290 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77673], Delivering... [----] I, [2016-09-13T07:00:35.418837 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037963390350341797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038166046142578125, :pending_vm_jobs=>0.000843048095703125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006159782409667969} [----] I, [2016-09-13T07:00:35.419147 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77673], State: [ok], Delivered in [0.006859201] seconds [----] I, [2016-09-13T07:00:41.156819 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003960847854614258, :worker_monitor=>1.471095085144043, :worker_dequeue=>0.009771585464477539, :total_time=>1.4851863384246826} [----] I, [2016-09-13T07:00:48.531090 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:00:48.554928 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77674], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:00:48.572292 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77675], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:00:48.583311 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77676], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:00:48.600804 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77677], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:00:51.323691 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:00:51.544154 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77675], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.985027733] seconds [----] I, [2016-09-13T07:00:51.544451 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77675], Delivering... [----] I, [2016-09-13T07:00:51.572538 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77677], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.980516158] seconds [----] I, [2016-09-13T07:00:51.572725 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77677], Delivering... [----] I, [2016-09-13T07:00:51.578441 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029861927032470703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030050277709960938, :pending_vm_jobs=>0.0006821155548095703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0053441524505615234} [----] I, [2016-09-13T07:00:51.578762 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77677], State: [ok], Delivered in [0.006020086] seconds [----] I, [2016-09-13T07:00:51.618141 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77675], State: [ok], Delivered in [0.073705013] seconds [----] I, [2016-09-13T07:00:53.475088 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77674], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.939792167] seconds [----] I, [2016-09-13T07:00:53.475272 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77674], Delivering... [----] I, [2016-09-13T07:00:53.479854 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77674], State: [ok], Delivered in [0.004570639] seconds [----] I, [2016-09-13T07:00:53.486753 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77676], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.909208963] seconds [----] I, [2016-09-13T07:00:53.486981 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77676], Delivering... [----] I, [2016-09-13T07:00:53.490628 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77676], State: [ok], Delivered in [0.003656698] seconds [----] I, [2016-09-13T07:00:58.010445 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00276947021484375, :worker_monitor=>1.6687657833099365, :worker_dequeue=>0.010388374328613281, :total_time=>1.6821537017822266} [----] I, [2016-09-13T07:01:03.011004 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:01:03 UTC]... [----] I, [2016-09-13T07:01:03.035178 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:01:03 UTC]...Complete [----] I, [2016-09-13T07:01:03.615034 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:01:03.635294 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77678], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:01:03.657892 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77679], id: [], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:01:08.073193 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:01:08.624237 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77679], MiqWorker id: [13], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.979430857] seconds [----] I, [2016-09-13T07:01:08.624472 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77679], Delivering... [----] I, [2016-09-13T07:01:08.635846 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77678], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.011814499] seconds [----] I, [2016-09-13T07:01:08.636101 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77678], Delivering... [----] I, [2016-09-13T07:01:08.643249 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003937721252441406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00396275520324707, :pending_vm_jobs=>0.0008227825164794922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006716012954711914} [----] I, [2016-09-13T07:01:08.643639 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77678], State: [ok], Delivered in [0.007537081] seconds [----] I, [2016-09-13T07:01:14.805793 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0045948028564453125, :worker_monitor=>1.7079646587371826, :worker_dequeue=>0.012594938278198242, :total_time=>1.7254352569580078} [----] I, [2016-09-13T07:01:18.667609 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:01:18.695535 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77680], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:01:18.719580 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77681], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:01:19.811386 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:01:19.867905 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77681], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.167038284] seconds [----] I, [2016-09-13T07:01:19.868112 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77681], Delivering... [----] I, [2016-09-13T07:01:19.873716 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002899646759033203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029735565185546875, :pending_vm_jobs=>0.0007419586181640625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005244016647338867} [----] I, [2016-09-13T07:01:19.874044 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77681], State: [ok], Delivered in [0.005929423] seconds [----] I, [2016-09-13T07:01:20.725851 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77680], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.054159527] seconds [----] I, [2016-09-13T07:01:20.726003 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77680], Delivering... [----] I, [2016-09-13T07:01:20.729466 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77680], State: [ok], Delivered in [0.003430733] seconds [----] I, [2016-09-13T07:01:31.336642 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004639148712158203, :worker_monitor=>1.479598045349121, :worker_dequeue=>0.006771564483642578, :total_time=>1.4912967681884766} [----] I, [2016-09-13T07:01:33.727536 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:01:33.754634 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77682], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:01:36.337126 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:01:36 UTC]... [----] I, [2016-09-13T07:01:36.362772 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:01:36 UTC]...Complete [----] I, [2016-09-13T07:01:36.380456 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:01:36.903642 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77682], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.172133297] seconds [----] I, [2016-09-13T07:01:36.903806 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77682], Delivering... [----] I, [2016-09-13T07:01:36.908405 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002468585968017578, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024847984313964844, :pending_vm_jobs=>0.0005664825439453125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004305601119995117} [----] I, [2016-09-13T07:01:36.908715 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77682], State: [ok], Delivered in [0.0048916] seconds [----] I, [2016-09-13T07:01:48.762908 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:01:48.943973 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77683], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:01:49.039328 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77684], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:01:49.068957 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77685], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:01:49.111579 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77686], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:01:49.582110 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:01:49.586139 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005654335021972656, :server_monitor=>0.13816380500793457, :worker_monitor=>3.0334854125976562, :worker_dequeue=>0.00743556022644043, :total_time=>3.1851770877838135} [----] I, [2016-09-13T07:01:50.063176 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77684], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.115227761] seconds [----] I, [2016-09-13T07:01:50.063374 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77684], Delivering... [----] I, [2016-09-13T07:01:50.115583 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77686], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.030463964] seconds [----] I, [2016-09-13T07:01:50.115751 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77686], Delivering... [----] I, [2016-09-13T07:01:50.123915 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0040705204010009766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004097461700439453, :pending_vm_jobs=>0.0010738372802734375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007766008377075195} [----] I, [2016-09-13T07:01:50.127498 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77686], State: [ok], Delivered in [0.011732804] seconds [----] I, [2016-09-13T07:01:50.136649 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77684], State: [ok], Delivered in [0.073242669] seconds [----] I, [2016-09-13T07:01:50.839688 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77683], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.073822487] seconds [----] I, [2016-09-13T07:01:50.839863 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77683], Delivering... [----] I, [2016-09-13T07:01:50.844089 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77683], State: [ok], Delivered in [0.004215477] seconds [----] I, [2016-09-13T07:01:50.925861 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77685], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.882422968] seconds [----] I, [2016-09-13T07:01:50.926078 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77685], Delivering... [----] I, [2016-09-13T07:01:50.930558 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77685], State: [ok], Delivered in [0.00445662] seconds [----] I, [2016-09-13T07:02:04.123076 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:02:04.188467 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77687], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:02:06.824530 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:02:06.834804 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0058252811431884766, :worker_monitor=>2.1959569454193115, :worker_dequeue=>0.01884603500366211, :total_time=>2.2210421562194824} [----] I, [2016-09-13T07:02:07.300569 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77687], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.171484705] seconds [----] I, [2016-09-13T07:02:07.300803 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77687], Delivering... [----] I, [2016-09-13T07:02:07.308133 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003821849822998047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038645267486572266, :pending_vm_jobs=>0.0009324550628662109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006924867630004883} [----] I, [2016-09-13T07:02:07.308561 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77687], State: [ok], Delivered in [0.007747759] seconds [----] I, [2016-09-13T07:02:11.835328 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:02:11 UTC]... [----] I, [2016-09-13T07:02:12.649351 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:02:11 UTC]...Complete [----] I, [2016-09-13T07:02:19.199616 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:02:19.283390 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77688], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:02:19.489409 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77689], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:02:24.664367 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:02:24.671162 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003328084945678711, :worker_monitor=>1.9637224674224854, :worker_dequeue=>0.012178659439086914, :total_time=>1.979475498199463} [----] I, [2016-09-13T07:02:25.467396 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77689], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.180414871] seconds [----] I, [2016-09-13T07:02:25.467559 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77689], Delivering... [----] I, [2016-09-13T07:02:25.472633 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002712726593017578, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002728700637817383, :pending_vm_jobs=>0.0006680488586425781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004792451858520508} [----] I, [2016-09-13T07:02:25.472949 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77689], State: [ok], Delivered in [0.005358065] seconds [----] I, [2016-09-13T07:02:27.098998 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77688], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.895180506] seconds [----] I, [2016-09-13T07:02:27.099122 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77688], Delivering... [----] I, [2016-09-13T07:02:27.102301 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77688], State: [ok], Delivered in [0.003161358] seconds [----] I, [2016-09-13T07:02:34.501835 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:02:34.582325 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77690], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:02:34.702757 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:02:35.577010 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77690], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.069521684] seconds [----] I, [2016-09-13T07:02:35.577280 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77690], Delivering... [----] I, [2016-09-13T07:02:35.586026 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004298210144042969, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004325389862060547, :pending_vm_jobs=>0.0010409355163574219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008185863494873047} [----] I, [2016-09-13T07:02:35.586588 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77690], State: [ok], Delivered in [0.009312526] seconds [----] I, [2016-09-13T07:02:41.504383 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003961801528930664, :worker_monitor=>1.7820875644683838, :worker_dequeue=>0.010327577590942383, :total_time=>1.796651840209961} [----] I, [2016-09-13T07:02:41.898025 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77679], State: [ok], Delivered in [93.273537647] seconds [----] I, [2016-09-13T07:02:46.504880 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:02:46 UTC]... [----] I, [2016-09-13T07:02:46.577293 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:02:46 UTC]...Complete [----] I, [2016-09-13T07:02:49.594292 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:02:49.628257 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77691], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:02:49.656862 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77692], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:02:49.673666 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77693], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:02:49.702789 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77694], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:02:51.723082 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:02:51.773372 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77692], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.141813978] seconds [----] I, [2016-09-13T07:02:51.773640 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77692], Delivering... [----] I, [2016-09-13T07:02:51.840513 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77692], State: [ok], Delivered in [0.066803457] seconds [----] I, [2016-09-13T07:02:51.862646 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77694], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.183329513] seconds [----] I, [2016-09-13T07:02:51.862760 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77694], Delivering... [----] I, [2016-09-13T07:02:51.866056 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0017409324645996094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0017528533935546875, :pending_vm_jobs=>0.0004069805145263672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003075122833251953} [----] I, [2016-09-13T07:02:51.866263 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77694], State: [ok], Delivered in [0.003499728] seconds [----] I, [2016-09-13T07:02:54.166828 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77691], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.568118604] seconds [----] I, [2016-09-13T07:02:54.167063 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77691], Delivering... [----] I, [2016-09-13T07:02:54.171867 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77691], State: [ok], Delivered in [0.004813667] seconds [----] I, [2016-09-13T07:02:54.254612 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77693], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.592791924] seconds [----] I, [2016-09-13T07:02:54.254714 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77693], Delivering... [----] I, [2016-09-13T07:02:54.256700 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77693], State: [ok], Delivered in [0.001979939] seconds [----] I, [2016-09-13T07:02:58.717390 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003430604934692383, :worker_monitor=>1.9740970134735107, :worker_dequeue=>0.01109623908996582, :total_time=>1.9889535903930664} [----] I, [2016-09-13T07:03:04.712175 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:03:04.738699 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77695], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:03:08.747919 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T07:03:08.753246 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:03:08.954592 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77695], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.236490491] seconds [----] I, [2016-09-13T07:03:08.954832 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77695], Delivering... [----] I, [2016-09-13T07:03:08.961196 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003327608108520508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033457279205322266, :pending_vm_jobs=>0.0007734298706054688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005961179733276367} [----] I, [2016-09-13T07:03:08.961541 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77695], State: [ok], Delivered in [0.006734549] seconds [----] I, [2016-09-13T07:03:19.747432 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:03:19 UTC]... [----] I, [2016-09-13T07:03:19.754865 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:03:19.772049 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77696], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:03:19.777473 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:03:19 UTC]...Complete [----] I, [2016-09-13T07:03:19.788502 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:03:19.789264 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77697], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:03:21.321599 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77696], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.561393689] seconds [----] I, [2016-09-13T07:03:21.321789 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77696], Delivering... [----] I, [2016-09-13T07:03:21.326545 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77696], State: [ok], Delivered in [0.004742991] seconds [----] I, [2016-09-13T07:03:24.807075 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:03:25.078292 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77697], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.300497131] seconds [----] I, [2016-09-13T07:03:25.078486 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77697], Delivering... [----] I, [2016-09-13T07:03:25.083666 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002709627151489258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002744913101196289, :pending_vm_jobs=>0.0006232261657714844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004888296127319336} [----] I, [2016-09-13T07:03:25.084728 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77697], State: [ok], Delivered in [0.006244872] seconds [----] I, [2016-09-13T07:03:31.560744 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0044536590576171875, :worker_monitor=>1.72499680519104, :worker_dequeue=>0.015043973922729492, :total_time=>1.744823694229126} [----] I, [2016-09-13T07:03:34.804311 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:03:34.833063 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77698], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:03:34.850267 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77699], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:03:34.862708 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77700], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:03:36.571624 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:03:37.176124 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77698], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.366971889] seconds [----] I, [2016-09-13T07:03:37.176355 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77698], Delivering... [----] I, [2016-09-13T07:03:37.177858 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T07:03:37.178181 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5342023680 [----] I, [2016-09-13T07:03:37.178297 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5119905792 [----] I, [2016-09-13T07:03:37.178438 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 222117888 [----] I, [2016-09-13T07:03:37.178539 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T07:03:37.178612 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5065895936 [----] I, [2016-09-13T07:03:37.178679 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T07:03:37.178755 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T07:03:37.178819 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 543666176 [----] I, [2016-09-13T07:03:37.178882 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T07:03:37.178977 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7865466880 [----] I, [2016-09-13T07:03:37.179053 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T07:03:37.179117 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T07:03:37.179184 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T07:03:37.179250 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 618496 [----] I, [2016-09-13T07:03:37.179314 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T07:03:37.179381 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T07:03:37.179491 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T07:03:37.179566 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T07:03:37.179625 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T07:03:37.179690 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T07:03:37.179752 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273752064 [----] I, [2016-09-13T07:03:37.179826 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56815616 [----] I, [2016-09-13T07:03:37.179897 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216936448 [----] I, [2016-09-13T07:03:37.179976 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6225920 [----] I, [2016-09-13T07:03:37.180051 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141381632 [----] I, [2016-09-13T07:03:37.180111 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2601570304 [----] I, [2016-09-13T07:03:37.180183 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2284359680 [----] I, [2016-09-13T07:03:37.180244 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T07:03:37.180303 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T07:03:37.180380 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T07:03:37.180487 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37277696 [----] I, [2016-09-13T07:03:37.180560 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102273024 [----] I, [2016-09-13T07:03:37.180622 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53112832 [----] I, [2016-09-13T07:03:37.180685 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110833664 [----] I, [2016-09-13T07:03:37.180756 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155385856 [----] I, [2016-09-13T07:03:37.180820 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T07:03:37.180878 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T07:03:37.180955 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T07:03:37.181024 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T07:03:37.181091 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T07:03:37.181151 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T07:03:37.181213 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T07:03:37.181275 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T07:03:37.181333 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T07:03:37.222760 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T07:03:37.223020 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T07:03:37.227272 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77700], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.372779935] seconds [----] I, [2016-09-13T07:03:37.227457 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77700], Delivering... [----] I, [2016-09-13T07:03:37.228218 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T07:03:37.232381 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T07:03:37.233583 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031280517578125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031456947326660156, :pending_vm_jobs=>0.0008001327514648438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005799531936645508} [----] I, [2016-09-13T07:03:37.233874 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77700], State: [ok], Delivered in [0.006440549] seconds [----] I, [2016-09-13T07:03:37.237071 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T07:03:37.242036 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T07:03:37.246958 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T07:03:37.252311 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 843 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T07:03:37.257709 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T07:03:37.262024 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T07:03:37.264883 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T07:03:37.267676 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T07:03:37.272345 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 182 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T07:03:37.277597 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T07:03:37.281665 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:03:37.281868 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:03:37.282072 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T07:03:37.287160 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [150677.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:03:37.287542 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77698], State: [ok], Delivered in [0.111188965] seconds [----] I, [2016-09-13T07:03:41.591671 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:03:42.290604 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77699], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.4532246] seconds [----] I, [2016-09-13T07:03:42.290860 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77699], Delivering... [----] I, [2016-09-13T07:03:42.303362 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:03:30 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48621.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T07:03:42.304336 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:03:31 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [51226.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:03:42.305181 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:03:30 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [202072.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T07:03:42.306015 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:03:19 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [238542.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T07:03:42.306734 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:03:22 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [103919.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T07:03:42.307593 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:03:31 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162417000], Memory % [3.1], CPU Time [37749.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T07:03:42.308454 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:03:31 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [150688.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:03:42.309196 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:03:31 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [149774.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:03:42.313688 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:03:27 UTC], Process Info: Memory Usage [592543744], Memory Size [922411008], Proportional Set Size: [427578000], Memory % [7.22], CPU Time [585.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:03:42.316795 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:03:26 UTC], Process Info: Memory Usage [592515072], Memory Size [922615808], Proportional Set Size: [427660000], Memory % [7.22], CPU Time [1478.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:03:42.319863 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:03:26 UTC], Process Info: Memory Usage [557989888], Memory Size [911458304], Proportional Set Size: [405611000], Memory % [6.8], CPU Time [5315.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T07:03:42.322823 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:03:28 UTC], Process Info: Memory Usage [580972544], Memory Size [923246592], Proportional Set Size: [420460000], Memory % [7.08], CPU Time [1907.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T07:03:42.323603 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:03:30 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [209118.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T07:03:42.324309 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:03:31 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51230.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:03:42.324964 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:03:26 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38645.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T07:03:42.325403 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77699], State: [ok], Delivered in [0.034534312] seconds [----] I, [2016-09-13T07:03:48.179861 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004606723785400391, :server_monitor=>0.17724370956420898, :worker_monitor=>1.3916034698486328, :worker_dequeue=>0.0060083866119384766, :total_time=>1.5798120498657227} [----] I, [2016-09-13T07:03:49.874764 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:03:49.893077 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77701], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:03:49.910220 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77702], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:03:49.927241 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77703], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:03:49.944449 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77704], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:03:53.180273 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:03:53 UTC]... [----] I, [2016-09-13T07:03:53.189648 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:03:53 UTC]...Complete [----] I, [2016-09-13T07:03:53.195627 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:03:53.470650 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77702], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.573275303] seconds [----] I, [2016-09-13T07:03:53.470811 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77702], Delivering... [----] I, [2016-09-13T07:03:53.475832 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77704], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.53929845] seconds [----] I, [2016-09-13T07:03:53.476035 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77704], Delivering... [----] I, [2016-09-13T07:03:53.482462 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003383159637451172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003400087356567383, :pending_vm_jobs=>0.0007669925689697266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060253143310546875} [----] I, [2016-09-13T07:03:53.482800 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77704], State: [ok], Delivered in [0.0067665] seconds [----] I, [2016-09-13T07:03:53.538518 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77702], State: [ok], Delivered in [0.067682397] seconds [----] I, [2016-09-13T07:03:54.533358 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77701], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.653792025] seconds [----] I, [2016-09-13T07:03:54.533586 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77701], Delivering... [----] I, [2016-09-13T07:03:54.538202 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77701], State: [ok], Delivered in [0.004612391] seconds [----] I, [2016-09-13T07:03:54.539585 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77703], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.621139512] seconds [----] I, [2016-09-13T07:03:54.539761 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77703], Delivering... [----] I, [2016-09-13T07:03:54.543240 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77703], State: [ok], Delivered in [0.003308253] seconds [----] I, [2016-09-13T07:04:04.685000 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040853023529052734, :worker_monitor=>1.4577581882476807, :worker_dequeue=>0.00769495964050293, :total_time=>1.4698193073272705} [----] I, [2016-09-13T07:04:04.959810 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T07:04:05.007279 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77705], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:04:05.029952 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77706], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:04:09.695799 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:04:10.607511 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77705], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.642425543] seconds [----] I, [2016-09-13T07:04:10.607750 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77705], Delivering... [----] I, [2016-09-13T07:04:10.617868 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005218029022216797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005247592926025391, :pending_vm_jobs=>0.001367807388305664, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009628772735595703} [----] I, [2016-09-13T07:04:10.618364 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77705], State: [ok], Delivered in [0.010602201] seconds [----] I, [2016-09-13T07:04:12.602742 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77706], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.579070961] seconds [----] I, [2016-09-13T07:04:12.602999 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77706], Delivering... [----] I, [2016-09-13T07:04:12.642106 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77707], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T07:04:12.664962 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77708], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T07:04:12.665562 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77706], State: [ok], Delivered in [0.062560641] seconds [----] I, [2016-09-13T07:04:14.722346 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T07:04:14.725900 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T07:04:16.728029 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [77708], MiqWorker id: [98], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [4.077493988] seconds [----] I, [2016-09-13T07:04:16.728261 #3290:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77708], Delivering... [----] I, [2016-09-13T07:04:16.732463 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T07:04:16.732648 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T07:04:16.732813 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T07:04:16.733023 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T07:04:16.733188 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:17.168287 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:17.480052 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:17.480291 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:17.968483 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [77707], MiqWorker id: [99], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [5.336272761] seconds [----] I, [2016-09-13T07:04:17.968796 #5369:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77707], Delivering... [----] I, [2016-09-13T07:04:17.974592 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T07:04:17.974858 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T07:04:17.975074 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T07:04:17.975324 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T07:04:17.975564 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:18.073037 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:18.263693 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:18.364782 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:18.365058 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:18.465469 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:18.465660 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:18.800766 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:18.850026 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:18.894257 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:18.983850 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:19.155943 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:19.156183 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:19.279852 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:19.383958 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:19.476219 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:19.567747 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:19.652168 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:19.659232 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:19.751992 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:19.844274 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:19.937311 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:19.950300 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:19.950465 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:20.029316 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:20.044955 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:04:20.081679 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77709], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:04:20.121119 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:20.150546 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77710], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:04:20.212506 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:20.304435 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:20.395837 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:20.428982 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:20.487992 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:20.580766 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:20.673205 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:20.752959 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:20.753139 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:20.764982 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:04:20.997321 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T07:04:20.997691 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004004240036010742, :collect_inventory_for_targets=>3.3855438232421875e-05, :parse_legacy_inventory=>15.796069860458374, :parse_targeted_inventory=>15.79621410369873, :save_inventory=>0.8850197792053223, :ems_refresh=>16.683483123779297} [----] I, [2016-09-13T07:04:21.036587 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T07:04:21.037292 #5369:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77707], State: [ok], Delivered in [3.068505239] seconds [----] I, [2016-09-13T07:04:21.115996 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:04:21.122588 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033724308013916016, :worker_monitor=>1.3807311058044434, :worker_dequeue=>0.011865377426147461, :total_time=>1.396212100982666} [----] I, [2016-09-13T07:04:21.270306 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:21.568966 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:21.569134 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:21.624560 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77710], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.537140316] seconds [----] I, [2016-09-13T07:04:21.624792 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77710], Delivering... [----] I, [2016-09-13T07:04:21.631328 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032482147216796875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003265380859375, :pending_vm_jobs=>0.0007202625274658203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006122589111328125} [----] I, [2016-09-13T07:04:21.631806 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77710], State: [ok], Delivered in [0.007082945] seconds [----] I, [2016-09-13T07:04:21.659038 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77709], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.609488493] seconds [----] I, [2016-09-13T07:04:21.659197 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77709], Delivering... [----] I, [2016-09-13T07:04:21.664021 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77709], State: [ok], Delivered in [0.004803996] seconds [----] I, [2016-09-13T07:04:22.047786 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:22.356116 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:22.356305 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:22.814705 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:23.120884 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:23.121072 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:23.589368 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:23.894191 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:23.894376 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:24.380190 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:24.672709 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:24.672874 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:25.137915 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:25.443375 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:25.443599 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:25.915556 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:26.123070 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:04:26 UTC]... [----] I, [2016-09-13T07:04:26.138685 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:04:26 UTC]...Complete [----] I, [2016-09-13T07:04:26.221562 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:26.221676 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:26.679099 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:26.978853 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:26.979104 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:27.460087 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:27.623004 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:27.760636 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:27.895973 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:28.032275 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:28.172620 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:28.308656 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:28.447280 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:28.587195 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:28.722974 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:28.857174 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:28.993610 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:29.134300 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:29.273308 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:29.411325 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:29.899215 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:30.060313 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:30.205555 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:30.349951 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:30.492609 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:30.636368 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:30.779668 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:35.163248 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:04:35.179095 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77711], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:04:36.938273 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:37.081824 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:37.225291 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:37.366226 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:37.505885 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:37.648130 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:37.835712 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:37.858151 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:04:37.864406 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005966901779174805, :worker_monitor=>1.6664350032806396, :worker_dequeue=>0.01101064682006836, :total_time=>1.683856725692749} [----] I, [2016-09-13T07:04:37.973860 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:38.107308 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:38.248691 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:38.712663 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:38.819263 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77711], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.650162214] seconds [----] I, [2016-09-13T07:04:38.819460 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77711], Delivering... [----] I, [2016-09-13T07:04:38.825772 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003238201141357422, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003258228302001953, :pending_vm_jobs=>0.0007791519165039062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005940437316894531} [----] I, [2016-09-13T07:04:38.826180 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77711], State: [ok], Delivered in [0.006734202] seconds [----] I, [2016-09-13T07:04:38.854878 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:38.996997 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:39.130045 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:39.272228 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:39.413918 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:39.547658 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:39.687206 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:39.827019 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:39.972689 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:40.112753 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:40.251402 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:40.393340 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:40.533580 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:40.680341 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:40.826399 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:40.974977 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:41.252053 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:41.416270 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:41.556911 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:41.698187 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:41.840277 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:42.030684 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:42.168654 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:42.307914 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:42.443152 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:42.582141 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:42.720830 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:42.860158 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:42.996517 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:43.135981 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:43.276288 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:43.412662 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:43.545488 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:43.979061 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:44.137731 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:44.272256 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:44.419505 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:44.557270 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:44.705646 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:44.853154 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:44.994328 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:45.142696 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:45.287993 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:45.431734 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:45.567375 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:45.705781 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:45.846239 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:45.980542 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:46.119914 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:46.273718 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:46.707963 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:46.873403 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:47.011558 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:47.149492 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:47.293208 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:47.434673 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:47.576485 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:47.721224 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:50.191200 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:04:50.213174 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77712], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:04:50.224866 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77713], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:04:50.236199 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77714], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:04:50.260974 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77715], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:04:53.887802 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:54.027164 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:54.169770 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:54.312571 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:54.444153 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:54.581169 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:54.640738 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:04:54.648803 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006345272064208984, :worker_monitor=>1.5971455574035645, :worker_dequeue=>0.014117717742919922, :total_time=>1.6179509162902832} [----] I, [2016-09-13T07:04:54.712610 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:54.781168 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77713], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.563728065] seconds [----] I, [2016-09-13T07:04:54.781579 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77713], Delivering... [----] I, [2016-09-13T07:04:54.832796 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77715], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.586755549] seconds [----] I, [2016-09-13T07:04:54.833036 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77715], Delivering... [----] I, [2016-09-13T07:04:54.838040 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77713], State: [ok], Delivered in [0.056657958] seconds [----] I, [2016-09-13T07:04:54.842783 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0041484832763671875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004199028015136719, :pending_vm_jobs=>0.00095367431640625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008335113525390625} [----] I, [2016-09-13T07:04:54.843387 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77715], State: [ok], Delivered in [0.010332763] seconds [----] I, [2016-09-13T07:04:54.850137 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:54.860917 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77712], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.661151338] seconds [----] I, [2016-09-13T07:04:54.861095 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77712], Delivering... [----] I, [2016-09-13T07:04:54.865537 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77712], State: [ok], Delivered in [0.004431304] seconds [----] I, [2016-09-13T07:04:54.878252 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77714], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.647839427] seconds [----] I, [2016-09-13T07:04:54.878510 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77714], Delivering... [----] I, [2016-09-13T07:04:54.881464 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77714], State: [ok], Delivered in [0.002945919] seconds [----] I, [2016-09-13T07:04:54.994210 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:55.410079 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:55.585860 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:55.725366 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:55.858970 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:56.002824 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:56.151017 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:56.294131 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:56.436289 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:56.572137 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:56.710954 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:56.853095 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:56.998039 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:57.150313 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:57.295092 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:57.431688 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:57.584716 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:57.721078 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:58.206823 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:58.388162 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:58.523748 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:58.676468 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:58.815917 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:58.958748 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:59.145184 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:59.283331 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:59.429772 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:59.563043 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:59.649456 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:04:59 UTC]... [----] I, [2016-09-13T07:04:59.706766 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:59.740831 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:04:59 UTC]...Complete [----] I, [2016-09-13T07:04:59.845880 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:04:59.984373 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:00.121956 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:00.256722 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:00.397059 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:00.536874 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:00.917224 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:01.069012 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:01.211994 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:01.353661 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:01.496070 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:01.635799 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:01.784107 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:01.925499 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:02.063403 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:02.204823 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:02.343980 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:02.483490 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:02.624020 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:02.768361 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:02.910259 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:03.044217 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:03.189219 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:03.596266 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:03.781251 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:03.920105 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:04.060237 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:04.203629 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:04.345682 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:04.489785 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:04.664822 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:05.273447 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:05:05.295487 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77716], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:05:10.825712 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:10.963105 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:11.100386 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:11.239784 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:11.346628 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:05:11.353555 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004251718521118164, :worker_monitor=>1.563096284866333, :worker_dequeue=>0.011981010437011719, :total_time=>1.5797197818756104} [----] I, [2016-09-13T07:05:11.382883 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:11.528227 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:11.663458 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:11.794499 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:11.932988 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:12.067334 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77716], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.787891758] seconds [----] I, [2016-09-13T07:05:12.067565 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77716], Delivering... [----] I, [2016-09-13T07:05:12.074195 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032923221588134766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034563541412353516, :pending_vm_jobs=>0.0007593631744384766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006224393844604492} [----] I, [2016-09-13T07:05:12.074571 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77716], State: [ok], Delivered in [0.007001064] seconds [----] I, [2016-09-13T07:05:12.395765 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:12.546387 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:12.691367 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:12.830144 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:12.976182 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:13.114871 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:13.257973 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:13.395773 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:13.585665 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:13.725113 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:13.867717 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:14.006168 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:14.143818 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:14.296072 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:14.435915 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:14.574850 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:14.721564 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:15.118082 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:15.290506 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:15.428141 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:15.568720 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:15.729633 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:15.870673 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:16.011025 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:16.147198 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:16.286872 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:16.429943 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:16.569145 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:16.709354 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:16.849025 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:16.992909 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:17.131612 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:17.275720 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:17.415744 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:17.801260 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:17.965788 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:18.104848 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:18.245832 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:18.389097 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:18.536162 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:18.673106 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:18.823558 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:18.971853 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:19.110180 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:19.264216 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:19.404711 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:19.539523 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:19.681538 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:19.816635 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:19.962834 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:20.097407 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:20.310538 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:05:20.341347 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77717], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:05:20.353627 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77718], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:05:20.554040 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:20.714794 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:20.855626 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:20.995688 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:21.135088 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:21.279100 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:21.378901 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:05:21.420652 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:21.565252 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:21.706754 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:21.964299 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77718], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.617280957] seconds [----] I, [2016-09-13T07:05:21.964502 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77718], Delivering... [----] I, [2016-09-13T07:05:21.971072 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034825801849365234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003610372543334961, :pending_vm_jobs=>0.000728607177734375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006123542785644531} [----] I, [2016-09-13T07:05:21.971382 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77718], State: [ok], Delivered in [0.006881663] seconds [----] I, [2016-09-13T07:05:21.975535 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77717], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.658424525] seconds [----] I, [2016-09-13T07:05:21.975700 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77717], Delivering... [----] I, [2016-09-13T07:05:21.980570 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77717], State: [ok], Delivered in [0.004857454] seconds [----] I, [2016-09-13T07:05:27.834788 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035915374755859375, :worker_monitor=>1.4390017986297607, :worker_dequeue=>0.005173206329345703, :total_time=>1.448091983795166} [----] I, [2016-09-13T07:05:27.872725 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:28.012455 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:28.145091 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:28.292399 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:28.434041 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:28.578150 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:28.722988 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:05:28.867768 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T07:05:29.060222 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T07:05:29.060738 #3290:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T07:05:29.061279 #3290:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T07:05:29.061477 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T07:05:29.061653 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T07:05:29.089771 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T07:05:29.090235 #3290:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [77708], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T07:05:29.090638 #3290:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T07:05:29.091043 #3290:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T07:05:29.091299 #3290:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77708], State: [error], Delivered in [72.363040845] seconds [----] I, [2016-09-13T07:05:32.835325 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:05:32 UTC]... [----] I, [2016-09-13T07:05:32.855297 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:05:32 UTC]...Complete [----] I, [2016-09-13T07:05:35.365813 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:05:35.387142 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77719], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:05:37.891470 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:05:38.215891 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77719], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.843316914] seconds [----] I, [2016-09-13T07:05:38.216180 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77719], Delivering... [----] I, [2016-09-13T07:05:38.225794 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004952669143676758, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0049817562103271484, :pending_vm_jobs=>0.0011701583862304688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009033918380737305} [----] I, [2016-09-13T07:05:38.226250 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77719], State: [ok], Delivered in [0.010073996] seconds [----] I, [2016-09-13T07:05:44.438860 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004103899002075195, :worker_monitor=>1.5263137817382812, :worker_dequeue=>0.009724855422973633, :total_time=>1.5404789447784424} [----] I, [2016-09-13T07:05:50.399738 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:05:50.421203 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77720], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:05:50.433634 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77721], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:05:50.449816 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77722], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:05:50.472704 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77723], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:05:54.599332 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:05:55.118686 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77721], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.693342608] seconds [----] I, [2016-09-13T07:05:55.118871 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77721], Delivering... [----] I, [2016-09-13T07:05:55.124260 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77723], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.665290638] seconds [----] I, [2016-09-13T07:05:55.124482 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77723], Delivering... [----] I, [2016-09-13T07:05:55.131114 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003505706787109375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035245418548583984, :pending_vm_jobs=>0.0008413791656494141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006212472915649414} [----] I, [2016-09-13T07:05:55.131526 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77723], State: [ok], Delivered in [0.007072744] seconds [----] I, [2016-09-13T07:05:55.158653 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77720], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.754521214] seconds [----] I, [2016-09-13T07:05:55.158839 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77720], Delivering... [----] I, [2016-09-13T07:05:55.163662 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77720], State: [ok], Delivered in [0.004813443] seconds [----] I, [2016-09-13T07:05:55.204190 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77721], State: [ok], Delivered in [0.085196142] seconds [----] I, [2016-09-13T07:05:55.233243 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77722], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.794012925] seconds [----] I, [2016-09-13T07:05:55.233530 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77722], Delivering... [----] I, [2016-09-13T07:05:55.237560 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77722], State: [ok], Delivered in [0.004048552] seconds [----] I, [2016-09-13T07:06:00.993547 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039632320404052734, :worker_monitor=>1.367532730102539, :worker_dequeue=>0.015052556991577148, :total_time=>1.386831521987915} [----] I, [2016-09-13T07:06:05.483977 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:06:05.499601 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77724], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:06:05.993990 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:06:05 UTC]... [----] I, [2016-09-13T07:06:06.036676 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:06:05 UTC]...Complete [----] I, [2016-09-13T07:06:06.044072 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:06:06.437746 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77724], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.949391305] seconds [----] I, [2016-09-13T07:06:06.437893 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77724], Delivering... [----] I, [2016-09-13T07:06:06.442110 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002349853515625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023632049560546875, :pending_vm_jobs=>0.0004696846008300781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003945350646972656} [----] I, [2016-09-13T07:06:06.442367 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77724], State: [ok], Delivered in [0.004476112] seconds [----] I, [2016-09-13T07:06:17.380495 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003789663314819336, :worker_monitor=>1.301454782485962, :worker_dequeue=>0.010262012481689453, :total_time=>1.315758228302002} [----] I, [2016-09-13T07:06:20.511314 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:06:20.527380 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77725], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:06:20.538264 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77726], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:06:22.390089 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:06:22.563447 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77726], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.030182909] seconds [----] I, [2016-09-13T07:06:22.563638 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77726], Delivering... [----] I, [2016-09-13T07:06:22.569851 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033125877380371094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033338069915771484, :pending_vm_jobs=>0.0007729530334472656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005881309509277344} [----] I, [2016-09-13T07:06:22.570212 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77726], State: [ok], Delivered in [0.006569164] seconds [----] I, [2016-09-13T07:06:25.304262 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77725], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.78793009] seconds [----] I, [2016-09-13T07:06:25.304390 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77725], Delivering... [----] I, [2016-09-13T07:06:25.307818 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77725], State: [ok], Delivered in [0.003376131] seconds [----] I, [2016-09-13T07:06:33.668689 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038650035858154297, :worker_monitor=>1.24434232711792, :worker_dequeue=>0.007547855377197266, :total_time=>1.2560882568359375} [----] I, [2016-09-13T07:06:35.550110 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:06:35.572601 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77727], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:06:38.669136 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:06:38 UTC]... [----] I, [2016-09-13T07:06:38.745710 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:06:38 UTC]...Complete [----] I, [2016-09-13T07:06:38.756741 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:06:39.675805 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77727], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.117509165] seconds [----] I, [2016-09-13T07:06:39.676027 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77727], Delivering... [----] I, [2016-09-13T07:06:39.681982 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030748844146728516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030944347381591797, :pending_vm_jobs=>0.0007541179656982422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055561065673828125} [----] I, [2016-09-13T07:06:39.682327 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77727], State: [ok], Delivered in [0.006310198] seconds [----] I, [2016-09-13T07:06:50.322352 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038635730743408203, :worker_monitor=>1.5313820838928223, :worker_dequeue=>0.009985208511352539, :total_time=>1.5455591678619385} [----] I, [2016-09-13T07:06:50.583406 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:06:50.601502 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77728], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:06:50.612809 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77729], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:06:50.629976 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77730], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:06:50.647086 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77731], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:06:55.392223 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:06:55.407153 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77729], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.800861368] seconds [----] I, [2016-09-13T07:06:55.407281 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77729], Delivering... [----] I, [2016-09-13T07:06:55.441459 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77729], State: [ok], Delivered in [0.034120866] seconds [----] I, [2016-09-13T07:06:55.459439 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77731], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.819653868] seconds [----] I, [2016-09-13T07:06:55.459556 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77731], Delivering... [----] I, [2016-09-13T07:06:55.463026 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0019211769104003906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0019350051879882812, :pending_vm_jobs=>0.0004239082336425781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0032525062561035156} [----] I, [2016-09-13T07:06:55.463232 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77731], State: [ok], Delivered in [0.003681046] seconds [----] I, [2016-09-13T07:06:55.481506 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77728], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.891329869] seconds [----] I, [2016-09-13T07:06:55.481690 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77728], Delivering... [----] I, [2016-09-13T07:06:55.486147 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77728], State: [ok], Delivered in [0.00444247] seconds [----] I, [2016-09-13T07:06:55.510018 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77730], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.890484761] seconds [----] I, [2016-09-13T07:06:55.510179 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77730], Delivering... [----] I, [2016-09-13T07:06:55.513050 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77730], State: [ok], Delivered in [0.00286097] seconds [----] I, [2016-09-13T07:07:05.659396 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:07:05.676735 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77732], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:07:06.752576 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:07:06.759011 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002789020538330078, :worker_monitor=>1.3307523727416992, :worker_dequeue=>0.011494874954223633, :total_time=>1.3452613353729248} [----] I, [2016-09-13T07:07:06.859864 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77732], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.193096929] seconds [----] I, [2016-09-13T07:07:06.860072 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77732], Delivering... [----] I, [2016-09-13T07:07:06.866054 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031135082244873047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031311511993408203, :pending_vm_jobs=>0.0007269382476806641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005604982376098633} [----] I, [2016-09-13T07:07:06.866356 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77732], State: [ok], Delivered in [0.006285936] seconds [----] I, [2016-09-13T07:07:11.759569 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:07:11 UTC]... [----] I, [2016-09-13T07:07:11.778763 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:07:11 UTC]...Complete [----] I, [2016-09-13T07:07:20.687130 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:07:20.698692 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77733], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:07:20.710104 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77734], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:07:23.384621 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:07:23.389047 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040705204010009766, :worker_monitor=>1.5565216541290283, :worker_dequeue=>0.008074045181274414, :total_time=>1.5689613819122314} [----] I, [2016-09-13T07:07:24.351498 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77734], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.649165979] seconds [----] I, [2016-09-13T07:07:24.351681 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77734], Delivering... [----] I, [2016-09-13T07:07:24.358030 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003226041793823242, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003247499465942383, :pending_vm_jobs=>0.0009050369262695312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005875825881958008} [----] I, [2016-09-13T07:07:24.358393 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77734], State: [ok], Delivered in [0.006704831] seconds [----] I, [2016-09-13T07:07:25.979547 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77733], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.28955888] seconds [----] I, [2016-09-13T07:07:25.979719 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77733], Delivering... [----] I, [2016-09-13T07:07:25.983700 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77733], State: [ok], Delivered in [0.003973421] seconds [----] I, [2016-09-13T07:07:35.721037 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:07:35.738991 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77735], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:07:39.880696 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:07:39.887818 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00400090217590332, :worker_monitor=>1.44500732421875, :worker_dequeue=>0.012499094009399414, :total_time=>1.461775779724121} [----] I, [2016-09-13T07:07:40.447543 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77735], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.719997088] seconds [----] I, [2016-09-13T07:07:40.447662 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77735], Delivering... [----] I, [2016-09-13T07:07:40.451398 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00213623046875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002148866653442383, :pending_vm_jobs=>0.00041031837463378906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0034813880920410156} [----] I, [2016-09-13T07:07:40.451600 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77735], State: [ok], Delivered in [0.003939559] seconds [----] I, [2016-09-13T07:07:44.888412 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:07:44 UTC]... [----] I, [2016-09-13T07:07:44.917569 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:07:44 UTC]...Complete [----] I, [2016-09-13T07:07:50.750884 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:07:50.774726 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77736], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:07:50.785822 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77737], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:07:50.803204 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77738], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:07:50.820402 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77739], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:07:56.576036 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:07:56.580387 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003900766372680664, :worker_monitor=>1.6243741512298584, :worker_dequeue=>0.008292675018310547, :total_time=>1.6370112895965576} [----] I, [2016-09-13T07:07:57.591837 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77737], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.812809829] seconds [----] I, [2016-09-13T07:07:57.592028 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77737], Delivering... [----] I, [2016-09-13T07:07:57.609481 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77739], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.797030709] seconds [----] I, [2016-09-13T07:07:57.609701 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77739], Delivering... [----] I, [2016-09-13T07:07:57.617338 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004033088684082031, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004057884216308594, :pending_vm_jobs=>0.0009925365447998047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00711822509765625} [----] I, [2016-09-13T07:07:57.617743 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77739], State: [ok], Delivered in [0.008046858] seconds [----] I, [2016-09-13T07:07:57.648770 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77737], State: [ok], Delivered in [0.056716701] seconds [----] I, [2016-09-13T07:07:59.088978 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77736], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.333710347] seconds [----] I, [2016-09-13T07:07:59.089187 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77736], Delivering... [----] I, [2016-09-13T07:07:59.094680 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77736], State: [ok], Delivered in [0.005481816] seconds [----] I, [2016-09-13T07:07:59.117793 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77738], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.326608813] seconds [----] I, [2016-09-13T07:07:59.117998 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77738], Delivering... [----] I, [2016-09-13T07:07:59.121443 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77738], State: [ok], Delivered in [0.003408748] seconds [----] I, [2016-09-13T07:08:05.836196 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:08:05.849137 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77740], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:08:06.662608 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:08:06.729570 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77740], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.887505311] seconds [----] I, [2016-09-13T07:08:06.729771 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77740], Delivering... [----] I, [2016-09-13T07:08:06.737136 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003702402114868164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037741661071777344, :pending_vm_jobs=>0.0009036064147949219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006924629211425781} [----] I, [2016-09-13T07:08:06.737557 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77740], State: [ok], Delivered in [0.007776672] seconds [----] I, [2016-09-13T07:08:11.685496 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T07:08:12.849704 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004455089569091797, :log_active_servers=>0.011890411376953125, :worker_monitor=>1.1535906791687012, :worker_dequeue=>0.010237693786621094, :total_time=>1.180532455444336} [----] I, [2016-09-13T07:08:17.850207 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:08:17 UTC]... [----] I, [2016-09-13T07:08:17.865900 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:08:17 UTC]...Complete [----] I, [2016-09-13T07:08:20.861300 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:08:20.871986 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77741], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:08:20.883188 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77742], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:08:22.893169 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:08:23.203387 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77742], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.325898693] seconds [----] I, [2016-09-13T07:08:23.203587 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77742], Delivering... [----] I, [2016-09-13T07:08:23.210462 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003263711929321289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003318309783935547, :pending_vm_jobs=>0.0009009838104248047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006475210189819336} [----] I, [2016-09-13T07:08:23.210766 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77742], State: [ok], Delivered in [0.007177535] seconds [----] I, [2016-09-13T07:08:23.237622 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77741], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.371813501] seconds [----] I, [2016-09-13T07:08:23.237794 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77741], Delivering... [----] I, [2016-09-13T07:08:23.242853 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77741], State: [ok], Delivered in [0.005049406] seconds [----] I, [2016-09-13T07:08:35.898234 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:08:35.911851 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77743], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:08:35.923242 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77744], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:08:35.934636 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77745], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:08:38.874802 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:08:38.912471 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77743], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.009741662] seconds [----] I, [2016-09-13T07:08:38.912654 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77743], Delivering... [----] I, [2016-09-13T07:08:38.913898 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T07:08:38.914135 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5356396544 [----] I, [2016-09-13T07:08:38.914229 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5133783040 [----] I, [2016-09-13T07:08:38.914317 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 222613504 [----] I, [2016-09-13T07:08:38.914392 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T07:08:38.914510 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5079822336 [----] I, [2016-09-13T07:08:38.914589 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T07:08:38.914666 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T07:08:38.914740 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 543936512 [----] I, [2016-09-13T07:08:38.914816 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T07:08:38.914886 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8052228096 [----] I, [2016-09-13T07:08:38.914978 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T07:08:38.915058 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T07:08:38.915128 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T07:08:38.915224 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T07:08:38.915297 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T07:08:38.915367 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T07:08:38.915455 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T07:08:38.915537 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T07:08:38.915604 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T07:08:38.915675 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T07:08:38.915744 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273522688 [----] I, [2016-09-13T07:08:38.915821 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56815616 [----] I, [2016-09-13T07:08:38.915891 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216707072 [----] I, [2016-09-13T07:08:38.915983 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T07:08:38.916063 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141381632 [----] I, [2016-09-13T07:08:38.916139 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2587750400 [----] I, [2016-09-13T07:08:38.916211 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2270273536 [----] I, [2016-09-13T07:08:38.916282 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T07:08:38.916351 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T07:08:38.916449 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T07:08:38.916532 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37556224 [----] I, [2016-09-13T07:08:38.916605 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102273024 [----] I, [2016-09-13T07:08:38.916673 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53428224 [----] I, [2016-09-13T07:08:38.916744 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110833664 [----] I, [2016-09-13T07:08:38.916825 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155701248 [----] I, [2016-09-13T07:08:38.916892 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T07:08:38.916992 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T07:08:38.917062 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T07:08:38.917137 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T07:08:38.917206 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T07:08:38.917271 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T07:08:38.917339 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T07:08:38.917407 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T07:08:38.917519 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T07:08:38.935117 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77745], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.00683313] seconds [----] I, [2016-09-13T07:08:38.935274 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77745], Delivering... [----] I, [2016-09-13T07:08:38.941073 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029821395874023438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030236244201660156, :pending_vm_jobs=>0.0007176399230957031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005458831787109375} [----] I, [2016-09-13T07:08:38.941436 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77745], State: [ok], Delivered in [0.006139099] seconds [----] I, [2016-09-13T07:08:38.954178 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T07:08:38.954391 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T07:08:38.958522 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T07:08:38.961517 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T07:08:38.965069 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T07:08:38.968588 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T07:08:38.972151 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T07:08:38.975586 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 844 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T07:08:38.979008 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T07:08:38.982957 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T07:08:38.986407 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T07:08:38.989784 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T07:08:38.993264 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T07:08:38.996682 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T07:08:38.999612 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:08:38.999758 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:08:38.999864 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T07:08:39.004222 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [149862.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T07:08:39.004616 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77743], State: [ok], Delivered in [0.091947954] seconds [----] I, [2016-09-13T07:08:45.019491 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:08:45.023029 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004038810729980469, :worker_monitor=>1.1272704601287842, :worker_dequeue=>0.006357908248901367, :total_time=>1.1379199028015137} [----] I, [2016-09-13T07:08:45.072442 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77744], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [9.156636997] seconds [----] I, [2016-09-13T07:08:45.072662 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77744], Delivering... [----] I, [2016-09-13T07:08:45.080789 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:08:42 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212541000], Memory % [3.5], CPU Time [48629.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T07:08:45.081477 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:08:44 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [51241.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:08:45.082071 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:08:43 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162418000], Memory % [3.1], CPU Time [37759.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T07:08:45.082641 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:08:44 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [202154.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T07:08:45.083217 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:08:35 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205293000], Memory % [3.5], CPU Time [238673.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T07:08:45.083795 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:08:44 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [149881.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:08:45.084282 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:08:34 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347149000], Memory % [5.04], CPU Time [103936.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T07:08:45.084813 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:08:43 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [150783.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:08:45.087826 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:08:41 UTC], Process Info: Memory Usage [592773120], Memory Size [937091072], Proportional Set Size: [427803000], Memory % [7.23], CPU Time [625.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:08:45.090004 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:08:39 UTC], Process Info: Memory Usage [603406336], Memory Size [1059606528], Proportional Set Size: [438367000], Memory % [7.36], CPU Time [1620.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:08:45.092224 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:08:38 UTC], Process Info: Memory Usage [581210112], Memory Size [937926656], Proportional Set Size: [420684000], Memory % [7.09], CPU Time [1918.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T07:08:45.094394 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:08:36 UTC], Process Info: Memory Usage [558530560], Memory Size [930906112], Proportional Set Size: [406132000], Memory % [6.81], CPU Time [5326.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T07:08:45.095011 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:08:44 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357918000], Memory % [5.27], CPU Time [209219.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T07:08:45.095575 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:08:44 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [51276.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:08:45.096082 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:08:38 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38656.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T07:08:45.096403 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77744], State: [ok], Delivered in [0.023746413] seconds [----] I, [2016-09-13T07:08:50.023560 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:08:50 UTC]... [----] I, [2016-09-13T07:08:50.046823 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:08:50 UTC]...Complete [----] I, [2016-09-13T07:08:50.946141 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:08:50.968034 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77746], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:08:50.978125 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77747], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:08:50.989524 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77748], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:08:51.006948 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77749], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:08:55.076571 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:08:55.195438 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77747], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.222905209] seconds [----] I, [2016-09-13T07:08:55.195654 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77747], Delivering... [----] I, [2016-09-13T07:08:55.258177 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77747], State: [ok], Delivered in [0.062502962] seconds [----] I, [2016-09-13T07:08:55.281114 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77749], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.282542213] seconds [----] I, [2016-09-13T07:08:55.281294 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77749], Delivering... [----] I, [2016-09-13T07:08:55.287815 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003455638885498047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034804344177246094, :pending_vm_jobs=>0.0008099079132080078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006129264831542969} [----] I, [2016-09-13T07:08:55.288174 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77749], State: [ok], Delivered in [0.006871792] seconds [----] I, [2016-09-13T07:08:56.374305 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77746], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.421420267] seconds [----] I, [2016-09-13T07:08:56.374567 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77746], Delivering... [----] I, [2016-09-13T07:08:56.380370 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77746], State: [ok], Delivered in [0.005810901] seconds [----] I, [2016-09-13T07:08:56.390528 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77748], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.406510855] seconds [----] I, [2016-09-13T07:08:56.390781 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77748], Delivering... [----] I, [2016-09-13T07:08:56.394889 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77748], State: [ok], Delivered in [0.004117398] seconds [----] I, [2016-09-13T07:09:01.395008 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005571126937866211, :worker_monitor=>1.298257827758789, :worker_dequeue=>0.007688045501708984, :total_time=>1.3118293285369873} [----] I, [2016-09-13T07:09:06.020313 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:09:06.037271 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77750], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:09:06.505211 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:09:07.157231 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77750], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.130797666] seconds [----] I, [2016-09-13T07:09:07.157462 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77750], Delivering... [----] I, [2016-09-13T07:09:07.164813 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038330554962158203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038607120513916016, :pending_vm_jobs=>0.000926971435546875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006907224655151367} [----] I, [2016-09-13T07:09:07.165227 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77750], State: [ok], Delivered in [0.007791155] seconds [----] I, [2016-09-13T07:09:17.702648 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003917694091796875, :worker_monitor=>1.1617040634155273, :worker_dequeue=>0.007215261459350586, :total_time=>1.173088550567627} [----] I, [2016-09-13T07:09:21.049167 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:09:21.065868 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77751], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:09:21.077095 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77752], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:09:22.703167 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:09:22 UTC]... [----] I, [2016-09-13T07:09:22.728485 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:09:22 UTC]...Complete [----] I, [2016-09-13T07:09:22.744367 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:09:23.278909 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77752], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.207392443] seconds [----] I, [2016-09-13T07:09:23.279194 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77752], Delivering... [----] I, [2016-09-13T07:09:23.285832 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037865638732910156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038101673126220703, :pending_vm_jobs=>0.0006740093231201172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006200313568115234} [----] I, [2016-09-13T07:09:23.286123 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77752], State: [ok], Delivered in [0.006942513] seconds [----] I, [2016-09-13T07:09:23.483873 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77751], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.429655237] seconds [----] I, [2016-09-13T07:09:23.484190 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77751], Delivering... [----] I, [2016-09-13T07:09:23.492523 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77751], State: [ok], Delivered in [0.008298039] seconds [----] I, [2016-09-13T07:09:33.947826 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003905773162841797, :worker_monitor=>1.1631295680999756, :worker_dequeue=>0.011005878448486328, :total_time=>1.1783499717712402} [----] I, [2016-09-13T07:09:36.087697 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:09:36.106104 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77753], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:09:38.955171 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:09:39.416624 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77753], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.323754011] seconds [----] I, [2016-09-13T07:09:39.416854 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77753], Delivering... [----] I, [2016-09-13T07:09:39.427689 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005104541778564453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005141735076904297, :pending_vm_jobs=>0.0016410350799560547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010316848754882812} [----] I, [2016-09-13T07:09:39.428234 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77753], State: [ok], Delivered in [0.01137628] seconds [----] I, [2016-09-13T07:09:50.207367 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00455784797668457, :worker_monitor=>1.2158987522125244, :worker_dequeue=>0.0059010982513427734, :total_time=>1.2266514301300049} [----] I, [2016-09-13T07:09:51.117605 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:09:51.136509 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77754], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:09:51.147885 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77755], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:09:51.159224 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77756], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:09:51.176677 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77757], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:09:55.207850 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:09:55 UTC]... [----] I, [2016-09-13T07:09:55.256792 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:09:55 UTC]...Complete [----] I, [2016-09-13T07:09:55.267898 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:09:55.634032 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77755], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.493571263] seconds [----] I, [2016-09-13T07:09:55.634231 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77755], Delivering... [----] I, [2016-09-13T07:09:55.691019 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77757], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.522549111] seconds [----] I, [2016-09-13T07:09:55.691214 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77757], Delivering... [----] I, [2016-09-13T07:09:55.696566 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77755], State: [ok], Delivered in [0.062320657] seconds [----] I, [2016-09-13T07:09:55.701608 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0055348873138427734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005562543869018555, :pending_vm_jobs=>0.0011622905731201172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009859561920166016} [----] I, [2016-09-13T07:09:55.702032 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77757], State: [ok], Delivered in [0.010796402] seconds [----] I, [2016-09-13T07:09:56.584217 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77754], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.458420907] seconds [----] I, [2016-09-13T07:09:56.584584 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77754], Delivering... [----] I, [2016-09-13T07:09:56.592643 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77754], State: [ok], Delivered in [0.008043925] seconds [----] I, [2016-09-13T07:09:56.605439 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77756], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.452232188] seconds [----] I, [2016-09-13T07:09:56.605644 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77756], Delivering... [----] I, [2016-09-13T07:09:56.613636 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77756], State: [ok], Delivered in [0.007972473] seconds [----] I, [2016-09-13T07:10:06.188433 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T07:10:06.199728 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77758], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:10:06.219519 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77759], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:10:06.233814 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77760], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:10:06.245845 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77761], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:10:06.634322 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:10:06.639036 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003879547119140625, :worker_monitor=>1.336111307144165, :worker_dequeue=>0.008676767349243164, :total_time=>1.3489322662353516} [----] I, [2016-09-13T07:10:06.817051 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77758], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.62307776] seconds [----] I, [2016-09-13T07:10:06.817203 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77758], Delivering... [----] I, [2016-09-13T07:10:06.822832 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029184818267822266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002953767776489258, :pending_vm_jobs=>0.0006954669952392578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0053272247314453125} [----] I, [2016-09-13T07:10:06.823157 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77758], State: [ok], Delivered in [0.005947327] seconds [----] I, [2016-09-13T07:10:08.645498 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77759], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.438469394] seconds [----] I, [2016-09-13T07:10:08.645681 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77759], Delivering... [----] I, [2016-09-13T07:10:08.648160 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77759], State: [ok], Delivered in [0.002472044] seconds [----] I, [2016-09-13T07:10:08.668693 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77760], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.443947518] seconds [----] I, [2016-09-13T07:10:08.668874 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77760], Delivering... [----] I, [2016-09-13T07:10:08.673977 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77761], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.435004148] seconds [----] I, [2016-09-13T07:10:08.674155 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77761], Delivering... [----] I, [2016-09-13T07:10:08.680593 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77760], State: [ok], Delivered in [0.011686586] seconds [----] I, [2016-09-13T07:10:08.684473 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77761], State: [ok], Delivered in [0.010280706] seconds [----] I, [2016-09-13T07:10:21.255175 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:10:21.274377 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77762], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:10:21.291490 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77763], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:10:22.919686 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:10:22.927632 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003532886505126953, :worker_monitor=>1.182020664215088, :worker_dequeue=>0.015263795852661133, :total_time=>1.2011051177978516} [----] I, [2016-09-13T07:10:22.938730 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77763], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.658652791] seconds [----] I, [2016-09-13T07:10:22.938946 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77763], Delivering... [----] I, [2016-09-13T07:10:22.945289 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032393932342529297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032606124877929688, :pending_vm_jobs=>0.000774383544921875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005945920944213867} [----] I, [2016-09-13T07:10:22.945606 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77763], State: [ok], Delivered in [0.006671272] seconds [----] I, [2016-09-13T07:10:23.750233 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77762], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.490570172] seconds [----] I, [2016-09-13T07:10:23.750407 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77762], Delivering... [----] I, [2016-09-13T07:10:23.755796 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77762], State: [ok], Delivered in [0.005379912] seconds [----] I, [2016-09-13T07:10:27.928474 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:10:27 UTC]... [----] I, [2016-09-13T07:10:27.950009 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:10:27 UTC]...Complete [----] I, [2016-09-13T07:10:36.307014 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:10:36.321610 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77764], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:10:39.127035 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:10:39.132384 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036971569061279297, :worker_monitor=>1.1352148056030273, :worker_dequeue=>0.008556127548217773, :total_time=>1.1477432250976562} [----] I, [2016-09-13T07:10:40.001903 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77764], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.689201664] seconds [----] I, [2016-09-13T07:10:40.002089 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77764], Delivering... [----] I, [2016-09-13T07:10:40.007977 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003188610076904297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032052993774414062, :pending_vm_jobs=>0.0006833076477050781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055332183837890625} [----] I, [2016-09-13T07:10:40.008309 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77764], State: [ok], Delivered in [0.006215955] seconds [----] I, [2016-09-13T07:10:51.333517 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:10:51.345592 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77765], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:10:51.355702 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77766], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:10:51.367385 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77767], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:10:51.378619 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77768], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:10:55.518573 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:10:55.524967 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003126382827758789, :worker_monitor=>1.3453657627105713, :worker_dequeue=>0.011650800704956055, :total_time=>1.360398769378662} [----] I, [2016-09-13T07:10:56.127778 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77766], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.777930582] seconds [----] I, [2016-09-13T07:10:56.128005 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77766], Delivering... [----] I, [2016-09-13T07:10:56.169615 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77768], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.796947526] seconds [----] I, [2016-09-13T07:10:56.169853 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77768], Delivering... [----] I, [2016-09-13T07:10:56.176993 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003699064254760742, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003786325454711914, :pending_vm_jobs=>0.0008804798126220703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006654500961303711} [----] I, [2016-09-13T07:10:56.177441 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77768], State: [ok], Delivered in [0.007554004] seconds [----] I, [2016-09-13T07:10:56.190437 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77766], State: [ok], Delivered in [0.062395897] seconds [----] I, [2016-09-13T07:10:56.847977 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77765], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.509893148] seconds [----] I, [2016-09-13T07:10:56.848182 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77765], Delivering... [----] I, [2016-09-13T07:10:56.853940 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77765], State: [ok], Delivered in [0.005725448] seconds [----] I, [2016-09-13T07:10:56.887793 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77767], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.526905396] seconds [----] I, [2016-09-13T07:10:56.888034 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77767], Delivering... [----] I, [2016-09-13T07:10:56.893061 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77767], State: [ok], Delivered in [0.004993341] seconds [----] I, [2016-09-13T07:11:00.525616 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:11:00 UTC]... [----] I, [2016-09-13T07:11:00.550483 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:11:00 UTC]...Complete [----] I, [2016-09-13T07:11:06.385452 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:11:06.396050 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77769], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:11:12.024261 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:11:12.032781 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00404047966003418, :worker_monitor=>1.4309906959533691, :worker_dequeue=>0.014194965362548828, :total_time=>1.4495136737823486} [----] I, [2016-09-13T07:11:12.289801 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77769], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.900818198] seconds [----] I, [2016-09-13T07:11:12.289992 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77769], Delivering... [----] I, [2016-09-13T07:11:12.296255 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031599998474121094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003261089324951172, :pending_vm_jobs=>0.0007846355438232422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00590205192565918} [----] I, [2016-09-13T07:11:12.296645 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77769], State: [ok], Delivered in [0.006643444] seconds [----] I, [2016-09-13T07:11:21.409164 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:11:21.432754 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77770], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:11:21.461525 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77771], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:11:22.164763 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:11:22.371044 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77771], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.931067823] seconds [----] I, [2016-09-13T07:11:22.371214 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77771], Delivering... [----] I, [2016-09-13T07:11:22.377569 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033457279205322266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00336456298828125, :pending_vm_jobs=>0.0007882118225097656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005980014801025391} [----] I, [2016-09-13T07:11:22.377940 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77771], State: [ok], Delivered in [0.006711823] seconds [----] I, [2016-09-13T07:11:23.948100 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77770], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.531664069] seconds [----] I, [2016-09-13T07:11:23.948311 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77770], Delivering... [----] I, [2016-09-13T07:11:23.953648 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77770], State: [ok], Delivered in [0.005326393] seconds [----] I, [2016-09-13T07:11:28.349172 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003947734832763672, :worker_monitor=>1.1622896194458008, :worker_dequeue=>0.010798931121826172, :total_time=>1.1774423122406006} [----] I, [2016-09-13T07:11:33.349704 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:11:33 UTC]... [----] I, [2016-09-13T07:11:33.369666 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:11:33 UTC]...Complete [----] I, [2016-09-13T07:11:36.473478 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:11:36.490056 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77772], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:11:38.395456 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:11:38.461168 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77772], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.981683661] seconds [----] I, [2016-09-13T07:11:38.461321 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77772], Delivering... [----] I, [2016-09-13T07:11:38.466726 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002780437469482422, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002795696258544922, :pending_vm_jobs=>0.0006802082061767578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005067110061645508} [----] I, [2016-09-13T07:11:38.467066 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77772], State: [ok], Delivered in [0.005737084] seconds [----] I, [2016-09-13T07:11:44.663450 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003837108612060547, :worker_monitor=>1.2516162395477295, :worker_dequeue=>0.005681514739990234, :total_time=>1.261495590209961} [----] I, [2016-09-13T07:11:51.502034 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:11:51.514150 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77773], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:11:51.524124 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77774], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:11:51.535334 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77775], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:11:51.552383 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77776], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:11:54.691305 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:11:55.639212 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77774], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.121105341] seconds [----] I, [2016-09-13T07:11:55.639439 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77774], Delivering... [----] I, [2016-09-13T07:11:55.650623 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77776], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.10677006] seconds [----] I, [2016-09-13T07:11:55.650827 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77776], Delivering... [----] I, [2016-09-13T07:11:55.657792 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003759622573852539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003782510757446289, :pending_vm_jobs=>0.0008444786071777344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006546497344970703} [----] I, [2016-09-13T07:11:55.658147 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77776], State: [ok], Delivered in [0.007322019] seconds [----] I, [2016-09-13T07:11:55.695814 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77774], State: [ok], Delivered in [0.0563865] seconds [----] I, [2016-09-13T07:11:57.055472 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77773], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.548929825] seconds [----] I, [2016-09-13T07:11:57.055624 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77773], Delivering... [----] I, [2016-09-13T07:11:57.059805 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77773], State: [ok], Delivered in [0.004173051] seconds [----] I, [2016-09-13T07:11:57.078948 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77775], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.550017803] seconds [----] I, [2016-09-13T07:11:57.079080 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77775], Delivering... [----] I, [2016-09-13T07:11:57.081279 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77775], State: [ok], Delivered in [0.002201155] seconds [----] I, [2016-09-13T07:12:00.824199 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005113840103149414, :worker_monitor=>1.1106841564178467, :worker_dequeue=>0.010233640670776367, :total_time=>1.1263477802276611} [----] I, [2016-09-13T07:12:05.824718 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:12:05 UTC]... [----] I, [2016-09-13T07:12:05.872739 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:12:05 UTC]...Complete [----] I, [2016-09-13T07:12:06.560603 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:12:06.577988 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77777], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:12:10.901109 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:12:11.764306 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77777], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.197096908] seconds [----] I, [2016-09-13T07:12:11.764487 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77777], Delivering... [----] I, [2016-09-13T07:12:11.769890 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002815723419189453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028867721557617188, :pending_vm_jobs=>0.0006473064422607422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005084991455078125} [----] I, [2016-09-13T07:12:11.770195 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77777], State: [ok], Delivered in [0.005715892] seconds [----] I, [2016-09-13T07:12:21.591188 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:12:21.616049 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77778], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:12:21.633338 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77779], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:12:22.013064 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:12:22.856472 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77779], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.234872813] seconds [----] I, [2016-09-13T07:12:22.856680 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77779], Delivering... [----] I, [2016-09-13T07:12:22.863371 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003457307815551758, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003521442413330078, :pending_vm_jobs=>0.0008208751678466797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006321907043457031} [----] I, [2016-09-13T07:12:22.863789 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77779], State: [ok], Delivered in [0.007116324] seconds [----] I, [2016-09-13T07:12:24.161386 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77778], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.565453728] seconds [----] I, [2016-09-13T07:12:24.161705 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77778], Delivering... [----] I, [2016-09-13T07:12:24.169737 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77778], State: [ok], Delivered in [0.008017077] seconds [----] I, [2016-09-13T07:12:33.638179 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003139019012451172, :worker_monitor=>1.5785083770751953, :worker_dequeue=>0.011093616485595703, :total_time=>1.5929813385009766} [----] I, [2016-09-13T07:12:36.645047 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:12:36.671270 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77780], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:12:38.638645 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:12:38 UTC]... [----] I, [2016-09-13T07:12:38.652187 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:12:38 UTC]...Complete [----] I, [2016-09-13T07:12:38.660131 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:12:38.990612 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77780], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.340111777] seconds [----] I, [2016-09-13T07:12:38.990829 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77780], Delivering... [----] I, [2016-09-13T07:12:38.997748 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037212371826171875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003773927688598633, :pending_vm_jobs=>0.0008175373077392578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006522655487060547} [----] I, [2016-09-13T07:12:38.998160 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77780], State: [ok], Delivered in [0.007311597] seconds [----] I, [2016-09-13T07:12:49.906523 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00710606575012207, :worker_monitor=>1.2108628749847412, :worker_dequeue=>0.0064697265625, :total_time=>1.2247934341430664} [----] I, [2016-09-13T07:12:51.680946 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:12:51.709782 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77781], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:12:51.721085 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77782], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:12:51.750297 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77783], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:12:51.778339 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77784], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:12:54.917751 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:12:55.103919 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77782], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.390390628] seconds [----] I, [2016-09-13T07:12:55.104115 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77782], Delivering... [----] I, [2016-09-13T07:12:55.132616 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77784], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.371358754] seconds [----] I, [2016-09-13T07:12:55.132800 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77784], Delivering... [----] I, [2016-09-13T07:12:55.138864 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030477046966552734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030705928802490234, :pending_vm_jobs=>0.0007886886596679688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00572657585144043} [----] I, [2016-09-13T07:12:55.139271 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77784], State: [ok], Delivered in [0.006470404] seconds [----] I, [2016-09-13T07:12:55.160870 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77782], State: [ok], Delivered in [0.056751868] seconds [----] I, [2016-09-13T07:12:57.310861 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77781], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.626892149] seconds [----] I, [2016-09-13T07:12:57.311105 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77781], Delivering... [----] I, [2016-09-13T07:12:57.315392 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77783], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.588115034] seconds [----] I, [2016-09-13T07:12:57.315549 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77783], Delivering... [----] I, [2016-09-13T07:12:57.317819 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77783], State: [ok], Delivered in [0.002269311] seconds [----] I, [2016-09-13T07:12:57.319345 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77781], State: [ok], Delivered in [0.008206567] seconds [----] I, [2016-09-13T07:13:06.282500 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004828929901123047, :worker_monitor=>1.3249762058258057, :worker_dequeue=>0.012901544570922852, :total_time=>1.3431212902069092} [----] I, [2016-09-13T07:13:06.788967 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:13:06.801330 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77785], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:13:11.283078 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:13:11 UTC]... [----] I, [2016-09-13T07:13:11.304106 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:13:11 UTC]...Complete [----] I, [2016-09-13T07:13:11.316483 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:13:12.275493 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77785], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.482796132] seconds [----] I, [2016-09-13T07:13:12.275665 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77785], Delivering... [----] I, [2016-09-13T07:13:12.284197 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004270792007446289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004294872283935547, :pending_vm_jobs=>0.0010557174682617188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008107185363769531} [----] I, [2016-09-13T07:13:12.284670 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77785], State: [ok], Delivered in [0.008971384] seconds [----] I, [2016-09-13T07:13:16.338784 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T07:13:21.814106 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:13:21.835208 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77786], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:13:21.858461 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77787], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:13:22.807101 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:13:22.812811 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038924217224121094, :worker_monitor=>1.4447884559631348, :worker_dequeue=>0.010253190994262695, :total_time=>1.459240198135376} [----] I, [2016-09-13T07:13:23.359129 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77787], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.519935845] seconds [----] I, [2016-09-13T07:13:23.359316 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77787], Delivering... [----] I, [2016-09-13T07:13:23.366058 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034117698669433594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034341812133789062, :pending_vm_jobs=>0.0009157657623291016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00633692741394043} [----] I, [2016-09-13T07:13:23.366461 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77787], State: [ok], Delivered in [0.00711573] seconds [----] I, [2016-09-13T07:13:24.404940 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77786], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.58605529] seconds [----] I, [2016-09-13T07:13:24.405132 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77786], Delivering... [----] I, [2016-09-13T07:13:24.409714 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77786], State: [ok], Delivered in [0.004585559] seconds [----] I, [2016-09-13T07:13:36.870727 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:13:36.890356 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77788], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:13:36.907448 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77789], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:13:36.924482 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77790], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:13:39.330796 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:13:39.335355 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004986286163330078, :worker_monitor=>1.3728501796722412, :worker_dequeue=>0.008139848709106445, :total_time=>1.3863017559051514} [----] I, [2016-09-13T07:13:39.467860 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77788], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.591477543] seconds [----] I, [2016-09-13T07:13:39.468061 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77788], Delivering... [----] I, [2016-09-13T07:13:39.469289 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T07:13:39.469518 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5355421696 [----] I, [2016-09-13T07:13:39.469657 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5132615680 [----] I, [2016-09-13T07:13:39.469802 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 222806016 [----] I, [2016-09-13T07:13:39.469948 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T07:13:39.470102 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5078597632 [----] I, [2016-09-13T07:13:39.470249 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T07:13:39.470393 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T07:13:39.470630 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 544133120 [----] I, [2016-09-13T07:13:39.470796 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T07:13:39.471011 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7974875136 [----] I, [2016-09-13T07:13:39.471185 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T07:13:39.471361 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T07:13:39.471593 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T07:13:39.471760 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 135168 [----] I, [2016-09-13T07:13:39.471937 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T07:13:39.472109 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T07:13:39.472266 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T07:13:39.472456 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T07:13:39.472616 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T07:13:39.472760 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T07:13:39.472936 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273526784 [----] I, [2016-09-13T07:13:39.473094 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56815616 [----] I, [2016-09-13T07:13:39.473245 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216711168 [----] I, [2016-09-13T07:13:39.473397 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6225920 [----] I, [2016-09-13T07:13:39.473607 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141443072 [----] I, [2016-09-13T07:13:39.473762 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2587353088 [----] I, [2016-09-13T07:13:39.473939 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2269679616 [----] I, [2016-09-13T07:13:39.474106 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T07:13:39.474278 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T07:13:39.474484 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T07:13:39.474656 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37777408 [----] I, [2016-09-13T07:13:39.474830 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102277120 [----] I, [2016-09-13T07:13:39.475013 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53153792 [----] I, [2016-09-13T07:13:39.475171 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110833664 [----] I, [2016-09-13T07:13:39.475367 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155430912 [----] I, [2016-09-13T07:13:39.475577 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T07:13:39.475746 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T07:13:39.475929 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T07:13:39.476092 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T07:13:39.476241 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T07:13:39.476392 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T07:13:39.476603 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T07:13:39.476756 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T07:13:39.476929 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T07:13:39.479780 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77789], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.58410848] seconds [----] I, [2016-09-13T07:13:39.479885 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77789], Delivering... [----] I, [2016-09-13T07:13:39.484824 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:13:36 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205293000], Memory % [3.5], CPU Time [238793.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T07:13:39.485191 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:13:38 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [149946.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:13:39.485518 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:13:38 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [150849.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:13:39.485813 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:13:34 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347149000], Memory % [5.04], CPU Time [103990.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T07:13:39.486145 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:13:38 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162418000], Memory % [3.1], CPU Time [37791.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T07:13:39.486525 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:13:36 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [202186.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T07:13:39.486840 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:13:39 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [51287.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:13:39.487116 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:13:31 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212541000], Memory % [3.5], CPU Time [48667.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T07:13:39.488948 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:13:29 UTC], Process Info: Memory Usage [579940352], Memory Size [908066816], Proportional Set Size: [419452000], Memory % [7.07], CPU Time [1961.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T07:13:39.489257 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:13:36 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357918000], Memory % [5.27], CPU Time [209249.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T07:13:39.489584 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:13:36 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [51291.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:13:39.489894 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:13:39 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38687.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T07:13:39.491215 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:13:32 UTC], Process Info: Memory Usage [591667200], Memory Size [920395776], Proportional Set Size: [426723000], Memory % [7.21], CPU Time [673.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:13:39.492410 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:13:29 UTC], Process Info: Memory Usage [603406336], Memory Size [1059606528], Proportional Set Size: [438367000], Memory % [7.36], CPU Time [1630.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:13:39.492960 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77790], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.578428319] seconds [----] I, [2016-09-13T07:13:39.493090 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77790], Delivering... [----] I, [2016-09-13T07:13:39.494173 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:13:36 UTC], Process Info: Memory Usage [557539328], Memory Size [894844928], Proportional Set Size: [405260000], Memory % [6.8], CPU Time [5393.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T07:13:39.494975 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77789], State: [ok], Delivered in [0.015035123] seconds [----] I, [2016-09-13T07:13:39.497483 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024764537811279297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002498626708984375, :pending_vm_jobs=>0.00045490264892578125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004100799560546875} [----] I, [2016-09-13T07:13:39.497766 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77790], State: [ok], Delivered in [0.00467608] seconds [----] I, [2016-09-13T07:13:39.543927 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T07:13:39.544077 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T07:13:39.546588 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T07:13:39.548369 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T07:13:39.550563 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T07:13:39.552780 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T07:13:39.555057 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T07:13:39.557220 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 844 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T07:13:39.559372 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T07:13:39.561432 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T07:13:39.563363 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.6 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T07:13:39.565884 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T07:13:39.568791 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T07:13:39.572268 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T07:13:39.575602 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:13:39.575853 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:13:39.576076 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T07:13:39.583047 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [149937.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:13:39.583448 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77788], State: [ok], Delivered in [0.115350126] seconds [----] I, [2016-09-13T07:13:44.335869 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:13:44 UTC]... [----] I, [2016-09-13T07:13:44.353540 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:13:44 UTC]...Complete [----] I, [2016-09-13T07:13:51.933592 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:13:51.947744 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77791], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:13:51.959287 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77792], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:13:51.976253 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77793], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:13:51.994002 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77794], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:13:55.686759 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:13:55.692047 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003432035446166992, :worker_monitor=>1.292186975479126, :worker_dequeue=>0.011426210403442383, :total_time=>1.3073291778564453} [----] I, [2016-09-13T07:13:56.637579 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77792], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.686160687] seconds [----] I, [2016-09-13T07:13:56.637792 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77792], Delivering... [----] I, [2016-09-13T07:13:56.666521 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77794], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.682289129] seconds [----] I, [2016-09-13T07:13:56.666821 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77794], Delivering... [----] I, [2016-09-13T07:13:56.678285 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0054931640625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005530118942260742, :pending_vm_jobs=>0.0015535354614257812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010544776916503906} [----] I, [2016-09-13T07:13:56.678819 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77794], State: [ok], Delivered in [0.011997001] seconds [----] I, [2016-09-13T07:13:56.711710 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77792], State: [ok], Delivered in [0.073915822] seconds [----] I, [2016-09-13T07:13:57.597761 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77791], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.660298923] seconds [----] I, [2016-09-13T07:13:57.597941 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77791], Delivering... [----] I, [2016-09-13T07:13:57.601794 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77791], State: [ok], Delivered in [0.003859784] seconds [----] I, [2016-09-13T07:13:57.666165 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77793], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.700593384] seconds [----] I, [2016-09-13T07:13:57.666331 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77793], Delivering... [----] I, [2016-09-13T07:13:57.669890 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77793], State: [ok], Delivered in [0.003537508] seconds [----] I, [2016-09-13T07:14:07.007712 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:14:07.026208 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77795], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:14:12.089158 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:14:12.096069 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030488967895507812, :worker_monitor=>1.3588814735412598, :worker_dequeue=>0.012569189071655273, :total_time=>1.3748400211334229} [----] I, [2016-09-13T07:14:12.706804 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77795], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.690990389] seconds [----] I, [2016-09-13T07:14:12.706962 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77795], Delivering... [----] I, [2016-09-13T07:14:12.711679 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024785995483398438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002495288848876953, :pending_vm_jobs=>0.0006184577941894531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004395961761474609} [----] I, [2016-09-13T07:14:12.711954 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77795], State: [ok], Delivered in [0.004991722] seconds [----] I, [2016-09-13T07:14:17.096736 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:14:17 UTC]... [----] I, [2016-09-13T07:14:17.117935 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:14:17 UTC]...Complete [----] I, [2016-09-13T07:14:22.039329 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:14:22.048891 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77796], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:14:22.060256 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77797], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:14:22.162602 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:14:22.866773 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77797], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.812347147] seconds [----] I, [2016-09-13T07:14:22.867058 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77797], Delivering... [----] I, [2016-09-13T07:14:22.877843 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005211591720581055, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005247831344604492, :pending_vm_jobs=>0.0014083385467529297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010263442993164062} [----] I, [2016-09-13T07:14:22.878337 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77797], State: [ok], Delivered in [0.011261394] seconds [----] I, [2016-09-13T07:14:24.763385 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77796], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.721053095] seconds [----] I, [2016-09-13T07:14:24.763568 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77796], Delivering... [----] I, [2016-09-13T07:14:24.767926 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77796], State: [ok], Delivered in [0.004324498] seconds [----] I, [2016-09-13T07:14:28.628671 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025060176849365234, :worker_monitor=>1.4484407901763916, :worker_dequeue=>0.006331920623779297, :total_time=>1.4574990272521973} [----] I, [2016-09-13T07:14:37.070712 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:14:37.083411 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77798], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:14:38.760062 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:14:38.954186 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77798], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.880009608] seconds [----] I, [2016-09-13T07:14:38.954337 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77798], Delivering... [----] I, [2016-09-13T07:14:38.959440 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026688575744628906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026853084564208984, :pending_vm_jobs=>0.0006608963012695312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004761934280395508} [----] I, [2016-09-13T07:14:38.959809 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77798], State: [ok], Delivered in [0.00546268] seconds [----] I, [2016-09-13T07:14:45.361029 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003427743911743164, :worker_monitor=>1.5791964530944824, :worker_dequeue=>0.01137232780456543, :total_time=>1.5942621231079102} [----] I, [2016-09-13T07:14:50.361553 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:14:50 UTC]... [----] I, [2016-09-13T07:14:50.386720 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:14:50 UTC]...Complete [----] I, [2016-09-13T07:14:52.093754 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:14:52.112161 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77799], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:14:52.123459 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77800], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:14:52.135260 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77801], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:14:52.152116 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77802], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:14:55.407260 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:14:56.108373 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77800], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.992860504] seconds [----] I, [2016-09-13T07:14:56.108520 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77800], Delivering... [----] I, [2016-09-13T07:14:56.118301 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77802], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.972375969] seconds [----] I, [2016-09-13T07:14:56.118487 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77802], Delivering... [----] I, [2016-09-13T07:14:56.123801 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002946138381958008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002967357635498047, :pending_vm_jobs=>0.0006082057952880859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004984855651855469} [----] I, [2016-09-13T07:14:56.124147 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77802], State: [ok], Delivered in [0.0056571] seconds [----] I, [2016-09-13T07:14:56.152260 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77800], State: [ok], Delivered in [0.043717939] seconds [----] I, [2016-09-13T07:14:57.866680 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77799], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.765408] seconds [----] I, [2016-09-13T07:14:57.866913 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77799], Delivering... [----] I, [2016-09-13T07:14:57.871874 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77799], State: [ok], Delivered in [0.004980673] seconds [----] I, [2016-09-13T07:14:57.901450 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77801], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.774393902] seconds [----] I, [2016-09-13T07:14:57.901724 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77801], Delivering... [----] I, [2016-09-13T07:14:57.906269 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77801], State: [ok], Delivered in [0.00452615] seconds [----] I, [2016-09-13T07:15:01.849917 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0029435157775878906, :worker_monitor=>1.4250154495239258, :worker_dequeue=>0.008011817932128906, :total_time=>1.4362843036651611} [----] I, [2016-09-13T07:15:07.164660 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:15:07.180939 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77803], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:15:11.874331 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:15:12.249720 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77803], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.079813876] seconds [----] I, [2016-09-13T07:15:12.249874 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77803], Delivering... [----] I, [2016-09-13T07:15:12.254966 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025780200958251953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025959014892578125, :pending_vm_jobs=>0.0006322860717773438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0047986507415771484} [----] I, [2016-09-13T07:15:12.255256 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77803], State: [ok], Delivered in [0.005374624] seconds [----] I, [2016-09-13T07:15:18.373332 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004189014434814453, :worker_monitor=>1.476992130279541, :worker_dequeue=>0.009870767593383789, :total_time=>1.4914157390594482} [----] I, [2016-09-13T07:15:22.438046 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:15:22.457647 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77804], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:15:22.472164 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77805], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:15:23.373922 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:15:23 UTC]... [----] I, [2016-09-13T07:15:23.401828 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:15:23 UTC]...Complete [----] I, [2016-09-13T07:15:23.415503 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:15:24.385128 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77805], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.922559274] seconds [----] I, [2016-09-13T07:15:24.385307 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77805], Delivering... [----] I, [2016-09-13T07:15:24.394703 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004445552825927734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004474163055419922, :pending_vm_jobs=>0.0014307498931884766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008948087692260742} [----] I, [2016-09-13T07:15:24.395217 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77805], State: [ok], Delivered in [0.009879044] seconds [----] I, [2016-09-13T07:15:24.945191 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77804], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.503279605] seconds [----] I, [2016-09-13T07:15:24.945392 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77804], Delivering... [----] I, [2016-09-13T07:15:24.950919 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77804], State: [ok], Delivered in [0.005472483] seconds [----] I, [2016-09-13T07:15:34.879163 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003785371780395508, :worker_monitor=>1.4306716918945312, :worker_dequeue=>0.008435726165771484, :total_time=>1.4432384967803955} [----] I, [2016-09-13T07:15:37.482803 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:15:37.499573 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77806], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:15:40.029662 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:15:40.486991 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77806], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.998321028] seconds [----] I, [2016-09-13T07:15:40.487217 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77806], Delivering... [----] I, [2016-09-13T07:15:40.494497 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037276744842529297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003751993179321289, :pending_vm_jobs=>0.0009760856628417969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006859779357910156} [----] I, [2016-09-13T07:15:40.494995 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77806], State: [ok], Delivered in [0.007764806] seconds [----] I, [2016-09-13T07:15:52.341965 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0034444332122802734, :worker_monitor=>2.282278060913086, :worker_dequeue=>0.010127544403076172, :total_time=>2.2961292266845703} [----] I, [2016-09-13T07:15:52.513339 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:15:52.537318 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77807], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:15:52.556607 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77808], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:15:52.571533 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77809], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:15:52.590651 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77810], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:15:57.346000 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:15:57 UTC]... [----] I, [2016-09-13T07:15:57.376635 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:15:57 UTC]...Complete [----] I, [2016-09-13T07:15:57.391047 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:15:57.624195 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77808], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.083751725] seconds [----] I, [2016-09-13T07:15:57.624461 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77808], Delivering... [----] I, [2016-09-13T07:15:57.657119 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77810], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.079455643] seconds [----] I, [2016-09-13T07:15:57.657307 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77810], Delivering... [----] I, [2016-09-13T07:15:57.663361 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030722618103027344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003091096878051758, :pending_vm_jobs=>0.0007162094116210938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005690097808837891} [----] I, [2016-09-13T07:15:57.663750 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77810], State: [ok], Delivered in [0.006427207] seconds [----] I, [2016-09-13T07:15:57.722535 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77808], State: [ok], Delivered in [0.098094448] seconds [----] I, [2016-09-13T07:15:58.088886 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77807], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.569380675] seconds [----] I, [2016-09-13T07:15:58.089116 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77807], Delivering... [----] I, [2016-09-13T07:15:58.094074 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77807], State: [ok], Delivered in [0.004959051] seconds [----] I, [2016-09-13T07:15:58.099542 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77809], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.53715796] seconds [----] I, [2016-09-13T07:15:58.099815 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77809], Delivering... [----] I, [2016-09-13T07:15:58.104291 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77809], State: [ok], Delivered in [0.004466761] seconds [----] I, [2016-09-13T07:16:07.602578 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:16:07.619478 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77811], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:16:08.850367 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:16:08.856667 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0022644996643066406, :worker_monitor=>1.4327771663665771, :worker_dequeue=>0.011066436767578125, :total_time=>1.4463231563568115} [----] I, [2016-09-13T07:16:09.833617 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77811], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.226296045] seconds [----] I, [2016-09-13T07:16:09.833794 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77811], Delivering... [----] I, [2016-09-13T07:16:09.839970 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003234386444091797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032536983489990234, :pending_vm_jobs=>0.0008027553558349609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005795955657958984} [----] I, [2016-09-13T07:16:09.840350 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77811], State: [ok], Delivered in [0.00654927] seconds [----] I, [2016-09-13T07:16:22.630322 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:16:22.644004 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77812], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:16:22.661345 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77813], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:16:25.186860 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:16:25.190780 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004988193511962891, :worker_monitor=>1.2906475067138672, :worker_dequeue=>0.007105588912963867, :total_time=>1.3031928539276123} [----] I, [2016-09-13T07:16:25.226942 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77813], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.576445778] seconds [----] I, [2016-09-13T07:16:25.227080 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77813], Delivering... [----] I, [2016-09-13T07:16:25.231138 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002286672592163086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002299785614013672, :pending_vm_jobs=>0.0004723072052001953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003818988800048828} [----] I, [2016-09-13T07:16:25.231353 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77813], State: [ok], Delivered in [0.004272178] seconds [----] I, [2016-09-13T07:16:25.324115 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77812], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.688673606] seconds [----] I, [2016-09-13T07:16:25.324245 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77812], Delivering... [----] I, [2016-09-13T07:16:25.327641 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77812], State: [ok], Delivered in [0.003383412] seconds [----] I, [2016-09-13T07:16:30.191253 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:16:30 UTC]... [----] I, [2016-09-13T07:16:30.233782 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:16:30 UTC]...Complete [----] I, [2016-09-13T07:16:37.677640 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:16:37.695556 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77814], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:16:41.595409 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:16:41.600615 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002463102340698242, :server_monitor=>0.10555195808410645, :worker_monitor=>1.2212624549865723, :worker_dequeue=>0.009642839431762695, :total_time=>1.3392188549041748} [----] I, [2016-09-13T07:16:42.010120 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77814], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.324688056] seconds [----] I, [2016-09-13T07:16:42.010276 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77814], Delivering... [----] I, [2016-09-13T07:16:42.015692 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027947425842285156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002832651138305664, :pending_vm_jobs=>0.0006711483001708984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005044460296630859} [----] I, [2016-09-13T07:16:42.016060 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77814], State: [ok], Delivered in [0.005767974] seconds [----] I, [2016-09-13T07:16:52.712194 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:16:52.724131 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77815], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:16:52.735689 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77816], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:16:52.752666 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77817], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:16:52.775538 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77818], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:16:58.082835 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:16:58.093261 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003919363021850586, :worker_monitor=>1.4423141479492188, :worker_dequeue=>0.018124818801879883, :total_time=>1.4647743701934814} [----] I, [2016-09-13T07:16:58.147448 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77816], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.419129925] seconds [----] I, [2016-09-13T07:16:58.147655 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77816], Delivering... [----] I, [2016-09-13T07:16:58.199549 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77816], State: [ok], Delivered in [0.051851596] seconds [----] I, [2016-09-13T07:16:58.204744 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77818], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.438785914] seconds [----] I, [2016-09-13T07:16:58.205028 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77818], Delivering... [----] I, [2016-09-13T07:16:58.211600 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003366231918334961, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033936500549316406, :pending_vm_jobs=>0.0008535385131835938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006102561950683594} [----] I, [2016-09-13T07:16:58.211990 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77818], State: [ok], Delivered in [0.006987768] seconds [----] I, [2016-09-13T07:16:58.285057 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77815], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.56681236] seconds [----] I, [2016-09-13T07:16:58.285350 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77815], Delivering... [----] I, [2016-09-13T07:16:58.291949 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77815], State: [ok], Delivered in [0.006592689] seconds [----] I, [2016-09-13T07:16:58.330778 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77817], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.586758904] seconds [----] I, [2016-09-13T07:16:58.331129 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77817], Delivering... [----] I, [2016-09-13T07:16:58.343104 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77817], State: [ok], Delivered in [0.01198479] seconds [----] I, [2016-09-13T07:17:03.093911 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:17:03 UTC]... [----] I, [2016-09-13T07:17:03.112719 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:17:03 UTC]...Complete [----] I, [2016-09-13T07:17:07.787477 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:17:07.816004 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77819], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:17:08.140748 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:17:08.284508 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77819], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.491191346] seconds [----] I, [2016-09-13T07:17:08.284675 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77819], Delivering... [----] I, [2016-09-13T07:17:08.290152 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003005504608154297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030231475830078125, :pending_vm_jobs=>0.0006630420684814453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005126953125} [----] I, [2016-09-13T07:17:08.290488 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77819], State: [ok], Delivered in [0.005804105] seconds [----] I, [2016-09-13T07:17:14.474149 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004979372024536133, :worker_monitor=>1.3114433288574219, :worker_dequeue=>0.006201505661010742, :total_time=>1.3230009078979492} [----] I, [2016-09-13T07:17:22.829055 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:17:22.848139 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77820], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:17:22.871290 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77821], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:17:24.508601 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:17:25.414072 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77821], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.559202122] seconds [----] I, [2016-09-13T07:17:25.414322 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77821], Delivering... [----] I, [2016-09-13T07:17:25.422388 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004257678985595703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004286289215087891, :pending_vm_jobs=>0.0009541511535644531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0074920654296875} [----] I, [2016-09-13T07:17:25.422798 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77821], State: [ok], Delivered in [0.008463901] seconds [----] I, [2016-09-13T07:17:25.442595 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77820], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.60832771] seconds [----] I, [2016-09-13T07:17:25.442836 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77820], Delivering... [----] I, [2016-09-13T07:17:25.448480 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77820], State: [ok], Delivered in [0.00560524] seconds [----] I, [2016-09-13T07:17:31.148714 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0058231353759765625, :worker_monitor=>1.6210246086120605, :worker_dequeue=>0.006276845932006836, :total_time=>1.6335663795471191} [----] I, [2016-09-13T07:17:36.149180 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:17:36 UTC]... [----] I, [2016-09-13T07:17:36.162113 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:17:36 UTC]...Complete [----] I, [2016-09-13T07:17:37.886622 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:17:37.905573 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77822], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:17:41.252217 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:17:41.499578 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77822], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.60625964] seconds [----] I, [2016-09-13T07:17:41.499836 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77822], Delivering... [----] I, [2016-09-13T07:17:41.505203 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026175975799560547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026350021362304688, :pending_vm_jobs=>0.0006210803985595703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005059242248535156} [----] I, [2016-09-13T07:17:41.505504 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77822], State: [ok], Delivered in [0.005765703] seconds [----] I, [2016-09-13T07:17:47.843840 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005750417709350586, :worker_monitor=>1.5753920078277588, :worker_dequeue=>0.005410432815551758, :total_time=>1.5868170261383057} [----] I, [2016-09-13T07:17:52.917704 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:17:52.940518 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77823], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:17:52.951766 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77824], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:17:52.969332 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77825], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:17:53.003861 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77826], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:17:57.867144 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:17:58.586508 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77824], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.642635791] seconds [----] I, [2016-09-13T07:17:58.586715 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77824], Delivering... [----] I, [2016-09-13T07:17:58.605659 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77826], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.624931162] seconds [----] I, [2016-09-13T07:17:58.605864 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77826], Delivering... [----] I, [2016-09-13T07:17:58.612798 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038115978240966797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038290023803710938, :pending_vm_jobs=>0.0008096694946289062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006495952606201172} [----] I, [2016-09-13T07:17:58.613152 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77826], State: [ok], Delivered in [0.007285036] seconds [----] I, [2016-09-13T07:17:58.651544 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77823], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.730404064] seconds [----] I, [2016-09-13T07:17:58.651822 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77823], Delivering... [----] I, [2016-09-13T07:17:58.656920 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77824], State: [ok], Delivered in [0.070173092] seconds [----] I, [2016-09-13T07:17:58.657802 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77823], State: [ok], Delivered in [0.006005188] seconds [----] I, [2016-09-13T07:17:58.714160 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77825], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.758243384] seconds [----] I, [2016-09-13T07:17:58.714340 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77825], Delivering... [----] I, [2016-09-13T07:17:58.717682 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77825], State: [ok], Delivered in [0.003330437] seconds [----] I, [2016-09-13T07:18:04.336077 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035257339477539062, :worker_monitor=>1.441089153289795, :worker_dequeue=>0.017050981521606445, :total_time=>1.4619760513305664} [----] I, [2016-09-13T07:18:08.018036 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T07:18:08.033862 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77827], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:18:08.051741 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77828], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [3600] [----] I, [2016-09-13T07:18:09.336708 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:18:09 UTC]... [----] I, [2016-09-13T07:18:09.353961 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:18:09 UTC]...Complete [----] I, [2016-09-13T07:18:09.365049 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:18:09.771553 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77827], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.747460944] seconds [----] I, [2016-09-13T07:18:09.771749 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77827], Delivering... [----] I, [2016-09-13T07:18:09.778303 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003496885299682617, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035164356231689453, :pending_vm_jobs=>0.0007617473602294922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006117105484008789} [----] I, [2016-09-13T07:18:09.778712 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77827], State: [ok], Delivered in [0.006958842] seconds [----] I, [2016-09-13T07:18:10.731357 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77828], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [3600], Dequeued in: [2.691223379] seconds [----] I, [2016-09-13T07:18:10.731498 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77828], Delivering... [----] I, [2016-09-13T07:18:10.740074 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77828], State: [ok], Delivered in [0.008557172] seconds [----] I, [2016-09-13T07:18:19.399880 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T07:18:20.723684 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00391387939453125, :log_active_servers=>0.011580705642700195, :worker_monitor=>1.31221604347229, :worker_dequeue=>0.011200904846191406, :total_time=>1.3393008708953857} [----] I, [2016-09-13T07:18:23.066103 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T07:18:23.080247 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77829], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:18:23.097614 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77830], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:18:23.114585 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77831], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:18:23.131978 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77832], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:18:25.738306 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:18:25.829073 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77830], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.741753866] seconds [----] I, [2016-09-13T07:18:25.829248 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77830], Delivering... [----] I, [2016-09-13T07:18:25.835939 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77831], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.73418369] seconds [----] I, [2016-09-13T07:18:25.836206 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77831], Delivering... [----] I, [2016-09-13T07:18:25.836572 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033121109008789062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003336668014526367, :pending_vm_jobs=>0.0008349418640136719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006865739822387695} [----] I, [2016-09-13T07:18:25.836997 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77830], State: [ok], Delivered in [0.007720924] seconds [----] I, [2016-09-13T07:18:25.838303 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T07:18:25.838637 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5344333824 [----] I, [2016-09-13T07:18:25.838816 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5121343488 [----] I, [2016-09-13T07:18:25.838992 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 222990336 [----] I, [2016-09-13T07:18:25.839150 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T07:18:25.839307 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5067333632 [----] I, [2016-09-13T07:18:25.839475 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T07:18:25.839642 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T07:18:25.839791 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 544321536 [----] I, [2016-09-13T07:18:25.839961 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T07:18:25.840103 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7865344000 [----] I, [2016-09-13T07:18:25.840251 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T07:18:25.840402 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T07:18:25.840543 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T07:18:25.840625 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T07:18:25.840696 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T07:18:25.840766 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T07:18:25.840837 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T07:18:25.840933 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T07:18:25.841026 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T07:18:25.841096 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T07:18:25.841166 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273534976 [----] I, [2016-09-13T07:18:25.841234 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56815616 [----] I, [2016-09-13T07:18:25.841303 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216719360 [----] I, [2016-09-13T07:18:25.841394 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T07:18:25.841508 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141443072 [----] I, [2016-09-13T07:18:25.841583 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2600140800 [----] I, [2016-09-13T07:18:25.841652 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2282274816 [----] I, [2016-09-13T07:18:25.841722 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T07:18:25.841811 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T07:18:25.841913 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T07:18:25.841990 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37556224 [----] I, [2016-09-13T07:18:25.842062 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102277120 [----] I, [2016-09-13T07:18:25.842126 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53235712 [----] I, [2016-09-13T07:18:25.842195 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110833664 [----] I, [2016-09-13T07:18:25.842260 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155512832 [----] I, [2016-09-13T07:18:25.842325 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T07:18:25.842393 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T07:18:25.842549 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T07:18:25.842637 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T07:18:25.842711 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T07:18:25.842783 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T07:18:25.842850 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T07:18:25.842955 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T07:18:25.843039 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T07:18:25.881210 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77829], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.810710579] seconds [----] I, [2016-09-13T07:18:25.881332 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77829], Delivering... [----] I, [2016-09-13T07:18:25.886488 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77829], State: [ok], Delivered in [0.005081762] seconds [----] I, [2016-09-13T07:18:25.903484 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T07:18:25.903713 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T07:18:25.907402 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T07:18:25.910180 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T07:18:25.913458 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T07:18:25.916603 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T07:18:25.919841 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T07:18:25.923234 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 844 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T07:18:25.926406 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T07:18:25.929753 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T07:18:25.933033 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T07:18:25.936165 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T07:18:25.939314 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T07:18:25.942643 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T07:18:25.945516 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:18:25.945694 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:18:25.945801 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T07:18:25.950482 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357918000], Memory % [5.27], CPU Time [209279.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T07:18:25.950875 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77831], State: [ok], Delivered in [0.114660932] seconds [----] I, [2016-09-13T07:18:30.756651 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:18:30.932541 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77832], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.813890372] seconds [----] I, [2016-09-13T07:18:30.932836 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77832], Delivering... [----] I, [2016-09-13T07:18:30.943454 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:18:19 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [150896.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:18:30.944139 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:18:11 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347149000], Memory % [5.04], CPU Time [104007.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T07:18:30.944593 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:18:19 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212541000], Memory % [3.5], CPU Time [48674.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T07:18:30.945120 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:18:18 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [51302.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:18:30.945639 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:18:18 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162418000], Memory % [3.1], CPU Time [37800.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T07:18:30.946111 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:18:08 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205293000], Memory % [3.5], CPU Time [238930.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T07:18:30.946597 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:18:19 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [202224.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T07:18:30.947088 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:18:19 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [150004.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:18:30.950039 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:18:12 UTC], Process Info: Memory Usage [591667200], Memory Size [920395776], Proportional Set Size: [426723000], Memory % [7.21], CPU Time [683.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:18:30.952271 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:18:10 UTC], Process Info: Memory Usage [591679488], Memory Size [920719360], Proportional Set Size: [426915000], Memory % [7.21], CPU Time [1688.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:18:30.954474 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:18:19 UTC], Process Info: Memory Usage [580153344], Memory Size [921698304], Proportional Set Size: [419660000], Memory % [7.07], CPU Time [1970.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T07:18:30.956538 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:18:17 UTC], Process Info: Memory Usage [557809664], Memory Size [909524992], Proportional Set Size: [405484000], Memory % [6.8], CPU Time [5404.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T07:18:30.957075 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:18:19 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357918000], Memory % [5.27], CPU Time [209286.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T07:18:30.957573 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:18:18 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [51304.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:18:30.958024 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:18:15 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38697.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T07:18:30.958358 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77832], State: [ok], Delivered in [0.025551993] seconds [----] I, [2016-09-13T07:18:36.912910 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036058425903320312, :worker_monitor=>1.134556531906128, :worker_dequeue=>0.010935068130493164, :total_time=>1.1494183540344238} [----] I, [2016-09-13T07:18:38.149481 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:18:38.171689 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77833], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:18:41.913464 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:18:41 UTC]... [----] I, [2016-09-13T07:18:41.931802 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:18:41 UTC]...Complete [----] I, [2016-09-13T07:18:42.047140 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:18:42.081101 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77833], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.925769588] seconds [----] I, [2016-09-13T07:18:42.081352 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77833], Delivering... [----] I, [2016-09-13T07:18:42.090056 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004536867141723633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004565238952636719, :pending_vm_jobs=>0.0010838508605957031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008208274841308594} [----] I, [2016-09-13T07:18:42.090558 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77833], State: [ok], Delivered in [0.00919915] seconds [----] I, [2016-09-13T07:18:53.180112 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:18:53.245946 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77834], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:18:53.326201 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77835], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:18:53.360453 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77836], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:18:53.394704 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77837], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:18:53.728277 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:18:53.732093 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004438638687133789, :worker_monitor=>1.647125005722046, :worker_dequeue=>0.008194208145141602, :total_time=>1.6601250171661377} [----] I, [2016-09-13T07:18:54.074845 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77835], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.826331821] seconds [----] I, [2016-09-13T07:18:54.075007 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77835], Delivering... [----] I, [2016-09-13T07:18:54.109107 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77835], State: [ok], Delivered in [0.034061731] seconds [----] I, [2016-09-13T07:18:54.149206 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77837], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.782466986] seconds [----] I, [2016-09-13T07:18:54.149334 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77837], Delivering... [----] I, [2016-09-13T07:18:54.153736 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023827552795410156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002396821975708008, :pending_vm_jobs=>0.0005269050598144531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004128932952880859} [----] I, [2016-09-13T07:18:54.154009 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77837], State: [ok], Delivered in [0.004668098] seconds [----] I, [2016-09-13T07:18:56.017945 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77834], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.833751462] seconds [----] I, [2016-09-13T07:18:56.018166 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77834], Delivering... [----] I, [2016-09-13T07:18:56.026959 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77834], State: [ok], Delivered in [0.008727345] seconds [----] I, [2016-09-13T07:18:56.058238 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77836], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.728363746] seconds [----] I, [2016-09-13T07:18:56.058513 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77836], Delivering... [----] I, [2016-09-13T07:18:56.061750 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77836], State: [ok], Delivered in [0.003277669] seconds [----] I, [2016-09-13T07:19:08.405537 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T07:19:08.435150 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77838], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:19:08.475056 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77839], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:19:10.108789 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:19:10.116094 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004158735275268555, :worker_monitor=>1.3388676643371582, :worker_dequeue=>0.01164865493774414, :total_time=>1.3549861907958984} [----] I, [2016-09-13T07:19:10.296040 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77838], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.881766364] seconds [----] I, [2016-09-13T07:19:10.296230 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77838], Delivering... [----] I, [2016-09-13T07:19:10.303294 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003644227981567383, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036745071411132812, :pending_vm_jobs=>0.0009472370147705078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006693124771118164} [----] I, [2016-09-13T07:19:10.303713 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77838], State: [ok], Delivered in [0.007472278] seconds [----] I, [2016-09-13T07:19:11.101592 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77839], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.640386441] seconds [----] I, [2016-09-13T07:19:11.101776 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77839], Delivering... [----] I, [2016-09-13T07:19:11.130700 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77840], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T07:19:11.147611 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77841], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T07:19:11.147964 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77839], State: [ok], Delivered in [0.046180011] seconds [----] I, [2016-09-13T07:19:15.116655 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:19:15 UTC]... [----] I, [2016-09-13T07:19:15.130075 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:19:15 UTC]...Complete [----] I, [2016-09-13T07:19:15.145971 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T07:19:15.148222 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T07:19:20.161343 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T07:19:20.163900 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T07:19:20.737265 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [77841], MiqWorker id: [98], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [9.600132619] seconds [----] I, [2016-09-13T07:19:20.737547 #3290:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77841], Delivering... [----] I, [2016-09-13T07:19:20.753192 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T07:19:20.753467 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T07:19:20.753615 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T07:19:20.753821 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T07:19:20.754041 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:22.651204 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [77840], MiqWorker id: [99], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [11.533617392] seconds [----] I, [2016-09-13T07:19:22.651452 #5369:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77840], Delivering... [----] I, [2016-09-13T07:19:22.655649 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T07:19:22.655863 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T07:19:22.656000 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T07:19:22.656176 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T07:19:22.656340 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:22.960486 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:23.159796 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:23.160016 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:23.485000 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:23.488839 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T07:19:23.502577 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77842], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:19:23.512753 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77843], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:19:23.524312 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77844], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:19:23.579379 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:23.757397 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:24.467297 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:24.570782 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:24.662755 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:24.800619 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:24.892854 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:24.997446 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:25.090567 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:25.182487 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:25.274810 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:25.368333 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:25.467756 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:25.568290 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:25.661394 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:25.753768 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:25.845531 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:25.939075 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:26.032158 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:19:26.292033 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T07:19:26.292291 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004004240036010742, :collect_inventory_for_targets=>4.00543212890625e-05, :parse_legacy_inventory=>19.296743154525757, :parse_targeted_inventory=>19.296905755996704, :save_inventory=>1.019979476928711, :ems_refresh=>20.319589614868164} [----] I, [2016-09-13T07:19:26.318928 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T07:19:26.319547 #5369:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77840], State: [ok], Delivered in [3.668086499] seconds [----] I, [2016-09-13T07:19:26.677150 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:19:26.683020 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003670215606689453, :worker_monitor=>1.5041141510009766, :worker_dequeue=>0.010577201843261719, :total_time=>1.5186634063720703} [----] I, [2016-09-13T07:19:27.204906 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:27.479120 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77843], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.971106108] seconds [----] I, [2016-09-13T07:19:27.479321 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77843], Delivering... [----] I, [2016-09-13T07:19:27.485784 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033638477325439453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003390073776245117, :pending_vm_jobs=>0.0008335113525390625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006089925765991211} [----] I, [2016-09-13T07:19:27.486180 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77843], State: [ok], Delivered in [0.006849681] seconds [----] I, [2016-09-13T07:19:27.494430 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:27.494560 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:27.988017 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:28.289561 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:28.289708 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:28.777997 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:29.071462 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:29.071578 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:29.159442 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77842], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.666366697] seconds [----] I, [2016-09-13T07:19:29.159686 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77842], Delivering... [----] I, [2016-09-13T07:19:29.164635 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77842], State: [ok], Delivered in [0.004948741] seconds [----] I, [2016-09-13T07:19:29.193440 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77844], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.676987746] seconds [----] I, [2016-09-13T07:19:29.193634 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77844], Delivering... [----] I, [2016-09-13T07:19:29.302396 #2928:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 11:19:26 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_16' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 11:19:26.681093') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2927,,2016-09-13 11:19:27 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2936,2016-09-13 11:19:29 UTC,2016-09-13 11:19:29 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2946,,2016-09-13 11:19:29 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 11:19:28 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 11:19:28 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 11:19:28 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2986,,2016-09-13 11:19:27 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2997,,2016-09-13 11:19:23 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 11:19:08.483621')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5, 3011,,2016-09-13 10:54:38 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1491, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,507724, 3030,,2016-09-13 09:54:17 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5111, 3054,,2016-09-13 10:24:28 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3300, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,507722, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,507722, 3160,,2016-09-13 10:54:45 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1483, 3298,,2016-09-13 11:19:20 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,8, 703,,2016-09-13 10:54:45 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1483, 27056,,2016-09-13 10:54:42 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1486, 28888,,2016-09-13 10:24:31 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3297, 5377,,2016-09-13 11:19:26 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 20394,,2016-09-13 10:54:37 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1491, 9004,,2016-09-13 11:11:53 UTC,ROLLBACK,false,root,"",16384,10.16.4.94,,35773,455, ACTIVITY_STATS_CSV [----] I, [2016-09-13T07:19:29.302863 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77844], State: [ok], Delivered in [0.109204633] seconds [----] I, [2016-09-13T07:19:29.550051 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:29.834837 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:29.835051 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:30.310370 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:30.618214 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:30.618434 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:31.090222 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:31.414752 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:31.414913 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:31.906996 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:32.205601 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:32.205753 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:32.675908 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:32.993806 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:32.993966 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:33.451742 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:33.752942 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:33.753089 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:34.250566 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:34.557368 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:34.557532 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:35.026922 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:35.323567 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:35.323706 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:35.815782 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:36.120381 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:36.120569 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:36.565377 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:36.871669 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:36.871834 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:37.398280 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:37.573544 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:37.713381 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:38.537193 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:19:38.559040 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77845], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:19:43.000326 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:19:43.006150 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003686666488647461, :worker_monitor=>1.2768888473510742, :worker_dequeue=>0.010546684265136719, :total_time=>1.2913920879364014} [----] I, [2016-09-13T07:19:43.578643 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77845], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.036067026] seconds [----] I, [2016-09-13T07:19:43.578828 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77845], Delivering... [----] I, [2016-09-13T07:19:43.584061 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002420663833618164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024437904357910156, :pending_vm_jobs=>0.0007243156433105469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004788398742675781} [----] I, [2016-09-13T07:19:43.584383 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77845], State: [ok], Delivered in [0.005542483] seconds [----] I, [2016-09-13T07:19:43.877348 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:44.017790 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:44.161557 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:44.297962 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:44.429451 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:44.566372 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:44.707380 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:44.840831 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:44.972896 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:45.107915 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:45.237157 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:45.368813 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:45.785804 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:45.941284 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:46.078579 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:46.222691 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:46.365904 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:46.507155 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:46.650577 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:46.796631 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:46.938449 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:47.078650 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:47.218641 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:47.361485 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:47.502351 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:47.646188 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:47.785338 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:47.929237 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:48.006621 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:19:48 UTC]... [----] I, [2016-09-13T07:19:48.023582 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:19:48 UTC]...Complete [----] I, [2016-09-13T07:19:48.067034 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:48.495979 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:48.684723 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:48.825957 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:48.965369 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:49.097723 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:49.242472 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:49.383181 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:49.514239 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:49.676472 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:49.815812 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:49.955947 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:50.095121 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:50.252261 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:50.402715 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:50.547136 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:50.686266 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:50.825117 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:51.250785 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:51.424555 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:51.565789 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:51.721079 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:51.866265 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:52.039161 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:52.176169 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:52.317130 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:52.461217 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:52.605861 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:52.746696 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:52.887090 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:53.027833 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:53.164031 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:53.294617 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:53.425789 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:53.559766 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:53.567827 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:19:53.583688 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77846], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:19:53.612370 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77847], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:19:53.624559 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77848], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:19:53.635854 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77849], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:19:54.042630 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:54.194456 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:54.340140 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:54.474528 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:54.610796 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:54.748398 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:19:59.290114 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:19:59.293996 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003546476364135742, :worker_monitor=>1.1758654117584229, :worker_dequeue=>0.008684873580932617, :total_time=>1.188385248184204} [----] I, [2016-09-13T07:19:59.413835 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77847], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.825637072] seconds [----] I, [2016-09-13T07:19:59.414109 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77847], Delivering... [----] I, [2016-09-13T07:19:59.499607 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77847], State: [ok], Delivered in [0.085478226] seconds [----] I, [2016-09-13T07:19:59.522111 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77849], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.891306145] seconds [----] I, [2016-09-13T07:19:59.522310 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77849], Delivering... [----] I, [2016-09-13T07:19:59.529167 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003660917282104492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036821365356445312, :pending_vm_jobs=>0.0008587837219238281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0064449310302734375} [----] I, [2016-09-13T07:19:59.529556 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77849], State: [ok], Delivered in [0.007236389] seconds [----] I, [2016-09-13T07:19:59.562706 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77846], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.987118872] seconds [----] I, [2016-09-13T07:19:59.562940 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77846], Delivering... [----] I, [2016-09-13T07:19:59.568408 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77846], State: [ok], Delivered in [0.005459861] seconds [----] I, [2016-09-13T07:19:59.676913 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77848], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.060514469] seconds [----] I, [2016-09-13T07:19:59.677028 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77848], Delivering... [----] I, [2016-09-13T07:19:59.679000 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77848], State: [ok], Delivered in [0.001966267] seconds [----] I, [2016-09-13T07:20:00.906068 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:01.043117 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:01.183055 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:01.322391 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:01.459618 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:01.597686 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:01.740463 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:01.888199 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:02.030562 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:02.170649 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:02.316619 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:02.775183 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:02.934107 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:03.077340 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:03.221619 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:03.362056 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:03.506316 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:03.658255 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:03.796409 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:03.935247 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:04.075747 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:04.215867 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:04.354563 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:04.496808 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:04.632281 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:04.775705 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:04.908350 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:05.049140 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:05.482920 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:05.652687 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:05.790900 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:05.938625 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:06.073567 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:06.219765 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:06.368282 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:06.509230 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:06.652052 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:06.797163 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:06.941925 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:07.077232 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:07.216870 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:07.350462 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:07.486515 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:07.625385 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:07.764659 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:08.076247 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:08.249964 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:08.387328 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:08.529258 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:08.644875 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T07:20:08.660691 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:08.661288 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77850], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:20:08.687577 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77851], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:20:08.716374 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77852], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:20:08.745090 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77853], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:20:08.796806 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:08.932916 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:09.070634 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:09.207619 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:09.317006 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:20:09.345620 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:09.485826 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:09.628692 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:09.769832 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:09.792921 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77850], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.143897105] seconds [----] I, [2016-09-13T07:20:09.793146 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77850], Delivering... [----] I, [2016-09-13T07:20:09.799439 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033211708068847656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033483505249023438, :pending_vm_jobs=>0.0008566379547119141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00590205192565918} [----] I, [2016-09-13T07:20:09.799704 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77850], State: [ok], Delivered in [0.006601609] seconds [----] I, [2016-09-13T07:20:09.916939 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:10.058850 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:10.201606 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:10.340049 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:10.720523 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:10.883361 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:11.021106 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:11.157588 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:11.296044 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:11.330079 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77851], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.661639197] seconds [----] I, [2016-09-13T07:20:11.330271 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77851], Delivering... [----] I, [2016-09-13T07:20:11.332513 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77851], State: [ok], Delivered in [0.002233943] seconds [----] I, [2016-09-13T07:20:11.376566 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77852], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.68566806] seconds [----] I, [2016-09-13T07:20:11.376764 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77852], Delivering... [----] I, [2016-09-13T07:20:11.382924 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77852], State: [ok], Delivered in [0.006171325] seconds [----] I, [2016-09-13T07:20:11.441553 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:11.472594 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77853], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.752921747] seconds [----] I, [2016-09-13T07:20:11.472724 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77853], Delivering... [----] I, [2016-09-13T07:20:11.475378 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77853], State: [ok], Delivered in [0.00265319] seconds [----] I, [2016-09-13T07:20:11.580285 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:11.724614 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:15.562608 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0032973289489746094, :worker_monitor=>1.2300784587860107, :worker_dequeue=>0.005856990814208984, :total_time=>1.2395236492156982} [----] I, [2016-09-13T07:20:17.882726 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:18.022103 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:18.163207 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:18.303118 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:18.440591 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:18.582412 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:18.720305 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:18.862105 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:19.000699 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:19.353457 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:19.503298 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:19.640694 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:19.783230 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:19.927151 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:20.064273 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:20.197011 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:20.337286 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:20.469767 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:20.563088 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:20:20 UTC]... [----] I, [2016-09-13T07:20:20.575162 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:20:20 UTC]...Complete [----] I, [2016-09-13T07:20:20.620502 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:20.756643 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:20.892071 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:21.032560 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:21.177195 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:21.318018 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:21.455251 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:21.587779 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:21.959211 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:22.127404 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:22.263602 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:22.410894 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:22.551823 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:22.689955 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:22.827704 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:23.007031 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:23.153864 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:23.289405 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:23.421846 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:23.561061 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:23.702332 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:23.756724 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:20:23.770990 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77854], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:20:23.786791 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77855], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:20:23.847921 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:23.983582 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:24.129346 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:24.279436 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:24.640384 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:24.790197 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:24.935405 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:25.081178 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:25.216508 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:25.355331 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:25.503290 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:25.595889 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:20:25.647518 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:25.786642 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:25.928719 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:25.931546 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77855], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.156625197] seconds [----] I, [2016-09-13T07:20:25.931695 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77855], Delivering... [----] I, [2016-09-13T07:20:25.936989 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002901315689086914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029201507568359375, :pending_vm_jobs=>0.0006442070007324219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0050067901611328125} [----] I, [2016-09-13T07:20:25.937300 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77855], State: [ok], Delivered in [0.005599801] seconds [----] I, [2016-09-13T07:20:26.074395 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:26.215797 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:26.364855 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:26.508912 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:26.547462 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77854], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.787364725] seconds [----] I, [2016-09-13T07:20:26.547629 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77854], Delivering... [----] I, [2016-09-13T07:20:26.551929 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77854], State: [ok], Delivered in [0.004268557] seconds [----] I, [2016-09-13T07:20:26.648558 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:26.789737 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:26.937396 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:27.313907 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:27.478145 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:27.622665 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:27.767579 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:27.911295 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:28.049273 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:28.189258 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:28.332629 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:28.471320 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:28.615279 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:28.756187 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:28.898636 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:29.041200 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:29.181125 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:29.328118 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:29.466545 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:29.605907 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:30.025931 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:30.196703 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:30.330527 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:30.466286 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:30.602580 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:30.801055 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:30.961568 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:31.102108 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:31.250302 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:31.389456 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:31.545129 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:31.706058 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:31.855328 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:32.007586 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:32.157083 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:32.290873 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:20:32.312186 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037658214569091797, :worker_monitor=>1.6954450607299805, :worker_dequeue=>0.010114431381225586, :total_time=>1.7096107006072998} [----] I, [2016-09-13T07:20:32.428794 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T07:20:32.624865 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T07:20:32.625223 #3290:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T07:20:32.625569 #3290:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T07:20:32.625675 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T07:20:32.625789 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T07:20:32.649775 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T07:20:32.650042 #3290:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [77841], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T07:20:32.650185 #3290:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T07:20:32.650318 #3290:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T07:20:32.650440 #3290:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77841], State: [error], Delivered in [71.912900717] seconds [----] I, [2016-09-13T07:20:38.798958 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:20:38.816346 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77856], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:20:42.341351 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:20:43.115063 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77856], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.308874859] seconds [----] I, [2016-09-13T07:20:43.115250 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77856], Delivering... [----] I, [2016-09-13T07:20:43.122373 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037360191345214844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037589073181152344, :pending_vm_jobs=>0.0009160041809082031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006712436676025391} [----] I, [2016-09-13T07:20:43.122783 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77856], State: [ok], Delivered in [0.007530947] seconds [----] I, [2016-09-13T07:20:48.698410 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005757570266723633, :worker_monitor=>1.3298578262329102, :worker_dequeue=>0.01086282730102539, :total_time=>1.3469018936157227} [----] I, [2016-09-13T07:20:53.699095 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:20:53 UTC]... [----] I, [2016-09-13T07:20:53.718544 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:20:53 UTC]...Complete [----] I, [2016-09-13T07:20:53.833224 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:20:53.861601 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77857], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:20:53.878724 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77858], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:20:53.895987 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77859], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:20:53.930228 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77860], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:20:58.876721 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:20:59.227774 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77858], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.36103557] seconds [----] I, [2016-09-13T07:20:59.228029 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77858], Delivering... [----] I, [2016-09-13T07:20:59.285141 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77860], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.378117772] seconds [----] I, [2016-09-13T07:20:59.285470 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77860], Delivering... [----] I, [2016-09-13T07:20:59.296091 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77858], State: [ok], Delivered in [0.068039493] seconds [----] I, [2016-09-13T07:20:59.303615 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005582094192504883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005637645721435547, :pending_vm_jobs=>0.0015330314636230469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.017487525939941406} [----] I, [2016-09-13T07:20:59.304288 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77860], State: [ok], Delivered in [0.018838102] seconds [----] I, [2016-09-13T07:20:59.703211 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77857], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.864664408] seconds [----] I, [2016-09-13T07:20:59.703541 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77857], Delivering... [----] I, [2016-09-13T07:20:59.708790 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77857], State: [ok], Delivered in [0.00533464] seconds [----] I, [2016-09-13T07:20:59.747240 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77859], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.861683888] seconds [----] I, [2016-09-13T07:20:59.747467 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77859], Delivering... [----] I, [2016-09-13T07:20:59.750675 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77859], State: [ok], Delivered in [0.003221] seconds [----] I, [2016-09-13T07:21:05.265975 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025358200073242188, :worker_monitor=>1.3685133457183838, :worker_dequeue=>0.011009931564331055, :total_time=>1.3822546005249023} [----] I, [2016-09-13T07:21:08.942613 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:21:08.965342 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77861], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:21:10.276549 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:21:10.399231 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77861], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.452871478] seconds [----] I, [2016-09-13T07:21:10.399360 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77861], Delivering... [----] I, [2016-09-13T07:21:10.403847 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023865699768066406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024030208587646484, :pending_vm_jobs=>0.0005512237548828125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004205942153930664} [----] I, [2016-09-13T07:21:10.404126 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77861], State: [ok], Delivered in [0.004753828] seconds [----] I, [2016-09-13T07:21:21.584382 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003045320510864258, :worker_monitor=>1.2668378353118896, :worker_dequeue=>0.015681028366088867, :total_time=>1.28580641746521} [----] I, [2016-09-13T07:21:23.974483 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:21:23.996118 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77862], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:21:24.017514 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77863], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:21:26.584981 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:21:26 UTC]... [----] I, [2016-09-13T07:21:26.600145 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:21:26 UTC]...Complete [----] I, [2016-09-13T07:21:26.611552 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:21:26.823201 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77863], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.820376785] seconds [----] I, [2016-09-13T07:21:26.823367 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77863], Delivering... [----] I, [2016-09-13T07:21:26.829821 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032024383544921875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003224611282348633, :pending_vm_jobs=>0.0007953643798828125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005984306335449219} [----] I, [2016-09-13T07:21:26.830185 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77863], State: [ok], Delivered in [0.006808144] seconds [----] I, [2016-09-13T07:21:26.863380 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77862], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.883727656] seconds [----] I, [2016-09-13T07:21:26.863590 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77862], Delivering... [----] I, [2016-09-13T07:21:26.867981 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77862], State: [ok], Delivered in [0.004378579] seconds [----] I, [2016-09-13T07:21:38.147652 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004045009613037109, :worker_monitor=>1.489600658416748, :worker_dequeue=>0.011553525924682617, :total_time=>1.5055358409881592} [----] I, [2016-09-13T07:21:39.028636 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:21:39.047784 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77864], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:21:43.157924 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:21:43.590746 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77864], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.556459848] seconds [----] I, [2016-09-13T07:21:43.590949 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77864], Delivering... [----] I, [2016-09-13T07:21:43.597234 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003278017044067383, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032987594604492188, :pending_vm_jobs=>0.00080108642578125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059206485748291016} [----] I, [2016-09-13T07:21:43.597696 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77864], State: [ok], Delivered in [0.006722248] seconds [----] I, [2016-09-13T07:21:54.060594 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:21:54.081932 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77865], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:21:54.093278 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77866], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:21:54.110589 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77867], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:21:54.127755 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77868], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:21:54.263197 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:21:54.269886 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004137516021728516, :worker_monitor=>1.066519021987915, :worker_dequeue=>0.012408018112182617, :total_time=>1.0834503173828125} [----] I, [2016-09-13T07:21:54.522236 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77866], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.436308359] seconds [----] I, [2016-09-13T07:21:54.522453 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77866], Delivering... [----] I, [2016-09-13T07:21:54.579158 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77866], State: [ok], Delivered in [0.056710679] seconds [----] I, [2016-09-13T07:21:54.614814 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77868], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.495453328] seconds [----] I, [2016-09-13T07:21:54.615049 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77868], Delivering... [----] I, [2016-09-13T07:21:54.624793 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004923820495605469, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0049669742584228516, :pending_vm_jobs=>0.0014193058013916016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009328603744506836} [----] I, [2016-09-13T07:21:54.625266 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77868], State: [ok], Delivered in [0.010187811] seconds [----] I, [2016-09-13T07:21:54.653543 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77865], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.587284517] seconds [----] I, [2016-09-13T07:21:54.653722 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77865], Delivering... [----] I, [2016-09-13T07:21:54.658222 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77865], State: [ok], Delivered in [0.004471945] seconds [----] I, [2016-09-13T07:21:54.699344 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77867], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.601142928] seconds [----] I, [2016-09-13T07:21:54.699504 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77867], Delivering... [----] I, [2016-09-13T07:21:54.701828 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77867], State: [ok], Delivered in [0.002306993] seconds [----] I, [2016-09-13T07:21:59.270359 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:21:59 UTC]... [----] I, [2016-09-13T07:21:59.281863 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:21:59 UTC]...Complete [----] I, [2016-09-13T07:22:09.137791 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:22:09.150637 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77869], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:22:10.830497 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:22:10.834918 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006159067153930664, :worker_monitor=>1.3820266723632812, :worker_dequeue=>0.007973194122314453, :total_time=>1.3967053890228271} [----] I, [2016-09-13T07:22:11.814117 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77869], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.672352629] seconds [----] I, [2016-09-13T07:22:11.814354 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77869], Delivering... [----] I, [2016-09-13T07:22:11.820353 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003143310546875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031621456146240234, :pending_vm_jobs=>0.0007326602935791016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005599260330200195} [----] I, [2016-09-13T07:22:11.820705 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77869], State: [ok], Delivered in [0.006355974] seconds [----] I, [2016-09-13T07:22:24.161306 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:22:24.197923 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77870], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:22:24.213785 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77871], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:22:27.427093 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:22:27.432810 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004471540451049805, :worker_monitor=>1.5600950717926025, :worker_dequeue=>0.010371685028076172, :total_time=>1.5752644538879395} [----] I, [2016-09-13T07:22:27.842753 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77871], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.638874902] seconds [----] I, [2016-09-13T07:22:27.842995 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77871], Delivering... [----] I, [2016-09-13T07:22:27.851716 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0052127838134765625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005239248275756836, :pending_vm_jobs=>0.0010526180267333984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008298873901367188} [----] I, [2016-09-13T07:22:27.852086 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77871], State: [ok], Delivered in [0.009086708] seconds [----] I, [2016-09-13T07:22:27.905583 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77870], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.739765704] seconds [----] I, [2016-09-13T07:22:27.905756 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77870], Delivering... [----] I, [2016-09-13T07:22:27.909988 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77870], State: [ok], Delivered in [0.004218641] seconds [----] I, [2016-09-13T07:22:32.433271 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:22:32 UTC]... [----] I, [2016-09-13T07:22:32.453608 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:22:32 UTC]...Complete [----] I, [2016-09-13T07:22:39.225767 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:22:39.249625 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77872], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:22:44.036372 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:22:44.042091 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004656791687011719, :worker_monitor=>1.5422694683074951, :worker_dequeue=>0.010198354721069336, :total_time=>1.5574219226837158} [----] I, [2016-09-13T07:22:44.361407 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77872], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.130026696] seconds [----] I, [2016-09-13T07:22:44.361666 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77872], Delivering... [----] I, [2016-09-13T07:22:44.368245 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035109519958496094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035326480865478516, :pending_vm_jobs=>0.0007627010345458984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006155729293823242} [----] I, [2016-09-13T07:22:44.368603 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77872], State: [ok], Delivered in [0.006938402] seconds [----] I, [2016-09-13T07:22:54.261313 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:22:54.275236 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77873], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:22:54.292704 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77874], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:22:54.309759 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77875], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:22:54.349937 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77876], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:23:00.611317 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:23:00.617817 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033614635467529297, :worker_monitor=>1.5283288955688477, :worker_dequeue=>0.01152348518371582, :total_time=>1.5434956550598145} [----] I, [2016-09-13T07:23:00.643202 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77874], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.363839219] seconds [----] I, [2016-09-13T07:23:00.643523 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77874], Delivering... [----] I, [2016-09-13T07:23:00.718275 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77874], State: [ok], Delivered in [0.074783805] seconds [----] I, [2016-09-13T07:23:00.775758 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77876], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.454433056] seconds [----] I, [2016-09-13T07:23:00.775991 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77876], Delivering... [----] I, [2016-09-13T07:23:00.782917 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003628969192504883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003648996353149414, :pending_vm_jobs=>0.0008287429809570312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00651240348815918} [----] I, [2016-09-13T07:23:00.783289 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77876], State: [ok], Delivered in [0.007292424] seconds [----] I, [2016-09-13T07:23:01.130153 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77873], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.864195521] seconds [----] I, [2016-09-13T07:23:01.130392 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77873], Delivering... [----] I, [2016-09-13T07:23:01.136442 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77873], State: [ok], Delivered in [0.006019155] seconds [----] I, [2016-09-13T07:23:01.204466 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77875], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.906245966] seconds [----] I, [2016-09-13T07:23:01.204703 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77875], Delivering... [----] I, [2016-09-13T07:23:01.208357 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77875], State: [ok], Delivered in [0.003651678] seconds [----] I, [2016-09-13T07:23:05.618458 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:23:05 UTC]... [----] I, [2016-09-13T07:23:05.643990 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:23:05 UTC]...Complete [----] I, [2016-09-13T07:23:09.361746 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:23:09.375142 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77877], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:23:09.393451 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77878], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:23:10.774011 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:23:10.884177 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77877], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.516656079] seconds [----] I, [2016-09-13T07:23:10.884377 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77877], Delivering... [----] I, [2016-09-13T07:23:10.891040 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033905506134033203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034148693084716797, :pending_vm_jobs=>0.0009691715240478516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00624394416809082} [----] I, [2016-09-13T07:23:10.891449 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77877], State: [ok], Delivered in [0.007047228] seconds [----] I, [2016-09-13T07:23:12.451504 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77878], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.071080663] seconds [----] I, [2016-09-13T07:23:12.451726 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77878], Delivering... [----] I, [2016-09-13T07:23:12.452116 #2937:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Starting [----] I, [2016-09-13T07:23:12.458038 #2937:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Complete [----] I, [2016-09-13T07:23:12.458355 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77878], State: [ok], Delivered in [0.006622859] seconds [----] I, [2016-09-13T07:23:17.517299 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0047948360443115234, :worker_monitor=>1.7215685844421387, :worker_dequeue=>0.011931419372558594, :total_time=>1.7386257648468018} [----] I, [2016-09-13T07:23:22.536225 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T07:23:24.404676 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T07:23:24.632937 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77879], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:23:24.707385 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77880], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:23:24.747288 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77881], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:23:24.793005 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77882], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:23:27.561470 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:23:27.690325 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77880], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.051519453] seconds [----] I, [2016-09-13T07:23:27.690564 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77880], Delivering... [----] I, [2016-09-13T07:23:27.697628 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003657817840576172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00368499755859375, :pending_vm_jobs=>0.000881195068359375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006601572036743164} [----] I, [2016-09-13T07:23:27.697969 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77880], State: [ok], Delivered in [0.007411122] seconds [----] I, [2016-09-13T07:23:27.724181 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77881], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.012351887] seconds [----] I, [2016-09-13T07:23:27.724349 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77881], Delivering... [----] I, [2016-09-13T07:23:27.725628 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T07:23:27.725833 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5355507712 [----] I, [2016-09-13T07:23:27.725945 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5132247040 [----] I, [2016-09-13T07:23:27.726033 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 223260672 [----] I, [2016-09-13T07:23:27.726115 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T07:23:27.726192 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5078261760 [----] I, [2016-09-13T07:23:27.726270 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T07:23:27.726345 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T07:23:27.726444 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 544600064 [----] I, [2016-09-13T07:23:27.726543 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T07:23:27.726621 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8049381376 [----] I, [2016-09-13T07:23:27.726697 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T07:23:27.726766 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T07:23:27.726840 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T07:23:27.726950 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T07:23:27.727028 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T07:23:27.727100 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T07:23:27.727175 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T07:23:27.727250 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T07:23:27.727323 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T07:23:27.727395 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T07:23:27.727513 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273543168 [----] I, [2016-09-13T07:23:27.727596 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56815616 [----] I, [2016-09-13T07:23:27.727669 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216727552 [----] I, [2016-09-13T07:23:27.727736 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T07:23:27.727814 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141393920 [----] I, [2016-09-13T07:23:27.727904 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2588119040 [----] I, [2016-09-13T07:23:27.727987 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2269974528 [----] I, [2016-09-13T07:23:27.728063 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T07:23:27.728135 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T07:23:27.728206 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T07:23:27.728283 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37548032 [----] I, [2016-09-13T07:23:27.728358 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102277120 [----] I, [2016-09-13T07:23:27.728452 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53260288 [----] I, [2016-09-13T07:23:27.728543 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110833664 [----] I, [2016-09-13T07:23:27.728623 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155537408 [----] I, [2016-09-13T07:23:27.728697 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T07:23:27.728769 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T07:23:27.728842 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T07:23:27.728948 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T07:23:27.729028 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T07:23:27.729102 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T07:23:27.729174 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T07:23:27.729244 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T07:23:27.729316 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T07:23:27.762981 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T07:23:27.763144 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T07:23:27.765963 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T07:23:27.768048 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T07:23:27.770573 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T07:23:27.773169 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T07:23:27.775641 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T07:23:27.778038 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 844 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T07:23:27.780340 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T07:23:27.782635 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T07:23:27.784938 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T07:23:27.787304 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T07:23:27.789771 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T07:23:27.792295 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T07:23:27.794811 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:23:27.795037 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:23:27.795238 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T07:23:27.800146 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [150095.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:23:27.800509 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77881], State: [ok], Delivered in [0.07614543] seconds [----] I, [2016-09-13T07:23:27.832914 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77882], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.081514575] seconds [----] I, [2016-09-13T07:23:27.833084 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77882], Delivering... [----] I, [2016-09-13T07:23:27.840281 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:23:16 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [150984.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:23:27.840886 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:23:09 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205293000], Memory % [3.5], CPU Time [239055.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T07:23:27.841390 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:23:16 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [150106.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:23:27.841887 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:23:11 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347149000], Memory % [5.04], CPU Time [104023.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T07:23:27.842447 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:23:16 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162418000], Memory % [3.1], CPU Time [37810.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T07:23:27.842993 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:23:15 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [202293.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T07:23:27.843531 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:23:16 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [51317.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:23:27.843977 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:23:07 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212541000], Memory % [3.5], CPU Time [48682.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T07:23:27.844475 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:23:16 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [51320.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:23:27.844940 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:23:15 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38707.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T07:23:27.847504 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:23:16 UTC], Process Info: Memory Usage [591974400], Memory Size [935747584], Proportional Set Size: [427023000], Memory % [7.22], CPU Time [721.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:23:27.849611 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:23:12 UTC], Process Info: Memory Usage [602894336], Memory Size [1059778560], Proportional Set Size: [437867000], Memory % [7.35], CPU Time [1830.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:23:27.851783 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:23:07 UTC], Process Info: Memory Usage [558350336], Memory Size [929497088], Proportional Set Size: [406084000], Memory % [6.81], CPU Time [5415.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T07:23:27.853905 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:23:09 UTC], Process Info: Memory Usage [580374528], Memory Size [935854080], Proportional Set Size: [419876000], Memory % [7.08], CPU Time [1982.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T07:23:27.854453 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:23:16 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357918000], Memory % [5.27], CPU Time [209389.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T07:23:27.854771 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77882], State: [ok], Delivered in [0.021687611] seconds [----] I, [2016-09-13T07:23:28.393991 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77879], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.984647996] seconds [----] I, [2016-09-13T07:23:28.394248 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77879], Delivering... [----] I, [2016-09-13T07:23:28.401139 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77879], State: [ok], Delivered in [0.006883291] seconds [----] I, [2016-09-13T07:23:33.755080 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004336357116699219, :worker_monitor=>1.1731235980987549, :worker_dequeue=>0.006363391876220703, :total_time=>1.184204339981079} [----] I, [2016-09-13T07:23:38.755666 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:23:38 UTC]... [----] I, [2016-09-13T07:23:38.783591 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:23:38 UTC]...Complete [----] I, [2016-09-13T07:23:39.805198 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:23:39.855949 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77883], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:23:43.819548 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:23:43.970544 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77883], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.159390407] seconds [----] I, [2016-09-13T07:23:43.970739 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77883], Delivering... [----] I, [2016-09-13T07:23:43.977512 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035109519958496094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003533601760864258, :pending_vm_jobs=>0.0008058547973632812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006329059600830078} [----] I, [2016-09-13T07:23:43.977891 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77883], State: [ok], Delivered in [0.007143539] seconds [----] I, [2016-09-13T07:23:50.408089 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005445003509521484, :worker_monitor=>1.5637400150299072, :worker_dequeue=>0.011839151382446289, :total_time=>1.5813789367675781} [----] I, [2016-09-13T07:23:54.867814 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:23:54.886371 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77884], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:23:54.913343 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77885], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:23:54.935864 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77886], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:23:54.976315 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77887], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:23:55.423228 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:23:55.576181 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77885], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.685740653] seconds [----] I, [2016-09-13T07:23:55.576397 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77885], Delivering... [----] I, [2016-09-13T07:23:55.650349 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77885], State: [ok], Delivered in [0.07392172] seconds [----] I, [2016-09-13T07:23:55.725092 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77887], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.780084462] seconds [----] I, [2016-09-13T07:23:55.725272 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77887], Delivering... [----] I, [2016-09-13T07:23:55.731858 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003402233123779297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034286975860595703, :pending_vm_jobs=>0.0008420944213867188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006189107894897461} [----] I, [2016-09-13T07:23:55.732225 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77887], State: [ok], Delivered in [0.006943804] seconds [----] I, [2016-09-13T07:23:55.844782 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77884], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.972481824] seconds [----] I, [2016-09-13T07:23:55.844975 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77884], Delivering... [----] I, [2016-09-13T07:23:55.850598 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77884], State: [ok], Delivered in [0.005577297] seconds [----] I, [2016-09-13T07:23:55.930532 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77886], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.011395336] seconds [----] I, [2016-09-13T07:23:55.930704 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77886], Delivering... [----] I, [2016-09-13T07:23:55.934075 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77886], State: [ok], Delivered in [0.003348358] seconds [----] I, [2016-09-13T07:24:07.099716 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0047571659088134766, :worker_monitor=>1.6327824592590332, :worker_dequeue=>0.011043787002563477, :total_time=>1.6489593982696533} [----] I, [2016-09-13T07:24:09.987442 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:24:10.005031 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77888], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:24:12.100224 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:24:12 UTC]... [----] I, [2016-09-13T07:24:12.119159 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:24:12 UTC]...Complete [----] I, [2016-09-13T07:24:12.330327 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:24:12.674617 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77888], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.682792769] seconds [----] I, [2016-09-13T07:24:12.674935 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77888], Delivering... [----] I, [2016-09-13T07:24:12.682139 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003792285919189453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038177967071533203, :pending_vm_jobs=>0.0009255409240722656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0067577362060546875} [----] I, [2016-09-13T07:24:12.682550 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77888], State: [ok], Delivered in [0.007645112] seconds [----] I, [2016-09-13T07:24:24.221937 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0059947967529296875, :worker_monitor=>1.8431754112243652, :worker_dequeue=>0.017480134963989258, :total_time=>1.8670265674591064} [----] I, [2016-09-13T07:24:25.014004 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:24:25.034230 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77889], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:24:25.057130 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77890], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:24:29.232535 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:24:29.343347 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77890], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.302878029] seconds [----] I, [2016-09-13T07:24:29.343597 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77890], Delivering... [----] I, [2016-09-13T07:24:29.350821 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003751516342163086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038149356842041016, :pending_vm_jobs=>0.0008573532104492188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006745100021362305} [----] I, [2016-09-13T07:24:29.351176 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77890], State: [ok], Delivered in [0.007582403] seconds [----] I, [2016-09-13T07:24:30.771940 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77889], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.753132157] seconds [----] I, [2016-09-13T07:24:30.772161 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77889], Delivering... [----] I, [2016-09-13T07:24:30.778206 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77889], State: [ok], Delivered in [0.006032433] seconds [----] I, [2016-09-13T07:24:40.069714 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:24:40.091438 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77891], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:24:40.594771 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:24:40.594946 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:24:40.605886 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:24:40.606121 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:24:40.617335 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:24:40.617493 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:24:40.628657 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:24:40.628811 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:24:40.640164 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:24:40.640318 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:24:40.651546 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:24:40.651680 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:24:40.663058 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:24:40.663191 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:24:40.691945 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:24:40.692152 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:24:40.709198 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:24:40.709463 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:24:40.732246 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:24:40.732605 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:24:40.760392 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:24:40.760627 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:24:40.771705 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:24:40.771910 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:24:40.783197 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:24:40.783460 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:24:40.806470 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:24:40.806753 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:24:40.823313 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:24:40.823576 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:24:40.833086 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:24:40.839651 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003931283950805664, :worker_monitor=>1.563077688217163, :worker_dequeue=>0.011785507202148438, :total_time=>1.5790770053863525} [----] I, [2016-09-13T07:24:41.080452 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77891], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.003313582] seconds [----] I, [2016-09-13T07:24:41.080643 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77891], Delivering... [----] I, [2016-09-13T07:24:41.087378 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003546476364135742, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035660266876220703, :pending_vm_jobs=>0.0008499622344970703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006372928619384766} [----] I, [2016-09-13T07:24:41.087901 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77891], State: [ok], Delivered in [0.007204673] seconds [----] I, [2016-09-13T07:24:42.511495 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:24:42.511643 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:24:42.511733 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:24:42.674296 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:24:42.675141 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T07:24:42.675222 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:24:42.675266 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:24:42.675304 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:24:42.675338 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T07:24:42.675371 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T07:24:42.675409 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:24:42.675500 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T07:24:42.675549 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:24:42.675584 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:24:42.675619 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:24:42.675650 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:24:42.675685 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T07:24:42.675723 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:24:42.675755 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T07:24:42.675784 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T07:24:42.676093 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:24:42.676239 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:24:43.067101 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T07:24:43.067266 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T07:24:43.067375 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T07:24:43.234345 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:24:43.235278 #3290:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T07:24:43.235356 #3290:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:24:43.235403 #3290:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:24:43.235485 #3290:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:24:43.235532 #3290:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T07:24:43.235569 #3290:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T07:24:43.235604 #3290:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:24:43.235638 #3290:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T07:24:43.235675 #3290:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:24:43.235705 #3290:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:24:43.235740 #3290:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T07:24:43.235774 #3290:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:24:43.235807 #3290:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T07:24:43.235837 #3290:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:24:43.235892 #3290:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T07:24:43.235928 #3290:34713c] INFO -- : --- [----] I, [2016-09-13T07:24:43.236320 #3290:34713c] INFO -- : :guid: 8b41dc22-7996-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:24:43.236383 #3290:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T07:24:43.236571 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T07:24:43.720492 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:24:43.720631 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:24:43.720702 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:24:43.863606 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:24:43.864317 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T07:24:43.864393 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:24:43.864492 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:24:43.864540 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:24:43.864577 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T07:24:43.864611 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T07:24:43.864646 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:24:43.864681 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T07:24:43.864715 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:24:43.864749 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:24:43.864782 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:24:43.864815 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:24:43.864848 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T07:24:43.864909 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T07:24:43.865184 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:24:43.865455 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:24:43.959300 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:24:43.959479 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:24:43.959570 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:24:44.151504 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:24:44.153137 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T07:24:44.153306 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:24:44.153410 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:24:44.153575 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:24:44.153667 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T07:24:44.153748 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T07:24:44.153832 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:24:44.153939 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T07:24:44.154028 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:24:44.154116 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:24:44.154197 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:24:44.154281 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:24:44.154369 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T07:24:44.154493 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:24:44.154583 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T07:24:44.154662 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T07:24:44.155204 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:24:44.155480 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:24:45.840170 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:24:45 UTC]... [----] I, [2016-09-13T07:24:45.857009 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:24:45 UTC]...Complete [----] I, [2016-09-13T07:24:46.534038 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:24:46.534200 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:24:46.534290 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:24:46.702108 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:24:46.703065 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T07:24:46.703157 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:24:46.703203 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:24:46.703240 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:24:46.703275 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T07:24:46.703310 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T07:24:46.703345 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:24:46.703378 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T07:24:46.703438 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:24:46.703491 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:24:46.703529 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:24:46.703561 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:24:46.703593 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T07:24:46.703628 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:24:46.703660 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T07:24:46.703690 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T07:24:46.704005 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:24:46.704160 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:24:46.801208 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T07:24:46.801448 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T07:24:46.801620 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T07:24:46.974633 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:24:46.975445 #5369:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T07:24:46.975526 #5369:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:24:46.975567 #5369:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:24:46.975601 #5369:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:24:46.975633 #5369:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T07:24:46.975667 #5369:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T07:24:46.975701 #5369:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:24:46.975734 #5369:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T07:24:46.975767 #5369:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:24:46.975799 #5369:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:24:46.975841 #5369:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T07:24:46.975898 #5369:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:24:46.975935 #5369:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T07:24:46.975965 #5369:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:24:46.975994 #5369:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T07:24:46.976025 #5369:34713c] INFO -- : --- [----] I, [2016-09-13T07:24:46.976387 #5369:34713c] INFO -- : :guid: 79c8c984-799a-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:24:46.976483 #5369:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T07:24:46.976640 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T07:24:47.201956 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:24:47.202086 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:24:47.202154 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:24:47.249534 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T07:24:47.249670 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T07:24:47.249740 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T07:24:47.348749 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:24:47.349507 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T07:24:47.349589 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:24:47.349633 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:24:47.349670 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:24:47.349705 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T07:24:47.349738 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T07:24:47.349771 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:24:47.349804 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T07:24:47.349836 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:24:47.349886 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:24:47.349927 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:24:47.349959 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:24:47.349991 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T07:24:47.350022 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T07:24:47.350280 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:24:47.350571 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:24:47.418533 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:24:47.419398 #684:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T07:24:47.419514 #684:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:24:47.419561 #684:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:24:47.419599 #684:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:24:47.419638 #684:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T07:24:47.419673 #684:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T07:24:47.419706 #684:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:24:47.419739 #684:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T07:24:47.419772 #684:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:24:47.419803 #684:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:24:47.419835 #684:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:24:47.419884 #684:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:24:47.419926 #684:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T07:24:47.419959 #684:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T07:24:47.419992 #684:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T07:24:47.420023 #684:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T07:24:47.420061 #684:34713c] INFO -- : --- [----] I, [2016-09-13T07:24:47.420436 #684:34713c] INFO -- : :guid: c253e5f6-7924-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:24:47.420515 #684:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T07:24:47.420643 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T07:24:48.870273 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:24:48.870507 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:24:48.870645 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:24:49.044334 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:24:49.045135 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T07:24:49.045215 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:24:49.045264 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:24:49.045304 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:24:49.045339 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T07:24:49.045376 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T07:24:49.045454 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:24:49.045511 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T07:24:49.045549 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:24:49.045582 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:24:49.045614 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:24:49.045651 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:24:49.045682 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T07:24:49.045712 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:24:49.045746 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T07:24:49.045776 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T07:24:49.046079 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:24:49.046252 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:24:49.291801 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:24:49.291985 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:24:49.292067 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:24:49.367930 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T07:24:49.368079 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T07:24:49.368156 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T07:24:49.443472 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:24:49.444248 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T07:24:49.444322 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:24:49.444363 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:24:49.444399 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:24:49.444478 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T07:24:49.444523 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T07:24:49.444559 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:24:49.444592 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T07:24:49.444627 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:24:49.444659 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:24:49.444691 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:24:49.444723 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:24:49.444755 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T07:24:49.444786 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:24:49.444835 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T07:24:49.444887 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T07:24:49.445194 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:24:49.445345 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:24:49.510651 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:24:49.511541 #20386:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T07:24:49.511630 #20386:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:24:49.511677 #20386:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:24:49.511716 #20386:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:24:49.511753 #20386:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T07:24:49.511790 #20386:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T07:24:49.511825 #20386:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:24:49.511859 #20386:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T07:24:49.511919 #20386:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:24:49.511955 #20386:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:24:49.512017 #20386:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:24:49.512054 #20386:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:24:49.512089 #20386:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T07:24:49.512124 #20386:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T07:24:49.512159 #20386:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T07:24:49.512193 #20386:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T07:24:49.512225 #20386:34713c] INFO -- : --- [----] I, [2016-09-13T07:24:49.512631 #20386:34713c] INFO -- : :guid: e5930efc-7974-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:24:49.512708 #20386:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T07:24:49.512841 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T07:24:50.132114 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:24:50.132356 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:24:50.132557 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:24:50.170183 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:24:50.170384 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:24:50.170568 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:24:50.336389 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:24:50.337249 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T07:24:50.337326 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:24:50.337368 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:24:50.337409 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:24:50.337494 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T07:24:50.337536 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T07:24:50.337575 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:24:50.337610 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T07:24:50.337643 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:24:50.337680 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:24:50.337713 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:24:50.337749 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:24:50.337782 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T07:24:50.337814 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:24:50.337846 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T07:24:50.337899 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T07:24:50.338201 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:24:50.338386 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:24:50.354914 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:24:50.355618 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T07:24:50.355684 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:24:50.355721 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:24:50.355751 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:24:50.355779 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T07:24:50.355805 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T07:24:50.355831 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:24:50.355859 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T07:24:50.355907 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:24:50.355935 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:24:50.355959 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:24:50.355988 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:24:50.356014 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T07:24:50.356040 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:24:50.356066 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T07:24:50.356090 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T07:24:50.356322 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:24:50.356480 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:24:51.370665 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:24:51.370767 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:24:51.370811 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:24:51.452753 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:24:51.453148 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T07:24:51.453190 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:24:51.453213 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:24:51.453233 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:24:51.453253 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T07:24:51.453271 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T07:24:51.453291 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:24:51.453310 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T07:24:51.453329 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:24:51.453347 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:24:51.453365 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:24:51.453384 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:24:51.453402 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T07:24:51.453443 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T07:24:51.453606 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:24:51.453756 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:24:55.106119 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:24:55.106306 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:24:55.106382 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:24:55.239588 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:24:55.241004 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T07:24:55.241089 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:24:55.241134 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:24:55.241186 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:24:55.241227 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T07:24:55.241261 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T07:24:55.241293 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:24:55.241327 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T07:24:55.241359 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:24:55.241389 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:24:55.241449 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:24:55.241499 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:24:55.241535 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T07:24:55.241567 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T07:24:55.241598 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T07:24:55.241630 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T07:24:55.241661 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T07:24:55.241692 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T07:24:55.241724 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T07:24:55.241756 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T07:24:55.241789 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T07:24:55.241821 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T07:24:55.241852 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T07:24:55.241905 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T07:24:55.241941 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T07:24:55.241972 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T07:24:55.242004 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T07:24:55.242036 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T07:24:55.242069 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T07:24:55.242100 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T07:24:55.242133 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T07:24:55.242164 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T07:24:55.242195 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T07:24:55.242226 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T07:24:55.242257 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T07:24:55.242288 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T07:24:55.242319 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T07:24:55.242350 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T07:24:55.242380 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T07:24:55.242720 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:24:55.242902 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:24:55.242985 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:24:55.257387 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77892], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:24:55.269527 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77893], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:24:55.286098 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77894], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:24:55.303844 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77895], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:24:57.259260 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:24:57.265814 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00562596321105957, :worker_monitor=>1.3554553985595703, :worker_dequeue=>0.011623859405517578, :total_time=>1.373032808303833} [----] I, [2016-09-13T07:24:57.806230 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77893], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.544486984] seconds [----] I, [2016-09-13T07:24:57.806466 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77893], Delivering... [----] I, [2016-09-13T07:24:57.811902 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77895], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.519175462] seconds [----] I, [2016-09-13T07:24:57.812118 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77895], Delivering... [----] I, [2016-09-13T07:24:57.819116 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036988258361816406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037229061126708984, :pending_vm_jobs=>0.0008862018585205078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00654149055480957} [----] I, [2016-09-13T07:24:57.819552 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77895], State: [ok], Delivered in [0.0074498] seconds [----] I, [2016-09-13T07:24:57.845762 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77893], State: [ok], Delivered in [0.039334558] seconds [----] I, [2016-09-13T07:24:58.120812 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77892], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.873205826] seconds [----] I, [2016-09-13T07:24:58.121158 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77892], Delivering... [----] I, [2016-09-13T07:24:58.128477 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77892], State: [ok], Delivered in [0.007302256] seconds [----] I, [2016-09-13T07:24:58.154659 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77894], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.881165326] seconds [----] I, [2016-09-13T07:24:58.154906 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77894], Delivering... [----] I, [2016-09-13T07:24:58.159113 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77894], State: [ok], Delivered in [0.004202513] seconds [----] I, [2016-09-13T07:25:10.315716 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:25:10.331542 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77896], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:25:13.633558 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:25:13.637667 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0051691532135009766, :server_monitor=>0.09563493728637695, :worker_monitor=>1.2243995666503906, :worker_dequeue=>0.00731658935546875, :total_time=>1.3328909873962402} [----] I, [2016-09-13T07:25:13.926128 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77896], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.604766069] seconds [----] I, [2016-09-13T07:25:13.926301 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77896], Delivering... [----] I, [2016-09-13T07:25:13.932712 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032949447631835938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033159255981445312, :pending_vm_jobs=>0.0008752346038818359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006044626235961914} [----] I, [2016-09-13T07:25:13.932978 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77896], State: [ok], Delivered in [0.006676499] seconds [----] I, [2016-09-13T07:25:18.638119 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:25:18 UTC]... [----] I, [2016-09-13T07:25:18.664403 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:25:18 UTC]...Complete [----] I, [2016-09-13T07:25:25.340308 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:25:25.354766 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77897], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:25:25.371828 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77898], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:25:30.048079 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:25:30.054792 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003676176071166992, :worker_monitor=>1.3436603546142578, :worker_dequeue=>0.012187004089355469, :total_time=>1.3598387241363525} [----] I, [2016-09-13T07:25:31.081057 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77898], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.720810896] seconds [----] I, [2016-09-13T07:25:31.081277 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77898], Delivering... [----] I, [2016-09-13T07:25:31.088152 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003623485565185547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037412643432617188, :pending_vm_jobs=>0.0008323192596435547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006460905075073242} [----] I, [2016-09-13T07:25:31.088577 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77898], State: [ok], Delivered in [0.007288314] seconds [----] I, [2016-09-13T07:25:31.265268 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77897], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.920383656] seconds [----] I, [2016-09-13T07:25:31.265515 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77897], Delivering... [----] I, [2016-09-13T07:25:31.270617 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77897], State: [ok], Delivered in [0.005093698] seconds [----] I, [2016-09-13T07:25:40.382325 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:25:40.394750 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77899], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:25:46.495396 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:25:46.501920 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004693508148193359, :worker_monitor=>1.3877363204956055, :worker_dequeue=>0.011290788650512695, :total_time=>1.4041285514831543} [----] I, [2016-09-13T07:25:47.184046 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77899], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.7976549] seconds [----] I, [2016-09-13T07:25:47.184211 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77899], Delivering... [----] I, [2016-09-13T07:25:47.190204 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031647682189941406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003181934356689453, :pending_vm_jobs=>0.0007030963897705078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005648136138916016} [----] I, [2016-09-13T07:25:47.190568 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77899], State: [ok], Delivered in [0.006332777] seconds [----] I, [2016-09-13T07:25:51.502733 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:25:51 UTC]... [----] I, [2016-09-13T07:25:51.544743 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:25:51 UTC]...Complete [----] I, [2016-09-13T07:25:55.403569 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:25:55.435594 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77900], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:25:55.452206 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77901], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:25:55.475338 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77902], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:25:55.505312 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77903], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:25:56.571810 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:25:56.637200 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77901], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.196782771] seconds [----] I, [2016-09-13T07:25:56.637486 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77901], Delivering... [----] I, [2016-09-13T07:25:56.692402 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77901], State: [ok], Delivered in [0.054956673] seconds [----] I, [2016-09-13T07:25:56.732789 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77903], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.247124361] seconds [----] I, [2016-09-13T07:25:56.732997 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77903], Delivering... [----] I, [2016-09-13T07:25:56.739523 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034694671630859375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003489255905151367, :pending_vm_jobs=>0.0008022785186767578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006118297576904297} [----] I, [2016-09-13T07:25:56.739906 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77903], State: [ok], Delivered in [0.006891057] seconds [----] I, [2016-09-13T07:25:56.772878 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77900], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.364062833] seconds [----] I, [2016-09-13T07:25:56.773131 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77900], Delivering... [----] I, [2016-09-13T07:25:56.778285 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77900], State: [ok], Delivered in [0.005167165] seconds [----] I, [2016-09-13T07:25:56.813017 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77902], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.354612474] seconds [----] I, [2016-09-13T07:25:56.813307 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77902], Delivering... [----] I, [2016-09-13T07:25:56.818200 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77902], State: [ok], Delivered in [0.004887205] seconds [----] I, [2016-09-13T07:26:03.138941 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004534482955932617, :worker_monitor=>1.5487704277038574, :worker_dequeue=>0.006318807601928711, :total_time=>1.5599145889282227} [----] I, [2016-09-13T07:26:10.518572 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:26:10.536883 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77904], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:26:13.264645 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:26:13.414058 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77904], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.888678875] seconds [----] I, [2016-09-13T07:26:13.414262 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77904], Delivering... [----] I, [2016-09-13T07:26:13.421058 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003566265106201172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003592967987060547, :pending_vm_jobs=>0.0008592605590820312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006352901458740234} [----] I, [2016-09-13T07:26:13.421466 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77904], State: [ok], Delivered in [0.007151689] seconds [----] I, [2016-09-13T07:26:19.617276 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006681919097900391, :worker_monitor=>1.3267462253570557, :worker_dequeue=>0.01170039176940918, :total_time=>1.345604419708252} [----] I, [2016-09-13T07:26:24.617944 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:26:24 UTC]... [----] I, [2016-09-13T07:26:24.637410 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:26:24 UTC]...Complete [----] I, [2016-09-13T07:26:25.550167 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:26:25.568031 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77905], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:26:25.579449 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77906], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:26:29.662201 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:26:29.986500 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77906], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.412945658] seconds [----] I, [2016-09-13T07:26:29.986704 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77906], Delivering... [----] I, [2016-09-13T07:26:29.992981 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003335714340209961, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033533573150634766, :pending_vm_jobs=>0.0007698535919189453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005927085876464844} [----] I, [2016-09-13T07:26:29.993327 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77906], State: [ok], Delivered in [0.006615738] seconds [----] I, [2016-09-13T07:26:30.019806 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77905], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.462449137] seconds [----] I, [2016-09-13T07:26:30.019972 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77905], Delivering... [----] I, [2016-09-13T07:26:30.023903 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77905], State: [ok], Delivered in [0.003903713] seconds [----] I, [2016-09-13T07:26:36.048875 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0047376155853271484, :worker_monitor=>1.3653500080108643, :worker_dequeue=>0.009993791580200195, :total_time=>1.3804774284362793} [----] I, [2016-09-13T07:26:40.592482 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:26:40.609293 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77907], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:26:41.058540 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:26:41.625788 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77907], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.027455679] seconds [----] I, [2016-09-13T07:26:41.626009 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77907], Delivering... [----] I, [2016-09-13T07:26:41.632337 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003373384475708008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034224987030029297, :pending_vm_jobs=>0.000743865966796875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00593113899230957} [----] I, [2016-09-13T07:26:41.632715 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77907], State: [ok], Delivered in [0.00670393] seconds [----] I, [2016-09-13T07:26:52.568938 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038917064666748047, :worker_monitor=>1.4749209880828857, :worker_dequeue=>0.008843660354614258, :total_time=>1.4879066944122314} [----] I, [2016-09-13T07:26:55.619347 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:26:55.648480 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77908], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:26:55.711345 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77909], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:26:55.722545 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77910], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:26:55.774254 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77911], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:26:57.569586 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:26:57 UTC]... [----] I, [2016-09-13T07:26:57.608539 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:26:57 UTC]...Complete [----] I, [2016-09-13T07:26:57.623229 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:26:57.707521 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77909], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.056017389] seconds [----] I, [2016-09-13T07:26:57.707737 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77909], Delivering... [----] I, [2016-09-13T07:26:57.779977 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77909], State: [ok], Delivered in [0.072212369] seconds [----] I, [2016-09-13T07:26:57.809028 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77911], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.080152072] seconds [----] I, [2016-09-13T07:26:57.809238 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77911], Delivering... [----] I, [2016-09-13T07:26:57.816501 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003699064254760742, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003722667694091797, :pending_vm_jobs=>0.0009007453918457031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006804466247558594} [----] I, [2016-09-13T07:26:57.816895 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77911], State: [ok], Delivered in [0.007641642] seconds [----] I, [2016-09-13T07:26:58.534451 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77908], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.911745297] seconds [----] I, [2016-09-13T07:26:58.534676 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77908], Delivering... [----] I, [2016-09-13T07:26:58.539657 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77908], State: [ok], Delivered in [0.004975267] seconds [----] I, [2016-09-13T07:26:58.574397 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77910], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.858893421] seconds [----] I, [2016-09-13T07:26:58.574597 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77910], Delivering... [----] I, [2016-09-13T07:26:58.577687 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77910], State: [ok], Delivered in [0.003077768] seconds [----] I, [2016-09-13T07:27:09.507955 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005379438400268555, :worker_monitor=>1.8360176086425781, :worker_dequeue=>0.013518571853637695, :total_time=>1.85536527633667} [----] I, [2016-09-13T07:27:10.786300 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:27:10.816043 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77912], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:27:10.854371 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77913], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:27:14.633453 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:27:14.957699 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77912], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.165434385] seconds [----] I, [2016-09-13T07:27:14.957926 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77912], Delivering... [----] I, [2016-09-13T07:27:14.964815 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037000179290771484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037245750427246094, :pending_vm_jobs=>0.0008625984191894531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006494283676147461} [----] I, [2016-09-13T07:27:14.965214 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77912], State: [ok], Delivered in [0.00730273] seconds [----] I, [2016-09-13T07:27:15.189153 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77913], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.369617838] seconds [----] I, [2016-09-13T07:27:15.189346 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77913], Delivering... [----] I, [2016-09-13T07:27:15.193655 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77913], State: [ok], Delivered in [0.004304515] seconds [----] I, [2016-09-13T07:27:25.864311 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:27:25.883309 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77914], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:27:26.150995 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:27:26.161482 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037288665771484375, :worker_monitor=>1.474318504333496, :worker_dequeue=>0.018665552139282227, :total_time=>1.4970364570617676} [----] I, [2016-09-13T07:27:27.086810 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77914], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.216528369] seconds [----] I, [2016-09-13T07:27:27.087005 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77914], Delivering... [----] I, [2016-09-13T07:27:27.093396 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032422542572021484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003262042999267578, :pending_vm_jobs=>0.0008220672607421875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006060361862182617} [----] I, [2016-09-13T07:27:27.093939 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77914], State: [ok], Delivered in [0.006923307] seconds [----] I, [2016-09-13T07:27:31.162015 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:27:31 UTC]... [----] I, [2016-09-13T07:27:31.177805 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:27:31 UTC]...Complete [----] I, [2016-09-13T07:27:40.895543 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:27:40.910925 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77915], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:27:40.929979 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77916], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:27:42.607488 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:27:42.611594 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004591941833496094, :worker_monitor=>1.3826651573181152, :worker_dequeue=>0.007823944091796875, :total_time=>1.395376205444336} [----] I, [2016-09-13T07:27:43.178439 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77915], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.276830483] seconds [----] I, [2016-09-13T07:27:43.178588 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77915], Delivering... [----] I, [2016-09-13T07:27:43.183268 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002521038055419922, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025382041931152344, :pending_vm_jobs=>0.0006163120269775391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004423618316650391} [----] I, [2016-09-13T07:27:43.183572 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77915], State: [ok], Delivered in [0.004968011] seconds [----] I, [2016-09-13T07:27:43.721474 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77916], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.80618866] seconds [----] I, [2016-09-13T07:27:43.721722 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77916], Delivering... [----] I, [2016-09-13T07:27:43.726286 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77916], State: [ok], Delivered in [0.00457856] seconds [----] I, [2016-09-13T07:27:55.943233 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T07:27:55.961507 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77917], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:27:55.984443 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77918], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:27:56.007135 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77919], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:27:59.411305 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:27:59.418339 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004462718963623047, :worker_monitor=>1.7551624774932861, :worker_dequeue=>0.013235330581665039, :total_time=>1.7731492519378662} [----] I, [2016-09-13T07:28:00.361732 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77917], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.413966627] seconds [----] I, [2016-09-13T07:28:00.361864 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77917], Delivering... [----] I, [2016-09-13T07:28:00.373321 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77919], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.379342043] seconds [----] I, [2016-09-13T07:28:00.373469 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77919], Delivering... [----] I, [2016-09-13T07:28:00.377023 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.001965045928955078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0019769668579101562, :pending_vm_jobs=>0.00041794776916503906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0033371448516845703} [----] I, [2016-09-13T07:28:00.377261 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77919], State: [ok], Delivered in [0.00377732] seconds [----] I, [2016-09-13T07:28:00.401738 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77917], State: [ok], Delivered in [0.039866376] seconds [----] I, [2016-09-13T07:28:00.424514 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77918], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.458063852] seconds [----] I, [2016-09-13T07:28:00.424613 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77918], Delivering... [----] I, [2016-09-13T07:28:00.426226 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77918], State: [ok], Delivered in [0.001609609] seconds [----] I, [2016-09-13T07:28:04.418831 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:28:04 UTC]... [----] I, [2016-09-13T07:28:04.436134 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:28:04 UTC]...Complete [----] I, [2016-09-13T07:28:11.017898 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:28:11.036443 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77920], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:28:11.064738 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77921], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:28:16.003023 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:28:16.010017 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003195047378540039, :worker_monitor=>1.5167787075042725, :worker_dequeue=>0.012722492218017578, :total_time=>1.5330045223236084} [----] I, [2016-09-13T07:28:16.476560 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77920], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.454570329] seconds [----] I, [2016-09-13T07:28:16.476843 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77920], Delivering... [----] I, [2016-09-13T07:28:16.485745 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0045773983001708984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004609107971191406, :pending_vm_jobs=>0.0011734962463378906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008387088775634766} [----] I, [2016-09-13T07:28:16.486260 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77920], State: [ok], Delivered in [0.009413818] seconds [----] I, [2016-09-13T07:28:16.841557 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77921], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.802322685] seconds [----] I, [2016-09-13T07:28:16.841689 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77921], Delivering... [----] I, [2016-09-13T07:28:16.844781 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77921], State: [ok], Delivered in [0.003087959] seconds [----] I, [2016-09-13T07:28:26.072792 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:28:26.088059 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77922], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:28:26.104794 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77923], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:28:26.116725 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T07:28:26.121884 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77924], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:28:26.124959 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:28:26.539005 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77922], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.461422063] seconds [----] I, [2016-09-13T07:28:26.539176 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77922], Delivering... [----] I, [2016-09-13T07:28:26.545518 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032885074615478516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003309488296508789, :pending_vm_jobs=>0.0008080005645751953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059435367584228516} [----] I, [2016-09-13T07:28:26.545893 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77922], State: [ok], Delivered in [0.006698147] seconds [----] I, [2016-09-13T07:28:26.578995 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77923], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.487342039] seconds [----] I, [2016-09-13T07:28:26.579142 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77923], Delivering... [----] I, [2016-09-13T07:28:26.580080 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T07:28:26.580240 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5356486656 [----] I, [2016-09-13T07:28:26.580314 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5133000704 [----] I, [2016-09-13T07:28:26.580378 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 223485952 [----] I, [2016-09-13T07:28:26.580464 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T07:28:26.580535 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5078982656 [----] I, [2016-09-13T07:28:26.580595 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T07:28:26.580650 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T07:28:26.580730 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 544837632 [----] I, [2016-09-13T07:28:26.580790 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T07:28:26.580874 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7972249600 [----] I, [2016-09-13T07:28:26.580938 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T07:28:26.580995 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T07:28:26.581050 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T07:28:26.581104 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T07:28:26.581158 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T07:28:26.581217 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T07:28:26.581271 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T07:28:26.581327 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T07:28:26.581382 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T07:28:26.581466 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T07:28:26.581532 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273551360 [----] I, [2016-09-13T07:28:26.581589 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56815616 [----] I, [2016-09-13T07:28:26.581647 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216735744 [----] I, [2016-09-13T07:28:26.581700 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T07:28:26.581756 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141393920 [----] I, [2016-09-13T07:28:26.581812 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2588467200 [----] I, [2016-09-13T07:28:26.581879 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2270085120 [----] I, [2016-09-13T07:28:26.581941 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T07:28:26.581996 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T07:28:26.582054 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T07:28:26.582108 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37502976 [----] I, [2016-09-13T07:28:26.582165 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102281216 [----] I, [2016-09-13T07:28:26.582218 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53194752 [----] I, [2016-09-13T07:28:26.582275 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110833664 [----] I, [2016-09-13T07:28:26.582337 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155475968 [----] I, [2016-09-13T07:28:26.582393 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T07:28:26.582510 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T07:28:26.582584 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T07:28:26.582641 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T07:28:26.582698 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T07:28:26.582750 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T07:28:26.582803 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T07:28:26.582867 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T07:28:26.582928 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T07:28:26.584754 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77924], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.474720821] seconds [----] I, [2016-09-13T07:28:26.584979 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77924], Delivering... [----] I, [2016-09-13T07:28:26.596475 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:28:11 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205293000], Memory % [3.5], CPU Time [239188.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T07:28:26.597369 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:28:15 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [151069.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:28:26.598041 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:28:15 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [150168.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:28:26.598666 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:28:11 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347149000], Memory % [5.04], CPU Time [104092.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T07:28:26.599376 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:28:14 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162418000], Memory % [3.1], CPU Time [37860.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T07:28:26.600176 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:28:13 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [202340.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T07:28:26.600737 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:28:08 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212541000], Memory % [3.5], CPU Time [48733.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T07:28:26.601443 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:28:14 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [51377.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:28:26.605255 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:28:07 UTC], Process Info: Memory Usage [592543744], Memory Size [922411008], Proportional Set Size: [427579000], Memory % [7.22], CPU Time [796.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:28:26.608120 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:28:13 UTC], Process Info: Memory Usage [603611136], Memory Size [1059778560], Proportional Set Size: [438567000], Memory % [7.36], CPU Time [1858.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:28:26.610990 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:28:07 UTC], Process Info: Memory Usage [557592576], Memory Size [893222912], Proportional Set Size: [405224000], Memory % [6.8], CPU Time [5486.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T07:28:26.612050 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T07:28:26.612315 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T07:28:26.613721 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:28:09 UTC], Process Info: Memory Usage [580603904], Memory Size [908496896], Proportional Set Size: [420100000], Memory % [7.08], CPU Time [2039.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T07:28:26.614446 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:28:15 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357918000], Memory % [5.27], CPU Time [209455.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T07:28:26.615141 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:28:15 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [51384.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:28:26.615760 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:28:15 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38754.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T07:28:26.615935 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T07:28:26.616133 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77924], State: [ok], Delivered in [0.031155963] seconds [----] I, [2016-09-13T07:28:26.620496 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T07:28:26.626030 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T07:28:26.629618 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T07:28:26.632508 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T07:28:26.637210 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 844 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T07:28:26.642616 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T07:28:26.646368 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T07:28:26.649916 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T07:28:26.654631 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T07:28:26.659949 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T07:28:26.663465 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T07:28:26.666038 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:28:26.666179 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:28:26.666283 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T07:28:26.672077 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [209451.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:28:26.672592 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77923], State: [ok], Delivered in [0.093396085] seconds [----] I, [2016-09-13T07:28:32.628478 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0058286190032958984, :worker_monitor=>1.4759869575500488, :worker_dequeue=>0.011656761169433594, :total_time=>1.493821620941162} [----] I, [2016-09-13T07:28:37.628955 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:28:37 UTC]... [----] I, [2016-09-13T07:28:37.641437 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:28:37 UTC]...Complete [----] I, [2016-09-13T07:28:41.137059 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:28:41.161845 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77925], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:28:41.178992 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77926], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:28:42.662453 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:28:42.750985 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77925], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.606894691] seconds [----] I, [2016-09-13T07:28:42.751288 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77925], Delivering... [----] I, [2016-09-13T07:28:42.762126 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005662202835083008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0056951045989990234, :pending_vm_jobs=>0.0013723373413085938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010240316390991211} [----] I, [2016-09-13T07:28:42.762608 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77925], State: [ok], Delivered in [0.011336273] seconds [----] I, [2016-09-13T07:28:43.939221 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77926], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.772232587] seconds [----] I, [2016-09-13T07:28:43.939389 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77926], Delivering... [----] I, [2016-09-13T07:28:43.943210 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77926], State: [ok], Delivered in [0.003810524] seconds [----] I, [2016-09-13T07:28:49.092578 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004027128219604492, :worker_monitor=>1.4067471027374268, :worker_dequeue=>0.011982440948486328, :total_time=>1.4231140613555908} [----] I, [2016-09-13T07:28:56.198315 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T07:28:56.209022 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77927], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:28:56.219786 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77928], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:28:56.231154 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77929], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:28:59.119954 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:28:59.962044 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77927], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.760773122] seconds [----] I, [2016-09-13T07:28:59.962320 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77927], Delivering... [----] I, [2016-09-13T07:28:59.968684 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77929], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.74379124] seconds [----] I, [2016-09-13T07:28:59.968807 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77929], Delivering... [----] I, [2016-09-13T07:28:59.973452 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024077892303466797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002448558807373047, :pending_vm_jobs=>0.0007433891296386719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0043659210205078125} [----] I, [2016-09-13T07:28:59.973736 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77929], State: [ok], Delivered in [0.004922624] seconds [----] I, [2016-09-13T07:29:00.054835 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77927], State: [ok], Delivered in [0.092517097] seconds [----] I, [2016-09-13T07:29:00.626391 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77928], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.41420592] seconds [----] I, [2016-09-13T07:29:00.626728 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77928], Delivering... [----] I, [2016-09-13T07:29:00.631589 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77928], State: [ok], Delivered in [0.004857967] seconds [----] I, [2016-09-13T07:29:05.512347 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041887760162353516, :worker_monitor=>1.3694326877593994, :worker_dequeue=>0.009256124496459961, :total_time=>1.3832752704620361} [----] I, [2016-09-13T07:29:10.512872 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:29:10 UTC]... [----] I, [2016-09-13T07:29:10.528611 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:29:10 UTC]...Complete [----] I, [2016-09-13T07:29:11.239262 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:29:11.260637 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77930], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:29:11.278710 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77931], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:29:15.556025 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:29:15.705698 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77930], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.459695507] seconds [----] I, [2016-09-13T07:29:15.705995 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77930], Delivering... [----] I, [2016-09-13T07:29:15.716151 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005137443542480469, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00519251823425293, :pending_vm_jobs=>0.0013399124145507812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009631633758544922} [----] I, [2016-09-13T07:29:15.716671 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77930], State: [ok], Delivered in [0.010678883] seconds [----] I, [2016-09-13T07:29:16.037897 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77931], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.77298524] seconds [----] I, [2016-09-13T07:29:16.038071 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77931], Delivering... [----] I, [2016-09-13T07:29:16.042474 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77931], State: [ok], Delivered in [0.004368658] seconds [----] I, [2016-09-13T07:29:21.719008 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004292488098144531, :worker_monitor=>1.1452324390411377, :worker_dequeue=>0.006455659866333008, :total_time=>1.1562590599060059} [----] I, [2016-09-13T07:29:26.293745 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:29:26.304907 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77932], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:29:26.830716 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:29:27.157626 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77932], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.858063824] seconds [----] I, [2016-09-13T07:29:27.157808 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77932], Delivering... [----] I, [2016-09-13T07:29:27.163004 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027360916137695312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002753019332885742, :pending_vm_jobs=>0.0006411075592041016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0048749446868896484} [----] I, [2016-09-13T07:29:27.163320 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77932], State: [ok], Delivered in [0.005521098] seconds [----] I, [2016-09-13T07:29:38.532987 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004057884216308594, :worker_monitor=>1.6556193828582764, :worker_dequeue=>0.011685609817504883, :total_time=>1.6716840267181396} [----] I, [2016-09-13T07:29:41.316604 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:29:41.333688 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77933], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:29:41.344926 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77934], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:29:41.356663 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77935], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:29:41.367704 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77936], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:29:43.533585 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:29:43 UTC]... [----] I, [2016-09-13T07:29:43.556753 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:29:43 UTC]...Complete [----] I, [2016-09-13T07:29:43.566806 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:29:44.179948 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77933], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.856992404] seconds [----] I, [2016-09-13T07:29:44.180222 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77933], Delivering... [----] I, [2016-09-13T07:29:44.188963 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005326032638549805, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005357265472412109, :pending_vm_jobs=>0.0009105205535888672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00812840461730957} [----] I, [2016-09-13T07:29:44.189346 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77933], State: [ok], Delivered in [0.009134855] seconds [----] I, [2016-09-13T07:29:44.219919 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77935], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.871808047] seconds [----] I, [2016-09-13T07:29:44.220102 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77935], Delivering... [----] I, [2016-09-13T07:29:44.282956 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77935], State: [ok], Delivered in [0.06283802] seconds [----] I, [2016-09-13T07:29:44.299620 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77934], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.962498418] seconds [----] I, [2016-09-13T07:29:44.299786 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77934], Delivering... [----] I, [2016-09-13T07:29:44.303550 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77934], State: [ok], Delivered in [0.003759237] seconds [----] I, [2016-09-13T07:29:44.334137 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77936], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.973033112] seconds [----] I, [2016-09-13T07:29:44.334347 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77936], Delivering... [----] I, [2016-09-13T07:29:44.337314 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77936], State: [ok], Delivered in [0.002964193] seconds [----] I, [2016-09-13T07:29:54.851223 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0048542022705078125, :worker_monitor=>1.2498817443847656, :worker_dequeue=>0.006825923919677734, :total_time=>1.2620511054992676} [----] I, [2016-09-13T07:29:56.380918 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:29:56.396805 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77937], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:29:59.860804 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:30:00.427042 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77937], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.036277339] seconds [----] I, [2016-09-13T07:30:00.427268 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77937], Delivering... [----] I, [2016-09-13T07:30:00.433918 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034134387969970703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035047531127929688, :pending_vm_jobs=>0.0008015632629394531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062046051025390625} [----] I, [2016-09-13T07:30:00.434276 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77937], State: [ok], Delivered in [0.007016875] seconds [----] I, [2016-09-13T07:30:11.405344 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:30:11.419519 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77938], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:30:11.432708 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77939], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:30:11.442395 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77940], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:30:11.453616 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77941], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:30:11.465158 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77942], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:30:15.875307 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:30:15 UTC]... [----] I, [2016-09-13T07:30:15.887998 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:30:15 UTC]...Complete [----] I, [2016-09-13T07:30:15.901724 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:30:16.248828 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77938], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.839898119] seconds [----] I, [2016-09-13T07:30:16.249050 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77938], Delivering... [----] I, [2016-09-13T07:30:16.255867 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036623477935791016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003681659698486328, :pending_vm_jobs=>0.0008516311645507812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006357669830322266} [----] I, [2016-09-13T07:30:16.256249 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77938], State: [ok], Delivered in [0.00718514] seconds [----] I, [2016-09-13T07:30:16.306814 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77939], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.882803459] seconds [----] I, [2016-09-13T07:30:16.307030 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77939], Delivering... [----] I, [2016-09-13T07:30:16.309343 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77939], State: [ok], Delivered in [0.00231334] seconds [----] I, [2016-09-13T07:30:16.339900 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77940], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.902426067] seconds [----] I, [2016-09-13T07:30:16.340128 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77940], Delivering... [----] I, [2016-09-13T07:30:16.352095 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77940], State: [ok], Delivered in [0.011955293] seconds [----] I, [2016-09-13T07:30:16.379670 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77941], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.933317163] seconds [----] I, [2016-09-13T07:30:16.379831 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77941], Delivering... [----] I, [2016-09-13T07:30:16.383839 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77941], State: [ok], Delivered in [0.004000142] seconds [----] I, [2016-09-13T07:30:16.437254 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77942], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.980574829] seconds [----] I, [2016-09-13T07:30:16.437480 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77942], Delivering... [----] I, [2016-09-13T07:30:16.441943 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77942], State: [ok], Delivered in [0.004484435] seconds [----] I, [2016-09-13T07:30:26.734386 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:30:26.759123 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77943], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:30:27.515319 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:30:27.526509 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006078004837036133, :worker_monitor=>1.5839476585388184, :worker_dequeue=>0.01590418815612793, :total_time=>1.606400489807129} [----] I, [2016-09-13T07:30:27.667572 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77943], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.923490587] seconds [----] I, [2016-09-13T07:30:27.667688 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77943], Delivering... [----] I, [2016-09-13T07:30:27.671208 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0019485950469970703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.001960277557373047, :pending_vm_jobs=>0.0004062652587890625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003321409225463867} [----] I, [2016-09-13T07:30:27.671429 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77943], State: [ok], Delivered in [0.003724104] seconds [----] I, [2016-09-13T07:30:41.774535 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:30:41.793199 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77944], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:30:41.816269 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77945], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:30:41.839107 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77946], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:30:41.930716 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77947], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:30:44.383524 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:30:44.388758 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004110097885131836, :worker_monitor=>1.7230701446533203, :worker_dequeue=>0.00991058349609375, :total_time=>1.7373971939086914} [----] I, [2016-09-13T07:30:44.525270 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77944], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.744746077] seconds [----] I, [2016-09-13T07:30:44.525509 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77944], Delivering... [----] I, [2016-09-13T07:30:44.532493 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00357818603515625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003597736358642578, :pending_vm_jobs=>0.0009181499481201172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0064351558685302734} [----] I, [2016-09-13T07:30:44.532842 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77944], State: [ok], Delivered in [0.00732906] seconds [----] I, [2016-09-13T07:30:44.622353 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77946], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.801068916] seconds [----] I, [2016-09-13T07:30:44.622567 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77946], Delivering... [----] I, [2016-09-13T07:30:44.727189 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77946], State: [ok], Delivered in [0.104580252] seconds [----] I, [2016-09-13T07:30:44.788310 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77945], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.991277315] seconds [----] I, [2016-09-13T07:30:44.788478 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77945], Delivering... [----] I, [2016-09-13T07:30:44.792669 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77945], State: [ok], Delivered in [0.004173907] seconds [----] I, [2016-09-13T07:30:44.822276 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77947], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.977695248] seconds [----] I, [2016-09-13T07:30:44.822516 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77947], Delivering... [----] I, [2016-09-13T07:30:44.826123 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77947], State: [ok], Delivered in [0.003596788] seconds [----] I, [2016-09-13T07:30:49.389224 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:30:49 UTC]... [----] I, [2016-09-13T07:30:49.404789 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:30:49 UTC]...Complete [----] I, [2016-09-13T07:30:56.949990 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:30:56.974789 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77948], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:31:01.349754 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:31:01.357800 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004091739654541016, :worker_monitor=>1.8999359607696533, :worker_dequeue=>0.013884544372558594, :total_time=>1.9182441234588623} [----] I, [2016-09-13T07:31:01.603177 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77948], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.643963418] seconds [----] I, [2016-09-13T07:31:01.603354 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77948], Delivering... [----] I, [2016-09-13T07:31:01.609765 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003313779830932617, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033311843872070312, :pending_vm_jobs=>0.0008828639984130859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006013154983520508} [----] I, [2016-09-13T07:31:01.610139 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77948], State: [ok], Delivered in [0.006783662] seconds [----] I, [2016-09-13T07:31:11.990186 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:31:12.026082 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77949], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:31:12.037478 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77950], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:31:17.720798 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:31:17.731775 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004861593246459961, :worker_monitor=>1.3197236061096191, :worker_dequeue=>0.0196993350982666, :total_time=>1.3446764945983887} [----] I, [2016-09-13T07:31:17.997777 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77949], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.002398468] seconds [----] I, [2016-09-13T07:31:17.997931 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77949], Delivering... [----] I, [2016-09-13T07:31:18.001744 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002142190933227539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002154111862182617, :pending_vm_jobs=>0.00043654441833496094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003545045852661133} [----] I, [2016-09-13T07:31:18.002647 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77949], State: [ok], Delivered in [0.004714375] seconds [----] I, [2016-09-13T07:31:18.032010 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77950], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.002059466] seconds [----] I, [2016-09-13T07:31:18.032168 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77950], Delivering... [----] I, [2016-09-13T07:31:18.036181 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77950], State: [ok], Delivered in [0.004008822] seconds [----] I, [2016-09-13T07:31:22.732274 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:31:22 UTC]... [----] I, [2016-09-13T07:31:22.751553 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:31:22 UTC]...Complete [----] I, [2016-09-13T07:31:27.049577 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:31:27.066645 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77951], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:31:27.770496 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:31:28.100450 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77951], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.044721544] seconds [----] I, [2016-09-13T07:31:28.100577 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77951], Delivering... [----] I, [2016-09-13T07:31:28.106515 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030736923217773438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030939579010009766, :pending_vm_jobs=>0.0005939006805419922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00475764274597168} [----] I, [2016-09-13T07:31:28.106734 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77951], State: [ok], Delivered in [0.006155054] seconds [----] I, [2016-09-13T07:31:34.180856 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0029697418212890625, :server_monitor=>0.10606718063354492, :worker_monitor=>1.2872047424316406, :worker_dequeue=>0.007600069046020508, :total_time=>1.404158353805542} [----] I, [2016-09-13T07:31:42.075255 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:31:42.086650 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77952], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:31:42.102836 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77953], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:31:42.119721 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77954], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:31:42.137060 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77955], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:31:44.219645 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:31:44.279899 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77952], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.199507698] seconds [----] I, [2016-09-13T07:31:44.280095 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77952], Delivering... [----] I, [2016-09-13T07:31:44.286291 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032892227172851562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033082962036132812, :pending_vm_jobs=>0.0007512569427490234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005872249603271484} [----] I, [2016-09-13T07:31:44.286610 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77952], State: [ok], Delivered in [0.006504052] seconds [----] I, [2016-09-13T07:31:44.348622 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77954], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.238982351] seconds [----] I, [2016-09-13T07:31:44.348803 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77954], Delivering... [----] I, [2016-09-13T07:31:44.411296 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77954], State: [ok], Delivered in [0.062474591] seconds [----] I, [2016-09-13T07:31:45.126042 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77953], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.034714536] seconds [----] I, [2016-09-13T07:31:45.126323 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77953], Delivering... [----] I, [2016-09-13T07:31:45.132377 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77953], State: [ok], Delivered in [0.006055513] seconds [----] I, [2016-09-13T07:31:45.205986 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77955], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.080401978] seconds [----] I, [2016-09-13T07:31:45.206204 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77955], Delivering... [----] I, [2016-09-13T07:31:45.209568 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77955], State: [ok], Delivered in [0.003347019] seconds [----] I, [2016-09-13T07:31:50.757813 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006444692611694336, :worker_monitor=>1.5133566856384277, :worker_dequeue=>0.011115312576293945, :total_time=>1.5313818454742432} [----] I, [2016-09-13T07:31:55.758319 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:31:55 UTC]... [----] I, [2016-09-13T07:31:55.771073 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:31:55 UTC]...Complete [----] I, [2016-09-13T07:31:57.158727 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:31:57.177480 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77956], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:32:00.803516 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:32:01.345015 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77956], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.176498334] seconds [----] I, [2016-09-13T07:32:01.345251 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77956], Delivering... [----] I, [2016-09-13T07:32:01.351623 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003381013870239258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003400087356567383, :pending_vm_jobs=>0.000789642333984375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005967855453491211} [----] I, [2016-09-13T07:32:01.351985 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77956], State: [ok], Delivered in [0.006739121] seconds [----] I, [2016-09-13T07:32:07.455120 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003841876983642578, :worker_monitor=>1.6290276050567627, :worker_dequeue=>0.011738300323486328, :total_time=>1.6448948383331299} [----] I, [2016-09-13T07:32:12.195167 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:32:12.217057 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77957], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:32:12.228351 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77958], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:32:12.465001 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:32:12.640310 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77957], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.439150089] seconds [----] I, [2016-09-13T07:32:12.640542 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77957], Delivering... [----] I, [2016-09-13T07:32:12.647316 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003444671630859375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034644603729248047, :pending_vm_jobs=>0.0008625984191894531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063588619232177734} [----] I, [2016-09-13T07:32:12.647726 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77957], State: [ok], Delivered in [0.007185982] seconds [----] I, [2016-09-13T07:32:13.903465 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77958], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.683734427] seconds [----] I, [2016-09-13T07:32:13.903670 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77958], Delivering... [----] I, [2016-09-13T07:32:13.908483 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77958], State: [ok], Delivered in [0.004788821] seconds [----] I, [2016-09-13T07:32:23.799474 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0044443607330322266, :worker_monitor=>1.2967321872711182, :worker_dequeue=>0.008548498153686523, :total_time=>1.3100769519805908} [----] I, [2016-09-13T07:32:27.237533 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:32:27.256542 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77959], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:32:28.799855 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:32:28 UTC]... [----] I, [2016-09-13T07:32:28.839072 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:32:28 UTC]...Complete [----] I, [2016-09-13T07:32:28.848256 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:32:29.011697 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77959], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.767061641] seconds [----] I, [2016-09-13T07:32:29.011814 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77959], Delivering... [----] I, [2016-09-13T07:32:29.015554 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020644664764404297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020761489868164062, :pending_vm_jobs=>0.0004467964172363281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0034961700439453125} [----] I, [2016-09-13T07:32:29.015821 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77959], State: [ok], Delivered in [0.003996471] seconds [----] I, [2016-09-13T07:32:40.282659 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004769086837768555, :worker_monitor=>1.2811589241027832, :worker_dequeue=>0.011865615844726562, :total_time=>1.2980473041534424} [----] I, [2016-09-13T07:32:42.270521 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:32:42.290810 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77960], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:32:42.313638 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77961], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:32:42.342505 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77962], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:32:42.370638 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77963], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:32:45.293580 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:32:45.399409 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77960], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.122985716] seconds [----] I, [2016-09-13T07:32:45.399656 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77960], Delivering... [----] I, [2016-09-13T07:32:45.406616 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035810470581054688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003606081008911133, :pending_vm_jobs=>0.0009007453918457031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006502628326416016} [----] I, [2016-09-13T07:32:45.407080 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77960], State: [ok], Delivered in [0.007393431] seconds [----] I, [2016-09-13T07:32:45.433875 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77962], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.113728006] seconds [----] I, [2016-09-13T07:32:45.434097 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77962], Delivering... [----] I, [2016-09-13T07:32:45.496682 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77962], State: [ok], Delivered in [0.062549265] seconds [----] I, [2016-09-13T07:32:45.519559 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77961], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.224577426] seconds [----] I, [2016-09-13T07:32:45.519746 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77961], Delivering... [----] I, [2016-09-13T07:32:45.524804 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77961], State: [ok], Delivered in [0.005037876] seconds [----] I, [2016-09-13T07:32:45.554159 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77963], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.202949961] seconds [----] I, [2016-09-13T07:32:45.554475 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77963], Delivering... [----] I, [2016-09-13T07:32:45.559153 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77963], State: [ok], Delivered in [0.004698126] seconds [----] I, [2016-09-13T07:32:56.384506 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005124330520629883, :worker_monitor=>1.0551342964172363, :worker_dequeue=>0.006449699401855469, :total_time=>1.0670750141143799} [----] I, [2016-09-13T07:32:57.387515 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:32:57.404395 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77964], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:33:01.385148 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:33:01 UTC]... [----] I, [2016-09-13T07:33:01.403924 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:33:01 UTC]...Complete [----] I, [2016-09-13T07:33:01.415262 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:33:01.798630 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77964], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.404812585] seconds [----] I, [2016-09-13T07:33:01.798813 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77964], Delivering... [----] I, [2016-09-13T07:33:01.806564 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0046918392181396484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004711151123046875, :pending_vm_jobs=>0.0008521080017089844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0073413848876953125} [----] I, [2016-09-13T07:33:01.806976 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77964], State: [ok], Delivered in [0.008156484] seconds [----] I, [2016-09-13T07:33:12.422468 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:33:12.438805 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77965], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:33:12.457135 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77966], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:33:13.031127 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:33:13.037954 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003898143768310547, :worker_monitor=>1.5890414714813232, :worker_dequeue=>0.011947393417358398, :total_time=>1.6052014827728271} [----] I, [2016-09-13T07:33:13.933338 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77965], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.504455412] seconds [----] I, [2016-09-13T07:33:13.933474 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77965], Delivering... [----] I, [2016-09-13T07:33:13.937299 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002187490463256836, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002199888229370117, :pending_vm_jobs=>0.00043320655822753906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0036096572875976562} [----] I, [2016-09-13T07:33:13.937542 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77965], State: [ok], Delivered in [0.004067478] seconds [----] I, [2016-09-13T07:33:14.150643 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77966], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.707161514] seconds [----] I, [2016-09-13T07:33:14.150856 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77966], Delivering... [----] I, [2016-09-13T07:33:14.155580 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77966], State: [ok], Delivered in [0.004729236] seconds [----] I, [2016-09-13T07:33:27.472392 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:33:27.499263 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77967], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:33:27.516226 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77968], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:33:27.533553 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77969], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:33:28.104965 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T07:33:29.422189 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:33:29.428108 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003896951675415039, :log_active_servers=>0.014902591705322266, :worker_monitor=>1.3120372295379639, :worker_dequeue=>0.010767936706542969, :total_time=>1.341947078704834} [----] I, [2016-09-13T07:33:30.094244 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77967], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.615753835] seconds [----] I, [2016-09-13T07:33:30.094561 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77967], Delivering... [----] I, [2016-09-13T07:33:30.105624 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005440235137939453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005537748336791992, :pending_vm_jobs=>0.0015523433685302734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.01050257682800293} [----] I, [2016-09-13T07:33:30.106167 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77967], State: [ok], Delivered in [0.011604408] seconds [----] I, [2016-09-13T07:33:30.158380 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77968], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.651812461] seconds [----] I, [2016-09-13T07:33:30.158646 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77968], Delivering... [----] I, [2016-09-13T07:33:30.159760 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T07:33:30.160014 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5347667968 [----] I, [2016-09-13T07:33:30.160142 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5123985408 [----] I, [2016-09-13T07:33:30.160255 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 223682560 [----] I, [2016-09-13T07:33:30.160371 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T07:33:30.160521 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5069955072 [----] I, [2016-09-13T07:33:30.160650 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T07:33:30.160758 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T07:33:30.160880 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 545071104 [----] I, [2016-09-13T07:33:30.160992 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T07:33:30.161096 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7870582784 [----] I, [2016-09-13T07:33:30.161204 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T07:33:30.161310 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T07:33:30.161449 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T07:33:30.161575 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 0 [----] I, [2016-09-13T07:33:30.161687 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T07:33:30.161795 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T07:33:30.161924 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T07:33:30.162033 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T07:33:30.162141 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T07:33:30.162247 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T07:33:30.162349 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273571840 [----] I, [2016-09-13T07:33:30.162485 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56827904 [----] I, [2016-09-13T07:33:30.162608 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216743936 [----] I, [2016-09-13T07:33:30.162716 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6242304 [----] I, [2016-09-13T07:33:30.162832 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141406208 [----] I, [2016-09-13T07:33:30.162965 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2596880384 [----] I, [2016-09-13T07:33:30.163079 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2278289408 [----] I, [2016-09-13T07:33:30.163189 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T07:33:30.163293 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T07:33:30.163398 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T07:33:30.163562 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37580800 [----] I, [2016-09-13T07:33:30.163704 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102289408 [----] I, [2016-09-13T07:33:30.163820 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53198848 [----] I, [2016-09-13T07:33:30.163953 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110866432 [----] I, [2016-09-13T07:33:30.164062 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155488256 [----] I, [2016-09-13T07:33:30.164167 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T07:33:30.164271 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T07:33:30.164377 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T07:33:30.164519 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T07:33:30.164628 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T07:33:30.164741 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T07:33:30.164867 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T07:33:30.164976 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T07:33:30.165082 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T07:33:30.168308 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77969], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.646929687] seconds [----] I, [2016-09-13T07:33:30.168596 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [77969], Delivering... [----] I, [2016-09-13T07:33:30.178709 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:33:20 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48741.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T07:33:30.179294 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:33:27 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358681000], Memory % [5.28], CPU Time [202394.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T07:33:30.179896 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:33:27 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [51393.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:33:30.180651 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:33:27 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205293000], Memory % [3.5], CPU Time [239349.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T07:33:30.181189 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:33:24 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [104109.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T07:33:30.181713 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:33:26 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162418000], Memory % [3.1], CPU Time [37870.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T07:33:30.182231 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:33:29 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [151127.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:33:30.182868 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:33:29 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [150226.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:33:30.186815 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:33:24 UTC], Process Info: Memory Usage [592785408], Memory Size [922730496], Proportional Set Size: [427994000], Memory % [7.23], CPU Time [1923.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:33:30.189548 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:33:28 UTC], Process Info: Memory Usage [592543744], Memory Size [922411008], Proportional Set Size: [427579000], Memory % [7.22], CPU Time [806.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:33:30.192395 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:33:28 UTC], Process Info: Memory Usage [557862912], Memory Size [909475840], Proportional Set Size: [405472000], Memory % [6.8], CPU Time [5497.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T07:33:30.196077 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:33:20 UTC], Process Info: Memory Usage [580849664], Memory Size [924225536], Proportional Set Size: [420339000], Memory % [7.08], CPU Time [2051.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T07:33:30.196829 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:33:29 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357918000], Memory % [5.27], CPU Time [209490.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T07:33:30.197609 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:33:27 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [51400.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:33:30.198123 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:33:27 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165802000], Memory % [3.16], CPU Time [38764.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T07:33:30.198454 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77969], State: [ok], Delivered in [0.029841589] seconds [----] I, [2016-09-13T07:33:30.224570 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T07:33:30.224820 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T07:33:30.228350 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T07:33:30.231119 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T07:33:30.234280 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T07:33:30.237640 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T07:33:30.240719 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T07:33:30.243659 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 845 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T07:33:30.246741 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T07:33:30.249783 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T07:33:30.252868 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.7 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T07:33:30.256029 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T07:33:30.259125 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T07:33:30.262248 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T07:33:30.264988 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:33:30.265142 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:33:30.265243 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T07:33:30.269677 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [358681000], Memory % [3.36], CPU Time [202383.0], CPU % [0.3], Priority [30] [----] I, [2016-09-13T07:33:30.270082 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [77968], State: [ok], Delivered in [0.111428048] seconds [----] I, [2016-09-13T07:33:34.428677 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:33:34 UTC]... [----] I, [2016-09-13T07:33:34.447553 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:33:34 UTC]...Complete [----] I, [2016-09-13T07:33:42.547075 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:33:42.568274 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77970], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:33:42.579009 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77971], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:33:42.597696 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77972], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:33:42.613747 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77973], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:33:45.837863 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:33:45.842156 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0029022693634033203, :worker_monitor=>1.2232418060302734, :worker_dequeue=>0.00789499282836914, :total_time=>1.234318733215332} [----] I, [2016-09-13T07:33:46.363482 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77970], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.808726728] seconds [----] I, [2016-09-13T07:33:46.363663 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77970], Delivering... [----] I, [2016-09-13T07:33:46.371372 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003554105758666992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035784244537353516, :pending_vm_jobs=>0.0008950233459472656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007310628890991211} [----] I, [2016-09-13T07:33:46.371812 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77970], State: [ok], Delivered in [0.00813101] seconds [----] I, [2016-09-13T07:33:46.386380 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77972], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.804043423] seconds [----] I, [2016-09-13T07:33:46.386599 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77972], Delivering... [----] I, [2016-09-13T07:33:46.449188 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77972], State: [ok], Delivered in [0.062559519] seconds [----] I, [2016-09-13T07:33:47.244476 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77971], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.671218208] seconds [----] I, [2016-09-13T07:33:47.244614 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77971], Delivering... [----] I, [2016-09-13T07:33:47.248690 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77971], State: [ok], Delivered in [0.004059984] seconds [----] I, [2016-09-13T07:33:47.266222 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77973], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.662193603] seconds [----] I, [2016-09-13T07:33:47.266345 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77973], Delivering... [----] I, [2016-09-13T07:33:47.268376 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77973], State: [ok], Delivered in [0.002023763] seconds [----] I, [2016-09-13T07:33:57.627379 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:33:57.643474 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77974], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:34:02.332207 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:34:02.343390 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039052963256835938, :worker_monitor=>1.454045295715332, :worker_dequeue=>0.021473407745361328, :total_time=>1.4797334671020508} [----] I, [2016-09-13T07:34:02.361738 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77974], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.729025384] seconds [----] I, [2016-09-13T07:34:02.362021 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77974], Delivering... [----] I, [2016-09-13T07:34:02.370919 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005128145217895508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005288362503051758, :pending_vm_jobs=>0.0011663436889648438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008391380310058594} [----] I, [2016-09-13T07:34:02.371297 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77974], State: [ok], Delivered in [0.009288194] seconds [----] I, [2016-09-13T07:34:07.344236 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:34:07 UTC]... [----] I, [2016-09-13T07:34:07.363185 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:34:07 UTC]...Complete [----] I, [2016-09-13T07:34:12.655279 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 11. [----] I, [2016-09-13T07:34:12.669865 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77975], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:34:12.687265 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77976], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:34:12.704356 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77977], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:34:18.861091 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:34:18.867931 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004788637161254883, :worker_monitor=>1.4545588493347168, :worker_dequeue=>0.012113809585571289, :total_time=>1.4717957973480225} [----] I, [2016-09-13T07:34:19.653138 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77975], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.992701303] seconds [----] I, [2016-09-13T07:34:19.653339 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77975], Delivering... [----] I, [2016-09-13T07:34:19.659370 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031299591064453125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003147125244140625, :pending_vm_jobs=>0.0007860660552978516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005654811859130859} [----] I, [2016-09-13T07:34:19.659699 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77975], State: [ok], Delivered in [0.006350091] seconds [----] I, [2016-09-13T07:34:20.439992 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77976], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.76125831] seconds [----] I, [2016-09-13T07:34:20.440169 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77976], Delivering... [----] I, [2016-09-13T07:34:20.476441 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77978], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T07:34:20.493364 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77979], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T07:34:20.493808 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77976], State: [ok], Delivered in [0.053604809] seconds [----] I, [2016-09-13T07:34:20.539101 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77977], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.84419974] seconds [----] I, [2016-09-13T07:34:20.539275 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77977], Delivering... [----] I, [2016-09-13T07:34:20.543534 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77977], State: [ok], Delivered in [0.004243751] seconds [----] I, [2016-09-13T07:34:23.876217 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T07:34:23.877524 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T07:34:24.665299 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [77979], MiqWorker id: [98], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [4.182704474] seconds [----] I, [2016-09-13T07:34:24.665569 #3290:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77979], Delivering... [----] I, [2016-09-13T07:34:24.669730 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T07:34:24.669936 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T07:34:24.670076 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T07:34:24.670243 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T07:34:24.670441 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:25.117475 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:25.443997 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:25.444206 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:25.958009 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:26.272310 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:26.272484 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:26.754081 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:27.043617 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:27.043809 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:27.517829 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:27.716763 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:34:27.773404 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77980], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:34:27.850726 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:27.850916 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:28.259246 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [77978], MiqWorker id: [99], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [7.801259269] seconds [----] I, [2016-09-13T07:34:28.259480 #5369:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77978], Delivering... [----] I, [2016-09-13T07:34:28.262652 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T07:34:28.262809 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T07:34:28.262937 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T07:34:28.263073 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T07:34:28.263194 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:28.356512 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:28.546288 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:28.645082 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:28.645290 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:28.756365 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:28.756586 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:28.887472 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:34:29.101310 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:29.161757 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:29.196864 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:29.287983 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:29.450978 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:29.451184 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:29.602825 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77980], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.878947248] seconds [----] I, [2016-09-13T07:34:29.603050 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77980], Delivering... [----] I, [2016-09-13T07:34:29.610065 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:29.610619 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038018226623535156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003869295120239258, :pending_vm_jobs=>0.0009982585906982422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007170677185058594} [----] I, [2016-09-13T07:34:29.611052 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77980], State: [ok], Delivered in [0.007992617] seconds [----] I, [2016-09-13T07:34:29.716044 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:29.807874 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:29.901578 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:29.910985 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:29.994968 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:30.087686 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:30.180879 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:30.226476 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:30.226653 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:30.274961 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:30.365532 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:30.456893 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:30.547981 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:30.638990 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:30.730881 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:30.738368 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:30.823484 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:30.916367 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:31.009738 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:31.043372 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:31.043586 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:31.102315 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:34:31.385203 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T07:34:31.385467 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004004240036010742, :collect_inventory_for_targets=>4.57763671875e-05, :parse_legacy_inventory=>22.28029489517212, :parse_targeted_inventory=>22.28047776222229, :save_inventory=>1.1583573818206787, :ems_refresh=>23.441925287246704} [----] I, [2016-09-13T07:34:31.402952 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T07:34:31.403454 #5369:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77978], State: [ok], Delivered in [3.14399472] seconds [----] I, [2016-09-13T07:34:31.528213 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:31.837874 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:31.838136 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:32.326053 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:32.624584 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:32.624803 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:33.088809 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:33.387959 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:33.388127 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:33.841716 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:34.159511 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:34.159680 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:34.641948 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:34.932363 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:34.932529 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:35.281541 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003733396530151367, :worker_monitor=>1.3694384098052979, :worker_dequeue=>0.012285470962524414, :total_time=>1.3857460021972656} [----] I, [2016-09-13T07:34:35.414290 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:35.584065 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:35.722381 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:35.860243 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:35.997681 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:36.139928 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:36.275496 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:36.410787 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:36.558322 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:36.698499 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:36.832445 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:36.974620 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:37.110067 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:37.249291 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:37.385521 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:37.832120 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:37.987450 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:38.120395 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:38.261554 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:38.396796 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:38.536796 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:38.670345 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:38.810656 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:38.948307 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:39.091001 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:39.230800 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:39.374796 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:39.517995 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:39.657622 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:39.795335 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:39.931688 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:40.072332 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:40.282067 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:34:40 UTC]... [----] I, [2016-09-13T07:34:40.300062 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:34:40 UTC]...Complete [----] I, [2016-09-13T07:34:40.518155 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:40.678028 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:40.816030 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:40.973960 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:41.118103 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:41.259201 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:41.398476 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:41.538992 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:41.682779 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:41.822288 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:41.959778 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:42.094914 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:42.237815 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:42.378731 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:42.520003 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:42.669084 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:42.789062 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:34:42.803194 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77981], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:34:42.807897 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:42.814403 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77982], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:34:42.832275 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77983], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:34:42.854866 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77984], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:34:43.303277 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:43.453792 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:43.593825 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:43.744320 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:43.881880 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:44.054791 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:44.192778 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:44.336133 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:44.469096 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:44.612569 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:44.757301 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:44.898535 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:45.041192 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:45.200674 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:45.338016 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:45.419539 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:34:45.473992 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:45.617897 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:45.833265 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77981], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.038233827] seconds [----] I, [2016-09-13T07:34:45.833503 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77981], Delivering... [----] I, [2016-09-13T07:34:45.841191 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003327608108520508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003353595733642578, :pending_vm_jobs=>0.0008473396301269531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0071566104888916016} [----] I, [2016-09-13T07:34:45.841668 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77981], State: [ok], Delivered in [0.008148425] seconds [----] I, [2016-09-13T07:34:45.850498 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77983], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.03185562] seconds [----] I, [2016-09-13T07:34:45.850743 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77983], Delivering... [----] I, [2016-09-13T07:34:45.912630 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77982], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.105014571] seconds [----] I, [2016-09-13T07:34:45.912961 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77982], Delivering... [----] I, [2016-09-13T07:34:45.920208 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77982], State: [ok], Delivered in [0.007268179] seconds [----] I, [2016-09-13T07:34:45.923472 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77983], State: [ok], Delivered in [0.072665847] seconds [----] I, [2016-09-13T07:34:45.959668 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77984], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.11869311] seconds [----] I, [2016-09-13T07:34:45.959957 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77984], Delivering... [----] I, [2016-09-13T07:34:45.965146 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77984], State: [ok], Delivered in [0.005161052] seconds [----] I, [2016-09-13T07:34:46.078858 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:46.255063 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:46.398177 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:46.541169 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:46.735026 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:51.759257 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003916025161743164, :worker_monitor=>1.3144922256469727, :worker_dequeue=>0.015071630477905273, :total_time=>1.3337838649749756} [----] I, [2016-09-13T07:34:52.889870 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:53.037307 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:53.178131 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:53.321029 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:53.464501 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:53.603993 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:53.745234 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:53.904624 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:54.038543 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:54.181123 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:54.329390 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:54.467952 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:54.934678 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:55.117742 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:55.312478 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:55.450209 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:55.586478 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:55.736785 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:55.875485 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:56.013501 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:56.161863 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:56.295853 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:56.442071 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:56.603806 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:56.743980 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:56.882450 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:57.033749 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:57.177458 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:57.324622 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:57.870553 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:34:57.919699 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77985], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:34:58.006856 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:58.172672 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:58.306484 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:58.447701 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:58.588135 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:58.734828 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:58.883627 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:59.019220 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:59.162210 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:59.309150 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:59.443215 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:59.582504 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:59.725617 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:34:59.859908 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:00.011225 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:00.149494 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:00.291742 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:00.760775 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:00.933002 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:01.071038 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:01.210529 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:01.352086 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:01.493727 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:01.627924 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:01.767339 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:01.780881 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:35:01.913728 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:02.017311 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77985], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.13765009] seconds [----] I, [2016-09-13T07:35:02.017538 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77985], Delivering... [----] I, [2016-09-13T07:35:02.023767 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00331878662109375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003336668014526367, :pending_vm_jobs=>0.0007605552673339844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005855083465576172} [----] I, [2016-09-13T07:35:02.024108 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77985], State: [ok], Delivered in [0.006574864] seconds [----] I, [2016-09-13T07:35:02.054350 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:02.191548 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:02.329441 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:02.474103 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:02.613336 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:02.751165 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:02.895734 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:03.057358 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:03.357283 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:03.513217 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:03.672973 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:03.821658 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:08.271371 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003635406494140625, :worker_monitor=>1.4712202548980713, :worker_dequeue=>0.008426427841186523, :total_time=>1.4835631847381592} [----] I, [2016-09-13T07:35:09.971262 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:10.110896 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:10.255755 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:10.391235 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:10.533133 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:10.669881 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:10.820349 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:10.966890 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:11.110110 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:11.248005 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:11.390850 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:11.528397 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:11.673149 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:12.034397 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:12.183666 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:12.329996 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:12.479700 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:12.624758 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:12.767297 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:12.912586 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:12.932477 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:35:12.954058 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77986], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:35:12.976965 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77987], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:35:13.052524 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:13.186494 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:13.271930 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:35:13 UTC]... [----] I, [2016-09-13T07:35:13.289290 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:35:13 UTC]...Complete [----] I, [2016-09-13T07:35:13.302062 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:35:13.319559 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:13.452185 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:13.587130 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:13.721685 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:13.866525 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:14.005227 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:14.123755 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77986], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.184598857] seconds [----] I, [2016-09-13T07:35:14.123916 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77986], Delivering... [----] I, [2016-09-13T07:35:14.128022 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002155780792236328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021703243255615234, :pending_vm_jobs=>0.0005049705505371094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038390159606933594} [----] I, [2016-09-13T07:35:14.128288 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77986], State: [ok], Delivered in [0.004377859] seconds [----] I, [2016-09-13T07:35:14.147296 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:14.288869 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:14.754342 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77987], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.796155998] seconds [----] I, [2016-09-13T07:35:14.754649 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77987], Delivering... [----] I, [2016-09-13T07:35:14.759751 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77987], State: [ok], Delivered in [0.005094885] seconds [----] I, [2016-09-13T07:35:14.793758 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:14.953553 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:15.089986 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:15.232781 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:15.377580 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:15.517706 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:15.657743 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:15.852062 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:16.000251 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:16.138021 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:16.278607 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:16.418658 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:16.561138 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:16.709248 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:16.854566 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:17.002957 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:17.149673 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:17.590529 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:17.744163 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:17.890826 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:18.029811 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:18.187676 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:18.337285 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:18.472545 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:18.614861 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:18.754164 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:18.900575 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:19.043192 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:19.177978 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:19.324535 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:19.460169 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:19.605853 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:19.737793 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:19.894103 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:20.242554 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:20.403209 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:20.537751 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:20.673484 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:24.925144 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004076480865478516, :worker_monitor=>1.583482027053833, :worker_dequeue=>0.012001514434814453, :total_time=>1.5998411178588867} [----] I, [2016-09-13T07:35:26.824700 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:26.962182 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:27.105049 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:27.240190 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:27.377826 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:27.517443 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:27.662123 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:27.813103 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:27.958696 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:27.989948 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:35:28.009455 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77988], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:35:28.098592 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:28.233410 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:28.374088 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:28.518044 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:28.991372 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:29.152933 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:29.295668 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:29.435798 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:29.574280 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:29.713379 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:29.854956 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:29.935281 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:35:29.998320 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:30.140047 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:30.251181 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77988], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.255199626] seconds [----] I, [2016-09-13T07:35:30.251369 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77988], Delivering... [----] I, [2016-09-13T07:35:30.257786 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034379959106445312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003462076187133789, :pending_vm_jobs=>0.0007884502410888672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00603938102722168} [----] I, [2016-09-13T07:35:30.258179 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77988], State: [ok], Delivered in [0.006806749] seconds [----] I, [2016-09-13T07:35:30.284010 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:30.420549 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:30.563667 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:30.709194 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:30.852873 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:30.988384 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:31.129390 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:35:31.263376 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T07:35:31.458658 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T07:35:31.459022 #3290:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T07:35:31.459308 #3290:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T07:35:31.459404 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T07:35:31.459563 #3290:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T07:35:31.487726 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T07:35:31.488041 #3290:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [77979], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T07:35:31.488263 #3290:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T07:35:31.488566 #3290:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T07:35:31.488772 #3290:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77979], State: [error], Delivered in [66.823233497] seconds [----] I, [2016-09-13T07:35:41.304390 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004005908966064453, :worker_monitor=>1.330772876739502, :worker_dequeue=>0.011337995529174805, :total_time=>1.3463976383209229} [----] I, [2016-09-13T07:35:43.020591 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:35:43.032589 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77989], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:35:43.043777 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77990], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:35:43.056457 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77991], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:35:43.066670 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77992], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:35:46.305003 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:35:46 UTC]... [----] I, [2016-09-13T07:35:46.324149 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:35:46 UTC]...Complete [----] I, [2016-09-13T07:35:46.489843 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:35:47.330000 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77989], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.303574258] seconds [----] I, [2016-09-13T07:35:47.330161 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77989], Delivering... [----] I, [2016-09-13T07:35:47.336067 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030777454376220703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030951499938964844, :pending_vm_jobs=>0.0007138252258300781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055882930755615234} [----] I, [2016-09-13T07:35:47.336382 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77989], State: [ok], Delivered in [0.006218759] seconds [----] I, [2016-09-13T07:35:47.359402 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77991], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.311962649] seconds [----] I, [2016-09-13T07:35:47.359615 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77991], Delivering... [----] I, [2016-09-13T07:35:47.409942 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77991], State: [ok], Delivered in [0.050330663] seconds [----] I, [2016-09-13T07:35:47.861300 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77990], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.825163021] seconds [----] I, [2016-09-13T07:35:47.861489 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77990], Delivering... [----] I, [2016-09-13T07:35:47.865397 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77990], State: [ok], Delivered in [0.003904144] seconds [----] I, [2016-09-13T07:35:47.890047 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77992], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.828697365] seconds [----] I, [2016-09-13T07:35:47.890189 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77992], Delivering... [----] I, [2016-09-13T07:35:47.896679 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77992], State: [ok], Delivered in [0.00647672] seconds [----] I, [2016-09-13T07:35:58.066151 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004276752471923828, :worker_monitor=>1.5279693603515625, :worker_dequeue=>0.012836456298828125, :total_time=>1.545417308807373} [----] I, [2016-09-13T07:35:58.083119 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:35:58.101508 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77993], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:36:03.075825 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:36:03.480289 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77993], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.38832553] seconds [----] I, [2016-09-13T07:36:03.480606 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77993], Delivering... [----] I, [2016-09-13T07:36:03.490474 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005113840103149414, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0051839351654052734, :pending_vm_jobs=>0.0012176036834716797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009261608123779297} [----] I, [2016-09-13T07:36:03.490932 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77993], State: [ok], Delivered in [0.010325427] seconds [----] I, [2016-09-13T07:36:13.117728 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:36:13.131779 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77994], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:36:13.149194 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77995], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:36:14.552133 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:36:14.558753 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004134654998779297, :worker_monitor=>1.4437763690948486, :worker_dequeue=>0.012268543243408203, :total_time=>1.4604599475860596} [----] I, [2016-09-13T07:36:14.588257 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77994], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.464567092] seconds [----] I, [2016-09-13T07:36:14.588536 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77994], Delivering... [----] I, [2016-09-13T07:36:14.598084 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0048029422760009766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0048296451568603516, :pending_vm_jobs=>0.0013413429260253906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00904536247253418} [----] I, [2016-09-13T07:36:14.598534 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77994], State: [ok], Delivered in [0.009992796] seconds [----] I, [2016-09-13T07:36:15.023974 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77995], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.888298968] seconds [----] I, [2016-09-13T07:36:15.024168 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77995], Delivering... [----] I, [2016-09-13T07:36:15.028609 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77995], State: [ok], Delivered in [0.004429742] seconds [----] I, [2016-09-13T07:36:19.559244 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:36:19 UTC]... [----] I, [2016-09-13T07:36:19.583485 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:36:19 UTC]...Complete [----] I, [2016-09-13T07:36:28.161218 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:36:28.178241 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77996], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:36:31.116696 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:36:31.122492 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00642848014831543, :worker_monitor=>1.4876692295074463, :worker_dequeue=>0.010360479354858398, :total_time=>1.5048878192901611} [----] I, [2016-09-13T07:36:31.280181 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77996], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.112142457] seconds [----] I, [2016-09-13T07:36:31.280408 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77996], Delivering... [----] I, [2016-09-13T07:36:31.291754 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035123825073242188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035321712493896484, :pending_vm_jobs=>0.0007927417755126953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0108795166015625} [----] I, [2016-09-13T07:36:31.292153 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77996], State: [ok], Delivered in [0.011756039] seconds [----] I, [2016-09-13T07:36:43.193615 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:36:43.240045 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77997], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:36:43.258299 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77998], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:36:43.285967 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [77999], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:36:43.314527 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78000], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:36:47.744169 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:36:47.750065 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004851818084716797, :worker_monitor=>1.576676607131958, :worker_dequeue=>0.010555744171142578, :total_time=>1.5924417972564697} [----] I, [2016-09-13T07:36:47.777163 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77997], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.57747257] seconds [----] I, [2016-09-13T07:36:47.777319 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [77997], Delivering... [----] I, [2016-09-13T07:36:47.782495 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025177001953125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002532482147216797, :pending_vm_jobs=>0.0005753040313720703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0048410892486572266} [----] I, [2016-09-13T07:36:47.782786 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [77997], State: [ok], Delivered in [0.005464642] seconds [----] I, [2016-09-13T07:36:47.799811 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [77999], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.537321241] seconds [----] I, [2016-09-13T07:36:47.799961 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77999], Delivering... [----] I, [2016-09-13T07:36:47.845848 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77999], State: [ok], Delivered in [0.045849572] seconds [----] I, [2016-09-13T07:36:48.131745 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [77998], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.887286596] seconds [----] I, [2016-09-13T07:36:48.132006 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [77998], Delivering... [----] I, [2016-09-13T07:36:48.136370 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [77998], State: [ok], Delivered in [0.004368365] seconds [----] I, [2016-09-13T07:36:48.165861 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78000], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.874287856] seconds [----] I, [2016-09-13T07:36:48.166056 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78000], Delivering... [----] I, [2016-09-13T07:36:48.169011 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78000], State: [ok], Delivered in [0.002941307] seconds [----] I, [2016-09-13T07:36:52.750648 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:36:52 UTC]... [----] I, [2016-09-13T07:36:52.777138 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:36:52 UTC]...Complete [----] I, [2016-09-13T07:36:58.331394 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:36:58.354756 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78001], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:37:04.723146 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:37:04.731318 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003991842269897461, :worker_monitor=>1.7607173919677734, :worker_dequeue=>0.014472723007202148, :total_time=>1.7795226573944092} [----] I, [2016-09-13T07:37:04.936078 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78001], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.594903433] seconds [----] I, [2016-09-13T07:37:04.936243 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78001], Delivering... [----] I, [2016-09-13T07:37:04.941123 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002557516098022461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025718212127685547, :pending_vm_jobs=>0.0006029605865478516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004537105560302734} [----] I, [2016-09-13T07:37:04.941434 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78001], State: [ok], Delivered in [0.00517603] seconds [----] I, [2016-09-13T07:37:13.367348 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:37:13.387783 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78002], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:37:13.412149 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78003], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:37:14.757015 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:37:15.045059 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78002], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.67214202] seconds [----] I, [2016-09-13T07:37:15.045262 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78002], Delivering... [----] I, [2016-09-13T07:37:15.051671 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00341033935546875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003429412841796875, :pending_vm_jobs=>0.0007863044738769531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00603938102722168} [----] I, [2016-09-13T07:37:15.052036 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78002], State: [ok], Delivered in [0.006766056] seconds [----] I, [2016-09-13T07:37:15.771927 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78003], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.380287546] seconds [----] I, [2016-09-13T07:37:15.772144 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78003], Delivering... [----] I, [2016-09-13T07:37:15.777711 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78003], State: [ok], Delivered in [0.005555915] seconds [----] I, [2016-09-13T07:37:20.963165 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003978729248046875, :worker_monitor=>1.1830997467041016, :worker_dequeue=>0.011254310607910156, :total_time=>1.1986610889434814} [----] I, [2016-09-13T07:37:25.963691 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:37:25 UTC]... [----] I, [2016-09-13T07:37:25.987559 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:37:25 UTC]...Complete [----] I, [2016-09-13T07:37:28.423389 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:37:28.440385 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78004], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:37:31.005635 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:37:31.572003 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78004], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.142010364] seconds [----] I, [2016-09-13T07:37:31.572202 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78004], Delivering... [----] I, [2016-09-13T07:37:31.578940 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035817623138427734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00360107421875, :pending_vm_jobs=>0.0007810592651367188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006273031234741211} [----] I, [2016-09-13T07:37:31.579325 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78004], State: [ok], Delivered in [0.007114382] seconds [----] I, [2016-09-13T07:37:37.316223 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003972768783569336, :worker_monitor=>1.289001226425171, :worker_dequeue=>0.011394500732421875, :total_time=>1.3047161102294922} [----] I, [2016-09-13T07:37:43.451254 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:37:43.467911 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78005], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:37:43.479149 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78006], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:37:43.497051 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78007], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:37:43.519913 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78008], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:37:47.340938 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:37:47.657221 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78005], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.200108095] seconds [----] I, [2016-09-13T07:37:47.657509 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78005], Delivering... [----] I, [2016-09-13T07:37:47.664321 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038318634033203125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038537979125976562, :pending_vm_jobs=>0.0007417201995849609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006311893463134766} [----] I, [2016-09-13T07:37:47.664659 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78005], State: [ok], Delivered in [0.007212596] seconds [----] I, [2016-09-13T07:37:47.693001 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78007], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.210505931] seconds [----] I, [2016-09-13T07:37:47.693177 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78007], Delivering... [----] I, [2016-09-13T07:37:47.750157 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78007], State: [ok], Delivered in [0.056954351] seconds [----] I, [2016-09-13T07:37:48.870153 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78006], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.398639537] seconds [----] I, [2016-09-13T07:37:48.870340 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78006], Delivering... [----] I, [2016-09-13T07:37:48.874553 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78006], State: [ok], Delivered in [0.00420267] seconds [----] I, [2016-09-13T07:37:48.898776 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78008], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.396494064] seconds [----] I, [2016-09-13T07:37:48.898972 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78008], Delivering... [----] I, [2016-09-13T07:37:48.902020 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78008], State: [ok], Delivered in [0.003042187] seconds [----] I, [2016-09-13T07:37:53.830980 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038144588470458984, :worker_monitor=>1.4698898792266846, :worker_dequeue=>0.009616374969482422, :total_time=>1.4836070537567139} [----] I, [2016-09-13T07:37:58.535858 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:37:58.561599 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78009], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:37:58.831635 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:37:58 UTC]... [----] I, [2016-09-13T07:37:58.852475 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:37:58 UTC]...Complete [----] I, [2016-09-13T07:37:58.966684 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:37:59.784380 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78009], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.242585435] seconds [----] I, [2016-09-13T07:37:59.784586 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78009], Delivering... [----] I, [2016-09-13T07:37:59.790189 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029976367950439453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003038644790649414, :pending_vm_jobs=>0.0006740093231201172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005243062973022461} [----] I, [2016-09-13T07:37:59.790518 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78009], State: [ok], Delivered in [0.005936745] seconds [----] I, [2016-09-13T07:38:10.390685 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004068613052368164, :worker_monitor=>1.3841559886932373, :worker_dequeue=>0.00943613052368164, :total_time=>1.3982465267181396} [----] I, [2016-09-13T07:38:13.573619 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:38:13.589864 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78010], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:38:13.601182 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78011], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:38:15.400693 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:38:15.921804 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78010], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.342142968] seconds [----] I, [2016-09-13T07:38:15.922022 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78010], Delivering... [----] I, [2016-09-13T07:38:15.929518 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003681182861328125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037949085235595703, :pending_vm_jobs=>0.0009179115295410156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007045269012451172} [----] I, [2016-09-13T07:38:15.929915 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78010], State: [ok], Delivered in [0.007887663] seconds [----] I, [2016-09-13T07:38:16.013131 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78011], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.418978794] seconds [----] I, [2016-09-13T07:38:16.013351 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78011], Delivering... [----] I, [2016-09-13T07:38:16.018953 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78011], State: [ok], Delivered in [0.005591913] seconds [----] I, [2016-09-13T07:38:26.787695 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004117250442504883, :worker_monitor=>1.3486065864562988, :worker_dequeue=>0.010970830917358398, :total_time=>1.3639740943908691} [----] I, [2016-09-13T07:38:28.613150 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:38:28.652792 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78012], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:38:28.664107 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78013], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:38:28.676600 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78014], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:38:31.788275 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:38:31 UTC]... [----] I, [2016-09-13T07:38:31.812788 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:38:31 UTC]...Complete [----] I, [2016-09-13T07:38:31.838572 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T07:38:31.847484 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:38:32.042318 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78012], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.423060733] seconds [----] I, [2016-09-13T07:38:32.042676 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78012], Delivering... [----] I, [2016-09-13T07:38:32.052507 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005744218826293945, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0057828426361083984, :pending_vm_jobs=>0.0010597705841064453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009167194366455078} [----] I, [2016-09-13T07:38:32.053009 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78012], State: [ok], Delivered in [0.010359657] seconds [----] I, [2016-09-13T07:38:32.065299 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78013], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.408365069] seconds [----] I, [2016-09-13T07:38:32.065524 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78013], Delivering... [----] I, [2016-09-13T07:38:32.066840 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T07:38:32.067024 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5365772288 [----] I, [2016-09-13T07:38:32.067113 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5141819392 [----] I, [2016-09-13T07:38:32.067189 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 223952896 [----] I, [2016-09-13T07:38:32.067289 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1323302912 [----] I, [2016-09-13T07:38:32.067382 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5087760384 [----] I, [2016-09-13T07:38:32.067486 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T07:38:32.067563 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T07:38:32.067649 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 545386496 [----] I, [2016-09-13T07:38:32.067722 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T07:38:32.067793 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8066686976 [----] I, [2016-09-13T07:38:32.067898 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T07:38:32.067976 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T07:38:32.068051 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T07:38:32.068122 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 0 [----] I, [2016-09-13T07:38:32.068189 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T07:38:32.068257 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T07:38:32.068329 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T07:38:32.068392 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T07:38:32.068494 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T07:38:32.068572 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T07:38:32.068641 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273596416 [----] I, [2016-09-13T07:38:32.068712 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56840192 [----] I, [2016-09-13T07:38:32.068784 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216756224 [----] I, [2016-09-13T07:38:32.068872 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6258688 [----] I, [2016-09-13T07:38:32.068949 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141467648 [----] I, [2016-09-13T07:38:32.069021 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2577928192 [----] I, [2016-09-13T07:38:32.069093 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2259046400 [----] I, [2016-09-13T07:38:32.069166 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T07:38:32.069290 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T07:38:32.069367 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T07:38:32.069512 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 38428672 [----] I, [2016-09-13T07:38:32.069611 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102305792 [----] I, [2016-09-13T07:38:32.069716 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53501952 [----] I, [2016-09-13T07:38:32.069796 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110899200 [----] I, [2016-09-13T07:38:32.069888 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155807744 [----] I, [2016-09-13T07:38:32.069963 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T07:38:32.070031 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T07:38:32.070098 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T07:38:32.070167 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T07:38:32.070249 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T07:38:32.070356 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T07:38:32.070454 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T07:38:32.070538 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T07:38:32.070610 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T07:38:32.131941 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T07:38:32.132158 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T07:38:32.135798 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T07:38:32.138479 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T07:38:32.141576 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T07:38:32.144760 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T07:38:32.147859 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T07:38:32.150994 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 845 MB 1.17 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T07:38:32.153872 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T07:38:32.156864 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T07:38:32.159924 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T07:38:32.163117 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T07:38:32.166233 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T07:38:32.169128 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T07:38:32.172731 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:38:32.173043 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:38:32.173228 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T07:38:32.180452 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200502000], Memory % [3.36], CPU Time [151223.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:38:32.181116 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78013], State: [ok], Delivered in [0.115480835] seconds [----] I, [2016-09-13T07:38:36.864219 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:38:37.087282 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78014], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.419547767] seconds [----] I, [2016-09-13T07:38:37.087505 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78014], Delivering... [----] I, [2016-09-13T07:38:37.095794 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:38:24 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347147000], Memory % [5.04], CPU Time [104124.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T07:38:37.096567 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:38:26 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [150332.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:38:37.097204 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:38:25 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [51407.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:38:37.097720 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:38:20 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [48749.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T07:38:37.098298 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:38:24 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162417000], Memory % [3.1], CPU Time [37879.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T07:38:37.098896 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:38:13 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205293000], Memory % [3.5], CPU Time [239470.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T07:38:37.099479 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:38:26 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358680000], Memory % [5.28], CPU Time [202451.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T07:38:37.100031 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:38:25 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200502000], Memory % [3.36], CPU Time [151234.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:38:37.100506 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:38:16 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165800000], Memory % [3.16], CPU Time [38774.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T07:38:37.103528 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:38:21 UTC], Process Info: Memory Usage [592773120], Memory Size [937091072], Proportional Set Size: [427803000], Memory % [7.23], CPU Time [844.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:38:37.105723 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:38:21 UTC], Process Info: Memory Usage [603836416], Memory Size [1059794944], Proportional Set Size: [438787000], Memory % [7.36], CPU Time [2061.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:38:37.108026 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:38:18 UTC], Process Info: Memory Usage [560304128], Memory Size [929497088], Proportional Set Size: [407940000], Memory % [6.83], CPU Time [5508.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T07:38:37.110205 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:38:20 UTC], Process Info: Memory Usage [581062656], Memory Size [937857024], Proportional Set Size: [420545000], Memory % [7.08], CPU Time [2062.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T07:38:37.110793 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:38:25 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357918000], Memory % [5.27], CPU Time [209576.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T07:38:37.111348 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:38:25 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [51414.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:38:37.111714 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78014], State: [ok], Delivered in [0.024205919] seconds [----] I, [2016-09-13T07:38:43.197587 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040416717529296875, :worker_monitor=>1.3177480697631836, :worker_dequeue=>0.006224632263183594, :total_time=>1.3282802104949951} [----] I, [2016-09-13T07:38:43.689501 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:38:43.704313 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78015], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:38:43.721583 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78016], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:38:43.738616 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78017], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:38:43.755720 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78018], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:38:48.207183 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:38:49.196579 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78015], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.498929349] seconds [----] I, [2016-09-13T07:38:49.196790 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78015], Delivering... [----] I, [2016-09-13T07:38:49.204901 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004250049591064453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00427699089050293, :pending_vm_jobs=>0.0010647773742675781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007607936859130859} [----] I, [2016-09-13T07:38:49.205265 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78015], State: [ok], Delivered in [0.008468929] seconds [----] I, [2016-09-13T07:38:49.207352 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78017], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.480042871] seconds [----] I, [2016-09-13T07:38:49.207509 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78017], Delivering... [----] I, [2016-09-13T07:38:49.230244 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78016], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.520793391] seconds [----] I, [2016-09-13T07:38:49.230448 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78016], Delivering... [----] I, [2016-09-13T07:38:49.235369 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78016], State: [ok], Delivered in [0.004935536] seconds [----] I, [2016-09-13T07:38:49.252893 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78017], State: [ok], Delivered in [0.045380477] seconds [----] I, [2016-09-13T07:38:49.258919 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78018], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.513223462] seconds [----] I, [2016-09-13T07:38:49.259076 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78018], Delivering... [----] I, [2016-09-13T07:38:49.261858 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78018], State: [ok], Delivered in [0.002769963] seconds [----] I, [2016-09-13T07:38:58.794013 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:38:58.807310 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78019], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:38:59.621904 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:38:59.628487 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0049207210540771484, :worker_monitor=>1.3821921348571777, :worker_dequeue=>0.011445045471191406, :total_time=>1.3988876342773438} [----] I, [2016-09-13T07:39:00.283050 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78019], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.482722293] seconds [----] I, [2016-09-13T07:39:00.283272 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78019], Delivering... [----] I, [2016-09-13T07:39:00.290527 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036873817443847656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037140846252441406, :pending_vm_jobs=>0.0009584426879882812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006775379180908203} [----] I, [2016-09-13T07:39:00.290908 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78019], State: [ok], Delivered in [0.007643505] seconds [----] I, [2016-09-13T07:39:04.629101 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:39:04 UTC]... [----] I, [2016-09-13T07:39:04.664877 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:39:04 UTC]...Complete [----] I, [2016-09-13T07:39:13.820028 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:39:13.836092 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78020], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:39:13.848480 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78021], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:39:16.244002 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:39:16.250651 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004060268402099609, :worker_monitor=>1.4323813915252686, :worker_dequeue=>0.011816978454589844, :total_time=>1.4485664367675781} [----] I, [2016-09-13T07:39:16.367758 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78020], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.540885301] seconds [----] I, [2016-09-13T07:39:16.368010 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78020], Delivering... [----] I, [2016-09-13T07:39:16.375435 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038690567016601562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038907527923583984, :pending_vm_jobs=>0.0009210109710693359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0069658756256103516} [----] I, [2016-09-13T07:39:16.375848 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78020], State: [ok], Delivered in [0.007839855] seconds [----] I, [2016-09-13T07:39:16.401866 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78021], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.561032983] seconds [----] I, [2016-09-13T07:39:16.402067 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78021], Delivering... [----] I, [2016-09-13T07:39:16.407375 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78021], State: [ok], Delivered in [0.005313221] seconds [----] I, [2016-09-13T07:39:28.861577 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:39:28.893340 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78022], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:39:32.799485 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:39:32.805743 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004347324371337891, :worker_monitor=>1.5069680213928223, :worker_dequeue=>0.011029720306396484, :total_time=>1.5226757526397705} [----] I, [2016-09-13T07:39:33.510954 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78022], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.643512965] seconds [----] I, [2016-09-13T07:39:33.511089 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78022], Delivering... [----] I, [2016-09-13T07:39:33.515788 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002454996109008789, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024712085723876953, :pending_vm_jobs=>0.0005803108215332031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0044209957122802734} [----] I, [2016-09-13T07:39:33.516078 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78022], State: [ok], Delivered in [0.004988216] seconds [----] I, [2016-09-13T07:39:37.806247 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:39:37 UTC]... [----] I, [2016-09-13T07:39:37.825160 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:39:37 UTC]...Complete [----] I, [2016-09-13T07:39:43.906344 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:39:43.928248 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78023], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:39:43.952746 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78024], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:39:43.968441 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78025], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:39:43.985599 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78026], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:39:49.008022 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:39:49.012530 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0026192665100097656, :worker_monitor=>1.1435132026672363, :worker_dequeue=>0.00814199447631836, :total_time=>1.1544861793518066} [----] I, [2016-09-13T07:39:49.505525 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78023], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.590546166] seconds [----] I, [2016-09-13T07:39:49.505742 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78023], Delivering... [----] I, [2016-09-13T07:39:49.512224 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032427310943603516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032622814178466797, :pending_vm_jobs=>0.0008413791656494141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00609588623046875} [----] I, [2016-09-13T07:39:49.512589 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78023], State: [ok], Delivered in [0.006871985] seconds [----] I, [2016-09-13T07:39:49.534269 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78025], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.576969288] seconds [----] I, [2016-09-13T07:39:49.534485 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78025], Delivering... [----] I, [2016-09-13T07:39:49.596928 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78025], State: [ok], Delivered in [0.062461276] seconds [----] I, [2016-09-13T07:39:49.643163 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78024], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.710958649] seconds [----] I, [2016-09-13T07:39:49.643371 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78024], Delivering... [----] I, [2016-09-13T07:39:49.648625 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78024], State: [ok], Delivered in [0.005251403] seconds [----] I, [2016-09-13T07:39:49.671215 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78026], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.697659471] seconds [----] I, [2016-09-13T07:39:49.671380 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78026], Delivering... [----] I, [2016-09-13T07:39:49.674386 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78026], State: [ok], Delivered in [0.002994361] seconds [----] I, [2016-09-13T07:39:59.001511 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T07:39:59.019995 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78027], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:39:59.031208 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78028], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:39:59.039300 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:39:59.048487 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78029], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:39:59.060059 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78030], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:39:59.507209 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78027], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.496582191] seconds [----] I, [2016-09-13T07:39:59.507467 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78027], Delivering... [----] I, [2016-09-13T07:39:59.514784 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003758668899536133, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003782987594604492, :pending_vm_jobs=>0.0009238719940185547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068285465240478516} [----] I, [2016-09-13T07:39:59.515200 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78027], State: [ok], Delivered in [0.00778668] seconds [----] I, [2016-09-13T07:39:59.540031 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78028], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.514473242] seconds [----] I, [2016-09-13T07:39:59.540213 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78028], Delivering... [----] I, [2016-09-13T07:39:59.542545 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78028], State: [ok], Delivered in [0.002331234] seconds [----] I, [2016-09-13T07:40:05.593477 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:40:05.598247 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004050254821777344, :worker_monitor=>1.5381875038146973, :worker_dequeue=>0.009155750274658203, :total_time=>1.5516819953918457} [----] I, [2016-09-13T07:40:07.740367 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78029], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.702010772] seconds [----] I, [2016-09-13T07:40:07.740645 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78029], Delivering... [----] I, [2016-09-13T07:40:07.757577 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78029], State: [ok], Delivered in [0.016884549] seconds [----] I, [2016-09-13T07:40:07.797929 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78030], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.743904547] seconds [----] I, [2016-09-13T07:40:07.798212 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78030], Delivering... [----] I, [2016-09-13T07:40:07.805105 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78030], State: [ok], Delivered in [0.006866893] seconds [----] I, [2016-09-13T07:40:10.598726 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:40:10 UTC]... [----] I, [2016-09-13T07:40:10.614046 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:40:10 UTC]...Complete [----] I, [2016-09-13T07:40:14.073210 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:40:14.094736 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78031], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:40:14.111711 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78032], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:40:15.783715 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:40:15.820295 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78031], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.740971309] seconds [----] I, [2016-09-13T07:40:15.820540 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78031], Delivering... [----] I, [2016-09-13T07:40:15.827549 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003558635711669922, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036334991455078125, :pending_vm_jobs=>0.0008385181427001953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065288543701171875} [----] I, [2016-09-13T07:40:15.827968 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78031], State: [ok], Delivered in [0.007433805] seconds [----] I, [2016-09-13T07:40:16.857079 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78032], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.757915219] seconds [----] I, [2016-09-13T07:40:16.857296 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78032], Delivering... [----] I, [2016-09-13T07:40:16.862960 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78032], State: [ok], Delivered in [0.005648092] seconds [----] I, [2016-09-13T07:40:22.583780 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005541324615478516, :worker_monitor=>1.774139404296875, :worker_dequeue=>0.011920452117919922, :total_time=>1.7919578552246094} [----] I, [2016-09-13T07:40:29.124093 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:40:29.140212 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78033], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:40:32.610358 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:40:32.643400 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78033], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.513043011] seconds [----] I, [2016-09-13T07:40:32.643630 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78033], Delivering... [----] I, [2016-09-13T07:40:32.650955 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003881216049194336, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003911018371582031, :pending_vm_jobs=>0.0008938312530517578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068857669830322266} [----] I, [2016-09-13T07:40:32.651339 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78033], State: [ok], Delivered in [0.007709033] seconds [----] I, [2016-09-13T07:40:38.835776 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00417017936706543, :worker_monitor=>1.205826759338379, :worker_dequeue=>0.00836801528930664, :total_time=>1.2186689376831055} [----] I, [2016-09-13T07:40:43.836228 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:40:43 UTC]... [----] I, [2016-09-13T07:40:43.852188 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:40:43 UTC]...Complete [----] I, [2016-09-13T07:40:44.150736 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:40:44.160727 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78034], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:40:44.166319 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78035], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:40:44.171952 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78036], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:40:44.183549 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78037], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:40:48.878807 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:40:49.064648 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78036], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.896349647] seconds [----] I, [2016-09-13T07:40:49.064887 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78036], Delivering... [----] I, [2016-09-13T07:40:49.069860 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78034], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.915309012] seconds [----] I, [2016-09-13T07:40:49.070059 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78034], Delivering... [----] I, [2016-09-13T07:40:49.077347 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003743886947631836, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037708282470703125, :pending_vm_jobs=>0.0009202957153320312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006747722625732422} [----] I, [2016-09-13T07:40:49.078135 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78034], State: [ok], Delivered in [0.008065656] seconds [----] I, [2016-09-13T07:40:49.126964 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78036], State: [ok], Delivered in [0.062104606] seconds [----] I, [2016-09-13T07:40:49.997380 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78035], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.834498805] seconds [----] I, [2016-09-13T07:40:49.997633 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78035], Delivering... [----] I, [2016-09-13T07:40:50.003368 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78035], State: [ok], Delivered in [0.005725234] seconds [----] I, [2016-09-13T07:40:50.058557 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78037], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.883798897] seconds [----] I, [2016-09-13T07:40:50.058772 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78037], Delivering... [----] I, [2016-09-13T07:40:50.067936 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78037], State: [ok], Delivered in [0.009145542] seconds [----] I, [2016-09-13T07:40:55.344488 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004072904586791992, :worker_monitor=>1.4430797100067139, :worker_dequeue=>0.011184453964233398, :total_time=>1.458622932434082} [----] I, [2016-09-13T07:40:59.193192 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:40:59.233650 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78038], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:41:00.353541 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:41:01.228227 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78038], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.029166226] seconds [----] I, [2016-09-13T07:41:01.228447 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78038], Delivering... [----] I, [2016-09-13T07:41:01.235301 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035440921783447266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035963058471679688, :pending_vm_jobs=>0.0008640289306640625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006453275680541992} [----] I, [2016-09-13T07:41:01.235641 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78038], State: [ok], Delivered in [0.007221189] seconds [----] I, [2016-09-13T07:41:11.700458 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003891468048095703, :worker_monitor=>1.303455114364624, :worker_dequeue=>0.011087417602539062, :total_time=>1.3187038898468018} [----] I, [2016-09-13T07:41:14.244372 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:41:14.264475 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78039], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:41:14.276019 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78040], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:41:16.701001 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:41:16 UTC]... [----] I, [2016-09-13T07:41:16.715737 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:41:16 UTC]...Complete [----] I, [2016-09-13T07:41:16.818476 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:41:17.167460 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78039], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.91688657] seconds [----] I, [2016-09-13T07:41:17.167634 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78039], Delivering... [----] I, [2016-09-13T07:41:17.173893 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030808448791503906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031278133392333984, :pending_vm_jobs=>0.0008397102355957031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005867481231689453} [----] I, [2016-09-13T07:41:17.174158 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78039], State: [ok], Delivered in [0.006532062] seconds [----] I, [2016-09-13T07:41:17.196379 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78040], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.928514698] seconds [----] I, [2016-09-13T07:41:17.196574 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78040], Delivering... [----] I, [2016-09-13T07:41:17.201378 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78040], State: [ok], Delivered in [0.004812038] seconds [----] I, [2016-09-13T07:41:28.276826 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005334615707397461, :worker_monitor=>1.4183707237243652, :worker_dequeue=>0.009687423706054688, :total_time=>1.4336936473846436} [----] I, [2016-09-13T07:41:29.286570 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:41:29.304645 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78041], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:41:33.286782 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:41:33.436296 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78041], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.143951735] seconds [----] I, [2016-09-13T07:41:33.436525 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78041], Delivering... [----] I, [2016-09-13T07:41:33.443203 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033500194549560547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003373384475708008, :pending_vm_jobs=>0.0008289813995361328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006235361099243164} [----] I, [2016-09-13T07:41:33.443591 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78041], State: [ok], Delivered in [0.007075243] seconds [----] I, [2016-09-13T07:41:44.330229 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:41:44.368232 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78042], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:41:44.385000 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78043], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:41:44.402281 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78044], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:41:44.425202 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78045], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:41:45.170525 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:41:45.175958 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005916118621826172, :worker_monitor=>1.850405216217041, :worker_dequeue=>0.009874820709228516, :total_time=>1.8666918277740479} [----] I, [2016-09-13T07:41:45.574395 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78042], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.235605992] seconds [----] I, [2016-09-13T07:41:45.574643 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78042], Delivering... [----] I, [2016-09-13T07:41:45.582860 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00420379638671875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004230499267578125, :pending_vm_jobs=>0.001041412353515625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007727146148681641} [----] I, [2016-09-13T07:41:45.583308 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78042], State: [ok], Delivered in [0.00865122] seconds [----] I, [2016-09-13T07:41:45.620006 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78044], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.229225611] seconds [----] I, [2016-09-13T07:41:45.620200 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78044], Delivering... [----] I, [2016-09-13T07:41:45.682305 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78044], State: [ok], Delivered in [0.062070704] seconds [----] I, [2016-09-13T07:41:47.311320 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78043], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.936709379] seconds [----] I, [2016-09-13T07:41:47.311576 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78043], Delivering... [----] I, [2016-09-13T07:41:47.317043 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78043], State: [ok], Delivered in [0.005456861] seconds [----] I, [2016-09-13T07:41:47.362768 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78045], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.952769386] seconds [----] I, [2016-09-13T07:41:47.363007 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78045], Delivering... [----] I, [2016-09-13T07:41:47.366554 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78045], State: [ok], Delivered in [0.003545032] seconds [----] I, [2016-09-13T07:41:50.176577 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:41:50 UTC]... [----] I, [2016-09-13T07:41:50.196505 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:41:50 UTC]...Complete [----] I, [2016-09-13T07:41:59.454440 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:41:59.493757 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78046], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:42:02.362049 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:42:02.370501 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004127979278564453, :worker_monitor=>2.121429204940796, :worker_dequeue=>0.014241695404052734, :total_time=>2.1401941776275635} [----] I, [2016-09-13T07:42:02.464631 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78046], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.004334215] seconds [----] I, [2016-09-13T07:42:02.464859 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78046], Delivering... [----] I, [2016-09-13T07:42:02.471734 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036563873291015625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036759376525878906, :pending_vm_jobs=>0.0008580684661865234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0064542293548583984} [----] I, [2016-09-13T07:42:02.472091 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78046], State: [ok], Delivered in [0.00724777] seconds [----] I, [2016-09-13T07:42:14.505011 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:42:14.528085 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78047], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:42:14.554995 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78048], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:42:19.809537 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:42:19.816184 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004053354263305664, :server_monitor=>0.1750636100769043, :worker_monitor=>2.1425020694732666, :worker_dequeue=>0.011991500854492188, :total_time=>2.3340258598327637} [----] I, [2016-09-13T07:42:19.898221 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78048], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.364507532] seconds [----] I, [2016-09-13T07:42:19.898459 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78048], Delivering... [----] I, [2016-09-13T07:42:19.906270 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0040628910064697266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004092216491699219, :pending_vm_jobs=>0.0009582042694091797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0073163509368896484} [----] I, [2016-09-13T07:42:19.906654 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78048], State: [ok], Delivered in [0.008217224] seconds [----] I, [2016-09-13T07:42:20.555384 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78047], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.045920768] seconds [----] I, [2016-09-13T07:42:20.555557 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78047], Delivering... [----] I, [2016-09-13T07:42:20.558944 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78047], State: [ok], Delivered in [0.003379] seconds [----] I, [2016-09-13T07:42:24.816786 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:42:24 UTC]... [----] I, [2016-09-13T07:42:24.858222 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:42:24 UTC]...Complete [----] I, [2016-09-13T07:42:29.567448 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:42:29.583529 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78049], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:42:29.886941 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:42:29.995261 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78049], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.421544605] seconds [----] I, [2016-09-13T07:42:29.995480 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78049], Delivering... [----] I, [2016-09-13T07:42:30.001917 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003404378890991211, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034246444702148438, :pending_vm_jobs=>0.000835418701171875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006046772003173828} [----] I, [2016-09-13T07:42:30.002274 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78049], State: [ok], Delivered in [0.00680756] seconds [----] I, [2016-09-13T07:42:36.317399 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004421710968017578, :worker_monitor=>1.4052441120147705, :worker_dequeue=>0.011218786239624023, :total_time=>1.4212419986724854} [----] I, [2016-09-13T07:42:44.594892 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:42:44.618071 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78050], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:42:44.635135 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78051], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:42:44.652140 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78052], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:42:44.715236 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78053], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:42:46.343354 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:42:47.127073 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78051], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.505298935] seconds [----] I, [2016-09-13T07:42:47.127251 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78051], Delivering... [----] I, [2016-09-13T07:42:47.138690 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78053], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.47804656] seconds [----] I, [2016-09-13T07:42:47.138954 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78053], Delivering... [----] I, [2016-09-13T07:42:47.146976 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0041980743408203125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004223823547363281, :pending_vm_jobs=>0.0010154247283935547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007615327835083008} [----] I, [2016-09-13T07:42:47.147389 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78053], State: [ok], Delivered in [0.008427308] seconds [----] I, [2016-09-13T07:42:47.195273 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78051], State: [ok], Delivered in [0.067996999] seconds [----] I, [2016-09-13T07:42:47.715306 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78050], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.115965417] seconds [----] I, [2016-09-13T07:42:47.715488 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78050], Delivering... [----] I, [2016-09-13T07:42:47.719155 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78050], State: [ok], Delivered in [0.0036612] seconds [----] I, [2016-09-13T07:42:47.755515 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78052], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.115426058] seconds [----] I, [2016-09-13T07:42:47.755653 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78052], Delivering... [----] I, [2016-09-13T07:42:47.757873 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78052], State: [ok], Delivered in [0.002216943] seconds [----] I, [2016-09-13T07:42:52.834662 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035240650177001953, :worker_monitor=>1.4675183296203613, :worker_dequeue=>0.00838923454284668, :total_time=>1.479705810546875} [----] I, [2016-09-13T07:42:57.835193 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:42:57 UTC]... [----] I, [2016-09-13T07:42:57.851344 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:42:57 UTC]...Complete [----] I, [2016-09-13T07:42:59.726790 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:42:59.742850 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78054], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:43:02.878318 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:43:03.149517 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78054], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.416829879] seconds [----] I, [2016-09-13T07:43:03.149755 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78054], Delivering... [----] I, [2016-09-13T07:43:03.157472 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004106760025024414, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004133462905883789, :pending_vm_jobs=>0.0009162425994873047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007201433181762695} [----] I, [2016-09-13T07:43:03.157877 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78054], State: [ok], Delivered in [0.008098157] seconds [----] I, [2016-09-13T07:43:09.240623 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004002571105957031, :worker_monitor=>1.3443448543548584, :worker_dequeue=>0.006533145904541016, :total_time=>1.3551609516143799} [----] I, [2016-09-13T07:43:14.753958 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:43:14.769303 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78055], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:43:14.792161 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78056], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:43:19.369689 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:43:19.427079 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78056], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.652561219] seconds [----] I, [2016-09-13T07:43:19.427284 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78056], Delivering... [----] I, [2016-09-13T07:43:19.434610 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035626888275146484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035893917083740234, :pending_vm_jobs=>0.0011785030364990234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006867170333862305} [----] I, [2016-09-13T07:43:19.434991 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78056], State: [ok], Delivered in [0.007697003] seconds [----] I, [2016-09-13T07:43:20.903101 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78055], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.144712332] seconds [----] I, [2016-09-13T07:43:20.903323 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78055], Delivering... [----] I, [2016-09-13T07:43:20.908897 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78055], State: [ok], Delivered in [0.005537167] seconds [----] I, [2016-09-13T07:43:26.068157 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00791621208190918, :worker_monitor=>1.6735379695892334, :worker_dequeue=>0.0093536376953125, :total_time=>1.6911530494689941} [----] I, [2016-09-13T07:43:29.804529 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:43:29.816765 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78057], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:43:29.828147 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78058], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:43:29.839386 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78059], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:43:31.068664 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:43:31 UTC]... [----] I, [2016-09-13T07:43:31.085115 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:43:31 UTC]...Complete [----] I, [2016-09-13T07:43:31.095368 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:43:31.531643 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78057], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.722539876] seconds [----] I, [2016-09-13T07:43:31.531853 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78057], Delivering... [----] I, [2016-09-13T07:43:31.533001 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T07:43:31.533194 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5357281280 [----] I, [2016-09-13T07:43:31.533286 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5133139968 [----] I, [2016-09-13T07:43:31.533361 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 224141312 [----] I, [2016-09-13T07:43:31.533473 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T07:43:31.533557 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5079117824 [----] I, [2016-09-13T07:43:31.533629 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T07:43:31.533696 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T07:43:31.533767 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 545542144 [----] I, [2016-09-13T07:43:31.533853 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T07:43:31.533926 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7974420480 [----] I, [2016-09-13T07:43:31.533998 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T07:43:31.534061 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T07:43:31.534142 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T07:43:31.534216 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T07:43:31.534285 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T07:43:31.534351 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T07:43:31.534439 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T07:43:31.534525 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T07:43:31.534593 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T07:43:31.534660 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T07:43:31.534727 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273584128 [----] I, [2016-09-13T07:43:31.534790 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56827904 [----] I, [2016-09-13T07:43:31.534887 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216756224 [----] I, [2016-09-13T07:43:31.534955 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6225920 [----] I, [2016-09-13T07:43:31.535021 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141418496 [----] I, [2016-09-13T07:43:31.535086 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2586816512 [----] I, [2016-09-13T07:43:31.535152 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2267746304 [----] I, [2016-09-13T07:43:31.535216 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T07:43:31.535282 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T07:43:31.535353 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T07:43:31.535447 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37797888 [----] I, [2016-09-13T07:43:31.535534 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102305792 [----] I, [2016-09-13T07:43:31.535605 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53329920 [----] I, [2016-09-13T07:43:31.535677 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110866432 [----] I, [2016-09-13T07:43:31.535744 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155635712 [----] I, [2016-09-13T07:43:31.535823 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T07:43:31.535898 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T07:43:31.535974 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T07:43:31.536043 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T07:43:31.536110 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T07:43:31.536180 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T07:43:31.536246 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T07:43:31.536312 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T07:43:31.536376 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T07:43:31.548506 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78059], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.715359638] seconds [----] I, [2016-09-13T07:43:31.548695 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78059], Delivering... [----] I, [2016-09-13T07:43:31.554831 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034177303314208984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034410953521728516, :pending_vm_jobs=>0.0007171630859375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005774259567260742} [----] I, [2016-09-13T07:43:31.555170 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78059], State: [ok], Delivered in [0.006466795] seconds [----] I, [2016-09-13T07:43:31.568758 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T07:43:31.568972 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T07:43:31.573193 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T07:43:31.575933 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T07:43:31.579149 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T07:43:31.581966 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T07:43:31.584914 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T07:43:31.587949 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 846 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T07:43:31.590978 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T07:43:31.594007 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T07:43:31.597115 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T07:43:31.599862 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T07:43:31.602520 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T07:43:31.605515 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T07:43:31.608101 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:43:31.608242 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:43:31.608339 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T07:43:31.612536 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [150383.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T07:43:31.612899 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78057], State: [ok], Delivered in [0.081069447] seconds [----] I, [2016-09-13T07:43:36.125621 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T07:43:36.134650 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:43:36.280454 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78058], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.459988555] seconds [----] I, [2016-09-13T07:43:36.280764 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78058], Delivering... [----] I, [2016-09-13T07:43:36.295463 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:43:25 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200502000], Memory % [3.36], CPU Time [151288.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:43:36.296059 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:43:24 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [104178.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T07:43:36.296711 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:43:23 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169069000], Memory % [3.14], CPU Time [51454.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:43:36.297218 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:43:20 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48786.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T07:43:36.297841 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:43:25 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162418000], Memory % [3.1], CPU Time [37916.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T07:43:36.298480 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:43:14 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205293000], Memory % [3.5], CPU Time [239596.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T07:43:36.299093 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:43:24 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358681000], Memory % [5.28], CPU Time [202485.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T07:43:36.299671 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:43:25 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [150392.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:43:36.302864 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:43:22 UTC], Process Info: Memory Usage [603836416], Memory Size [1059794944], Proportional Set Size: [438789000], Memory % [7.36], CPU Time [2072.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:43:36.305108 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:43:22 UTC], Process Info: Memory Usage [591667200], Memory Size [920395776], Proportional Set Size: [426723000], Memory % [7.21], CPU Time [902.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:43:36.307378 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:43:18 UTC], Process Info: Memory Usage [557686784], Memory Size [893894656], Proportional Set Size: [405248000], Memory % [6.8], CPU Time [5556.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T07:43:36.309632 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:43:20 UTC], Process Info: Memory Usage [579969024], Memory Size [907886592], Proportional Set Size: [419479000], Memory % [7.07], CPU Time [2116.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T07:43:36.310243 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:43:23 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357918000], Memory % [5.27], CPU Time [209637.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T07:43:36.310831 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:43:23 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [51462.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:43:36.311336 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:43:16 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165802000], Memory % [3.16], CPU Time [38816.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T07:43:36.311717 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78058], State: [ok], Delivered in [0.030972337] seconds [----] I, [2016-09-13T07:43:42.234665 #2763:34713c] INFO -- : MIQ(MiqServer#validate_worker) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit [----] I, [2016-09-13T07:43:42.274874 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78060], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_uptime_exceeded", {:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T07:43:42.275203 #2763:34713c] INFO -- : MIQ(MiqServer#stop_worker) Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3], status [started]... [----] I, [2016-09-13T07:43:42.291691 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78061], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T07:43:42.344238 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3] is being requested to exit [----] I, [2016-09-13T07:43:42.695707 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:43:42.702522 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004436016082763672, :worker_monitor=>1.5329816341400146, :worker_dequeue=>0.018181324005126953, :total_time=>1.555952787399292} [----] I, [2016-09-13T07:43:44.850721 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:43:44.863967 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78062], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:43:44.875378 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78063], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:43:44.887101 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78064], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:43:44.904080 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78065], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:43:44.979162 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78060], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_uptime_exceeded", {:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [2.742492936] seconds [----] I, [2016-09-13T07:43:44.979342 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78060], Delivering... [----] I, [2016-09-13T07:43:45.002596 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_uptime_exceeded"> inputs=<{:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1082, :miq_event_id=>1082, "EventStream::event_stream"=>1082, :event_stream_id=>1082}> [----] I, [2016-09-13T07:43:45.035588 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78066], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1082, :miq_event_id=>1082, "EventStream::event_stream"=>1082, :event_stream_id=>1082}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T07:43:45.036032 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78060], State: [ok], Delivered in [0.056666728] seconds [----] I, [2016-09-13T07:43:45.063501 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78061], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [2.786534457] seconds [----] I, [2016-09-13T07:43:45.063697 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78061], Delivering... [----] I, [2016-09-13T07:43:45.079937 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_stop"> inputs=<{:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1083, :miq_event_id=>1083, "EventStream::event_stream"=>1083, :event_stream_id=>1083}> [----] I, [2016-09-13T07:43:45.104090 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78067], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1083, :miq_event_id=>1083, "EventStream::event_stream"=>1083, :event_stream_id=>1083}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T07:43:45.104557 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78061], State: [ok], Delivered in [0.040847547] seconds [----] I, [2016-09-13T07:43:47.712056 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:43:47.749826 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78063], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.882244039] seconds [----] I, [2016-09-13T07:43:47.749992 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78063], Delivering... [----] I, [2016-09-13T07:43:47.839021 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78063], State: [ok], Delivered in [0.089007539] seconds [----] I, [2016-09-13T07:43:47.885755 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78065], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.989270347] seconds [----] I, [2016-09-13T07:43:47.885946 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78065], Delivering... [----] I, [2016-09-13T07:43:47.892253 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031478404998779297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00316619873046875, :pending_vm_jobs=>0.0008132457733154297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005912303924560547} [----] I, [2016-09-13T07:43:47.892657 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78065], State: [ok], Delivered in [0.006703487] seconds [----] I, [2016-09-13T07:43:47.915291 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78066], MiqWorker id: [16], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1082, :miq_event_id=>1082, "EventStream::event_stream"=>1082, :event_stream_id=>1082}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [2.898042369] seconds [----] I, [2016-09-13T07:43:47.915507 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78066], Delivering... [----] I, [2016-09-13T07:43:47.917298 #2957:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1082, :miq_event_id=>1082, "EventStream::event_stream"=>1082, :event_stream_id=>1082} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T07:43:47.922628 #2957:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1082&MiqEvent%3A%3Amiq_event=1082&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B98%5D%2C%20PID%3A%20%5B3290%5D%2C%20GUID%3A%20%5B8b41dc22-7996-11e6-87c1-fa163e7d01a3%5D%20uptime%20has%20reached%20the%20interval%20of%207200%20seconds%2C%20requesting%20worker%20to%20exit&event_stream_id=1082&event_type=evm_worker_uptime_exceeded&miq_event_id=1082&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T07:43:47.955062 #2957:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1082&MiqEvent%3A%3Amiq_event=1082&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B98%5D%2C%20PID%3A%20%5B3290%5D%2C%20GUID%3A%20%5B8b41dc22-7996-11e6-87c1-fa163e7d01a3%5D%20uptime%20has%20reached%20the%20interval%20of%207200%20seconds%2C%20requesting%20worker%20to%20exit&event_stream_id=1082&event_type=evm_worker_uptime_exceeded&miq_event_id=1082&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T07:43:48.041511 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create] [----] I, [2016-09-13T07:43:48.067232 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T07:43:48.091720 #2957:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T07:43:48.115519 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T07:43:48.123609 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T07:43:48.138222 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78067], MiqWorker id: [13], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1083, :miq_event_id=>1083, "EventStream::event_stream"=>1083, :event_stream_id=>1083}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [3.049045544] seconds [----] I, [2016-09-13T07:43:48.138454 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78067], Delivering... [----] I, [2016-09-13T07:43:48.140458 #2928:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1083, :miq_event_id=>1083, "EventStream::event_stream"=>1083, :event_stream_id=>1083} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T07:43:48.146031 #2928:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1083&MiqEvent%3A%3Amiq_event=1083&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B98%5D%2C%20PID%3A%20%5B3290%5D%2C%20GUID%3A%20%5B8b41dc22-7996-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1083&event_type=evm_worker_stop&miq_event_id=1083&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T07:43:48.148078 #2957:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T07:43:48.159176 #2957:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T07:43:48.165267 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 11:43:31", os_priority: 21, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 277401600, memory_size: 578035712, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 202019000, has_active_websocket: true>] [----] I, [2016-09-13T07:43:48.165646 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_uptime_exceeded] [----] I, [2016-09-13T07:43:48.178069 #2928:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1083&MiqEvent%3A%3Amiq_event=1083&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B98%5D%2C%20PID%3A%20%5B3290%5D%2C%20GUID%3A%20%5B8b41dc22-7996-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1083&event_type=evm_worker_stop&miq_event_id=1083&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T07:43:48.188694 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_uptime_exceeded] [----] I, [2016-09-13T07:43:48.189084 #2957:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_uptime_exceeded] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T07:43:48.200912 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T07:43:48.201686 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create] [----] I, [2016-09-13T07:43:48.202751 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78066], State: [ok], Delivered in [0.287216053] seconds [----] I, [2016-09-13T07:43:48.267856 #2928:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T07:43:48.290410 #2928:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T07:43:48.313007 #2928:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_stop] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T07:43:48.334741 #2928:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T07:43:48.340691 #2928:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T07:43:48.359771 #2928:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T07:43:48.369179 #2928:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T07:43:48.373235 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78062], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.51798905] seconds [----] I, [2016-09-13T07:43:48.373486 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78062], Delivering... [----] I, [2016-09-13T07:43:48.374822 #2928:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 11:43:31", os_priority: 21, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 277401600, memory_size: 578035712, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 202019000, has_active_websocket: true>] [----] I, [2016-09-13T07:43:48.375108 #2928:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_stop] [----] I, [2016-09-13T07:43:48.379787 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78062], State: [ok], Delivered in [0.006295718] seconds [----] I, [2016-09-13T07:43:48.400048 #2928:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_stop] [----] I, [2016-09-13T07:43:48.400394 #2928:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_stop] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T07:43:48.412209 #2928:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T07:43:48.412876 #2928:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T07:43:48.413743 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78067], State: [ok], Delivered in [0.275317792] seconds [----] I, [2016-09-13T07:43:48.417592 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78064], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.537069354] seconds [----] I, [2016-09-13T07:43:48.417775 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78064], Delivering... [----] I, [2016-09-13T07:43:48.421454 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78064], State: [ok], Delivered in [0.003633124] seconds [----] I, [2016-09-13T07:43:52.347090 #3290:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [98], PID [3290], GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:43:42 UTC], Process Info: Memory Usage [603836416], Memory Size [1059794944], Proportional Set Size: [438809000], Memory % [7.36], CPU Time [2074.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:43:52.347662 #3290:34713c] INFO -- : EMS [livingontheedge.hawkular.org] as [jdoe] ID [98] PID [3290] GUID [8b41dc22-7996-11e6-87c1-fa163e7d01a3] Exit request received. Worker exiting. [----] I, [2016-09-13T07:43:57.850573 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker.sync_workers) Workers are being synchronized: Current: ["ems_15"], Desired: ["ems_15", "ems_16"] [----] I, [2016-09-13T07:43:57.946251 #2763:34713c] INFO -- : :kill_algorithm: [----] I, [2016-09-13T07:43:57.946403 #2763:34713c] INFO -- : :name: :used_swap_percent_gt_value [----] I, [2016-09-13T07:43:57.946500 #2763:34713c] INFO -- : :value: 80 [----] I, [2016-09-13T07:43:57.946542 #2763:34713c] INFO -- : :miq_server_time_threshold: 120 [----] I, [2016-09-13T07:43:57.946599 #2763:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T07:43:57.946634 #2763:34713c] INFO -- : :poll: 2 [----] I, [2016-09-13T07:43:57.946667 #2763:34713c] INFO -- : :start_algorithm: [----] I, [2016-09-13T07:43:57.946700 #2763:34713c] INFO -- : :name: :used_swap_percent_lt_value [----] I, [2016-09-13T07:43:57.946759 #2763:34713c] INFO -- : :value: 60 [----] I, [2016-09-13T07:43:57.946793 #2763:34713c] INFO -- : :sync_interval: 1800 [----] I, [2016-09-13T07:43:57.946869 #2763:34713c] INFO -- : :wait_for_started_timeout: 600 [----] I, [2016-09-13T07:43:58.266175 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker.close_pg_sockets_inherited_from_parent) Closing socket: 21 [----] I, [2016-09-13T07:43:58.417257 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78068], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T07:43:58.417371 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#start) Worker started: ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3] [----] I, [2016-09-13T07:43:58.668605 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:43:58.669773 #10859:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T07:43:58.669883 #10859:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:43:58.669935 #10859:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:43:58.669983 #10859:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:43:58.670023 #10859:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T07:43:58.670061 #10859:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T07:43:58.670097 #10859:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:43:58.670152 #10859:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T07:43:58.670194 #10859:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:43:58.670232 #10859:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:43:58.670266 #10859:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T07:43:58.670303 #10859:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:43:58.670338 #10859:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T07:43:58.670376 #10859:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:43:58.670409 #10859:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T07:43:58.670487 #10859:34713c] INFO -- : --- [----] I, [2016-09-13T07:43:58.670946 #10859:34713c] INFO -- : :guid: 5b4aad44-79a7-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:43:58.671019 #10859:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T07:43:59.180652 #10859:34713c] INFO -- : MIQ(AuthUseridPassword#validation_successful) [ExtManagementSystem] [16], previously valid/invalid on: [2016-09-13 09:43:44 UTC]/[], previous status: [Valid] [----] I, [2016-09-13T07:43:59.211862 #10859:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78069], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 16], "ems_auth_valid", {}] [----] I, [2016-09-13T07:43:59.415981 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:43:59.422229 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004080772399902344, :worker_monitor=>1.669884443283081, :worker_dequeue=>0.011297225952148438, :total_time=>1.6856205463409424} [----] I, [2016-09-13T07:43:59.680744 #10859:34713c] INFO -- : ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner started. ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Zone [default], Role [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket] [----] I, [2016-09-13T07:43:59.681093 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_wait_for_worker_monitor) EMS [livingontheedge.hawkular.org] as [jdoe] Checking that worker monitor has started before doing work [----] I, [2016-09-13T07:43:59.683525 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_wait_for_worker_monitor) EMS [livingontheedge.hawkular.org] as [jdoe] Starting work since worker monitor has started [----] I, [2016-09-13T07:43:59.683607 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_before_work_loop) EMS [livingontheedge.hawkular.org] as [jdoe] Queueing initial refresh for EMS. [----] I, [2016-09-13T07:43:59.711287 #10859:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78070], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T07:43:59.713330 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#worker_monitor_drb) EMS [livingontheedge.hawkular.org] as [jdoe] Initializing DRb Connection to MiqServer with ID=[1], NAME=[EVM], PID=[2763], GUID=[36647afc-71a3-11e6-838a-fa163e68952f] DRb URI=[druby://127.0.0.1:41718] [----] I, [2016-09-13T07:43:59.914632 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:43:59.931619 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78071], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:44:00.504677 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78068], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [2.101133198] seconds [----] I, [2016-09-13T07:44:00.504926 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78068], Delivering... [----] I, [2016-09-13T07:44:00.510228 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78069], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 16], "ems_auth_valid", {}], Dequeued in: [1.309218282] seconds [----] I, [2016-09-13T07:44:00.510513 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78069], Delivering... [----] I, [2016-09-13T07:44:00.527564 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_start"> inputs=<{:event_details=>"Worker started: ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1084, :miq_event_id=>1084, "EventStream::event_stream"=>1084, :event_stream_id=>1084}> [----] I, [2016-09-13T07:44:00.532035 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"ems_auth_valid"> inputs=<{"MiqEvent::miq_event"=>1085, :miq_event_id=>1085, "EventStream::event_stream"=>1085, :event_stream_id=>1085}> [----] I, [2016-09-13T07:44:00.555816 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78072], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1084, :miq_event_id=>1084, "EventStream::event_stream"=>1084, :event_stream_id=>1084}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T07:44:00.556265 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78068], State: [ok], Delivered in [0.051310284] seconds [----] I, [2016-09-13T07:44:00.574331 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78073], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>16, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1085, :miq_event_id=>1085, "EventStream::event_stream"=>1085, :event_stream_id=>1085}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T07:44:00.574881 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78069], State: [ok], Delivered in [0.064365696] seconds [----] I, [2016-09-13T07:44:04.422734 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:44:04 UTC]... [----] I, [2016-09-13T07:44:04.446324 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:44:04 UTC]...Complete [----] I, [2016-09-13T07:44:04.457563 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:44:04.464329 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=3, priority=200 [----] I, [2016-09-13T07:44:04.800791 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78071], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.880278762] seconds [----] I, [2016-09-13T07:44:04.801013 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78071], Delivering... [----] I, [2016-09-13T07:44:04.807641 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003352642059326172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033762454986572266, :pending_vm_jobs=>0.0008728504180908203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006235837936401367} [----] I, [2016-09-13T07:44:04.808091 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78071], State: [ok], Delivered in [0.007060986] seconds [----] I, [2016-09-13T07:44:04.836511 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78072], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1084, :miq_event_id=>1084, "EventStream::event_stream"=>1084, :event_stream_id=>1084}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [4.299065311] seconds [----] I, [2016-09-13T07:44:04.836715 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78072], Delivering... [----] I, [2016-09-13T07:44:04.838865 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1084, :miq_event_id=>1084, "EventStream::event_stream"=>1084, :event_stream_id=>1084} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T07:44:04.844714 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1084&MiqEvent%3A%3Amiq_event=1084&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B100%5D%2C%20PID%20%5B10859%5D%2C%20GUID%20%5B5b4aad44-79a7-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1084&event_type=evm_worker_start&miq_event_id=1084&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T07:44:04.877473 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1084&MiqEvent%3A%3Amiq_event=1084&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B100%5D%2C%20PID%20%5B10859%5D%2C%20GUID%20%5B5b4aad44-79a7-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1084&event_type=evm_worker_start&miq_event_id=1084&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T07:44:04.969952 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T07:44:04.992519 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T07:44:05.015715 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_start] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T07:44:05.037262 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T07:44:05.043488 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T07:44:05.063185 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T07:44:05.073179 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T07:44:05.078373 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 11:44:04", os_priority: 21, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 277401600, memory_size: 578035712, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 202019000, has_active_websocket: true>] [----] I, [2016-09-13T07:44:05.078671 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_start] [----] I, [2016-09-13T07:44:05.097589 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_start] [----] I, [2016-09-13T07:44:05.097844 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_start] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T07:44:05.106664 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T07:44:05.107270 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T07:44:05.108142 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78072], State: [ok], Delivered in [0.271417763] seconds [----] I, [2016-09-13T07:44:05.133072 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78073], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>16, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1085, :miq_event_id=>1085, "EventStream::event_stream"=>1085, :event_stream_id=>1085}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [4.579594305] seconds [----] I, [2016-09-13T07:44:05.133253 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78073], Delivering... [----] I, [2016-09-13T07:44:05.135087 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1085, :miq_event_id=>1085, "EventStream::event_stream"=>1085, :event_stream_id=>1085} for object [ManageIQ::Providers::Hawkular::MiddlewareManager.16] with state [] to Automate [----] I, [2016-09-13T07:44:05.140406 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1085&ExtManagementSystem%3A%3Aext_management_system=16&MiqEvent%3A%3Amiq_event=1085&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1085&event_type=ems_auth_valid&miq_event_id=1085&object_name=Event&vmdb_object_type=ext_management_system] [----] I, [2016-09-13T07:44:05.170031 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1085&ExtManagementSystem%3A%3Aext_management_system=16&MiqEvent%3A%3Amiq_event=1085&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1085&event_type=ems_auth_valid&miq_event_id=1085&object_name=Event&vmdb_object_type=ext_management_system ManageIQ/System] [----] I, [2016-09-13T07:44:05.254959 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T07:44:05.275983 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T07:44:05.296902 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/ems_auth_valid] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T07:44:05.317394 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T07:44:05.323032 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T07:44:05.340055 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T07:44:05.348649 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T07:44:05.352949 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#] [----] I, [2016-09-13T07:44:05.353243 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [ems_auth_valid] [----] I, [2016-09-13T07:44:05.371762 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [ems_auth_valid] [----] I, [2016-09-13T07:44:05.372024 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [ems_auth_valid] Target: ManageIQ::Providers::Hawkular::MiddlewareManager Name: [Hawkular-Provider], Id: [16] [----] I, [2016-09-13T07:44:05.376833 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T07:44:05.377443 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T07:44:05.378265 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78073], State: [ok], Delivered in [0.244991446] seconds [----] I, [2016-09-13T07:44:09.479600 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=3, priority=200 [----] I, [2016-09-13T07:44:10.178351 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [78070], MiqWorker id: [100], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [10.486248517] seconds [----] I, [2016-09-13T07:44:10.178653 #10859:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78070], Delivering... [----] I, [2016-09-13T07:44:10.192444 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T07:44:10.192677 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T07:44:10.192835 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T07:44:10.193032 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T07:44:10.198032 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:10.651075 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:10.981563 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:10.981914 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:11.464570 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:11.766464 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:11.766759 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:14.945764 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:44:14.954611 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78074], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:44:14.966004 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78075], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:44:15.566347 #2763:34713c] INFO -- : MIQ(MiqServer#clean_worker_records) SQL Record for Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [98], PID: [3290], GUID: [8b41dc22-7996-11e6-87c1-fa163e7d01a3], Status: [stopped] is being deleted [----] I, [2016-09-13T07:44:15.834823 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:44:15.841772 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0044558048248291016, :worker_monitor=>1.3446450233459473, :worker_dequeue=>0.012254953384399414, :total_time=>1.3616955280303955} [----] I, [2016-09-13T07:44:16.463971 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78075], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.506255383] seconds [----] I, [2016-09-13T07:44:16.464203 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78075], Delivering... [----] I, [2016-09-13T07:44:16.471258 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038280487060546875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003847837448120117, :pending_vm_jobs=>0.0008652210235595703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006602287292480469} [----] I, [2016-09-13T07:44:16.471645 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78075], State: [ok], Delivered in [0.00743843] seconds [----] I, [2016-09-13T07:44:18.454006 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:18.671452 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78074], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.722933031] seconds [----] I, [2016-09-13T07:44:18.671707 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78074], Delivering... [----] I, [2016-09-13T07:44:18.677235 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78074], State: [ok], Delivered in [0.005525113] seconds [----] I, [2016-09-13T07:44:18.759470 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:18.759645 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:19.261604 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:19.559826 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:19.560022 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:20.048286 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:20.357385 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:20.357597 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:20.813887 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:21.096396 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:21.096603 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:21.582762 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:21.884934 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:21.885099 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:22.353040 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:22.644556 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:22.644722 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:23.116378 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:23.456580 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:23.456858 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:23.922994 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:24.213458 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:24.213667 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:24.674057 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:24.974841 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:24.975027 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:25.449649 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:25.762644 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:25.762876 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:26.242785 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:26.552562 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:26.552724 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:27.056569 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:27.225364 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:27.363496 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:27.509566 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:27.644209 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:27.775069 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:27.912835 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:28.049582 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:28.179835 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:28.317360 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:28.452396 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:28.588182 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:28.727349 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:28.862986 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:28.999284 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:29.321972 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:29.460353 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:29.599410 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:29.740573 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:29.881018 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:29.973899 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:44:29.991365 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78076], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:44:30.025509 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:30.164778 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:30.308266 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:30.445305 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:30.589049 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:30.729775 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:30.864961 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:31.010446 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:31.153186 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:31.291352 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:31.427615 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:31.567004 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:31.948502 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:32.110863 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:32.272380 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:32.320218 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:44:32.330657 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038254261016845703, :worker_monitor=>1.3111987113952637, :worker_dequeue=>0.018533945083618164, :total_time=>1.3339295387268066} [----] I, [2016-09-13T07:44:32.409858 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:32.543326 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78076], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.562931436] seconds [----] I, [2016-09-13T07:44:32.543592 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78076], Delivering... [----] I, [2016-09-13T07:44:32.550055 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:32.550302 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003167867660522461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031898021697998047, :pending_vm_jobs=>0.0006964206695556641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063266754150390625} [----] I, [2016-09-13T07:44:32.550732 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78076], State: [ok], Delivered in [0.007125433] seconds [----] I, [2016-09-13T07:44:32.691104 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:32.829108 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:32.963351 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:33.109876 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:33.249847 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:33.389050 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:33.525478 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:33.669381 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:33.803904 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:33.941576 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:34.077627 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:34.212904 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:34.577565 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:34.720545 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:34.858300 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:34.993390 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:35.135232 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:35.279778 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:35.429480 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:35.568754 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:35.708618 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:35.848989 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:35.992051 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:36.130251 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:36.274214 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:36.419093 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:36.556587 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:36.716549 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:36.853894 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:37.331388 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:44:37 UTC]... [----] I, [2016-09-13T07:44:37.349081 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:37.377143 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:44:37 UTC]...Complete [----] I, [2016-09-13T07:44:37.511766 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:37.649696 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:37.791683 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:37.938508 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:38.080113 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:38.221010 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:38.358585 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:38.499071 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:38.637725 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:38.781873 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:38.919308 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:39.055574 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:39.194787 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:39.345217 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:39.483643 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:39.658193 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:40.074017 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:40.220942 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:40.359983 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:40.498369 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:40.635646 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:40.809448 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:40.950551 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:41.091920 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:41.230559 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:41.364621 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:41.503530 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:41.645116 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:41.779456 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:41.918456 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:42.066271 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:42.211780 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:42.349124 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:42.885475 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:43.039053 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:43.176132 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:43.317887 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:43.456597 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:43.589876 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:43.728161 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:43.865518 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:44.007920 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:44.152238 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:44.290486 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:44.433092 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:44.574906 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:44.709214 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:44.844369 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:44.979623 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:45.004011 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:44:45.017153 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78077], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:44:45.028567 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78078], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:44:45.041126 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78079], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:44:45.068710 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78080], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:44:45.122521 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:45.470768 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:45.619310 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:45.754717 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:49.098712 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:44:49.105841 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003918647766113281, :worker_monitor=>1.678321123123169, :worker_dequeue=>0.012863636016845703, :total_time=>1.6954703330993652} [----] I, [2016-09-13T07:44:49.714756 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78078], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.693761274] seconds [----] I, [2016-09-13T07:44:49.714971 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78078], Delivering... [----] I, [2016-09-13T07:44:49.737451 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78080], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.687671126] seconds [----] I, [2016-09-13T07:44:49.737636 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78080], Delivering... [----] I, [2016-09-13T07:44:49.743453 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002949953079223633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002971172332763672, :pending_vm_jobs=>0.0007424354553222656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0054242610931396484} [----] I, [2016-09-13T07:44:49.743785 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78080], State: [ok], Delivered in [0.006150424] seconds [----] I, [2016-09-13T07:44:49.765848 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78078], State: [ok], Delivered in [0.050831796] seconds [----] I, [2016-09-13T07:44:51.732027 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78077], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.723510515] seconds [----] I, [2016-09-13T07:44:51.732297 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78077], Delivering... [----] I, [2016-09-13T07:44:51.738226 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78077], State: [ok], Delivered in [0.005942917] seconds [----] I, [2016-09-13T07:44:51.760500 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78079], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.726989962] seconds [----] I, [2016-09-13T07:44:51.760676 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78079], Delivering... [----] I, [2016-09-13T07:44:51.764000 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78079], State: [ok], Delivered in [0.003319224] seconds [----] I, [2016-09-13T07:44:51.904565 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:52.044878 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:52.184018 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:52.321544 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:52.466786 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:52.605703 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:52.747487 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:52.882980 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:53.223217 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:53.357182 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:53.494491 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:53.634316 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:53.773886 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:53.912308 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:54.243253 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:54.400305 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:54.549708 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:54.694367 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:54.827155 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:54.963658 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:55.332597 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:55.478076 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:55.620405 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:55.768598 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:55.909817 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:56.055447 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:56.203824 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:56.358632 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:56.495536 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:56.632373 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:56.768087 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:57.268592 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:57.424329 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:57.563966 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:57.695164 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:57.839883 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:57.979253 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:58.149438 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:58.291260 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:58.436530 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:58.580086 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:58.746082 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:58.885979 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:59.030233 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:59.168212 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:59.313096 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:59.456520 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:44:59.600270 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:00.059111 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:00.079882 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:45:00.098755 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78081], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:45:00.226646 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:00.370961 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:00.519124 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:00.665874 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:00.807051 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:00.944909 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:01.087736 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:01.226709 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:01.365339 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:01.498684 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:01.646736 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:01.784683 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:01.924223 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:02.059686 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:02.197364 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:02.338533 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:02.653482 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:02.815878 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:05.683163 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:45:05.689499 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003842592239379883, :worker_monitor=>1.533743143081665, :worker_dequeue=>0.011134147644042969, :total_time=>1.549043893814087} [----] I, [2016-09-13T07:45:05.849924 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78081], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.761501757] seconds [----] I, [2016-09-13T07:45:05.850107 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78081], Delivering... [----] I, [2016-09-13T07:45:05.856106 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032236576080322266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032415390014648438, :pending_vm_jobs=>0.00070953369140625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0056726932525634766} [----] I, [2016-09-13T07:45:05.856471 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78081], State: [ok], Delivered in [0.006339165] seconds [----] I, [2016-09-13T07:45:08.965534 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:09.107894 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:09.251128 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:09.391757 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:09.528592 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:09.669298 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:09.815040 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:09.970766 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:10.120019 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:10.275228 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:10.422492 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:10.563591 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:10.690107 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:45:10 UTC]... [----] I, [2016-09-13T07:45:10.708935 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:10.740267 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:45:10 UTC]...Complete [----] I, [2016-09-13T07:45:10.851194 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:10.993976 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:11.352931 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:11.509757 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:11.669842 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:11.808688 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:11.951830 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:12.092636 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:12.233959 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:12.369894 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:12.512867 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:12.658168 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:12.798550 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:12.939177 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:13.078766 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:13.220760 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:13.363293 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:13.508638 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:13.678486 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:15.109525 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:45:15.124676 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78082], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:45:15.134939 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78083], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:45:15.250502 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:15.406960 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:15.549886 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:15.689125 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:15.767910 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:45:15.828122 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:15.837329 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78083], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.707493371] seconds [----] I, [2016-09-13T07:45:15.837530 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78083], Delivering... [----] I, [2016-09-13T07:45:15.843992 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003273487091064453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033111572265625, :pending_vm_jobs=>0.0008206367492675781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006095170974731445} [----] I, [2016-09-13T07:45:15.844331 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78083], State: [ok], Delivered in [0.006805334] seconds [----] I, [2016-09-13T07:45:15.878009 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78082], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.763669018] seconds [----] I, [2016-09-13T07:45:15.878197 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78082], Delivering... [----] I, [2016-09-13T07:45:15.882542 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78082], State: [ok], Delivered in [0.004351281] seconds [----] I, [2016-09-13T07:45:15.972786 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:16.106036 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:16.239998 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:16.383638 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:16.519949 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:16.659051 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:16.795724 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:16.939508 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:17.078330 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:17.216665 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:17.358749 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:45:17.496941 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T07:45:17.700960 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T07:45:17.701333 #10859:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T07:45:17.701682 #10859:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T07:45:17.701819 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T07:45:17.701971 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T07:45:17.730146 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T07:45:17.730740 #10859:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [78070], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T07:45:17.731053 #10859:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T07:45:17.731302 #10859:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T07:45:17.731572 #10859:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78070], State: [error], Delivered in [67.55295016] seconds [----] I, [2016-09-13T07:45:22.086580 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003991127014160156, :worker_monitor=>1.3005902767181396, :worker_dequeue=>0.007201194763183594, :total_time=>1.3120806217193604} [----] I, [2016-09-13T07:45:30.489782 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:45:30.546574 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78084], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:45:32.213658 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:45:33.061098 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78084], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.529815243] seconds [----] I, [2016-09-13T07:45:33.061275 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78084], Delivering... [----] I, [2016-09-13T07:45:33.067952 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003483295440673828, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003506898880004883, :pending_vm_jobs=>0.0008654594421386719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006250619888305664} [----] I, [2016-09-13T07:45:33.068343 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78084], State: [ok], Delivered in [0.007037914] seconds [----] I, [2016-09-13T07:45:38.463102 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004233837127685547, :worker_monitor=>1.2334632873535156, :worker_dequeue=>0.0066034793853759766, :total_time=>1.2445871829986572} [----] I, [2016-09-13T07:45:43.463674 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:45:43 UTC]... [----] I, [2016-09-13T07:45:43.483658 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:45:43 UTC]...Complete [----] I, [2016-09-13T07:45:45.558915 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:45:45.569587 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78085], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:45:45.580960 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78086], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:45:45.592273 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78087], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:45:45.609572 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78088], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:45:48.521395 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:45:48.981255 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78086], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.407919831] seconds [----] I, [2016-09-13T07:45:48.981470 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78086], Delivering... [----] I, [2016-09-13T07:45:48.986730 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78088], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.385232226] seconds [----] I, [2016-09-13T07:45:48.986934 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78088], Delivering... [----] I, [2016-09-13T07:45:48.993203 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034637451171875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034818649291992188, :pending_vm_jobs=>0.0007722377777099609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005906820297241211} [----] I, [2016-09-13T07:45:48.993603 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78088], State: [ok], Delivered in [0.00667867] seconds [----] I, [2016-09-13T07:45:49.020972 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78085], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.457427158] seconds [----] I, [2016-09-13T07:45:49.021136 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78085], Delivering... [----] I, [2016-09-13T07:45:49.024678 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78085], State: [ok], Delivered in [0.003549865] seconds [----] I, [2016-09-13T07:45:49.043958 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78086], State: [ok], Delivered in [0.062481179] seconds [----] I, [2016-09-13T07:45:49.049639 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78087], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.463405337] seconds [----] I, [2016-09-13T07:45:49.049787 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78087], Delivering... [----] I, [2016-09-13T07:45:49.052342 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78087], State: [ok], Delivered in [0.002552275] seconds [----] I, [2016-09-13T07:45:55.160606 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004659414291381836, :worker_monitor=>1.6162846088409424, :worker_dequeue=>0.011132955551147461, :total_time=>1.6324284076690674} [----] I, [2016-09-13T07:46:00.622137 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:46:00.644252 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78089], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:46:05.188270 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:46:05.261334 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78089], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.631962393] seconds [----] I, [2016-09-13T07:46:05.261578 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78089], Delivering... [----] I, [2016-09-13T07:46:05.268078 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032804012298583984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003299713134765625, :pending_vm_jobs=>0.00086212158203125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006062507629394531} [----] I, [2016-09-13T07:46:05.268411 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78089], State: [ok], Delivered in [0.006841029] seconds [----] I, [2016-09-13T07:46:11.518391 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0044765472412109375, :worker_monitor=>1.3089234828948975, :worker_dequeue=>0.00913381576538086, :total_time=>1.3228271007537842} [----] I, [2016-09-13T07:46:15.661084 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:46:15.676966 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78090], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:46:15.688370 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78091], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:46:16.518991 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:46:16 UTC]... [----] I, [2016-09-13T07:46:16.539721 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:46:16 UTC]...Complete [----] I, [2016-09-13T07:46:16.550867 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:46:17.403190 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78091], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.720959651] seconds [----] I, [2016-09-13T07:46:17.403370 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78091], Delivering... [----] I, [2016-09-13T07:46:17.409998 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003519296646118164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003539562225341797, :pending_vm_jobs=>0.0007898807525634766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006262302398681641} [----] I, [2016-09-13T07:46:17.410351 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78091], State: [ok], Delivered in [0.006968603] seconds [----] I, [2016-09-13T07:46:19.186072 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78090], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.520015923] seconds [----] I, [2016-09-13T07:46:19.186325 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78090], Delivering... [----] I, [2016-09-13T07:46:19.192166 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78090], State: [ok], Delivered in [0.005835609] seconds [----] I, [2016-09-13T07:46:27.995118 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004692792892456055, :worker_monitor=>1.4075183868408203, :worker_dequeue=>0.007490634918212891, :total_time=>1.4199965000152588} [----] I, [2016-09-13T07:46:30.699773 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:46:30.717311 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78092], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:46:33.105710 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:46:33.477375 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78092], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.770182897] seconds [----] I, [2016-09-13T07:46:33.477586 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78092], Delivering... [----] I, [2016-09-13T07:46:33.483347 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002922534942626953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029535293579101562, :pending_vm_jobs=>0.0007264614105224609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0053920745849609375} [----] I, [2016-09-13T07:46:33.483710 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78092], State: [ok], Delivered in [0.006126539] seconds [----] I, [2016-09-13T07:46:44.522979 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038454532623291016, :worker_monitor=>1.377511978149414, :worker_dequeue=>0.01232767105102539, :total_time=>1.3939948081970215} [----] I, [2016-09-13T07:46:45.730119 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:46:45.742079 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78093], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:46:45.759680 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78094], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:46:45.782361 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78095], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:46:45.799320 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78096], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:46:49.523674 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:46:49 UTC]... [----] I, [2016-09-13T07:46:49.542352 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:46:49 UTC]...Complete [----] I, [2016-09-13T07:46:49.554260 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:46:49.611052 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78093], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.87646831] seconds [----] I, [2016-09-13T07:46:49.611261 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78093], Delivering... [----] I, [2016-09-13T07:46:49.641059 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78096], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.850647435] seconds [----] I, [2016-09-13T07:46:49.641283 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78096], Delivering... [----] I, [2016-09-13T07:46:49.647847 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033593177795410156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033800601959228516, :pending_vm_jobs=>0.0008344650268554688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006093502044677734} [----] I, [2016-09-13T07:46:49.648266 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78096], State: [ok], Delivered in [0.006989802] seconds [----] I, [2016-09-13T07:46:49.662273 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78093], State: [ok], Delivered in [0.05099076] seconds [----] I, [2016-09-13T07:46:52.314276 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78094], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.56680977] seconds [----] I, [2016-09-13T07:46:52.314609 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78094], Delivering... [----] I, [2016-09-13T07:46:52.319236 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78094], State: [ok], Delivered in [0.00464397] seconds [----] I, [2016-09-13T07:46:52.325050 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78095], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.553051909] seconds [----] I, [2016-09-13T07:46:52.325320 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78095], Delivering... [----] I, [2016-09-13T07:46:52.330546 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78095], State: [ok], Delivered in [0.005212134] seconds [----] I, [2016-09-13T07:47:00.761147 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0052258968353271484, :worker_monitor=>1.1657278537750244, :worker_dequeue=>0.011022806167602539, :total_time=>1.182337760925293} [----] I, [2016-09-13T07:47:00.809781 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:47:00.827465 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78097], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:47:05.771143 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:47:06.787789 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78097], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.974084784] seconds [----] I, [2016-09-13T07:47:06.788002 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78097], Delivering... [----] I, [2016-09-13T07:47:06.794349 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032198429107666016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032396316528320312, :pending_vm_jobs=>0.0008640289306640625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059909820556640625} [----] I, [2016-09-13T07:47:06.794741 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78097], State: [ok], Delivered in [0.006735714] seconds [----] I, [2016-09-13T07:47:15.836699 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:47:15.862337 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78098], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:47:15.879131 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78099], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:47:17.181027 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:47:17.188111 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004366159439086914, :worker_monitor=>1.3749773502349854, :worker_dequeue=>0.012440919876098633, :total_time=>1.3921070098876953} [----] I, [2016-09-13T07:47:17.921185 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78099], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.052194487] seconds [----] I, [2016-09-13T07:47:17.921372 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78099], Delivering... [----] I, [2016-09-13T07:47:17.927874 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033538341522216797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034360885620117188, :pending_vm_jobs=>0.0007891654968261719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060672760009765625} [----] I, [2016-09-13T07:47:17.928200 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78099], State: [ok], Delivered in [0.006820375] seconds [----] I, [2016-09-13T07:47:19.412406 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78098], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.568808556] seconds [----] I, [2016-09-13T07:47:19.412643 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78098], Delivering... [----] I, [2016-09-13T07:47:19.418045 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78098], State: [ok], Delivered in [0.005371899] seconds [----] I, [2016-09-13T07:47:22.188661 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:47:22 UTC]... [----] I, [2016-09-13T07:47:22.212292 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:47:22 UTC]...Complete [----] I, [2016-09-13T07:47:30.891852 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:47:30.909595 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78100], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:47:33.688840 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:47:33.695377 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004587888717651367, :worker_monitor=>1.434575080871582, :worker_dequeue=>0.011623620986938477, :total_time=>1.4511358737945557} [----] I, [2016-09-13T07:47:33.972654 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78100], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.074179737] seconds [----] I, [2016-09-13T07:47:33.972866 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78100], Delivering... [----] I, [2016-09-13T07:47:33.979114 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003376007080078125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033974647521972656, :pending_vm_jobs=>0.0007622241973876953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005910634994506836} [----] I, [2016-09-13T07:47:33.979480 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78100], State: [ok], Delivered in [0.006581061] seconds [----] I, [2016-09-13T07:47:45.921700 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:47:45.938677 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78101], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:47:45.949746 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78102], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:47:45.966859 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78103], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:47:45.978148 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78104], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:47:50.287287 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:47:50.292194 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004403591156005859, :worker_monitor=>1.4426569938659668, :worker_dequeue=>0.008842706680297852, :total_time=>1.4562015533447266} [----] I, [2016-09-13T07:47:51.166383 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78101], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.239981648] seconds [----] I, [2016-09-13T07:47:51.166652 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78101], Delivering... [----] I, [2016-09-13T07:47:51.231395 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78104], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.258955571] seconds [----] I, [2016-09-13T07:47:51.231654 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78104], Delivering... [----] I, [2016-09-13T07:47:51.238868 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037178993225097656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037391185760498047, :pending_vm_jobs=>0.0009329319000244141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006752490997314453} [----] I, [2016-09-13T07:47:51.239269 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78104], State: [ok], Delivered in [0.007616884] seconds [----] I, [2016-09-13T07:47:51.245320 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78101], State: [ok], Delivered in [0.078640937] seconds [----] I, [2016-09-13T07:47:52.572010 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78102], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.627608106] seconds [----] I, [2016-09-13T07:47:52.572220 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78102], Delivering... [----] I, [2016-09-13T07:47:52.575594 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78102], State: [ok], Delivered in [0.00337664] seconds [----] I, [2016-09-13T07:47:52.579804 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78103], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.621985627] seconds [----] I, [2016-09-13T07:47:52.580012 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78103], Delivering... [----] I, [2016-09-13T07:47:52.585408 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78103], State: [ok], Delivered in [0.005382705] seconds [----] I, [2016-09-13T07:47:55.295000 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:47:55 UTC]... [----] I, [2016-09-13T07:47:55.310753 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:47:55 UTC]...Complete [----] I, [2016-09-13T07:48:00.991362 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:48:01.007954 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78105], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:48:06.690360 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:48:06.696858 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.008316516876220703, :worker_monitor=>1.3302183151245117, :worker_dequeue=>0.011672258377075195, :total_time=>1.3504772186279297} [----] I, [2016-09-13T07:48:07.402272 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78105], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.404357201] seconds [----] I, [2016-09-13T07:48:07.402565 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78105], Delivering... [----] I, [2016-09-13T07:48:07.408625 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030841827392578125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003106355667114258, :pending_vm_jobs=>0.0007719993591308594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005593299865722656} [----] I, [2016-09-13T07:48:07.408988 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78105], State: [ok], Delivered in [0.006441237] seconds [----] I, [2016-09-13T07:48:16.020863 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:48:16.030850 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78106], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:48:16.042230 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78107], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:48:16.726310 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:48:17.459604 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78107], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.423593005] seconds [----] I, [2016-09-13T07:48:17.459762 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78107], Delivering... [----] I, [2016-09-13T07:48:17.465366 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028514862060546875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028688907623291016, :pending_vm_jobs=>0.0007157325744628906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005269527435302734} [----] I, [2016-09-13T07:48:17.465711 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78107], State: [ok], Delivered in [0.00594628] seconds [----] I, [2016-09-13T07:48:19.659633 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78106], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.634338887] seconds [----] I, [2016-09-13T07:48:19.659804 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78106], Delivering... [----] I, [2016-09-13T07:48:19.664031 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78106], State: [ok], Delivered in [0.004231552] seconds [----] I, [2016-09-13T07:48:23.034674 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004117250442504883, :worker_monitor=>1.2861154079437256, :worker_dequeue=>0.011010885238647461, :total_time=>1.30155611038208} [----] I, [2016-09-13T07:48:28.035121 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:48:28 UTC]... [----] I, [2016-09-13T07:48:28.053656 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:48:28 UTC]...Complete [----] I, [2016-09-13T07:48:31.054724 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:48:31.071182 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78108], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:48:31.082554 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78109], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:48:31.094128 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78110], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:48:33.078921 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:48:33.614527 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78108], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.554150609] seconds [----] I, [2016-09-13T07:48:33.614771 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78108], Delivering... [----] I, [2016-09-13T07:48:33.616192 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T07:48:33.616491 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5353799680 [----] I, [2016-09-13T07:48:33.616622 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5129326592 [----] I, [2016-09-13T07:48:33.616735 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 224473088 [----] I, [2016-09-13T07:48:33.616852 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T07:48:33.616956 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5075320832 [----] I, [2016-09-13T07:48:33.617056 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T07:48:33.617157 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T07:48:33.617273 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 545820672 [----] I, [2016-09-13T07:48:33.617391 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T07:48:33.617519 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7967436800 [----] I, [2016-09-13T07:48:33.617613 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T07:48:33.617721 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T07:48:33.617816 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T07:48:33.617890 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 126976 [----] I, [2016-09-13T07:48:33.617957 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T07:48:33.618017 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T07:48:33.618082 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T07:48:33.618144 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T07:48:33.618210 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T07:48:33.618272 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T07:48:33.618337 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273563648 [----] I, [2016-09-13T07:48:33.618402 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56803328 [----] I, [2016-09-13T07:48:33.618517 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216760320 [----] I, [2016-09-13T07:48:33.618589 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6160384 [----] I, [2016-09-13T07:48:33.618657 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140771328 [----] I, [2016-09-13T07:48:33.618724 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2591870976 [----] I, [2016-09-13T07:48:33.618810 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2272464896 [----] I, [2016-09-13T07:48:33.618921 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T07:48:33.618991 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T07:48:33.619056 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T07:48:33.619119 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37126144 [----] I, [2016-09-13T07:48:33.619189 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102305792 [----] I, [2016-09-13T07:48:33.619250 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53207040 [----] I, [2016-09-13T07:48:33.619312 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110809088 [----] I, [2016-09-13T07:48:33.619384 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155512832 [----] I, [2016-09-13T07:48:33.619501 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T07:48:33.619583 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T07:48:33.619648 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T07:48:33.619709 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T07:48:33.619772 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T07:48:33.619862 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T07:48:33.619929 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T07:48:33.619956 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78109], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.544691238] seconds [----] I, [2016-09-13T07:48:33.619992 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T07:48:33.620052 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T07:48:33.620110 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78109], Delivering... [----] I, [2016-09-13T07:48:33.627609 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:48:22 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200500000], Memory % [3.36], CPU Time [151392.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:48:33.628261 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:48:12 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347147000], Memory % [5.04], CPU Time [104195.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T07:48:33.628712 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:48:21 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48793.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T07:48:33.629197 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:48:20 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169067000], Memory % [3.14], CPU Time [51469.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:48:33.629681 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:48:16 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [239754.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T07:48:33.630193 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:48:20 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162416000], Memory % [3.1], CPU Time [37926.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T07:48:33.630674 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:48:22 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [202533.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T07:48:33.631150 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:48:22 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202018000], Memory % [3.38], CPU Time [150486.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:48:33.633992 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:48:18 UTC], Process Info: Memory Usage [605765632], Memory Size [1030008832], Proportional Set Size: [438517000], Memory % [7.38], CPU Time [289.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:48:33.636021 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:48:13 UTC], Process Info: Memory Usage [591667200], Memory Size [920395776], Proportional Set Size: [426614000], Memory % [7.21], CPU Time [913.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:48:33.638196 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:48:18 UTC], Process Info: Memory Usage [557957120], Memory Size [909623296], Proportional Set Size: [405484000], Memory % [6.8], CPU Time [5567.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T07:48:33.640241 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:48:20 UTC], Process Info: Memory Usage [580206592], Memory Size [923090944], Proportional Set Size: [419825000], Memory % [7.07], CPU Time [2127.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T07:48:33.640781 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:48:22 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [209703.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T07:48:33.641267 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:48:21 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51479.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:48:33.641722 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:48:16 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165801000], Memory % [3.16], CPU Time [38826.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T07:48:33.642076 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78109], State: [ok], Delivered in [0.02196626] seconds [----] I, [2016-09-13T07:48:33.655496 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T07:48:33.655682 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T07:48:33.659044 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T07:48:33.661485 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T07:48:33.664348 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T07:48:33.665537 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78110], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.576964722] seconds [----] I, [2016-09-13T07:48:33.665696 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78110], Delivering... [----] I, [2016-09-13T07:48:33.667260 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T07:48:33.670094 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T07:48:33.671609 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003080129623413086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003103017807006836, :pending_vm_jobs=>0.0007381439208984375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055904388427734375} [----] I, [2016-09-13T07:48:33.671958 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78110], State: [ok], Delivered in [0.0062544] seconds [----] I, [2016-09-13T07:48:33.672851 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 845 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T07:48:33.675637 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T07:48:33.678516 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T07:48:33.681310 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.7 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T07:48:33.684058 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T07:48:33.686846 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T07:48:33.689584 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T07:48:33.692076 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:48:33.692211 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:48:33.692303 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T07:48:33.696461 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [202018000], Memory % [3.36], CPU Time [150477.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:48:33.696807 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78108], State: [ok], Delivered in [0.082062826] seconds [----] I, [2016-09-13T07:48:38.108169 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T07:48:39.485178 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040934085845947266, :log_active_servers=>0.01116180419921875, :worker_monitor=>1.365713119506836, :worker_dequeue=>0.010929107666015625, :total_time=>1.3922395706176758} [----] I, [2016-09-13T07:48:46.106583 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:48:46.122832 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78111], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:48:46.140177 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78112], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:48:46.157055 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78113], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:48:46.179130 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78114], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:48:49.604501 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:48:49.768892 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78111], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.657454945] seconds [----] I, [2016-09-13T07:48:49.769124 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78111], Delivering... [----] I, [2016-09-13T07:48:49.774391 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78114], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.611963982] seconds [----] I, [2016-09-13T07:48:49.774626 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78114], Delivering... [----] I, [2016-09-13T07:48:49.781006 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003266572952270508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032842159271240234, :pending_vm_jobs=>0.0008478164672851562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059773921966552734} [----] I, [2016-09-13T07:48:49.781338 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78114], State: [ok], Delivered in [0.006714859] seconds [----] I, [2016-09-13T07:48:49.808603 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78112], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.680195046] seconds [----] I, [2016-09-13T07:48:49.808775 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78112], Delivering... [----] I, [2016-09-13T07:48:49.811544 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78112], State: [ok], Delivered in [0.002754584] seconds [----] I, [2016-09-13T07:48:49.847501 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78111], State: [ok], Delivered in [0.078300817] seconds [----] I, [2016-09-13T07:48:49.852726 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78113], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.702744934] seconds [----] I, [2016-09-13T07:48:49.852920 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78113], Delivering... [----] I, [2016-09-13T07:48:49.857544 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78113], State: [ok], Delivered in [0.004616132] seconds [----] I, [2016-09-13T07:48:55.923922 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004446983337402344, :worker_monitor=>1.2962415218353271, :worker_dequeue=>0.010999202728271484, :total_time=>1.3120598793029785} [----] I, [2016-09-13T07:49:00.924390 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:49:00 UTC]... [----] I, [2016-09-13T07:49:00.947074 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:49:00 UTC]...Complete [----] I, [2016-09-13T07:49:01.192355 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:49:01.207147 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78115], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:49:05.971712 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:49:06.922909 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78115], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.72486051] seconds [----] I, [2016-09-13T07:49:06.923101 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78115], Delivering... [----] I, [2016-09-13T07:49:06.929122 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003093242645263672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031118392944335938, :pending_vm_jobs=>0.0007543563842773438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005647182464599609} [----] I, [2016-09-13T07:49:06.929443 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78115], State: [ok], Delivered in [0.006318447] seconds [----] I, [2016-09-13T07:49:12.201994 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003950834274291992, :worker_monitor=>1.2060766220092773, :worker_dequeue=>0.013165712356567383, :total_time=>1.2235708236694336} [----] I, [2016-09-13T07:49:16.219563 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 11. [----] I, [2016-09-13T07:49:16.264970 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78116], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:49:16.287313 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78117], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:49:16.310847 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78118], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:49:17.211568 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:49:17.979276 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78118], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.686223052] seconds [----] I, [2016-09-13T07:49:17.979596 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78118], Delivering... [----] I, [2016-09-13T07:49:17.989971 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005461215972900391, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00549769401550293, :pending_vm_jobs=>0.0012989044189453125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0096893310546875} [----] I, [2016-09-13T07:49:17.990505 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78118], State: [ok], Delivered in [0.010880206] seconds [----] I, [2016-09-13T07:49:19.944388 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78116], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.708720199] seconds [----] I, [2016-09-13T07:49:19.944592 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78116], Delivering... [----] I, [2016-09-13T07:49:19.950403 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78117], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.677976944] seconds [----] I, [2016-09-13T07:49:19.950660 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78117], Delivering... [----] I, [2016-09-13T07:49:19.957011 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78117], State: [ok], Delivered in [0.006345969] seconds [----] I, [2016-09-13T07:49:19.973223 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78119], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T07:49:19.990327 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78120], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T07:49:19.990709 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78116], State: [ok], Delivered in [0.046099921] seconds [----] I, [2016-09-13T07:49:22.230734 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T07:49:22.233113 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T07:49:23.193113 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [78119], MiqWorker id: [99], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [3.227384765] seconds [----] I, [2016-09-13T07:49:23.193376 #5369:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78119], Delivering... [----] I, [2016-09-13T07:49:23.198019 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T07:49:23.198220 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T07:49:23.198372 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T07:49:23.198602 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T07:49:23.198826 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:23.485225 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:23.686097 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:23.686318 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:24.023263 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:24.116680 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:24.207143 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:24.508033 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:24.611598 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:24.705392 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:24.798734 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:24.890927 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:24.982839 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:25.074655 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:25.168462 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:25.262971 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:25.355627 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:25.450072 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:25.543509 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:25.636575 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:25.730477 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:25.824749 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:25.922089 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:26.016636 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T07:49:26.246876 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T07:49:26.247220 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004004240036010742, :collect_inventory_for_targets=>5.435943603515625e-05, :parse_legacy_inventory=>25.20115637779236, :parse_targeted_inventory=>25.201363563537598, :save_inventory=>1.285478115081787, :ems_refresh=>26.490490913391113} [----] I, [2016-09-13T07:49:26.270003 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T07:49:26.270445 #5369:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78119], State: [ok], Delivered in [3.077047964] seconds [----] I, [2016-09-13T07:49:28.148522 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [78120], MiqWorker id: [100], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [8.169533397] seconds [----] I, [2016-09-13T07:49:28.148769 #10859:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78120], Delivering... [----] I, [2016-09-13T07:49:28.152585 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T07:49:28.152755 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T07:49:28.152918 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T07:49:28.153104 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T07:49:28.153267 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:28.551708 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038604736328125, :worker_monitor=>1.3047139644622803, :worker_dequeue=>0.009255409240722656, :total_time=>1.3181490898132324} [----] I, [2016-09-13T07:49:28.601997 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:28.894810 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:28.895007 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:29.374734 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:29.677845 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:29.678025 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:30.167212 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:30.471816 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:30.471991 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:30.985191 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:31.282489 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:31.282676 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:31.322412 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:49:31.336349 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78121], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:49:31.347711 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78122], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:49:31.751945 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:32.046450 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:32.046611 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:32.577563 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:33.552352 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:49:33 UTC]... [----] I, [2016-09-13T07:49:33.570936 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:49:33 UTC]...Complete [----] I, [2016-09-13T07:49:33.582987 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:49:34.119549 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78122], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.77821916] seconds [----] I, [2016-09-13T07:49:34.119738 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78122], Delivering... [----] I, [2016-09-13T07:49:34.126038 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032536983489990234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032720565795898438, :pending_vm_jobs=>0.0008065700531005859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005921840667724609} [----] I, [2016-09-13T07:49:34.126360 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78122], State: [ok], Delivered in [0.006616343] seconds [----] I, [2016-09-13T07:49:35.016746 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78121], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.689897851] seconds [----] I, [2016-09-13T07:49:35.016940 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78121], Delivering... [----] I, [2016-09-13T07:49:35.093383 #2937:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 11:49:33 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_16' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 11:49:33.588399') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2927,,2016-09-13 11:49:32 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2936,,2016-09-13 11:49:32 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3, 2946,2016-09-13 11:49:35 UTC,2016-09-13 11:49:35 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 11:49:34 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 11:49:34 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 11:49:33 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2986,,2016-09-13 11:49:33 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2997,,2016-09-13 11:49:31 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 11:49:16.317384')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3, 3011,,2016-09-13 11:24:51 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1483, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,509530, 3030,,2016-09-13 11:24:47 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1487, 3054,,2016-09-13 11:24:43 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1491, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,509528, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,509527, 3160,,2016-09-13 10:54:45 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3289, 10867,,2016-09-13 11:49:28 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,6, 703,,2016-09-13 11:24:47 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1487, 27056,,2016-09-13 10:54:42 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3292, 28888,,2016-09-13 10:24:31 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5103, 5377,,2016-09-13 11:49:26 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,8, 20394,,2016-09-13 11:24:49 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1485, ACTIVITY_STATS_CSV [----] I, [2016-09-13T07:49:35.093818 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78121], State: [ok], Delivered in [0.076840986] seconds [----] I, [2016-09-13T07:49:38.911925 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:38.912133 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:39.383332 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:39.685463 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:39.685628 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:40.164027 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:40.482212 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:40.482387 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:41.001860 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:41.301707 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:41.301883 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:41.762005 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:42.073165 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:42.073406 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:42.570671 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:42.871868 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:42.872057 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:43.340881 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:43.651992 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:43.652239 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:44.148405 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:44.443619 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:44.443830 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:44.885924 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:44.938861 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004241943359375, :worker_monitor=>1.3134334087371826, :worker_dequeue=>0.013244152069091797, :total_time=>1.3312501907348633} [----] I, [2016-09-13T07:49:45.060159 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:45.192501 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:45.329231 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:45.472567 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:45.604501 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:45.747395 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:45.881663 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:46.014149 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:46.147122 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:46.286552 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:46.359080 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:49:46.379348 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78123], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:49:46.393843 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78124], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:49:46.411045 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78125], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:49:46.422811 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:46.424310 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78126], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:49:46.561856 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:46.697024 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:46.832005 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:47.299456 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:47.448954 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:47.598954 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:47.738591 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:47.881098 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:48.017585 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:48.162780 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:48.302536 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:48.438532 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:48.583529 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:48.728087 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:48.867080 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:49.008226 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:49.148265 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:49.293024 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:49.451209 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:49.598209 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:50.029251 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:50.126066 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:49:50.189299 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:50.229508 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78123], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.866014674] seconds [----] I, [2016-09-13T07:49:50.229718 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78123], Delivering... [----] I, [2016-09-13T07:49:50.234166 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78126], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.818157543] seconds [----] I, [2016-09-13T07:49:50.234402 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78126], Delivering... [----] I, [2016-09-13T07:49:50.244132 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004786252975463867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004837512969970703, :pending_vm_jobs=>0.0012979507446289062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009176254272460938} [----] I, [2016-09-13T07:49:50.244714 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78126], State: [ok], Delivered in [0.010298393] seconds [----] I, [2016-09-13T07:49:50.279627 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78124], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.893062774] seconds [----] I, [2016-09-13T07:49:50.279821 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78124], Delivering... [----] I, [2016-09-13T07:49:50.282729 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78124], State: [ok], Delivered in [0.00292989] seconds [----] I, [2016-09-13T07:49:50.285394 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78123], State: [ok], Delivered in [0.055656659] seconds [----] I, [2016-09-13T07:49:50.313970 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78125], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.909497944] seconds [----] I, [2016-09-13T07:49:50.314151 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78125], Delivering... [----] I, [2016-09-13T07:49:50.318987 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78125], State: [ok], Delivered in [0.004822671] seconds [----] I, [2016-09-13T07:49:50.329364 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:50.467263 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:50.613848 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:50.751446 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:50.885526 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:51.045019 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:51.184341 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:51.322147 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:51.461694 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:51.600667 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:51.741031 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:51.881969 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:52.022278 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:52.165812 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:52.305492 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:52.715366 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:52.871256 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:53.009866 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:53.151631 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:53.292503 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:53.437581 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:53.579086 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:53.758470 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:53.898540 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:54.039289 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:54.176337 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:54.319735 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:54.457374 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:54.596036 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:54.734433 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:54.867532 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:55.009211 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:55.385193 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:55.539062 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:55.673599 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:55.812147 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:55.963842 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:56.101969 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:56.241651 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:56.373709 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:56.514722 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:56.666599 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:56.805041 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:56.941243 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:57.081161 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:57.221720 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:57.360341 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:57.498820 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:57.637747 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:58.146240 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:58.322174 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:58.464169 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:58.610502 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:58.745334 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:58.889927 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:59.034873 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:59.172922 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:59.316061 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:59.458516 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:59.597963 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:59.737261 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:49:59.871447 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:00.012045 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:00.155368 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:00.304823 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:00.446929 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:00.956485 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:01.120914 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:01.267557 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:01.413120 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:01.439163 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:50:01.486953 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78127], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:50:01.498057 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78128], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:50:01.503731 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78129], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:50:01.509384 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78130], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:50:01.520853 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78131], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:50:01.526624 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78132], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:50:01.553271 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:01.630334 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:50:01.637111 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004921436309814453, :worker_monitor=>1.465066909790039, :worker_dequeue=>0.012134313583374023, :total_time=>1.482503890991211} [----] I, [2016-09-13T07:50:01.697125 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:01.841545 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:01.985643 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:02.130100 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:02.144462 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78132], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.620958848] seconds [----] I, [2016-09-13T07:50:02.144677 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78132], Delivering... [----] I, [2016-09-13T07:50:02.151108 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033845901489257812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034062862396240234, :pending_vm_jobs=>0.0007722377777099609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006000518798828125} [----] I, [2016-09-13T07:50:02.151497 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78132], State: [ok], Delivered in [0.006835612] seconds [----] I, [2016-09-13T07:50:02.178951 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78127], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.730613762] seconds [----] I, [2016-09-13T07:50:02.179169 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78127], Delivering... [----] I, [2016-09-13T07:50:02.181771 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78127], State: [ok], Delivered in [0.002593528] seconds [----] I, [2016-09-13T07:50:02.218807 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78128], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.728701728] seconds [----] I, [2016-09-13T07:50:02.218973 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78128], Delivering... [----] I, [2016-09-13T07:50:02.227665 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78128], State: [ok], Delivered in [0.008637649] seconds [----] I, [2016-09-13T07:50:02.252841 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78129], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.752417537] seconds [----] I, [2016-09-13T07:50:02.253007 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78129], Delivering... [----] I, [2016-09-13T07:50:02.256521 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78129], State: [ok], Delivered in [0.003491054] seconds [----] I, [2016-09-13T07:50:02.273990 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:02.276843 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78130], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.771370275] seconds [----] I, [2016-09-13T07:50:02.277005 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78130], Delivering... [----] I, [2016-09-13T07:50:02.293098 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78133], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 11:50:02 UTC] [----] I, [2016-09-13T07:50:02.304303 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78134], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 11:50:02 UTC] [----] I, [2016-09-13T07:50:02.304675 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78130], State: [ok], Delivered in [0.0276528] seconds [----] I, [2016-09-13T07:50:02.327138 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78131], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.81600957] seconds [----] I, [2016-09-13T07:50:02.327294 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78131], Delivering... [----] I, [2016-09-13T07:50:02.338707 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78135], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 11:50:02 UTC] [----] I, [2016-09-13T07:50:02.349959 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78136], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 11:50:02 UTC] [----] I, [2016-09-13T07:50:02.350256 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78131], State: [ok], Delivered in [0.022951568] seconds [----] I, [2016-09-13T07:50:02.421234 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:02.559596 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:02.703986 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:02.848873 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:02.992972 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:03.129666 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:03.269153 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:03.638561 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:03.802064 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:03.943594 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:04.087084 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:04.227624 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:04.369015 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:04.512123 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:04.654602 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:04.795146 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:04.936020 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:05.077824 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:05.225205 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:05.363199 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:05.503189 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:05.645882 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:05.793804 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:05.935981 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:06.422041 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:06.580597 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:06.637898 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:50:06 UTC]... [----] I, [2016-09-13T07:50:06.658833 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:50:06 UTC]...Complete [----] I, [2016-09-13T07:50:06.673887 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:50:06.725035 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:08.379164 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78133], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 11:50:02 UTC], Dequeued in: [6.096639394] seconds [----] I, [2016-09-13T07:50:08.379317 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78133], Delivering... [----] I, [2016-09-13T07:50:08.379606 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 11:50:02 UTC]... [----] I, [2016-09-13T07:50:08.382305 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T07:50:08.384273 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 11:50:02 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T07:50:08.384574 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78133], State: [ok], Delivered in [0.005249982] seconds [----] I, [2016-09-13T07:50:08.425501 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78134], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 11:50:02 UTC], Dequeued in: [6.127719593] seconds [----] I, [2016-09-13T07:50:08.425681 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78134], Delivering... [----] I, [2016-09-13T07:50:08.426023 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 11:50:02 UTC]... [----] I, [2016-09-13T07:50:08.428551 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T07:50:08.430707 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 11:50:02 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T07:50:08.431028 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78134], State: [ok], Delivered in [0.005337869] seconds [----] I, [2016-09-13T07:50:08.459389 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78135], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 11:50:02 UTC], Dequeued in: [6.127322004] seconds [----] I, [2016-09-13T07:50:08.459578 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78135], Delivering... [----] I, [2016-09-13T07:50:08.459863 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 11:50:02 UTC]... [----] I, [2016-09-13T07:50:08.462185 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T07:50:08.476454 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78136], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 11:50:02 UTC], Dequeued in: [6.133355019] seconds [----] I, [2016-09-13T07:50:08.476614 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78136], Delivering... [----] I, [2016-09-13T07:50:08.476889 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 11:50:02 UTC]... [----] I, [2016-09-13T07:50:08.479149 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T07:50:08.535263 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 11:50:02 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T07:50:08.535634 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78135], State: [ok], Delivered in [0.076048171] seconds [----] I, [2016-09-13T07:50:08.560075 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 11:50:02 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T07:50:08.560609 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78136], State: [ok], Delivered in [0.083962535] seconds [----] I, [2016-09-13T07:50:12.880492 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:13.030167 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:13.180953 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:13.318970 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:13.460102 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:13.604155 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:13.746135 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:13.897195 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:14.037987 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:14.176074 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:14.319561 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:14.459364 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:14.599993 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:14.736721 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:15.129932 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:15.293945 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:15.433915 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:15.577016 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:15.714085 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:15.853713 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:15.992880 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:16.140204 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:16.278892 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:16.423285 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:16.535105 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:50:16.564627 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:16.571750 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78137], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:50:16.589225 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78138], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:50:16.734436 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:16.876846 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:17.022382 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:17.162328 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:17.305542 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:17.450336 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:17.945613 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:18.069081 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:50:18.075632 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039768218994140625, :worker_monitor=>1.3586323261260986, :worker_dequeue=>0.011954069137573242, :total_time=>1.3748948574066162} [----] I, [2016-09-13T07:50:18.094319 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:18.235992 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:18.375364 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:18.485848 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78138], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.908488549] seconds [----] I, [2016-09-13T07:50:18.485993 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78138], Delivering... [----] I, [2016-09-13T07:50:18.491329 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027875900268554688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028061866760253906, :pending_vm_jobs=>0.00067138671875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005043506622314453} [----] I, [2016-09-13T07:50:18.491634 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78138], State: [ok], Delivered in [0.005634382] seconds [----] I, [2016-09-13T07:50:18.516893 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:18.664298 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:18.806649 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:18.945579 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:19.090801 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:19.232965 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:19.377231 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:19.519236 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:20.088652 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:20.225914 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:20.364050 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:20.498688 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:20.636733 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:20.663056 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78137], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.123528786] seconds [----] I, [2016-09-13T07:50:20.663233 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78137], Delivering... [----] I, [2016-09-13T07:50:20.667539 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78137], State: [ok], Delivered in [0.004297599] seconds [----] I, [2016-09-13T07:50:21.011659 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:21.160085 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:21.303626 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:21.448777 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:21.590060 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:21.725492 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:21.871459 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:22.014833 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:22.150528 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:22.293980 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:22.439198 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:22.581865 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:22.722349 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:22.861612 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:23.000338 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:23.144739 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:23.289668 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:23.727132 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:29.921754 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:30.059070 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:30.196675 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:30.335909 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:30.474805 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:30.611974 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:30.751302 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:30.891954 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:31.032243 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:31.176840 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:31.317349 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:31.458034 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:31.599867 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:31.600708 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:50:31.617249 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78139], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:50:31.739249 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:31.878576 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:32.015008 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:32.455059 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:32.611122 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:32.752366 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:32.893397 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:33.031092 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:33.167643 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:33.309192 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:33.451160 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:33.599495 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:33.739656 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:33.875337 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:34.013254 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:34.146438 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:34.282841 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:34.320094 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:50:34.326687 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003912925720214844, :worker_monitor=>1.2026853561401367, :worker_dequeue=>0.011632204055786133, :total_time=>1.2185239791870117} [----] I, [2016-09-13T07:50:34.424687 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:34.562896 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T07:50:34.571754 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78139], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.965392876] seconds [----] I, [2016-09-13T07:50:34.571964 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78139], Delivering... [----] I, [2016-09-13T07:50:34.578169 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003215789794921875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003236055374145508, :pending_vm_jobs=>0.0007843971252441406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005819082260131836} [----] I, [2016-09-13T07:50:34.578571 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78139], State: [ok], Delivered in [0.00660536] seconds [----] I, [2016-09-13T07:50:34.703393 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T07:50:34.896163 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T07:50:34.896647 #10859:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T07:50:34.897032 #10859:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T07:50:34.897157 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T07:50:34.897287 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T07:50:34.931920 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T07:50:34.932461 #10859:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [78120], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T07:50:34.932780 #10859:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T07:50:34.933135 #10859:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T07:50:34.933349 #10859:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78120], State: [error], Delivered in [66.784589472] seconds [----] I, [2016-09-13T07:50:39.327145 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:50:39 UTC]... [----] I, [2016-09-13T07:50:39.365842 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:50:39 UTC]...Complete [----] I, [2016-09-13T07:50:46.630232 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:50:46.646142 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78140], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:50:46.664529 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78141], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:50:46.680303 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78142], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:50:46.691891 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78143], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:50:51.071346 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:50:51.078126 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004732608795166016, :worker_monitor=>1.6623883247375488, :worker_dequeue=>0.012100696563720703, :total_time=>1.6796278953552246} [----] I, [2016-09-13T07:50:51.726322 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78140], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.090909801] seconds [----] I, [2016-09-13T07:50:51.726553 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78140], Delivering... [----] I, [2016-09-13T07:50:51.738097 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78143], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.052174001] seconds [----] I, [2016-09-13T07:50:51.738450 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78143], Delivering... [----] I, [2016-09-13T07:50:51.749331 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005486488342285156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005679607391357422, :pending_vm_jobs=>0.0014700889587402344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010250091552734375} [----] I, [2016-09-13T07:50:51.749929 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78143], State: [ok], Delivered in [0.011502956] seconds [----] I, [2016-09-13T07:50:51.783321 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78140], State: [ok], Delivered in [0.056752224] seconds [----] I, [2016-09-13T07:50:53.749207 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78141], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.097474966] seconds [----] I, [2016-09-13T07:50:53.749443 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78141], Delivering... [----] I, [2016-09-13T07:50:53.752902 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78141], State: [ok], Delivered in [0.003477077] seconds [----] I, [2016-09-13T07:50:53.777546 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78142], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.104476635] seconds [----] I, [2016-09-13T07:50:53.777717 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78142], Delivering... [----] I, [2016-09-13T07:50:53.782546 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78142], State: [ok], Delivered in [0.004818655] seconds [----] I, [2016-09-13T07:51:01.703299 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:51:01.720500 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78144], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:51:07.532248 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:51:07.537372 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0056302547454833984, :worker_monitor=>1.3072404861450195, :worker_dequeue=>0.009166240692138672, :total_time=>1.322462797164917} [----] I, [2016-09-13T07:51:07.932654 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78144], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.223396125] seconds [----] I, [2016-09-13T07:51:07.932875 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78144], Delivering... [----] I, [2016-09-13T07:51:07.939465 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035729408264160156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00359344482421875, :pending_vm_jobs=>0.0008103847503662109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00619196891784668} [----] I, [2016-09-13T07:51:07.939822 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78144], State: [ok], Delivered in [0.006924569] seconds [----] I, [2016-09-13T07:51:12.537897 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:51:12 UTC]... [----] I, [2016-09-13T07:51:12.560402 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:51:12 UTC]...Complete [----] I, [2016-09-13T07:51:16.732223 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:51:16.743353 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78145], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:51:16.754874 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78146], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:51:17.584969 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:51:17.841066 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78146], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.092218057] seconds [----] I, [2016-09-13T07:51:17.841268 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78146], Delivering... [----] I, [2016-09-13T07:51:17.848613 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034270286560058594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034461021423339844, :pending_vm_jobs=>0.0008172988891601562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006918430328369141} [----] I, [2016-09-13T07:51:17.848991 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78146], State: [ok], Delivered in [0.007725726] seconds [----] I, [2016-09-13T07:51:17.858204 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78145], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.121496167] seconds [----] I, [2016-09-13T07:51:17.858375 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78145], Delivering... [----] I, [2016-09-13T07:51:17.862887 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78145], State: [ok], Delivered in [0.004503434] seconds [----] I, [2016-09-13T07:51:24.135931 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003977298736572266, :worker_monitor=>1.5283443927764893, :worker_dequeue=>0.011059761047363281, :total_time=>1.5436749458312988} [----] I, [2016-09-13T07:51:31.766725 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:51:31.789716 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78147], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:51:34.160365 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:51:35.058966 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78147], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.285902443] seconds [----] I, [2016-09-13T07:51:35.059147 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78147], Delivering... [----] I, [2016-09-13T07:51:35.065374 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032432079315185547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003261566162109375, :pending_vm_jobs=>0.0007815361022949219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058252811431884766} [----] I, [2016-09-13T07:51:35.065752 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78147], State: [ok], Delivered in [0.006598895] seconds [----] I, [2016-09-13T07:51:40.391048 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003449678421020508, :worker_monitor=>1.2113769054412842, :worker_dequeue=>0.008802175521850586, :total_time=>1.2238726615905762} [----] I, [2016-09-13T07:51:45.391557 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:51:45 UTC]... [----] I, [2016-09-13T07:51:45.408301 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:51:45 UTC]...Complete [----] I, [2016-09-13T07:51:46.803179 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:51:46.825600 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78148], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:51:46.842859 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78149], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:51:46.865868 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78150], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:51:46.894503 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78151], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:51:50.436972 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:51:51.003055 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78148], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.196214822] seconds [----] I, [2016-09-13T07:51:51.003235 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78148], Delivering... [----] I, [2016-09-13T07:51:51.015650 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78151], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.143557281] seconds [----] I, [2016-09-13T07:51:51.015935 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78151], Delivering... [----] I, [2016-09-13T07:51:51.025244 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004892587661743164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00491642951965332, :pending_vm_jobs=>0.001107931137084961, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008805274963378906} [----] I, [2016-09-13T07:51:51.025654 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78151], State: [ok], Delivered in [0.009723998] seconds [----] I, [2016-09-13T07:51:51.065798 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78149], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.235879246] seconds [----] I, [2016-09-13T07:51:51.065965 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78149], Delivering... [----] I, [2016-09-13T07:51:51.068691 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78149], State: [ok], Delivered in [0.002716026] seconds [----] I, [2016-09-13T07:51:51.071384 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78148], State: [ok], Delivered in [0.068135065] seconds [----] I, [2016-09-13T07:51:51.094191 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78150], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.243128555] seconds [----] I, [2016-09-13T07:51:51.094349 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78150], Delivering... [----] I, [2016-09-13T07:51:51.098595 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78150], State: [ok], Delivered in [0.004237116] seconds [----] I, [2016-09-13T07:51:56.694854 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003847837448120117, :worker_monitor=>1.241002082824707, :worker_dequeue=>0.006039857864379883, :total_time=>1.2511632442474365} [----] I, [2016-09-13T07:52:01.906696 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:52:01.927906 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78152], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:52:06.832759 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:52:07.299066 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78152], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.385689491] seconds [----] I, [2016-09-13T07:52:07.299254 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78152], Delivering... [----] I, [2016-09-13T07:52:07.305242 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030663013458251953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030868053436279297, :pending_vm_jobs=>0.0007226467132568359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055925846099853516} [----] I, [2016-09-13T07:52:07.305610 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78152], State: [ok], Delivered in [0.006355133] seconds [----] I, [2016-09-13T07:52:13.234215 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040247440338134766, :worker_monitor=>1.3783941268920898, :worker_dequeue=>0.011899232864379883, :total_time=>1.394592523574829} [----] I, [2016-09-13T07:52:16.943126 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:52:16.956185 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78153], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:52:16.967639 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78154], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:52:18.234795 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:52:18 UTC]... [----] I, [2016-09-13T07:52:18.247471 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:52:18 UTC]...Complete [----] I, [2016-09-13T07:52:18.258047 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:52:18.390547 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78154], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.429139529] seconds [----] I, [2016-09-13T07:52:18.390715 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78154], Delivering... [----] I, [2016-09-13T07:52:18.396722 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031228065490722656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031404495239257812, :pending_vm_jobs=>0.000762939453125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0056421756744384766} [----] I, [2016-09-13T07:52:18.397092 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78154], State: [ok], Delivered in [0.00636672] seconds [----] I, [2016-09-13T07:52:18.528250 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78153], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.580512583] seconds [----] I, [2016-09-13T07:52:18.528567 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78153], Delivering... [----] I, [2016-09-13T07:52:18.534569 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78153], State: [ok], Delivered in [0.006007114] seconds [----] I, [2016-09-13T07:52:29.699228 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004235029220581055, :worker_monitor=>1.40391206741333, :worker_dequeue=>0.010963678359985352, :total_time=>1.419349193572998} [----] I, [2016-09-13T07:52:31.977259 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:52:31.988401 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78155], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:52:34.713231 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:52:34.914691 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78155], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.933336394] seconds [----] I, [2016-09-13T07:52:34.914944 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78155], Delivering... [----] I, [2016-09-13T07:52:34.922346 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0045468807220458984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004567384719848633, :pending_vm_jobs=>0.0007116794586181641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006966114044189453} [----] I, [2016-09-13T07:52:34.922696 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78155], State: [ok], Delivered in [0.007769473] seconds [----] I, [2016-09-13T07:52:46.028764 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041196346282958984, :worker_monitor=>1.2752101421356201, :worker_dequeue=>0.01374673843383789, :total_time=>1.293393611907959} [----] I, [2016-09-13T07:52:46.999639 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:52:47.018648 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78156], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:52:47.033827 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78157], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:52:47.051232 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78158], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:52:47.068389 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78159], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:52:51.029446 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:52:51 UTC]... [----] I, [2016-09-13T07:52:51.047372 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:52:51 UTC]...Complete [----] I, [2016-09-13T07:52:51.058646 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:52:51.093467 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78156], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.089126954] seconds [----] I, [2016-09-13T07:52:51.093674 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78156], Delivering... [----] I, [2016-09-13T07:52:51.161527 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78156], State: [ok], Delivered in [0.067817944] seconds [----] I, [2016-09-13T07:52:51.188231 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78159], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.128487174] seconds [----] I, [2016-09-13T07:52:51.188445 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78159], Delivering... [----] I, [2016-09-13T07:52:51.194867 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003231525421142578, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003252267837524414, :pending_vm_jobs=>0.0008573532104492188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006031036376953125} [----] I, [2016-09-13T07:52:51.195221 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78159], State: [ok], Delivered in [0.006803402] seconds [----] I, [2016-09-13T07:52:51.662846 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78157], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.638365444] seconds [----] I, [2016-09-13T07:52:51.663064 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78157], Delivering... [----] I, [2016-09-13T07:52:51.666741 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78157], State: [ok], Delivered in [0.003659257] seconds [----] I, [2016-09-13T07:52:51.709168 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78158], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.667097909] seconds [----] I, [2016-09-13T07:52:51.709291 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78158], Delivering... [----] I, [2016-09-13T07:52:51.712728 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78158], State: [ok], Delivered in [0.003421521] seconds [----] I, [2016-09-13T07:53:02.079320 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:53:02.091667 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78160], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:53:02.260460 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:53:02.270207 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007658243179321289, :worker_monitor=>1.1658527851104736, :worker_dequeue=>0.01521754264831543, :total_time=>1.1892199516296387} [----] I, [2016-09-13T07:53:02.280391 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78160], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.19729011] seconds [----] I, [2016-09-13T07:53:02.280572 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78160], Delivering... [----] I, [2016-09-13T07:53:02.285096 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002346038818359375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023641586303710938, :pending_vm_jobs=>0.0006506443023681641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004216432571411133} [----] I, [2016-09-13T07:53:02.285369 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78160], State: [ok], Delivered in [0.004814351] seconds [----] I, [2016-09-13T07:53:17.105365 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:53:17.149527 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78161], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:53:17.166542 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78162], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:53:18.850766 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:53:18.857743 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041315555572509766, :worker_monitor=>1.4441149234771729, :worker_dequeue=>0.012449502944946289, :total_time=>1.4610049724578857} [----] I, [2016-09-13T07:53:19.241093 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78162], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.085019489] seconds [----] I, [2016-09-13T07:53:19.241322 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78162], Delivering... [----] I, [2016-09-13T07:53:19.249509 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0040018558502197266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004029035568237305, :pending_vm_jobs=>0.0009324550628662109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007627010345458984} [----] I, [2016-09-13T07:53:19.250033 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78162], State: [ok], Delivered in [0.008677621] seconds [----] I, [2016-09-13T07:53:21.812405 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78161], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.700231212] seconds [----] I, [2016-09-13T07:53:21.812636 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78161], Delivering... [----] I, [2016-09-13T07:53:21.817849 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78161], State: [ok], Delivered in [0.005212955] seconds [----] I, [2016-09-13T07:53:23.858344 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:53:23 UTC]... [----] I, [2016-09-13T07:53:23.880797 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:53:23 UTC]...Complete [----] I, [2016-09-13T07:53:32.178505 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:53:32.223104 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78163], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:53:32.235250 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78164], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:53:32.245905 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78165], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:53:35.282014 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:53:35.288522 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0046117305755615234, :worker_monitor=>1.3521099090576172, :worker_dequeue=>0.01147150993347168, :total_time=>1.3684899806976318} [----] I, [2016-09-13T07:53:35.371732 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78163], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.188814417] seconds [----] I, [2016-09-13T07:53:35.371925 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78163], Delivering... [----] I, [2016-09-13T07:53:35.373217 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T07:53:35.373456 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5365481472 [----] I, [2016-09-13T07:53:35.373571 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5140721664 [----] I, [2016-09-13T07:53:35.373660 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 224759808 [----] I, [2016-09-13T07:53:35.373739 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T07:53:35.373844 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5086715904 [----] I, [2016-09-13T07:53:35.373928 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T07:53:35.374008 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T07:53:35.374085 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 546107392 [----] I, [2016-09-13T07:53:35.374162 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T07:53:35.374237 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8009052160 [----] I, [2016-09-13T07:53:35.374314 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T07:53:35.374390 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T07:53:35.374510 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T07:53:35.374594 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T07:53:35.374673 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T07:53:35.374752 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T07:53:35.374847 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T07:53:35.374931 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T07:53:35.375009 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T07:53:35.375085 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T07:53:35.375158 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273563648 [----] I, [2016-09-13T07:53:35.375233 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56803328 [----] I, [2016-09-13T07:53:35.375311 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216760320 [----] I, [2016-09-13T07:53:35.375386 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T07:53:35.375510 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140771328 [----] I, [2016-09-13T07:53:35.375602 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2581712896 [----] I, [2016-09-13T07:53:35.375679 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2262020096 [----] I, [2016-09-13T07:53:35.375757 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T07:53:35.375861 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T07:53:35.375941 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T07:53:35.376012 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37167104 [----] I, [2016-09-13T07:53:35.376083 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102305792 [----] I, [2016-09-13T07:53:35.376160 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53071872 [----] I, [2016-09-13T07:53:35.376233 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110809088 [----] I, [2016-09-13T07:53:35.376307 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155377664 [----] I, [2016-09-13T07:53:35.376377 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T07:53:35.376489 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T07:53:35.376575 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T07:53:35.376650 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T07:53:35.376729 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T07:53:35.376823 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T07:53:35.376912 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T07:53:35.376988 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T07:53:35.377061 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T07:53:35.412673 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T07:53:35.412913 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T07:53:35.417111 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T07:53:35.420201 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T07:53:35.424063 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T07:53:35.427957 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T07:53:35.431626 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T07:53:35.435170 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 845 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T07:53:35.438701 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T07:53:35.442102 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T07:53:35.445493 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T07:53:35.448972 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T07:53:35.452693 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T07:53:35.456375 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T07:53:35.459637 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:53:35.459826 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:53:35.459956 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T07:53:35.464684 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [200501000], Memory % [5.28], CPU Time [151491.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T07:53:35.465077 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78163], State: [ok], Delivered in [0.093141395] seconds [----] I, [2016-09-13T07:53:35.497715 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78164], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.27099255] seconds [----] I, [2016-09-13T07:53:35.497928 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78164], Delivering... [----] I, [2016-09-13T07:53:35.511262 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:53:34 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [151503.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:53:35.512128 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:53:24 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347151000], Memory % [5.04], CPU Time [104212.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T07:53:35.513120 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:53:33 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169068000], Memory % [3.14], CPU Time [51486.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:53:35.513999 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:53:33 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212543000], Memory % [3.5], CPU Time [48800.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T07:53:35.514924 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:53:32 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [239883.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T07:53:35.515556 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:53:32 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162417000], Memory % [3.1], CPU Time [37936.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T07:53:35.516133 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:53:33 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358685000], Memory % [5.28], CPU Time [202622.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T07:53:35.516693 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:53:34 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [150584.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:53:35.519600 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:53:26 UTC], Process Info: Memory Usage [591974400], Memory Size [935747584], Proportional Set Size: [426922000], Memory % [7.22], CPU Time [952.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:53:35.521879 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:53:25 UTC], Process Info: Memory Usage [615026688], Memory Size [1020682240], Proportional Set Size: [447788000], Memory % [7.5], CPU Time [485.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:53:35.524156 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:53:29 UTC], Process Info: Memory Usage [558497792], Memory Size [930201600], Proportional Set Size: [406113000], Memory % [6.81], CPU Time [5578.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T07:53:35.526360 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:53:31 UTC], Process Info: Memory Usage [580444160], Memory Size [938295296], Proportional Set Size: [420068000], Memory % [7.08], CPU Time [2139.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T07:53:35.526960 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:53:33 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [209797.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T07:53:35.527517 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:53:34 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51526.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:53:35.528025 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:53:28 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165803000], Memory % [3.16], CPU Time [38836.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T07:53:35.528349 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78164], State: [ok], Delivered in [0.03042782] seconds [----] I, [2016-09-13T07:53:35.543194 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78165], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.303094472] seconds [----] I, [2016-09-13T07:53:35.543360 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78165], Delivering... [----] I, [2016-09-13T07:53:35.549918 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033087730407714844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033311843872070312, :pending_vm_jobs=>0.0008592605590820312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006129264831542969} [----] I, [2016-09-13T07:53:35.550238 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78165], State: [ok], Delivered in [0.006870556] seconds [----] I, [2016-09-13T07:53:40.306331 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T07:53:47.255786 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:53:47.274445 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78166], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:53:47.297484 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78167], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:53:47.308646 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78168], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:53:47.321250 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78169], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:53:51.480724 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:53:51.485451 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004179239273071289, :worker_monitor=>1.1298837661743164, :worker_dequeue=>0.00848698616027832, :total_time=>1.1428024768829346} [----] I, [2016-09-13T07:53:51.658877 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78166], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.400057284] seconds [----] I, [2016-09-13T07:53:51.659080 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78166], Delivering... [----] I, [2016-09-13T07:53:51.674789 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78169], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.363484753] seconds [----] I, [2016-09-13T07:53:51.674938 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78169], Delivering... [----] I, [2016-09-13T07:53:51.679652 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024025440216064453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002421140670776367, :pending_vm_jobs=>0.0006079673767089844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004431486129760742} [----] I, [2016-09-13T07:53:51.679972 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78169], State: [ok], Delivered in [0.005038097] seconds [----] I, [2016-09-13T07:53:51.726461 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78166], State: [ok], Delivered in [0.067310068] seconds [----] I, [2016-09-13T07:53:51.898010 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78167], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.620722289] seconds [----] I, [2016-09-13T07:53:51.898266 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78167], Delivering... [----] I, [2016-09-13T07:53:51.907856 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78167], State: [ok], Delivered in [0.009598253] seconds [----] I, [2016-09-13T07:53:51.939227 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78168], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.637467016] seconds [----] I, [2016-09-13T07:53:51.939574 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78168], Delivering... [----] I, [2016-09-13T07:53:51.947885 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78168], State: [ok], Delivered in [0.008307129] seconds [----] I, [2016-09-13T07:53:56.485877 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:53:56 UTC]... [----] I, [2016-09-13T07:53:56.516600 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:53:56 UTC]...Complete [----] I, [2016-09-13T07:54:02.329348 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:54:02.345010 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78170], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:54:07.493958 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:54:07.785247 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78170], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.450300071] seconds [----] I, [2016-09-13T07:54:07.785369 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78170], Delivering... [----] I, [2016-09-13T07:54:07.789459 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021314620971679688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021462440490722656, :pending_vm_jobs=>0.0005013942718505859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003798246383666992} [----] I, [2016-09-13T07:54:07.789705 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78170], State: [ok], Delivered in [0.00433418] seconds [----] I, [2016-09-13T07:54:17.357245 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:54:17.368195 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78171], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:54:17.379706 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78172], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:54:17.637830 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:54:17.899900 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78172], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.525310848] seconds [----] I, [2016-09-13T07:54:17.900103 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78172], Delivering... [----] I, [2016-09-13T07:54:17.907452 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037322044372558594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003908872604370117, :pending_vm_jobs=>0.0008919239044189453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006897687911987305} [----] I, [2016-09-13T07:54:17.907850 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78172], State: [ok], Delivered in [0.007736152] seconds [----] I, [2016-09-13T07:54:18.985343 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78171], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.622809553] seconds [----] I, [2016-09-13T07:54:18.985574 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78171], Delivering... [----] I, [2016-09-13T07:54:18.991231 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78171], State: [ok], Delivered in [0.005648136] seconds [----] I, [2016-09-13T07:54:23.867528 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0034716129302978516, :worker_monitor=>1.1448566913604736, :worker_dequeue=>0.07384300231933594, :total_time=>1.222458839416504} [----] I, [2016-09-13T07:54:28.868083 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:54:28 UTC]... [----] I, [2016-09-13T07:54:28.979657 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:54:28 UTC]...Complete [----] I, [2016-09-13T07:54:32.396039 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:54:32.413905 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78173], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:54:34.014316 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:54:34.036809 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78173], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.634396402] seconds [----] I, [2016-09-13T07:54:34.036937 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78173], Delivering... [----] I, [2016-09-13T07:54:34.043247 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029973983764648438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030188560485839844, :pending_vm_jobs=>0.0009450912475585938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006016254425048828} [----] I, [2016-09-13T07:54:34.043609 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78173], State: [ok], Delivered in [0.006648508] seconds [----] I, [2016-09-13T07:54:40.475380 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041408538818359375, :worker_monitor=>1.4359779357910156, :worker_dequeue=>0.011110067367553711, :total_time=>1.4515743255615234} [----] I, [2016-09-13T07:54:47.425867 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:54:47.528475 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78174], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:54:47.545514 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78175], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:54:47.562633 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78176], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:54:47.573942 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78177], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:54:50.504090 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:54:51.111726 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78174], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.68141012] seconds [----] I, [2016-09-13T07:54:51.111990 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78174], Delivering... [----] I, [2016-09-13T07:54:51.174015 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78174], State: [ok], Delivered in [0.062021001] seconds [----] I, [2016-09-13T07:54:51.191223 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78177], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.623166638] seconds [----] I, [2016-09-13T07:54:51.191456 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78177], Delivering... [----] I, [2016-09-13T07:54:51.198074 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033283233642578125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033812522888183594, :pending_vm_jobs=>0.0008373260498046875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062024593353271484} [----] I, [2016-09-13T07:54:51.198494 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78177], State: [ok], Delivered in [0.007051826] seconds [----] I, [2016-09-13T07:54:52.117489 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78175], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.58330799] seconds [----] I, [2016-09-13T07:54:52.117759 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78175], Delivering... [----] I, [2016-09-13T07:54:52.121688 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78175], State: [ok], Delivered in [0.003934456] seconds [----] I, [2016-09-13T07:54:52.162632 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78176], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.609090239] seconds [----] I, [2016-09-13T07:54:52.162864 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78176], Delivering... [----] I, [2016-09-13T07:54:52.168648 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78176], State: [ok], Delivered in [0.005759324] seconds [----] I, [2016-09-13T07:54:56.665705 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [100], PID: [10859], GUID: [5b4aad44-79a7-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:54:56.665901 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [100], PID: [10859], GUID: [5b4aad44-79a7-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:54:56.676953 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:54:56.677127 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:54:56.683204 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T07:54:56.683353 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T07:54:56.683472 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T07:54:56.694026 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:54:56.694235 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:54:56.705471 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:54:56.705764 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:54:56.716934 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:54:56.717166 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:54:56.728390 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:54:56.728662 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:54:56.739412 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:54:56.739672 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:54:56.750827 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:54:56.750986 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:54:56.762352 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:54:56.762533 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:54:56.773901 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:54:56.774075 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:54:56.785346 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:54:56.785561 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:54:56.796687 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:54:56.796898 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:54:56.808125 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:54:56.808303 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:54:56.819486 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:54:56.819661 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:54:56.830985 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T07:54:56.831155 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T07:54:56.843453 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:54:56.844184 #5369:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T07:54:56.844248 #5369:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:54:56.844288 #5369:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:54:56.844320 #5369:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:54:56.844352 #5369:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T07:54:56.844381 #5369:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T07:54:56.844437 #5369:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:54:56.844487 #5369:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T07:54:56.844521 #5369:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:54:56.844553 #5369:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:54:56.844582 #5369:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T07:54:56.844624 #5369:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:54:56.844661 #5369:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T07:54:56.844690 #5369:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:54:56.844722 #5369:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T07:54:56.844749 #5369:34713c] INFO -- : --- [----] I, [2016-09-13T07:54:56.845119 #5369:34713c] INFO -- : :guid: 79c8c984-799a-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:54:56.845178 #5369:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T07:54:56.845320 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T07:54:56.846108 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00394892692565918, :worker_monitor=>1.3161375522613525, :worker_dequeue=>0.011128664016723633, :total_time=>1.3314917087554932} [----] I, [2016-09-13T07:54:57.320287 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:54:57.320452 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:54:57.320538 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:54:57.465177 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:54:57.465909 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T07:54:57.465990 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:54:57.466035 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:54:57.466072 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:54:57.466106 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T07:54:57.466140 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T07:54:57.466175 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:54:57.466207 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T07:54:57.466241 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:54:57.466274 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:54:57.466307 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:54:57.466339 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:54:57.466372 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T07:54:57.466403 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T07:54:57.466712 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:54:57.466983 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:54:58.185577 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:54:58.185730 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:54:58.185853 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:54:58.362960 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:54:58.363758 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T07:54:58.363855 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:54:58.363903 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:54:58.363939 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:54:58.363974 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T07:54:58.364008 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T07:54:58.364040 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:54:58.364074 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T07:54:58.364108 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:54:58.364142 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:54:58.364175 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:54:58.364208 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:54:58.364240 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T07:54:58.364271 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:54:58.364301 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T07:54:58.364332 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T07:54:58.364650 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:54:58.364846 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:54:59.124290 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T07:54:59.124473 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T07:54:59.124571 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T07:54:59.244352 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:54:59.245054 #684:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T07:54:59.245104 #684:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:54:59.245150 #684:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:54:59.245180 #684:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:54:59.245207 #684:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T07:54:59.245237 #684:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T07:54:59.245275 #684:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:54:59.245304 #684:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T07:54:59.245328 #684:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:54:59.245352 #684:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:54:59.245375 #684:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:54:59.245406 #684:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:54:59.245454 #684:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T07:54:59.245484 #684:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T07:54:59.245510 #684:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T07:54:59.245537 #684:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T07:54:59.245566 #684:34713c] INFO -- : --- [----] I, [2016-09-13T07:54:59.245829 #684:34713c] INFO -- : :guid: c253e5f6-7924-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:54:59.245873 #684:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T07:54:59.245961 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T07:54:59.259016 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:54:59.259151 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:54:59.259229 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:54:59.401153 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:54:59.402000 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T07:54:59.402075 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:54:59.402116 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:54:59.402148 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:54:59.402179 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T07:54:59.402209 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T07:54:59.402239 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:54:59.402268 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T07:54:59.402300 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:54:59.402331 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:54:59.402360 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:54:59.402389 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:54:59.402446 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T07:54:59.402493 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:54:59.402524 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T07:54:59.402551 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T07:54:59.402824 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:54:59.402998 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:55:01.001920 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:55:01.002051 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:55:01.002119 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:55:01.140404 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T07:55:01.140653 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T07:55:01.140806 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T07:55:01.145550 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:55:01.146241 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T07:55:01.146313 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:55:01.146354 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:55:01.146389 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:55:01.146464 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T07:55:01.146509 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T07:55:01.146544 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:55:01.146576 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T07:55:01.146608 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:55:01.146640 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:55:01.146671 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:55:01.146703 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:55:01.146735 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T07:55:01.146786 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T07:55:01.147052 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:55:01.147306 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:55:01.191078 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:55:01.191325 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:55:01.191546 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:55:01.288936 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:55:01.289152 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:55:01.289319 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:55:01.305751 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:55:01.307217 #20386:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T07:55:01.307331 #20386:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:55:01.307405 #20386:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:55:01.307520 #20386:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:55:01.307595 #20386:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T07:55:01.307665 #20386:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T07:55:01.307731 #20386:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:55:01.307819 #20386:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T07:55:01.307894 #20386:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:55:01.307962 #20386:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:55:01.308024 #20386:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:55:01.308084 #20386:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:55:01.308149 #20386:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T07:55:01.308215 #20386:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T07:55:01.308276 #20386:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T07:55:01.308335 #20386:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T07:55:01.308391 #20386:34713c] INFO -- : --- [----] I, [2016-09-13T07:55:01.308974 #20386:34713c] INFO -- : :guid: e5930efc-7974-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:55:01.309070 #20386:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T07:55:01.309250 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T07:55:01.402494 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:55:01.403369 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T07:55:01.403478 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:55:01.403534 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:55:01.403574 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:55:01.403611 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T07:55:01.403646 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T07:55:01.403684 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:55:01.403721 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T07:55:01.403756 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:55:01.403817 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:55:01.403870 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:55:01.403912 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:55:01.403947 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T07:55:01.403988 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:55:01.404020 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T07:55:01.404051 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T07:55:01.404339 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:55:01.404547 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:55:01.488970 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:55:01.489853 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T07:55:01.489936 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:55:01.489984 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:55:01.490023 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:55:01.490060 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T07:55:01.490096 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T07:55:01.490139 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:55:01.490175 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T07:55:01.490211 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:55:01.490245 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:55:01.490280 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:55:01.490312 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:55:01.490347 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T07:55:01.490383 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:55:01.490444 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T07:55:01.490494 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T07:55:01.490817 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:55:01.490962 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:55:01.846681 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:55:01 UTC]... [----] I, [2016-09-13T07:55:01.859230 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:55:01 UTC]...Complete [----] I, [2016-09-13T07:55:02.585351 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:55:02.585562 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:55:02.585642 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:55:02.715715 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:55:02.717081 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T07:55:02.717163 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:55:02.717206 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:55:02.717241 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:55:02.717275 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T07:55:02.717307 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T07:55:02.717339 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:55:02.717371 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T07:55:02.717402 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:55:02.717479 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:55:02.717519 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:55:02.717551 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:55:02.717582 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T07:55:02.717613 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T07:55:02.717644 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T07:55:02.717676 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T07:55:02.717708 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T07:55:02.717739 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T07:55:02.717794 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T07:55:02.717833 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T07:55:02.717865 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T07:55:02.717896 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T07:55:02.717927 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T07:55:02.717958 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T07:55:02.717989 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T07:55:02.718021 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T07:55:02.718052 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T07:55:02.718084 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T07:55:02.718115 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T07:55:02.718146 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T07:55:02.718177 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T07:55:02.718207 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T07:55:02.718237 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T07:55:02.718273 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T07:55:02.718304 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T07:55:02.718334 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T07:55:02.718370 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T07:55:02.718400 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T07:55:02.718489 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T07:55:02.718840 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:55:02.719000 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:55:02.719075 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:55:02.739387 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78178], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:55:03.268920 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:55:03.269071 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:55:03.269156 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:55:03.429644 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:55:03.430480 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T07:55:03.430560 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:55:03.430604 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:55:03.430644 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:55:03.430678 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T07:55:03.430711 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T07:55:03.430744 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:55:03.430799 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T07:55:03.430840 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:55:03.430877 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:55:03.430910 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:55:03.430941 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:55:03.430971 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T07:55:03.431003 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:55:03.431033 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T07:55:03.431063 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T07:55:03.431357 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:55:03.431558 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:55:04.959982 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:55:04.960116 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:55:04.960185 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:55:05.104759 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:55:05.105472 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T07:55:05.105553 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:55:05.105598 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:55:05.105636 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:55:05.105671 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T07:55:05.105705 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T07:55:05.105739 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:55:05.105790 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T07:55:05.105831 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:55:05.105865 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:55:05.105898 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:55:05.105930 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:55:05.105962 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T07:55:05.105993 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T07:55:05.106251 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:55:05.106515 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:55:05.369939 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T07:55:05.370142 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T07:55:05.370251 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T07:55:05.463754 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:55:05.464136 #10859:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T07:55:05.464168 #10859:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:55:05.464189 #10859:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:55:05.464207 #10859:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:55:05.464222 #10859:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T07:55:05.464239 #10859:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T07:55:05.464255 #10859:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:55:05.464270 #10859:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T07:55:05.464286 #10859:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:55:05.464313 #10859:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:55:05.464333 #10859:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T07:55:05.464350 #10859:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:55:05.464367 #10859:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T07:55:05.464382 #10859:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:55:05.464396 #10859:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T07:55:05.464411 #10859:34713c] INFO -- : --- [----] I, [2016-09-13T07:55:05.464621 #10859:34713c] INFO -- : :guid: 5b4aad44-79a7-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:55:05.464652 #10859:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T07:55:05.464727 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T07:55:05.963399 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:55:05.963569 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:55:05.963642 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:55:06.109743 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:55:06.110535 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T07:55:06.110616 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:55:06.110659 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:55:06.110695 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:55:06.110728 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T07:55:06.110760 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T07:55:06.110818 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:55:06.110854 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T07:55:06.110888 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:55:06.110920 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:55:06.110951 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:55:06.110983 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:55:06.111014 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T07:55:06.111045 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:55:06.111075 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T07:55:06.111105 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T07:55:06.111372 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:55:06.111576 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:55:06.888698 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:55:07.408168 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78178], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.683761692] seconds [----] I, [2016-09-13T07:55:07.408384 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78178], Delivering... [----] I, [2016-09-13T07:55:07.416485 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00429081916809082, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004313945770263672, :pending_vm_jobs=>0.0009675025939941406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007642984390258789} [----] I, [2016-09-13T07:55:07.416919 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78178], State: [ok], Delivered in [0.008536641] seconds [----] I, [2016-09-13T07:55:08.007133 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T07:55:08.007294 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T07:55:08.007392 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T07:55:08.188801 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T07:55:08.189752 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T07:55:08.189855 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T07:55:08.189905 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T07:55:08.189943 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T07:55:08.189980 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T07:55:08.190020 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T07:55:08.190057 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T07:55:08.190096 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T07:55:08.190130 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T07:55:08.190162 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T07:55:08.190204 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T07:55:08.190238 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T07:55:08.190273 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T07:55:08.190308 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T07:55:08.190345 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T07:55:08.190378 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T07:55:08.190706 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T07:55:08.190892 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T07:55:13.263079 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004060983657836914, :worker_monitor=>1.3507814407348633, :worker_dequeue=>0.012008428573608398, :total_time=>1.3671653270721436} [----] I, [2016-09-13T07:55:17.751219 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:55:17.769586 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78179], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:55:17.785361 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78180], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:55:18.397061 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:55:18.551371 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78180], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.776173703] seconds [----] I, [2016-09-13T07:55:18.551594 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78180], Delivering... [----] I, [2016-09-13T07:55:18.558015 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033195018768310547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033388137817382812, :pending_vm_jobs=>0.0008392333984375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060367584228515625} [----] I, [2016-09-13T07:55:18.558412 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78180], State: [ok], Delivered in [0.006828605] seconds [----] I, [2016-09-13T07:55:19.465943 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78179], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.710112862] seconds [----] I, [2016-09-13T07:55:19.466174 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78179], Delivering... [----] I, [2016-09-13T07:55:19.471112 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78179], State: [ok], Delivered in [0.00494334] seconds [----] I, [2016-09-13T07:55:29.805532 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041577816009521484, :worker_monitor=>1.3662569522857666, :worker_dequeue=>0.010799646377563477, :total_time=>1.381537914276123} [----] I, [2016-09-13T07:55:32.797439 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:55:32.815075 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78181], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:55:34.806038 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:55:34 UTC]... [----] I, [2016-09-13T07:55:34.820479 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:55:34 UTC]...Complete [----] I, [2016-09-13T07:55:34.830793 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:55:35.660680 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78181], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.857402594] seconds [----] I, [2016-09-13T07:55:35.660880 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78181], Delivering... [----] I, [2016-09-13T07:55:35.666616 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028998851776123047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029239654541015625, :pending_vm_jobs=>0.0007727146148681641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005403757095336914} [----] I, [2016-09-13T07:55:35.666962 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78181], State: [ok], Delivered in [0.00608128] seconds [----] I, [2016-09-13T07:55:46.070842 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041773319244384766, :worker_monitor=>1.2029950618743896, :worker_dequeue=>0.00810384750366211, :total_time=>1.2155888080596924} [----] I, [2016-09-13T07:55:47.826963 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:55:47.843551 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78182], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:55:47.855058 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78183], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:55:47.872145 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78184], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:55:47.883508 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78185], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:55:51.082327 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:55:51.809746 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78182], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.978391582] seconds [----] I, [2016-09-13T07:55:51.809953 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78182], Delivering... [----] I, [2016-09-13T07:55:51.815318 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78185], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.93821487] seconds [----] I, [2016-09-13T07:55:51.815553 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78185], Delivering... [----] I, [2016-09-13T07:55:51.825993 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005312681198120117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005343198776245117, :pending_vm_jobs=>0.0014848709106445312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009932279586791992} [----] I, [2016-09-13T07:55:51.826511 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78185], State: [ok], Delivered in [0.01089529] seconds [----] I, [2016-09-13T07:55:51.860828 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78182], State: [ok], Delivered in [0.050845806] seconds [----] I, [2016-09-13T07:55:52.609600 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78183], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.761193018] seconds [----] I, [2016-09-13T07:55:52.609822 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78183], Delivering... [----] I, [2016-09-13T07:55:52.612914 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78183], State: [ok], Delivered in [0.003103978] seconds [----] I, [2016-09-13T07:55:52.615174 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78184], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.752549832] seconds [----] I, [2016-09-13T07:55:52.615357 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78184], Delivering... [----] I, [2016-09-13T07:55:52.620293 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78184], State: [ok], Delivered in [0.004934256] seconds [----] I, [2016-09-13T07:56:02.419051 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004350185394287109, :worker_monitor=>1.297945499420166, :worker_dequeue=>0.011679649353027344, :total_time=>1.3142917156219482} [----] I, [2016-09-13T07:56:02.895168 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:56:02.912593 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78186], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:56:07.419753 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:56:07 UTC]... [----] I, [2016-09-13T07:56:07.438151 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:56:07 UTC]...Complete [----] I, [2016-09-13T07:56:07.453794 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:56:07.672810 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78186], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.769555185] seconds [----] I, [2016-09-13T07:56:07.673006 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78186], Delivering... [----] I, [2016-09-13T07:56:07.680300 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003823518753051758, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003849029541015625, :pending_vm_jobs=>0.0008974075317382812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006854534149169922} [----] I, [2016-09-13T07:56:07.680714 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78186], State: [ok], Delivered in [0.007700177] seconds [----] I, [2016-09-13T07:56:17.921828 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:56:17.935467 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78187], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:56:17.946689 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78188], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:56:18.837037 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:56:18.845399 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004682302474975586, :worker_monitor=>1.3478846549987793, :worker_dequeue=>0.013393640518188477, :total_time=>1.366339921951294} [----] I, [2016-09-13T07:56:19.029250 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78188], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.089490243] seconds [----] I, [2016-09-13T07:56:19.029510 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78188], Delivering... [----] I, [2016-09-13T07:56:19.035536 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030908584594726562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031409263610839844, :pending_vm_jobs=>0.0007424354553222656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005610466003417969} [----] I, [2016-09-13T07:56:19.035897 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78188], State: [ok], Delivered in [0.006394947] seconds [----] I, [2016-09-13T07:56:19.715180 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78187], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.789363084] seconds [----] I, [2016-09-13T07:56:19.715443 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78187], Delivering... [----] I, [2016-09-13T07:56:19.721123 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78187], State: [ok], Delivered in [0.005717776] seconds [----] I, [2016-09-13T07:56:32.956031 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:56:32.977679 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78189], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:56:35.582722 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:56:35.589758 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004433393478393555, :worker_monitor=>1.565847635269165, :worker_dequeue=>0.014545917510986328, :total_time=>1.585141658782959} [----] I, [2016-09-13T07:56:36.143562 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78189], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.182251521] seconds [----] I, [2016-09-13T07:56:36.143738 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78189], Delivering... [----] I, [2016-09-13T07:56:36.149887 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031049251556396484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031278133392333984, :pending_vm_jobs=>0.0008327960968017578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057489871978759766} [----] I, [2016-09-13T07:56:36.150221 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78189], State: [ok], Delivered in [0.006481339] seconds [----] I, [2016-09-13T07:56:40.590499 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:56:40 UTC]... [----] I, [2016-09-13T07:56:40.611833 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:56:40 UTC]...Complete [----] I, [2016-09-13T07:56:47.989151 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:56:48.006278 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78190], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:56:48.017661 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78191], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:56:48.029000 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78192], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:56:48.041504 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78193], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:56:52.066358 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:56:52.073478 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004417896270751953, :worker_monitor=>1.4095401763916016, :worker_dequeue=>0.01268625259399414, :total_time=>1.4270834922790527} [----] I, [2016-09-13T07:56:52.286668 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78190], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.292988743] seconds [----] I, [2016-09-13T07:56:52.286911 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78190], Delivering... [----] I, [2016-09-13T07:56:52.297955 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78193], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.263975898] seconds [----] I, [2016-09-13T07:56:52.298169 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78193], Delivering... [----] I, [2016-09-13T07:56:52.305017 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035462379455566406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003568410873413086, :pending_vm_jobs=>0.0008835792541503906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0064105987548828125} [----] I, [2016-09-13T07:56:52.305394 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78193], State: [ok], Delivered in [0.007230266] seconds [----] I, [2016-09-13T07:56:52.349558 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78190], State: [ok], Delivered in [0.062635124] seconds [----] I, [2016-09-13T07:56:52.829635 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78191], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.81818584] seconds [----] I, [2016-09-13T07:56:52.829879 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78191], Delivering... [----] I, [2016-09-13T07:56:52.833165 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78191], State: [ok], Delivered in [0.003285742] seconds [----] I, [2016-09-13T07:56:52.858193 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78192], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.83331251] seconds [----] I, [2016-09-13T07:56:52.858381 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78192], Delivering... [----] I, [2016-09-13T07:56:52.863620 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78192], State: [ok], Delivered in [0.00523139] seconds [----] I, [2016-09-13T07:57:03.053160 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:57:03.069586 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78194], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:57:08.477678 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:57:08.486752 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0046999454498291016, :worker_monitor=>1.3629217147827148, :worker_dequeue=>0.013949394226074219, :total_time=>1.3818988800048828} [----] I, [2016-09-13T07:57:09.441270 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78194], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.381617162] seconds [----] I, [2016-09-13T07:57:09.441508 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78194], Delivering... [----] I, [2016-09-13T07:57:09.448241 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033807754516601562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034034252166748047, :pending_vm_jobs=>0.0008974075317382812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006305217742919922} [----] I, [2016-09-13T07:57:09.448660 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78194], State: [ok], Delivered in [0.007160862] seconds [----] I, [2016-09-13T07:57:13.487240 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:57:13 UTC]... [----] I, [2016-09-13T07:57:13.509396 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:57:13 UTC]...Complete [----] I, [2016-09-13T07:57:18.082859 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:57:18.099800 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78195], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:57:18.115465 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78196], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:57:18.541458 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:57:19.544347 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78196], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.439130072] seconds [----] I, [2016-09-13T07:57:19.544571 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78196], Delivering... [----] I, [2016-09-13T07:57:19.551178 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003375530242919922, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003395557403564453, :pending_vm_jobs=>0.0008728504180908203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006204843521118164} [----] I, [2016-09-13T07:57:19.551548 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78196], State: [ok], Delivered in [0.006970222] seconds [----] I, [2016-09-13T07:57:19.921933 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78195], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.834632323] seconds [----] I, [2016-09-13T07:57:19.922198 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78195], Delivering... [----] I, [2016-09-13T07:57:19.927901 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78195], State: [ok], Delivered in [0.005705852] seconds [----] I, [2016-09-13T07:57:25.006908 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0034706592559814453, :worker_monitor=>1.4427740573883057, :worker_dequeue=>0.008907556533813477, :total_time=>1.4553723335266113} [----] I, [2016-09-13T07:57:33.127050 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:57:33.138368 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78197], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:57:35.141689 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:57:35.681508 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78197], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.54835353] seconds [----] I, [2016-09-13T07:57:35.681689 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78197], Delivering... [----] I, [2016-09-13T07:57:35.687649 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029726028442382812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002991199493408203, :pending_vm_jobs=>0.0007941722869873047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005601406097412109} [----] I, [2016-09-13T07:57:35.688016 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78197], State: [ok], Delivered in [0.006322733] seconds [----] I, [2016-09-13T07:57:41.956321 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004361629486083984, :worker_monitor=>1.7901890277862549, :worker_dequeue=>0.01264190673828125, :total_time=>1.8075103759765625} [----] I, [2016-09-13T07:57:46.956902 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:57:46 UTC]... [----] I, [2016-09-13T07:57:46.978644 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:57:46 UTC]...Complete [----] I, [2016-09-13T07:57:48.148642 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:57:48.170903 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78198], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:57:48.193790 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78199], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:57:48.216723 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78200], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:57:48.245288 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78201], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:57:52.012457 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:57:52.805663 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78198], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.653041969] seconds [----] I, [2016-09-13T07:57:52.805899 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78198], Delivering... [----] I, [2016-09-13T07:57:52.811198 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78201], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.58970533] seconds [----] I, [2016-09-13T07:57:52.811405 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78201], Delivering... [----] I, [2016-09-13T07:57:52.818629 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003939390182495117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003962516784667969, :pending_vm_jobs=>0.0008885860443115234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006776571273803711} [----] I, [2016-09-13T07:57:52.819016 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78201], State: [ok], Delivered in [0.007607206] seconds [----] I, [2016-09-13T07:57:52.856647 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78198], State: [ok], Delivered in [0.050728841] seconds [----] I, [2016-09-13T07:57:53.062877 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78199], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.88767057] seconds [----] I, [2016-09-13T07:57:53.063095 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78199], Delivering... [----] I, [2016-09-13T07:57:53.066671 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78199], State: [ok], Delivered in [0.003571916] seconds [----] I, [2016-09-13T07:57:53.068963 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78200], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.868668448] seconds [----] I, [2016-09-13T07:57:53.069238 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78200], Delivering... [----] I, [2016-09-13T07:57:53.076033 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78200], State: [ok], Delivered in [0.006793447] seconds [----] I, [2016-09-13T07:57:58.405525 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004361867904663086, :worker_monitor=>1.3734936714172363, :worker_dequeue=>0.008727788925170898, :total_time=>1.3869025707244873} [----] I, [2016-09-13T07:58:03.257124 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:58:03.275088 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78202], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:58:03.416118 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:58:03.920995 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78202], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.657226885] seconds [----] I, [2016-09-13T07:58:03.921182 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78202], Delivering... [----] I, [2016-09-13T07:58:03.927383 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003108978271484375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031273365020751953, :pending_vm_jobs=>0.0008308887481689453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005819797515869141} [----] I, [2016-09-13T07:58:03.927782 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78202], State: [ok], Delivered in [0.006591687] seconds [----] I, [2016-09-13T07:58:14.714316 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004636526107788086, :worker_monitor=>1.2612998485565186, :worker_dequeue=>0.008567094802856445, :total_time=>1.2748603820800781} [----] I, [2016-09-13T07:58:18.287613 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:58:18.303671 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78203], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:58:18.315139 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78204], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:58:19.714854 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:58:19 UTC]... [----] I, [2016-09-13T07:58:19.743849 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:58:19 UTC]...Complete [----] I, [2016-09-13T07:58:19.760936 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:58:20.058550 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78204], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.749600714] seconds [----] I, [2016-09-13T07:58:20.058749 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78204], Delivering... [----] I, [2016-09-13T07:58:20.069054 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005349874496459961, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005411386489868164, :pending_vm_jobs=>0.0014274120330810547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009839296340942383} [----] I, [2016-09-13T07:58:20.069595 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78204], State: [ok], Delivered in [0.010806891] seconds [----] I, [2016-09-13T07:58:20.161147 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78203], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.869066696] seconds [----] I, [2016-09-13T07:58:20.161329 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78203], Delivering... [----] I, [2016-09-13T07:58:20.166465 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78203], State: [ok], Delivered in [0.005092689] seconds [----] I, [2016-09-13T07:58:31.129379 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004484891891479492, :worker_monitor=>1.3252298831939697, :worker_dequeue=>0.011350870132446289, :total_time=>1.3413705825805664} [----] I, [2016-09-13T07:58:33.326179 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:58:33.338943 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78205], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:58:33.355281 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78206], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:58:33.366611 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78207], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:58:36.246887 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:58:37.161381 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78205], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.830683216] seconds [----] I, [2016-09-13T07:58:37.161610 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78205], Delivering... [----] I, [2016-09-13T07:58:37.162580 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T07:58:37.162800 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5365739520 [----] I, [2016-09-13T07:58:37.162916 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5140746240 [----] I, [2016-09-13T07:58:37.163031 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 224993280 [----] I, [2016-09-13T07:58:37.163108 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T07:58:37.163179 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5086740480 [----] I, [2016-09-13T07:58:37.163251 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T07:58:37.163318 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T07:58:37.163453 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 546340864 [----] I, [2016-09-13T07:58:37.163567 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T07:58:37.163642 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7931179008 [----] I, [2016-09-13T07:58:37.163710 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T07:58:37.163801 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T07:58:37.163872 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T07:58:37.163940 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T07:58:37.164007 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T07:58:37.164077 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T07:58:37.164144 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T07:58:37.164211 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T07:58:37.164275 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T07:58:37.164342 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T07:58:37.164412 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273563648 [----] I, [2016-09-13T07:58:37.164520 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 56803328 [----] I, [2016-09-13T07:58:37.164593 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216760320 [----] I, [2016-09-13T07:58:37.164660 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6160384 [----] I, [2016-09-13T07:58:37.164729 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 140771328 [----] I, [2016-09-13T07:58:37.164819 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2581090304 [----] I, [2016-09-13T07:58:37.164901 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2261164032 [----] I, [2016-09-13T07:58:37.164975 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T07:58:37.165041 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T07:58:37.165108 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T07:58:37.165172 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37122048 [----] I, [2016-09-13T07:58:37.165239 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102305792 [----] I, [2016-09-13T07:58:37.165303 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53100544 [----] I, [2016-09-13T07:58:37.165373 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 110809088 [----] I, [2016-09-13T07:58:37.165468 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155406336 [----] I, [2016-09-13T07:58:37.165551 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T07:58:37.165625 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T07:58:37.165691 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T07:58:37.165773 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T07:58:37.165851 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T07:58:37.165917 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T07:58:37.165985 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T07:58:37.166049 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T07:58:37.166113 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T07:58:37.202304 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T07:58:37.202484 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T07:58:37.205194 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T07:58:37.207087 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T07:58:37.209336 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T07:58:37.211597 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T07:58:37.213800 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T07:58:37.215974 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 846 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T07:58:37.218149 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T07:58:37.218238 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78207], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.857516503] seconds [----] I, [2016-09-13T07:58:37.218390 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78207], Delivering... [----] I, [2016-09-13T07:58:37.220301 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T07:58:37.222530 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T07:58:37.224870 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003236055374145508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032532215118408203, :pending_vm_jobs=>0.0009191036224365234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006094932556152344} [----] I, [2016-09-13T07:58:37.224995 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T07:58:37.225235 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78207], State: [ok], Delivered in [0.006819925] seconds [----] I, [2016-09-13T07:58:37.227137 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T07:58:37.229199 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T07:58:37.231135 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:58:37.231249 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T07:58:37.231325 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T07:58:37.234382 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [151576.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:58:37.234643 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78205], State: [ok], Delivered in [0.073047983] seconds [----] I, [2016-09-13T07:58:41.277139 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T07:58:41.282668 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:58:42.281386 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78206], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.938499266] seconds [----] I, [2016-09-13T07:58:42.281620 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78206], Delivering... [----] I, [2016-09-13T07:58:42.289773 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:58:18 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205292000], Memory % [3.5], CPU Time [240006.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T07:58:42.290393 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:58:30 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [151587.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:58:42.290937 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:58:30 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [150671.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T07:58:42.291392 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:58:25 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347151000], Memory % [5.04], CPU Time [104282.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T07:58:42.291908 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:58:21 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212543000], Memory % [3.5], CPU Time [48851.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T07:58:42.292543 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:58:30 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162417000], Memory % [3.1], CPU Time [37989.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T07:58:42.293119 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:58:29 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358685000], Memory % [5.28], CPU Time [202674.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T07:58:42.293666 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:58:29 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169070000], Memory % [3.14], CPU Time [51548.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:58:42.296797 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:58:25 UTC], Process Info: Memory Usage [615661568], Memory Size [1020682240], Proportional Set Size: [448434000], Memory % [7.51], CPU Time [504.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:58:42.299080 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:58:27 UTC], Process Info: Memory Usage [592543744], Memory Size [922411008], Proportional Set Size: [427481000], Memory % [7.22], CPU Time [1025.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T07:58:42.301341 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:58:21 UTC], Process Info: Memory Usage [579948544], Memory Size [907706368], Proportional Set Size: [419584000], Memory % [7.07], CPU Time [2215.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T07:58:42.303527 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:58:29 UTC], Process Info: Memory Usage [557629440], Memory Size [895729664], Proportional Set Size: [405377000], Memory % [6.8], CPU Time [5645.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T07:58:42.304121 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:58:29 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [209844.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T07:58:42.304680 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:58:29 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51559.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T07:58:42.305208 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 11:58:29 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165805000], Memory % [3.16], CPU Time [38887.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T07:58:42.305582 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78206], State: [ok], Delivered in [0.023955588] seconds [----] I, [2016-09-13T07:58:47.682201 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004311561584472656, :worker_monitor=>1.3756380081176758, :worker_dequeue=>0.011020183563232422, :total_time=>1.3912403583526611} [----] I, [2016-09-13T07:58:48.377188 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:58:48.388575 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78208], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:58:48.400147 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78209], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:58:48.417182 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78210], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:58:48.445981 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78211], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:58:52.682742 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:58:52 UTC]... [----] I, [2016-09-13T07:58:52.702857 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:58:52 UTC]...Complete [----] I, [2016-09-13T07:58:52.713744 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:58:53.274746 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78208], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.893136133] seconds [----] I, [2016-09-13T07:58:53.275004 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78208], Delivering... [----] I, [2016-09-13T07:58:53.314826 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78211], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.892430251] seconds [----] I, [2016-09-13T07:58:53.315085 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78211], Delivering... [----] I, [2016-09-13T07:58:53.322334 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038063526153564453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003828763961791992, :pending_vm_jobs=>0.000919342041015625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006729841232299805} [----] I, [2016-09-13T07:58:53.322869 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78211], State: [ok], Delivered in [0.007762045] seconds [----] I, [2016-09-13T07:58:53.344369 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78208], State: [ok], Delivered in [0.069337689] seconds [----] I, [2016-09-13T07:58:53.350334 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78209], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.956630153] seconds [----] I, [2016-09-13T07:58:53.350570 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78209], Delivering... [----] I, [2016-09-13T07:58:53.353920 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78209], State: [ok], Delivered in [0.003335496] seconds [----] I, [2016-09-13T07:58:53.384795 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78210], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.977344243] seconds [----] I, [2016-09-13T07:58:53.385018 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78210], Delivering... [----] I, [2016-09-13T07:58:53.390539 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78210], State: [ok], Delivered in [0.005513646] seconds [----] I, [2016-09-13T07:59:03.465654 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:59:03.481527 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78212], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:59:03.994078 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:59:04.000999 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004387617111206055, :worker_monitor=>1.2474396228790283, :worker_dequeue=>0.012372255325317383, :total_time=>1.2646262645721436} [----] I, [2016-09-13T07:59:04.435731 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78212], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.96424749] seconds [----] I, [2016-09-13T07:59:04.435886 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78212], Delivering... [----] I, [2016-09-13T07:59:04.440038 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021598339080810547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021724700927734375, :pending_vm_jobs=>0.0005347728729248047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038645267486572266} [----] I, [2016-09-13T07:59:04.440334 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78212], State: [ok], Delivered in [0.004446551] seconds [----] I, [2016-09-13T07:59:18.494212 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T07:59:18.510322 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78213], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:59:18.521532 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78214], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:59:20.356853 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:59:20.360912 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004127025604248047, :worker_monitor=>1.3175060749053955, :worker_dequeue=>0.0074558258056640625, :total_time=>1.3294525146484375} [----] I, [2016-09-13T07:59:20.436064 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78214], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.919961144] seconds [----] I, [2016-09-13T07:59:20.436197 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78214], Delivering... [----] I, [2016-09-13T07:59:20.440320 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021295547485351562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021436214447021484, :pending_vm_jobs=>0.0005595684051513672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003858804702758789} [----] I, [2016-09-13T07:59:20.440600 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78214], State: [ok], Delivered in [0.004399153] seconds [----] I, [2016-09-13T07:59:20.464275 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78213], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.965316144] seconds [----] I, [2016-09-13T07:59:20.464396 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78213], Delivering... [----] I, [2016-09-13T07:59:20.467661 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78213], State: [ok], Delivered in [0.003262588] seconds [----] I, [2016-09-13T07:59:25.361330 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:59:25 UTC]... [----] I, [2016-09-13T07:59:25.378581 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:59:25 UTC]...Complete [----] I, [2016-09-13T07:59:33.534300 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T07:59:33.550398 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78215], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:59:36.480389 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:59:36.484015 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0027675628662109375, :worker_monitor=>1.0660626888275146, :worker_dequeue=>0.00640559196472168, :total_time=>1.075587272644043} [----] I, [2016-09-13T07:59:36.653406 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78215], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.112981963] seconds [----] I, [2016-09-13T07:59:36.653594 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78215], Delivering... [----] I, [2016-09-13T07:59:36.658606 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002543926239013672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025589466094970703, :pending_vm_jobs=>0.0006563663482666016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00469207763671875} [----] I, [2016-09-13T07:59:36.658932 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78215], State: [ok], Delivered in [0.005350531] seconds [----] I, [2016-09-13T07:59:48.562287 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T07:59:48.574393 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78216], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:59:48.584665 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78217], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:59:48.596145 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78218], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:59:48.607597 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78219], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T07:59:53.096805 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T07:59:53.103975 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004878520965576172, :worker_monitor=>1.4371209144592285, :worker_dequeue=>0.012966394424438477, :total_time=>1.455482006072998} [----] I, [2016-09-13T07:59:53.579747 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78216], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.013152684] seconds [----] I, [2016-09-13T07:59:53.580027 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78216], Delivering... [----] I, [2016-09-13T07:59:53.595389 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78219], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.994382306] seconds [----] I, [2016-09-13T07:59:53.595623 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78219], Delivering... [----] I, [2016-09-13T07:59:53.601984 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035071372985839844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003525972366333008, :pending_vm_jobs=>0.0007164478302001953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005935192108154297} [----] I, [2016-09-13T07:59:53.602309 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78219], State: [ok], Delivered in [0.006688967] seconds [----] I, [2016-09-13T07:59:53.630874 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78217], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.05159239] seconds [----] I, [2016-09-13T07:59:53.631077 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78217], Delivering... [----] I, [2016-09-13T07:59:53.634566 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78217], State: [ok], Delivered in [0.003477694] seconds [----] I, [2016-09-13T07:59:53.641062 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78216], State: [ok], Delivered in [0.060992507] seconds [----] I, [2016-09-13T07:59:53.670100 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78218], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.078275417] seconds [----] I, [2016-09-13T07:59:53.670457 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78218], Delivering... [----] I, [2016-09-13T07:59:53.677834 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78218], State: [ok], Delivered in [0.007398307] seconds [----] I, [2016-09-13T07:59:58.104647 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:59:58 UTC]... [----] I, [2016-09-13T07:59:58.120628 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 11:59:58 UTC]...Complete [----] I, [2016-09-13T08:00:03.619157 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T08:00:03.634905 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78220], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:00:03.646292 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78221], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:00:03.663914 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78222], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:00:03.665907 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget] [----] I, [2016-09-13T08:00:03.675038 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78223], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473771600] [----] I, [2016-09-13T08:00:03.675158 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T08:00:03.676455 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget] [----] I, [2016-09-13T08:00:03.686546 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78224], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473771600] [----] I, [2016-09-13T08:00:03.686666 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T08:00:03.703701 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78225], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:00:09.350198 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:00:09.353824 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004096269607543945, :worker_monitor=>1.184342384338379, :worker_dequeue=>0.006646871566772461, :total_time=>1.195439100265503} [----] I, [2016-09-13T08:00:09.870373 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78225], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.178549326] seconds [----] I, [2016-09-13T08:00:09.870607 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78225], Delivering... [----] I, [2016-09-13T08:00:09.877220 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003490447998046875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035364627838134766, :pending_vm_jobs=>0.0008273124694824219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006201267242431641} [----] I, [2016-09-13T08:00:09.877552 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78225], State: [ok], Delivered in [0.006944819] seconds [----] I, [2016-09-13T08:00:11.729272 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78220], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.100791685] seconds [----] I, [2016-09-13T08:00:11.729647 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78220], Delivering... [----] I, [2016-09-13T08:00:11.733972 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78220], State: [ok], Delivered in [0.004323696] seconds [----] I, [2016-09-13T08:00:11.756275 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78221], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.116620878] seconds [----] I, [2016-09-13T08:00:11.756511 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78221], Delivering... [----] I, [2016-09-13T08:00:11.772882 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78221], State: [ok], Delivered in [0.016335765] seconds [----] I, [2016-09-13T08:00:11.773647 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78222], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.122514257] seconds [----] I, [2016-09-13T08:00:11.773919 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78222], Delivering... [----] I, [2016-09-13T08:00:11.788266 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78222], State: [ok], Delivered in [0.014313048] seconds [----] I, [2016-09-13T08:00:11.802187 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78223], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473771600], Dequeued in: [8.13478394] seconds [----] I, [2016-09-13T08:00:11.802390 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78223], Delivering... [----] I, [2016-09-13T08:00:11.813176 #2937:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered Hosts] invoking action: [generate_widget] for target: [rss_newest_hosts] [----] I, [2016-09-13T08:00:11.819265 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78224], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473771600], Dequeued in: [8.141443511] seconds [----] I, [2016-09-13T08:00:11.819480 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78224], Delivering... [----] I, [2016-09-13T08:00:11.829619 #2928:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered VMs] invoking action: [generate_widget] for target: [rss_newest_vms] [----] I, [2016-09-13T08:00:11.852952 #2937:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [217], Name: [Generate Widget: 'EVM: Recently Discovered Hosts'] for: [1] groups [----] I, [2016-09-13T08:00:11.864276 #2928:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [218], Name: [Generate Widget: 'EVM: Recently Discovered VMs'] for: [1] groups [----] I, [2016-09-13T08:00:11.897667 #2937:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered Hosts] ID: [18] Queueing Content Generation [----] I, [2016-09-13T08:00:11.904893 #2928:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered VMs] ID: [19] Queueing Content Generation [----] I, [2016-09-13T08:00:11.916664 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78226], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T08:00:11.916970 #2937:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered Hosts] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered Hosts] [----] I, [2016-09-13T08:00:11.930807 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78227], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T08:00:11.931064 #2928:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered VMs] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered VMs] [----] I, [2016-09-13T08:00:11.936148 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78223], State: [ok], Delivered in [0.133716931] seconds [----] I, [2016-09-13T08:00:11.953259 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78224], State: [ok], Delivered in [0.133769385] seconds [----] I, [2016-09-13T08:00:14.365333 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=reporting, wcount=2, priority=200 [----] I, [2016-09-13T08:00:14.954385 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [78226], MiqWorker id: [17], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [3.047786591] seconds [----] I, [2016-09-13T08:00:14.954654 #2967:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78226], Delivering... [----] I, [2016-09-13T08:00:14.983493 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T08:00:15.056606 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T08:00:15.057163 #2967:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78226], State: [ok], Delivered in [0.102505544] seconds [----] I, [2016-09-13T08:00:15.060851 #2967:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [78226], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T08:00:15.061095 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [18], MiqTask ID: [217], Status: [ok] [----] I, [2016-09-13T08:00:15.068219 #2967:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [217] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T08:00:15.181368 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [78227], MiqWorker id: [17], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [3.267248936] seconds [----] I, [2016-09-13T08:00:15.181727 #2967:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78227], Delivering... [----] I, [2016-09-13T08:00:15.199216 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T08:00:15.237143 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T08:00:15.237621 #2967:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78227], State: [ok], Delivered in [0.055912325] seconds [----] I, [2016-09-13T08:00:15.240440 #2967:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [78227], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T08:00:15.240621 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [19], MiqTask ID: [218], Status: [ok] [----] I, [2016-09-13T08:00:15.246577 #2967:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [218] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T08:00:18.744651 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:00:18.768862 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78228], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:00:18.785925 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78229], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:00:18.794042 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered Hosts] with id: [18] [----] I, [2016-09-13T08:00:18.794221 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_18 [----] I, [2016-09-13T08:00:18.798129 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T08:00:18.798621 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 13:00:00 UTC [----] I, [2016-09-13T08:00:18.800618 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered Hosts] schedule updated to run at 2016-09-13 13:00:00 UTC with interval 3600 [----] I, [2016-09-13T08:00:18.801065 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered VMs] with id: [19] [----] I, [2016-09-13T08:00:18.801211 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_19 [----] I, [2016-09-13T08:00:18.804546 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T08:00:18.805130 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 13:00:00 UTC [----] I, [2016-09-13T08:00:18.807096 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered VMs] schedule updated to run at 2016-09-13 13:00:00 UTC with interval 3600 [----] I, [2016-09-13T08:00:19.379160 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:00:19.986062 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78229], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.210956887] seconds [----] I, [2016-09-13T08:00:19.986270 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78229], Delivering... [----] I, [2016-09-13T08:00:19.993173 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036597251892089844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036835670471191406, :pending_vm_jobs=>0.0008969306945800781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006514787673950195} [----] I, [2016-09-13T08:00:19.993579 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78229], State: [ok], Delivered in [0.007303157] seconds [----] I, [2016-09-13T08:00:20.974649 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78228], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.224069552] seconds [----] I, [2016-09-13T08:00:20.974830 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78228], Delivering... [----] I, [2016-09-13T08:00:20.978947 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78228], State: [ok], Delivered in [0.004107839] seconds [----] I, [2016-09-13T08:00:25.789070 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006691694259643555, :worker_monitor=>1.3853776454925537, :worker_dequeue=>0.011171579360961914, :total_time=>1.403698205947876} [----] I, [2016-09-13T08:00:30.789658 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:00:30 UTC]... [----] I, [2016-09-13T08:00:30.808783 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:00:30 UTC]...Complete [----] I, [2016-09-13T08:00:34.216390 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:00:34.237801 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78230], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:00:35.837714 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:00:36.031883 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78230], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.807713982] seconds [----] I, [2016-09-13T08:00:36.032065 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78230], Delivering... [----] I, [2016-09-13T08:00:36.038638 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034112930297851562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034322738647460938, :pending_vm_jobs=>0.0008349418640136719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006165504455566406} [----] I, [2016-09-13T08:00:36.039041 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78230], State: [ok], Delivered in [0.006970949] seconds [----] I, [2016-09-13T08:00:42.367328 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004755496978759766, :worker_monitor=>1.4991917610168457, :worker_dequeue=>0.018146038055419922, :total_time=>1.5224673748016357} [----] I, [2016-09-13T08:00:49.252953 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:00:49.278655 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78231], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:00:49.306052 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78232], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:00:49.334748 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78233], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:00:49.357514 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78234], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:00:52.536930 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:00:53.203245 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78231], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.945746527] seconds [----] I, [2016-09-13T08:00:53.203453 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78231], Delivering... [----] I, [2016-09-13T08:00:53.261667 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78231], State: [ok], Delivered in [0.058210815] seconds [----] I, [2016-09-13T08:00:53.266234 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78234], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.925955138] seconds [----] I, [2016-09-13T08:00:53.266411 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78234], Delivering... [----] I, [2016-09-13T08:00:53.272558 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031125545501708984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031294822692871094, :pending_vm_jobs=>0.0007643699645996094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005732297897338867} [----] I, [2016-09-13T08:00:53.272925 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78234], State: [ok], Delivered in [0.006514708] seconds [----] I, [2016-09-13T08:00:54.140599 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78232], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.85651354] seconds [----] I, [2016-09-13T08:00:54.140823 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78232], Delivering... [----] I, [2016-09-13T08:00:54.144236 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78232], State: [ok], Delivered in [0.003432118] seconds [----] I, [2016-09-13T08:00:54.146161 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78233], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.83256513] seconds [----] I, [2016-09-13T08:00:54.146370 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78233], Delivering... [----] I, [2016-09-13T08:00:54.151298 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78233], State: [ok], Delivered in [0.004950492] seconds [----] I, [2016-09-13T08:00:58.878487 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038399696350097656, :worker_monitor=>1.3239939212799072, :worker_dequeue=>0.006441354751586914, :total_time=>1.334531307220459} [----] I, [2016-09-13T08:01:03.878994 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:01:03 UTC]... [----] I, [2016-09-13T08:01:03.898913 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:01:03 UTC]...Complete [----] I, [2016-09-13T08:01:04.368772 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:01:04.391561 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78235], id: [], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:01:04.401862 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78236], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:01:08.924924 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:01:09.281153 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78235], MiqWorker id: [13], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.897696429] seconds [----] I, [2016-09-13T08:01:09.281352 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78235], Delivering... [----] I, [2016-09-13T08:01:09.298199 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78236], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.901016765] seconds [----] I, [2016-09-13T08:01:09.298476 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78236], Delivering... [----] I, [2016-09-13T08:01:09.305179 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034732818603515625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035004615783691406, :pending_vm_jobs=>0.0008351802825927734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062024593353271484} [----] I, [2016-09-13T08:01:09.305521 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78236], State: [ok], Delivered in [0.007096174] seconds [----] I, [2016-09-13T08:01:16.263662 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004231691360473633, :worker_monitor=>2.309826612472534, :worker_dequeue=>0.017404556274414062, :total_time=>2.331833839416504} [----] I, [2016-09-13T08:01:19.413649 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:01:19.446055 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78237], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:01:19.563066 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78238], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:01:21.278497 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:01:21.515645 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78238], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.060374718] seconds [----] I, [2016-09-13T08:01:21.515804 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78238], Delivering... [----] I, [2016-09-13T08:01:21.521021 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026340484619140625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026502609252929688, :pending_vm_jobs=>0.0005865097045898438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004860639572143555} [----] I, [2016-09-13T08:01:21.521509 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78238], State: [ok], Delivered in [0.005676852] seconds [----] I, [2016-09-13T08:01:21.630320 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78237], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.212316119] seconds [----] I, [2016-09-13T08:01:21.630531 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78237], Delivering... [----] I, [2016-09-13T08:01:21.637251 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78237], State: [ok], Delivered in [0.006670078] seconds [----] I, [2016-09-13T08:01:33.520527 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003821849822998047, :worker_monitor=>2.1918087005615234, :worker_dequeue=>0.011705875396728516, :total_time=>2.207658052444458} [----] I, [2016-09-13T08:01:34.582048 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:01:34.634660 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78239], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:01:38.521087 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:01:38 UTC]... [----] I, [2016-09-13T08:01:38.564669 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:01:38 UTC]...Complete [----] I, [2016-09-13T08:01:38.578657 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:01:38.651383 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78239], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.063714737] seconds [----] I, [2016-09-13T08:01:38.651733 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78239], Delivering... [----] I, [2016-09-13T08:01:38.660708 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00415492057800293, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0041882991790771484, :pending_vm_jobs=>0.0012345314025878906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00835418701171875} [----] I, [2016-09-13T08:01:38.661186 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78239], State: [ok], Delivered in [0.009459002] seconds [----] I, [2016-09-13T08:01:49.664971 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:01:49.699840 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78240], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:01:49.728525 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78241], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:01:49.762783 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78242], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:01:49.825556 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78243], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:01:51.044029 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:01:51.054681 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004331111907958984, :server_monitor=>0.1539018154144287, :worker_monitor=>2.271635055541992, :worker_dequeue=>0.01968526840209961, :total_time=>2.450239896774292} [----] I, [2016-09-13T08:01:51.748992 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78240], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.077110889] seconds [----] I, [2016-09-13T08:01:51.749305 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78240], Delivering... [----] I, [2016-09-13T08:01:51.827011 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78240], State: [ok], Delivered in [0.077709796] seconds [----] I, [2016-09-13T08:01:51.895500 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78243], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.126696626] seconds [----] I, [2016-09-13T08:01:51.895832 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78243], Delivering... [----] I, [2016-09-13T08:01:51.904638 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005454540252685547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005478858947753906, :pending_vm_jobs=>0.0008955001831054688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008269548416137695} [----] I, [2016-09-13T08:01:51.905065 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78243], State: [ok], Delivered in [0.009283228] seconds [----] I, [2016-09-13T08:01:51.987608 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78241], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.281479748] seconds [----] I, [2016-09-13T08:01:51.987889 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78241], Delivering... [----] I, [2016-09-13T08:01:51.992536 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78241], State: [ok], Delivered in [0.004633885] seconds [----] I, [2016-09-13T08:01:52.071347 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78242], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.334394002] seconds [----] I, [2016-09-13T08:01:52.071559 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78242], Delivering... [----] I, [2016-09-13T08:01:52.076183 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78242], State: [ok], Delivered in [0.004617343] seconds [----] I, [2016-09-13T08:02:04.838573 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:02:04.866998 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78244], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:02:08.228087 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:02:08.234368 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004421234130859375, :worker_monitor=>2.1311724185943604, :worker_dequeue=>0.011245250701904297, :total_time=>2.1472573280334473} [----] I, [2016-09-13T08:02:08.991964 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78244], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.144058858] seconds [----] I, [2016-09-13T08:02:08.992162 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78244], Delivering... [----] I, [2016-09-13T08:02:08.998536 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033864974975585938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034050941467285156, :pending_vm_jobs=>0.0007660388946533203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005927324295043945} [----] I, [2016-09-13T08:02:08.998906 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78244], State: [ok], Delivered in [0.006735781] seconds [----] I, [2016-09-13T08:02:13.234897 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:02:13 UTC]... [----] I, [2016-09-13T08:02:13.268887 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:02:13 UTC]...Complete [----] I, [2016-09-13T08:02:19.881574 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:02:19.937677 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78245], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:02:20.001548 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78246], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:02:25.684168 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:02:25.693879 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038602352142333984, :worker_monitor=>2.370190143585205, :worker_dequeue=>0.017761945724487305, :total_time=>2.392165422439575} [----] I, [2016-09-13T08:02:26.194319 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78246], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.250928729] seconds [----] I, [2016-09-13T08:02:26.194547 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78246], Delivering... [----] I, [2016-09-13T08:02:26.201239 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034601688385009766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003487825393676758, :pending_vm_jobs=>0.0008711814880371094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006289005279541016} [----] I, [2016-09-13T08:02:26.201660 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78246], State: [ok], Delivered in [0.007129666] seconds [----] I, [2016-09-13T08:02:28.261522 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78245], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.375220709] seconds [----] I, [2016-09-13T08:02:28.261732 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78245], Delivering... [----] I, [2016-09-13T08:02:28.266650 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78245], State: [ok], Delivered in [0.004907372] seconds [----] I, [2016-09-13T08:02:35.013133 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:02:35.045195 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78247], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:02:35.720887 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:02:36.339971 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78247], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.321590914] seconds [----] I, [2016-09-13T08:02:36.340176 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78247], Delivering... [----] I, [2016-09-13T08:02:36.347215 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038940906524658203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0039196014404296875, :pending_vm_jobs=>0.0008213520050048828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006627321243286133} [----] I, [2016-09-13T08:02:36.347623 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78247], State: [ok], Delivered in [0.007438043] seconds [----] I, [2016-09-13T08:02:42.591734 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005689144134521484, :worker_monitor=>1.8466718196868896, :worker_dequeue=>0.011222362518310547, :total_time=>1.8639576435089111} [----] I, [2016-09-13T08:02:47.592250 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:02:47 UTC]... [----] I, [2016-09-13T08:02:47.622907 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:02:47 UTC]...Complete [----] I, [2016-09-13T08:02:49.433889 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78235], State: [ok], Delivered in [100.152468369] seconds [----] I, [2016-09-13T08:02:50.057586 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:02:50.095014 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78248], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:02:50.129020 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78249], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:02:50.157772 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78250], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:02:50.191881 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78251], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:02:52.783070 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:02:53.478593 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78248], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.416146254] seconds [----] I, [2016-09-13T08:02:53.478902 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78248], Delivering... [----] I, [2016-09-13T08:02:53.546956 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78251], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.382772574] seconds [----] I, [2016-09-13T08:02:53.547167 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78251], Delivering... [----] I, [2016-09-13T08:02:53.556855 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004973888397216797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005002260208129883, :pending_vm_jobs=>0.0013632774353027344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009247064590454102} [----] I, [2016-09-13T08:02:53.557249 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78251], State: [ok], Delivered in [0.010086254] seconds [----] I, [2016-09-13T08:02:53.557841 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78248], State: [ok], Delivered in [0.078943477] seconds [----] I, [2016-09-13T08:02:55.566319 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78249], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.465403499] seconds [----] I, [2016-09-13T08:02:55.566668 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78249], Delivering... [----] I, [2016-09-13T08:02:55.571671 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78249], State: [ok], Delivered in [0.005044684] seconds [----] I, [2016-09-13T08:02:55.589107 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78250], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.451725692] seconds [----] I, [2016-09-13T08:02:55.589337 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78250], Delivering... [----] I, [2016-09-13T08:02:55.594338 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78250], State: [ok], Delivered in [0.005007674] seconds [----] I, [2016-09-13T08:02:59.554023 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006275177001953125, :worker_monitor=>1.748307228088379, :worker_dequeue=>0.008849143981933594, :total_time=>1.7637035846710205} [----] I, [2016-09-13T08:03:05.204511 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:03:05.229018 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78252], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:03:09.582700 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:03:09.708005 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78252], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.497595353] seconds [----] I, [2016-09-13T08:03:09.708185 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78252], Delivering... [----] I, [2016-09-13T08:03:09.714665 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035004615783691406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035200119018554688, :pending_vm_jobs=>0.0008172988891601562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006110191345214844} [----] I, [2016-09-13T08:03:09.715066 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78252], State: [ok], Delivered in [0.006871174] seconds [----] I, [2016-09-13T08:03:16.142607 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0048601627349853516, :worker_monitor=>1.5362141132354736, :worker_dequeue=>0.01171731948852539, :total_time=>1.5532121658325195} [----] I, [2016-09-13T08:03:20.241444 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:03:20.268627 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78253], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:03:20.318792 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78254], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:03:21.143409 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:03:21 UTC]... [----] I, [2016-09-13T08:03:21.179583 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:03:21 UTC]...Complete [----] I, [2016-09-13T08:03:21.191783 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:03:21.781793 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78254], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.507829805] seconds [----] I, [2016-09-13T08:03:21.781965 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78254], Delivering... [----] I, [2016-09-13T08:03:21.787927 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031061172485351562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031282901763916016, :pending_vm_jobs=>0.0007562637329101562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005636930465698242} [----] I, [2016-09-13T08:03:21.788263 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78254], State: [ok], Delivered in [0.006290412] seconds [----] I, [2016-09-13T08:03:22.698054 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78253], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.451963523] seconds [----] I, [2016-09-13T08:03:22.698289 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78253], Delivering... [----] I, [2016-09-13T08:03:22.705017 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78253], State: [ok], Delivered in [0.006699342] seconds [----] I, [2016-09-13T08:03:32.782987 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0043981075286865234, :worker_monitor=>1.553666353225708, :worker_dequeue=>0.00987553596496582, :total_time=>1.5682973861694336} [----] I, [2016-09-13T08:03:35.330409 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:03:35.353683 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78255], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:03:35.376472 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78256], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:03:35.410836 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78257], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:03:37.792860 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:03:37.970945 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78255], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.636103464] seconds [----] I, [2016-09-13T08:03:37.971153 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78255], Delivering... [----] I, [2016-09-13T08:03:37.972283 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T08:03:37.972507 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5357895680 [----] I, [2016-09-13T08:03:37.972632 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5132693504 [----] I, [2016-09-13T08:03:37.972738 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 225202176 [----] I, [2016-09-13T08:03:37.972842 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T08:03:37.972915 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5078675456 [----] I, [2016-09-13T08:03:37.972983 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T08:03:37.973050 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T08:03:37.973140 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 547061760 [----] I, [2016-09-13T08:03:37.973208 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T08:03:37.973273 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7896633344 [----] I, [2016-09-13T08:03:37.973339 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T08:03:37.973403 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T08:03:37.973514 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T08:03:37.973589 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 331776 [----] I, [2016-09-13T08:03:37.973653 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T08:03:37.973720 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T08:03:37.973810 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T08:03:37.973879 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T08:03:37.973949 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T08:03:37.974018 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T08:03:37.974084 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 274055168 [----] I, [2016-09-13T08:03:37.974148 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57053184 [----] I, [2016-09-13T08:03:37.974224 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217001984 [----] I, [2016-09-13T08:03:37.974297 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T08:03:37.974365 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141688832 [----] I, [2016-09-13T08:03:37.974473 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2589016064 [----] I, [2016-09-13T08:03:37.974598 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2268643328 [----] I, [2016-09-13T08:03:37.974674 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T08:03:37.974739 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T08:03:37.974830 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T08:03:37.974896 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37318656 [----] I, [2016-09-13T08:03:37.974961 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102301696 [----] I, [2016-09-13T08:03:37.975027 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53137408 [----] I, [2016-09-13T08:03:37.975094 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111079424 [----] I, [2016-09-13T08:03:37.975159 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155439104 [----] I, [2016-09-13T08:03:37.975220 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T08:03:37.975285 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T08:03:37.975357 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T08:03:37.975449 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T08:03:37.975537 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T08:03:37.975606 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T08:03:37.975672 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T08:03:37.975735 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T08:03:37.975823 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T08:03:37.984035 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78256], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.62429472] seconds [----] I, [2016-09-13T08:03:37.984241 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78256], Delivering... [----] I, [2016-09-13T08:03:37.992088 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:03:22 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48861.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T08:03:37.992754 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:03:29 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169070000], Memory % [3.14], CPU Time [51566.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:03:37.993272 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:03:20 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205295000], Memory % [3.5], CPU Time [240179.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T08:03:37.993842 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:03:31 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [202731.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T08:03:37.994315 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:03:25 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [104303.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T08:03:37.994912 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:03:31 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162418000], Memory % [3.1], CPU Time [37998.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T08:03:37.995451 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:03:31 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [151646.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:03:37.995927 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:03:31 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [150732.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:03:37.998947 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:03:27 UTC], Process Info: Memory Usage [605802496], Memory Size [951275520], Proportional Set Size: [438807000], Memory % [7.39], CPU Time [614.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:03:38.001256 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:03:28 UTC], Process Info: Memory Usage [592543744], Memory Size [922411008], Proportional Set Size: [427481000], Memory % [7.22], CPU Time [1037.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:03:38.003389 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:03:32 UTC], Process Info: Memory Usage [580177920], Memory Size [922386432], Proportional Set Size: [419805000], Memory % [7.07], CPU Time [2230.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T08:03:38.005487 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:03:29 UTC], Process Info: Memory Usage [557899776], Memory Size [911458304], Proportional Set Size: [405617000], Memory % [6.8], CPU Time [5658.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T08:03:38.006047 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:03:31 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [211531.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T08:03:38.006571 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:03:30 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51592.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:03:38.007042 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:03:29 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165805000], Memory % [3.16], CPU Time [38897.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T08:03:38.007401 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78256], State: [ok], Delivered in [0.02315035] seconds [----] I, [2016-09-13T08:03:38.019826 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T08:03:38.020010 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T08:03:38.023722 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T08:03:38.026302 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T08:03:38.029401 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T08:03:38.032507 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T08:03:38.035767 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T08:03:38.038856 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 846 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T08:03:38.041882 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T08:03:38.044914 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T08:03:38.047956 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.7 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T08:03:38.051041 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T08:03:38.051503 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78257], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.664874244] seconds [----] I, [2016-09-13T08:03:38.051684 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78257], Delivering... [----] I, [2016-09-13T08:03:38.058376 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 182 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T08:03:38.058411 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003607034683227539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003651142120361328, :pending_vm_jobs=>0.0008306503295898438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006354808807373047} [----] I, [2016-09-13T08:03:38.058830 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78257], State: [ok], Delivered in [0.007135116] seconds [----] I, [2016-09-13T08:03:38.061676 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T08:03:38.064345 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1, "smartstate"=>1}} [----] I, [2016-09-13T08:03:38.064520 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:03:38.064640 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T08:03:38.068940 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [151636.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:03:38.069342 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78255], State: [ok], Delivered in [0.098172554] seconds [----] I, [2016-09-13T08:03:42.815861 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T08:03:49.334081 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0052394866943359375, :worker_monitor=>1.4898555278778076, :worker_dequeue=>0.01111292839050293, :total_time=>1.5066125392913818} [----] I, [2016-09-13T08:03:50.428589 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:03:50.462140 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78258], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:03:50.484813 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78259], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:03:50.518979 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78260], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:03:50.542700 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78261], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:03:54.334675 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:03:54 UTC]... [----] I, [2016-09-13T08:03:54.364278 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:03:54 UTC]...Complete [----] I, [2016-09-13T08:03:54.478391 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:03:55.228107 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78258], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.794909198] seconds [----] I, [2016-09-13T08:03:55.228304 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78258], Delivering... [----] I, [2016-09-13T08:03:55.251213 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78261], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.725268464] seconds [----] I, [2016-09-13T08:03:55.251449 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78261], Delivering... [----] I, [2016-09-13T08:03:55.257716 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033812522888183594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033979415893554688, :pending_vm_jobs=>0.0007579326629638672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005887031555175781} [----] I, [2016-09-13T08:03:55.258042 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78261], State: [ok], Delivered in [0.006634754] seconds [----] I, [2016-09-13T08:03:55.290067 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78258], State: [ok], Delivered in [0.061743502] seconds [----] I, [2016-09-13T08:03:55.805566 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78259], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.336454567] seconds [----] I, [2016-09-13T08:03:55.805789 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78259], Delivering... [----] I, [2016-09-13T08:03:55.808961 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78259], State: [ok], Delivered in [0.003201354] seconds [----] I, [2016-09-13T08:03:55.846656 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78260], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.352355018] seconds [----] I, [2016-09-13T08:03:55.846860 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78260], Delivering... [----] I, [2016-09-13T08:03:55.851466 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78260], State: [ok], Delivered in [0.004574794] seconds [----] I, [2016-09-13T08:04:05.584099 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T08:04:05.627354 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78262], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:04:05.656003 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78263], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:04:06.053045 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:04:06.059517 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004201173782348633, :worker_monitor=>1.5389020442962646, :worker_dequeue=>0.011592626571655273, :total_time=>1.555039405822754} [----] I, [2016-09-13T08:04:06.353376 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78263], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.717405046] seconds [----] I, [2016-09-13T08:04:06.353577 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78263], Delivering... [----] I, [2016-09-13T08:04:06.359582 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00310516357421875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031249523162841797, :pending_vm_jobs=>0.000743865966796875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005644798278808594} [----] I, [2016-09-13T08:04:06.359939 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78263], State: [ok], Delivered in [0.006361874] seconds [----] I, [2016-09-13T08:04:07.884880 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78262], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.283889666] seconds [----] I, [2016-09-13T08:04:07.885074 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78262], Delivering... [----] I, [2016-09-13T08:04:07.919799 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78264], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T08:04:07.948710 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78265], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T08:04:07.949178 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78262], State: [ok], Delivered in [0.064077956] seconds [----] I, [2016-09-13T08:04:11.073000 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T08:04:11.075284 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T08:04:16.088362 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T08:04:16.090720 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T08:04:17.286901 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [78265], MiqWorker id: [100], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [9.356491852] seconds [----] I, [2016-09-13T08:04:17.287170 #10859:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78265], Delivering... [----] I, [2016-09-13T08:04:17.291692 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T08:04:17.291910 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T08:04:17.292081 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T08:04:17.292296 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T08:04:17.292503 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:17.765168 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:18.077286 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:18.077509 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:18.153773 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [78264], MiqWorker id: [99], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [10.251964526] seconds [----] I, [2016-09-13T08:04:18.154004 #5369:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78264], Delivering... [----] I, [2016-09-13T08:04:18.157858 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T08:04:18.158031 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T08:04:18.158166 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T08:04:18.158336 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T08:04:18.158549 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:18.445975 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:18.551720 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:18.644868 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:18.645084 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:18.847847 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:18.848039 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:18.997157 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:19.090923 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:19.181266 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:19.328965 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:19.477388 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:19.587335 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:19.621122 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:19.621319 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:19.680104 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:19.774933 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:19.868545 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:19.961492 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:20.054219 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:20.096887 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:20.148520 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:20.242163 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:20.338446 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:20.404869 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:20.405082 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:20.432828 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:20.527342 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:20.620671 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:20.668249 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:04:20.685031 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78266], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:04:20.708058 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78267], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:04:20.713294 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:20.805847 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:20.898296 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:20.917534 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:20.990324 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:04:21.218919 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:21.219088 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:21.235359 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T08:04:21.235644 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004004240036010742, :collect_inventory_for_targets=>6.151199340820312e-05, :parse_legacy_inventory=>28.13962411880493, :parse_targeted_inventory=>28.139854907989502, :save_inventory=>1.423820972442627, :ems_refresh=>29.56778860092163} [----] I, [2016-09-13T08:04:21.261912 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T08:04:21.262363 #5369:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78264], State: [ok], Delivered in [3.108369252] seconds [----] I, [2016-09-13T08:04:21.689660 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:22.000532 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:22.000831 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:22.481386 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:22.553090 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:04:22.558852 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004576921463012695, :worker_monitor=>1.452303171157837, :worker_dequeue=>0.010377883911132812, :total_time=>1.4676461219787598} [----] I, [2016-09-13T08:04:22.770609 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:22.770850 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:22.982695 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78267], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.291418868] seconds [----] I, [2016-09-13T08:04:22.983059 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78267], Delivering... [----] I, [2016-09-13T08:04:22.995294 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.006361722946166992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.006406068801879883, :pending_vm_jobs=>0.0016245841979980469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.011560678482055664} [----] I, [2016-09-13T08:04:22.995917 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78267], State: [ok], Delivered in [0.012853396] seconds [----] I, [2016-09-13T08:04:23.010357 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78266], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.337310599] seconds [----] I, [2016-09-13T08:04:23.010529 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78266], Delivering... [----] I, [2016-09-13T08:04:23.013984 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78266], State: [ok], Delivered in [0.003452198] seconds [----] I, [2016-09-13T08:04:23.272006 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:23.569210 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:23.569400 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:24.047878 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:24.348034 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:24.348208 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:24.803655 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:25.101770 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:25.101958 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:25.574515 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:25.900189 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:25.900359 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:26.387875 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:26.691019 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:26.691201 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:27.160612 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:27.466829 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:27.466983 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:27.559358 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:04:27 UTC]... [----] I, [2016-09-13T08:04:27.582050 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:04:27 UTC]...Complete [----] I, [2016-09-13T08:04:27.907261 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:28.083235 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:28.219184 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:28.350469 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:28.485293 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:28.620775 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:28.760054 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:28.894458 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:29.033290 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:29.168580 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:29.300614 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:29.436334 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:29.570096 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:29.702206 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:35.721290 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:04:35.761099 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78268], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:04:35.884202 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:36.214682 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:36.365997 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:36.510454 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:36.654450 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:36.795547 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:36.937582 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:37.076682 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:37.215412 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:37.356238 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:37.496169 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:37.633218 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:37.775699 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:37.915368 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:38.055055 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:38.195337 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:38.344887 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:38.488315 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:38.829962 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:38.993118 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:39.130274 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:39.234678 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:04:39.242102 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003891468048095703, :worker_monitor=>1.6091251373291016, :worker_dequeue=>0.013097047805786133, :total_time=>1.6264145374298096} [----] I, [2016-09-13T08:04:39.266211 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:39.408966 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:39.550220 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:39.605142 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78268], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.878056014] seconds [----] I, [2016-09-13T08:04:39.605301 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78268], Delivering... [----] I, [2016-09-13T08:04:39.610895 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002875804901123047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028934478759765625, :pending_vm_jobs=>0.0006780624389648438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005228281021118164} [----] I, [2016-09-13T08:04:39.611232 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78268], State: [ok], Delivered in [0.00590884] seconds [----] I, [2016-09-13T08:04:39.692883 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:39.831138 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:39.972823 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:40.119006 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:40.259233 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:40.401499 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:40.543818 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:40.680063 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:40.817538 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:40.956222 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:41.096616 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:42.164230 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:42.332351 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:42.518337 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:42.652536 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:42.789383 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:42.922790 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:43.063488 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:43.207871 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:43.341011 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:43.477110 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:43.618705 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:43.765945 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:43.908289 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:44.045550 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:44.183729 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:44.319339 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:44.460755 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:44.791110 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:44.942379 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:45.080962 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:45.219091 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:45.358354 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:45.503206 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:45.638043 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:45.773497 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:45.918117 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:46.057186 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:46.202060 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:46.339794 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:46.484437 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:46.623020 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:46.763287 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:46.906254 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:47.041303 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:47.438501 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:47.604604 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:47.751031 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:47.884404 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:48.028184 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:48.167572 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:48.300858 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:48.438934 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:48.576293 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:48.712167 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:48.847259 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:48.989388 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:49.129545 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:49.266320 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:49.407275 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:49.574000 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:49.708952 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:50.170162 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:50.344118 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:50.487672 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:50.626488 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:50.762263 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:50.773201 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:04:50.787807 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78269], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:04:50.799069 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78270], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:04:50.816299 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78271], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:04:50.827667 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78272], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:04:50.899716 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:51.034577 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:51.167177 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:51.302605 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:51.453028 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:51.597751 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:51.740710 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:51.879561 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:52.013961 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:52.147255 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:52.285698 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:52.424774 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:52.814000 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:55.440618 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:04:55.444102 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004071235656738281, :worker_monitor=>1.160196304321289, :worker_dequeue=>0.006563663482666016, :total_time=>1.1710753440856934} [----] I, [2016-09-13T08:04:55.749775 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78269], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.971889515] seconds [----] I, [2016-09-13T08:04:55.749990 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78269], Delivering... [----] I, [2016-09-13T08:04:55.754174 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78272], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.932715375] seconds [----] I, [2016-09-13T08:04:55.754310 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78272], Delivering... [----] I, [2016-09-13T08:04:55.758630 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023338794708251953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002348661422729492, :pending_vm_jobs=>0.0004897117614746094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004044532775878906} [----] I, [2016-09-13T08:04:55.758910 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78272], State: [ok], Delivered in [0.004599322] seconds [----] I, [2016-09-13T08:04:55.799449 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78269], State: [ok], Delivered in [0.049418548] seconds [----] I, [2016-09-13T08:04:56.126667 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78270], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.333183441] seconds [----] I, [2016-09-13T08:04:56.126823 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78270], Delivering... [----] I, [2016-09-13T08:04:56.130188 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78270], State: [ok], Delivered in [0.003347013] seconds [----] I, [2016-09-13T08:04:56.154581 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78271], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.347718678] seconds [----] I, [2016-09-13T08:04:56.154809 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78271], Delivering... [----] I, [2016-09-13T08:04:56.159389 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78271], State: [ok], Delivered in [0.004614883] seconds [----] I, [2016-09-13T08:04:58.927312 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:59.062949 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:59.208016 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:59.347055 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:59.486784 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:59.632808 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:59.775132 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:04:59.917639 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:00.052295 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:00.190771 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:00.327594 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:00.444527 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:05:00 UTC]... [----] I, [2016-09-13T08:05:00.465130 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:00.485234 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:05:00 UTC]...Complete [----] I, [2016-09-13T08:05:00.603077 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:00.745762 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:00.885787 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:01.023223 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:01.311467 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:01.463733 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:01.603623 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:01.737494 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:01.876945 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:02.013076 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:02.152586 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:02.291694 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:02.430253 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:02.573282 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:02.712300 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:02.854910 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:02.995507 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:03.130561 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:03.274896 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:03.415517 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:03.555683 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:03.986065 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:04.133093 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:04.268789 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:04.410900 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:04.549397 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:04.697071 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:04.838068 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:04.996201 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:05.130775 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:05.266887 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:05.410578 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:05.559911 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:05.705752 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:05.839545 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:05:05.857798 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78273], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:05:05.893548 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:06.036710 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:06.183093 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:06.323606 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:06.723301 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:06.875062 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:07.022306 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:07.167085 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:07.397315 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:07.546139 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:07.684965 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:07.832608 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:07.982441 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:08.148942 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:08.298940 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:08.439662 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:08.586897 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:08.725636 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:08.872140 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:09.024120 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:09.165902 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:09.517317 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:09.743053 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:11.794140 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:11.933012 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:12.077252 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:12.220657 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:12.362553 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:12.389775 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:05:12.396056 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006417751312255859, :worker_monitor=>1.7491612434387207, :worker_dequeue=>0.011906147003173828, :total_time=>1.7678923606872559} [----] I, [2016-09-13T08:05:12.508564 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:12.655515 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:12.807106 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:12.891237 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78273], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.044530357] seconds [----] I, [2016-09-13T08:05:12.891453 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78273], Delivering... [----] I, [2016-09-13T08:05:12.897611 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033044815063476562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033254623413085938, :pending_vm_jobs=>0.0007700920104980469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005795478820800781} [----] I, [2016-09-13T08:05:12.897947 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78273], State: [ok], Delivered in [0.0065134] seconds [----] I, [2016-09-13T08:05:12.965614 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:13.111185 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:13.245916 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:13.390820 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:13.528236 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:13.704250 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:13.847005 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:14.203268 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:14.377524 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:14.517172 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:14.663226 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:14.805562 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:14.945272 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:15.085384 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:15.226285 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:15.367583 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:15.512826 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:15.654914 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:15.803327 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:15.947967 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:16.094857 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:16.234545 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:16.375450 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:16.521276 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:17.047701 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:17.209780 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:17.348483 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:17.498594 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:17.635637 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:17.773577 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:17.917668 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:18.051245 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:18.187530 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:18.326385 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:18.458999 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:18.600136 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:18.742974 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:18.884322 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:19.024897 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:19.168215 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:05:19.304877 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T08:05:19.511717 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T08:05:19.512248 #10859:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T08:05:19.512594 #10859:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T08:05:19.512707 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T08:05:19.512840 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T08:05:19.542768 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T08:05:19.543150 #10859:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [78265], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T08:05:19.543408 #10859:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T08:05:19.543688 #10859:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T08:05:19.543898 #10859:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78265], State: [error], Delivered in [62.256764449] seconds [----] I, [2016-09-13T08:05:20.871558 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:05:20.891629 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78274], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:05:20.902488 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78275], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:05:22.422165 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:05:23.017664 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78275], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.120111317] seconds [----] I, [2016-09-13T08:05:23.017896 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78275], Delivering... [----] I, [2016-09-13T08:05:23.024503 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036716461181640625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036916732788085938, :pending_vm_jobs=>0.0007369518280029297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006200313568115234} [----] I, [2016-09-13T08:05:23.024836 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78275], State: [ok], Delivered in [0.006933987] seconds [----] I, [2016-09-13T08:05:23.263539 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78274], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.38665284] seconds [----] I, [2016-09-13T08:05:23.263793 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78274], Delivering... [----] I, [2016-09-13T08:05:23.269721 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78274], State: [ok], Delivered in [0.00590531] seconds [----] I, [2016-09-13T08:05:28.903103 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004392862319946289, :worker_monitor=>1.456207036972046, :worker_dequeue=>0.013080120086669922, :total_time=>1.4740140438079834} [----] I, [2016-09-13T08:05:33.903689 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:05:33 UTC]... [----] I, [2016-09-13T08:05:33.925582 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:05:33 UTC]...Complete [----] I, [2016-09-13T08:05:35.914982 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:05:35.937059 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78276], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:05:38.954486 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:05:39.109828 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78276], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.188048303] seconds [----] I, [2016-09-13T08:05:39.109993 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78276], Delivering... [----] I, [2016-09-13T08:05:39.115849 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002994537353515625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030133724212646484, :pending_vm_jobs=>0.0007529258728027344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055255889892578125} [----] I, [2016-09-13T08:05:39.116176 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78276], State: [ok], Delivered in [0.006179223] seconds [----] I, [2016-09-13T08:05:45.276283 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005032777786254883, :worker_monitor=>1.3026807308197021, :worker_dequeue=>0.006350278854370117, :total_time=>1.3145058155059814} [----] I, [2016-09-13T08:05:50.950328 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:05:50.972809 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78277], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:05:50.994368 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78278], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:05:51.028858 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78279], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:05:51.040004 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78280], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:05:55.303604 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:05:56.314677 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78277], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.359145922] seconds [----] I, [2016-09-13T08:05:56.314894 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78277], Delivering... [----] I, [2016-09-13T08:05:56.320241 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78280], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.285605367] seconds [----] I, [2016-09-13T08:05:56.320443 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78280], Delivering... [----] I, [2016-09-13T08:05:56.326347 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030596256256103516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003079652786254883, :pending_vm_jobs=>0.0007405281066894531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005543231964111328} [----] I, [2016-09-13T08:05:56.326693 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78280], State: [ok], Delivered in [0.006278511] seconds [----] I, [2016-09-13T08:05:56.360141 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78277], State: [ok], Delivered in [0.045235147] seconds [----] I, [2016-09-13T08:05:56.383147 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78278], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.404864632] seconds [----] I, [2016-09-13T08:05:56.383540 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78278], Delivering... [----] I, [2016-09-13T08:05:56.388976 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78279], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.386039441] seconds [----] I, [2016-09-13T08:05:56.389154 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78279], Delivering... [----] I, [2016-09-13T08:05:56.390609 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78278], State: [ok], Delivered in [0.00710676] seconds [----] I, [2016-09-13T08:05:56.393800 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78279], State: [ok], Delivered in [0.004608109] seconds [----] I, [2016-09-13T08:06:01.904901 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004693746566772461, :worker_monitor=>1.5775749683380127, :worker_dequeue=>0.011513710021972656, :total_time=>1.5941205024719238} [----] I, [2016-09-13T08:06:06.053006 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:06:06.097847 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78281], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:06:06.905412 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:06:06 UTC]... [----] I, [2016-09-13T08:06:06.926278 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:06:06 UTC]...Complete [----] I, [2016-09-13T08:06:07.041257 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:06:07.418031 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78281], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.358358239] seconds [----] I, [2016-09-13T08:06:07.418200 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78281], Delivering... [----] I, [2016-09-13T08:06:07.423990 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002932310104370117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029501914978027344, :pending_vm_jobs=>0.0007479190826416016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0054471492767333984} [----] I, [2016-09-13T08:06:07.424329 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78281], State: [ok], Delivered in [0.006120178] seconds [----] I, [2016-09-13T08:06:18.490304 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039708614349365234, :worker_monitor=>1.4096825122833252, :worker_dequeue=>0.011283159255981445, :total_time=>1.4253158569335938} [----] I, [2016-09-13T08:06:21.110620 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:06:21.155930 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78282], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:06:21.173020 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78283], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:06:23.500053 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:06:23.585256 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78283], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.424071696] seconds [----] I, [2016-09-13T08:06:23.585480 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78283], Delivering... [----] I, [2016-09-13T08:06:23.592048 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003251314163208008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003269195556640625, :pending_vm_jobs=>0.0007796287536621094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006176471710205078} [----] I, [2016-09-13T08:06:23.592553 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78283], State: [ok], Delivered in [0.00707787] seconds [----] I, [2016-09-13T08:06:26.499188 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78282], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.384071574] seconds [----] I, [2016-09-13T08:06:26.499381 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78282], Delivering... [----] I, [2016-09-13T08:06:26.504376 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78282], State: [ok], Delivered in [0.004980332] seconds [----] I, [2016-09-13T08:06:34.718281 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033664703369140625, :worker_monitor=>1.1799957752227783, :worker_dequeue=>0.010162353515625, :total_time=>1.1938235759735107} [----] I, [2016-09-13T08:06:36.183785 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:06:36.207354 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78284], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:06:39.718786 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:06:39 UTC]... [----] I, [2016-09-13T08:06:39.738752 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:06:39 UTC]...Complete [----] I, [2016-09-13T08:06:39.749332 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:06:40.676388 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78284], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.487567036] seconds [----] I, [2016-09-13T08:06:40.676598 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78284], Delivering... [----] I, [2016-09-13T08:06:40.682722 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003261089324951172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032799243927001953, :pending_vm_jobs=>0.0007505416870117188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005767107009887695} [----] I, [2016-09-13T08:06:40.683093 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78284], State: [ok], Delivered in [0.006486168] seconds [----] I, [2016-09-13T08:06:51.218368 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:06:51.242116 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78285], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:06:51.253404 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78286], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:06:51.271389 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78287], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:06:51.298997 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78288], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:06:51.404461 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:06:51.416461 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00481724739074707, :worker_monitor=>1.6219582557678223, :worker_dequeue=>0.01760077476501465, :total_time=>1.6447627544403076} [----] I, [2016-09-13T08:06:51.831009 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78285], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.606750017] seconds [----] I, [2016-09-13T08:06:51.831214 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78285], Delivering... [----] I, [2016-09-13T08:06:51.888020 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78288], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.612195027] seconds [----] I, [2016-09-13T08:06:51.888153 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78288], Delivering... [----] I, [2016-09-13T08:06:51.892141 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022437572479248047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002255678176879883, :pending_vm_jobs=>0.0004439353942871094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0037453174591064453} [----] I, [2016-09-13T08:06:51.892320 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78288], State: [ok], Delivered in [0.004168806] seconds [----] I, [2016-09-13T08:06:51.933393 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78285], State: [ok], Delivered in [0.102189547] seconds [----] I, [2016-09-13T08:06:53.585273 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78286], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.337310431] seconds [----] I, [2016-09-13T08:06:53.585495 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78286], Delivering... [----] I, [2016-09-13T08:06:53.588873 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78286], State: [ok], Delivered in [0.003409893] seconds [----] I, [2016-09-13T08:06:53.619402 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78287], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.356264515] seconds [----] I, [2016-09-13T08:06:53.619607 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78287], Delivering... [----] I, [2016-09-13T08:06:53.624056 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78287], State: [ok], Delivered in [0.004448227] seconds [----] I, [2016-09-13T08:07:06.309402 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:07:06.327772 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78289], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:07:07.827943 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:07:07.833671 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004082918167114258, :worker_monitor=>1.3763856887817383, :worker_dequeue=>0.010501861572265625, :total_time=>1.3913311958312988} [----] I, [2016-09-13T08:07:08.128389 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78289], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.812755354] seconds [----] I, [2016-09-13T08:07:08.128593 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78289], Delivering... [----] I, [2016-09-13T08:07:08.135150 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003155231475830078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031747817993164062, :pending_vm_jobs=>0.0007884502410888672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006224870681762695} [----] I, [2016-09-13T08:07:08.135516 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78289], State: [ok], Delivered in [0.006916687] seconds [----] I, [2016-09-13T08:07:12.834167 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:07:12 UTC]... [----] I, [2016-09-13T08:07:12.853535 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:07:12 UTC]...Complete [----] I, [2016-09-13T08:07:21.342032 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:07:21.385939 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78290], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:07:21.402695 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78291], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:07:24.604940 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:07:24.611551 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004884958267211914, :worker_monitor=>1.604017734527588, :worker_dequeue=>0.011792421340942383, :total_time=>1.621070146560669} [----] I, [2016-09-13T08:07:24.648588 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78291], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.254118198] seconds [----] I, [2016-09-13T08:07:24.648795 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78291], Delivering... [----] I, [2016-09-13T08:07:24.654889 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032002925872802734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032176971435546875, :pending_vm_jobs=>0.0007419586181640625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005712270736694336} [----] I, [2016-09-13T08:07:24.655239 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78291], State: [ok], Delivered in [0.006423883] seconds [----] I, [2016-09-13T08:07:27.105750 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78290], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.756803593] seconds [----] I, [2016-09-13T08:07:27.105939 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78290], Delivering... [----] I, [2016-09-13T08:07:27.110185 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78290], State: [ok], Delivered in [0.004246857] seconds [----] I, [2016-09-13T08:07:36.419664 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:07:36.436945 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78292], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:07:41.257916 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:07:41.264970 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004727602005004883, :worker_monitor=>1.600266695022583, :worker_dequeue=>0.012263774871826172, :total_time=>1.6176376342773438} [----] I, [2016-09-13T08:07:41.791529 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78292], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.365583768] seconds [----] I, [2016-09-13T08:07:41.791703 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78292], Delivering... [----] I, [2016-09-13T08:07:41.797662 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003088712692260742, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003106355667114258, :pending_vm_jobs=>0.0007696151733398438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005615234375} [----] I, [2016-09-13T08:07:41.798010 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78292], State: [ok], Delivered in [0.006300573] seconds [----] I, [2016-09-13T08:07:46.265510 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:07:46 UTC]... [----] I, [2016-09-13T08:07:46.294116 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:07:46 UTC]...Complete [----] I, [2016-09-13T08:07:51.449150 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:07:51.465816 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78293], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:07:51.489011 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78294], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:07:51.511406 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78295], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:07:51.557462 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78296], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:07:57.845953 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:07:57.852809 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0050890445709228516, :worker_monitor=>1.5060722827911377, :worker_dequeue=>0.012404918670654297, :total_time=>1.5241525173187256} [----] I, [2016-09-13T08:07:57.923329 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78293], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.469137861] seconds [----] I, [2016-09-13T08:07:57.923557 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78293], Delivering... [----] I, [2016-09-13T08:07:57.986034 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78293], State: [ok], Delivered in [0.06246147] seconds [----] I, [2016-09-13T08:07:58.003641 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78296], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.486040657] seconds [----] I, [2016-09-13T08:07:58.003937 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78296], Delivering... [----] I, [2016-09-13T08:07:58.014495 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00521087646484375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0052640438079833984, :pending_vm_jobs=>0.0013277530670166016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009927988052368164} [----] I, [2016-09-13T08:07:58.014963 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78296], State: [ok], Delivered in [0.011031351] seconds [----] I, [2016-09-13T08:08:00.284193 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78294], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.812371991] seconds [----] I, [2016-09-13T08:08:00.284591 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78294], Delivering... [----] I, [2016-09-13T08:08:00.297525 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78294], State: [ok], Delivered in [0.012905276] seconds [----] I, [2016-09-13T08:08:00.335241 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78295], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.837171675] seconds [----] I, [2016-09-13T08:08:00.335474 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78295], Delivering... [----] I, [2016-09-13T08:08:00.341133 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78295], State: [ok], Delivered in [0.005684501] seconds [----] I, [2016-09-13T08:08:06.571023 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:08:06.592104 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78297], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:08:07.880926 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:08:08.060763 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78297], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.482436465] seconds [----] I, [2016-09-13T08:08:08.060939 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78297], Delivering... [----] I, [2016-09-13T08:08:08.067205 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031507015228271484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031740665435791016, :pending_vm_jobs=>0.0008063316345214844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005915403366088867} [----] I, [2016-09-13T08:08:08.067548 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78297], State: [ok], Delivered in [0.006603771] seconds [----] I, [2016-09-13T08:08:14.228537 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003970146179199219, :server_monitor=>0.10387659072875977, :worker_monitor=>1.2251832485198975, :worker_dequeue=>0.005719423294067383, :total_time=>1.3391070365905762} [----] I, [2016-09-13T08:08:19.229096 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:08:19 UTC]... [----] I, [2016-09-13T08:08:19.261930 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:08:19 UTC]...Complete [----] I, [2016-09-13T08:08:21.604052 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:08:21.622107 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78298], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:08:21.635955 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78299], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:08:24.289133 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:08:24.451749 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78299], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.824082146] seconds [----] I, [2016-09-13T08:08:24.451970 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78299], Delivering... [----] I, [2016-09-13T08:08:24.459329 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038475990295410156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003871917724609375, :pending_vm_jobs=>0.000949859619140625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006940364837646484} [----] I, [2016-09-13T08:08:24.459777 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78299], State: [ok], Delivered in [0.007783903] seconds [----] I, [2016-09-13T08:08:24.490243 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78298], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.88170311] seconds [----] I, [2016-09-13T08:08:24.490452 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78298], Delivering... [----] I, [2016-09-13T08:08:24.495240 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78298], State: [ok], Delivered in [0.0048109] seconds [----] I, [2016-09-13T08:08:30.837110 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004019737243652344, :worker_monitor=>1.5285968780517578, :worker_dequeue=>0.008182287216186523, :total_time=>1.5410656929016113} [----] I, [2016-09-13T08:08:36.647499 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:08:36.661625 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78300], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:08:36.679093 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78301], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:08:36.695964 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78302], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:08:40.859860 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:08:41.342154 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78300], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.690303351] seconds [----] I, [2016-09-13T08:08:41.342331 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78300], Delivering... [----] I, [2016-09-13T08:08:41.343482 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T08:08:41.343651 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5368209408 [----] I, [2016-09-13T08:08:41.343744 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5142499328 [----] I, [2016-09-13T08:08:41.343818 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 225710080 [----] I, [2016-09-13T08:08:41.343885 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T08:08:41.343945 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5088481280 [----] I, [2016-09-13T08:08:41.344008 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T08:08:41.344071 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T08:08:41.344133 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 547332096 [----] I, [2016-09-13T08:08:41.344196 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T08:08:41.344257 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8025468928 [----] I, [2016-09-13T08:08:41.344318 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T08:08:41.344379 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T08:08:41.344471 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T08:08:41.344542 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T08:08:41.344603 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T08:08:41.344667 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T08:08:41.344736 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T08:08:41.344807 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T08:08:41.344866 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T08:08:41.344926 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T08:08:41.344985 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273817600 [----] I, [2016-09-13T08:08:41.345055 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57053184 [----] I, [2016-09-13T08:08:41.345121 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216764416 [----] I, [2016-09-13T08:08:41.345178 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T08:08:41.345238 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141688832 [----] I, [2016-09-13T08:08:41.345299 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2579415040 [----] I, [2016-09-13T08:08:41.345353 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2258771968 [----] I, [2016-09-13T08:08:41.345437 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T08:08:41.345513 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T08:08:41.345576 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T08:08:41.345634 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37474304 [----] I, [2016-09-13T08:08:41.345693 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102301696 [----] I, [2016-09-13T08:08:41.345770 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53297152 [----] I, [2016-09-13T08:08:41.345833 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111079424 [----] I, [2016-09-13T08:08:41.345891 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155598848 [----] I, [2016-09-13T08:08:41.345951 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T08:08:41.346009 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T08:08:41.346070 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T08:08:41.346126 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T08:08:41.346190 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T08:08:41.346267 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T08:08:41.346334 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T08:08:41.346393 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T08:08:41.346485 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T08:08:41.376851 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78302], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.690645175] seconds [----] I, [2016-09-13T08:08:41.377202 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78302], Delivering... [----] I, [2016-09-13T08:08:41.385651 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004687070846557617, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004717111587524414, :pending_vm_jobs=>0.0008785724639892578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007779598236083984} [----] I, [2016-09-13T08:08:41.386018 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78302], State: [ok], Delivered in [0.008871745] seconds [----] I, [2016-09-13T08:08:41.388605 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T08:08:41.388902 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T08:08:41.393377 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T08:08:41.396615 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T08:08:41.400353 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T08:08:41.405605 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T08:08:41.411328 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T08:08:41.415248 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 846 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T08:08:41.419226 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T08:08:41.425495 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T08:08:41.431272 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T08:08:41.435186 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T08:08:41.438742 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T08:08:41.442097 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T08:08:41.445304 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:08:41.445508 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:08:41.445631 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T08:08:41.450786 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [150834.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:08:41.451485 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78300], State: [ok], Delivered in [0.109069232] seconds [----] I, [2016-09-13T08:08:45.876104 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T08:08:46.693503 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:08:47.456889 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78301], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [10.791484763] seconds [----] I, [2016-09-13T08:08:47.457127 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78301], Delivering... [----] I, [2016-09-13T08:08:47.465867 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:08:46 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [150856.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:08:47.466382 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:08:37 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [104323.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T08:08:47.466909 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:08:46 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48870.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T08:08:47.467529 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:08:45 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169070000], Memory % [3.14], CPU Time [51583.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:08:47.468142 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:08:44 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162418000], Memory % [3.1], CPU Time [38009.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T08:08:47.468715 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:08:36 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205295000], Memory % [3.5], CPU Time [240309.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T08:08:47.469273 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:08:45 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [202804.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T08:08:47.469849 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:08:46 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [151757.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:08:47.472965 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:08:41 UTC], Process Info: Memory Usage [592773120], Memory Size [937091072], Proportional Set Size: [427707000], Memory % [7.23], CPU Time [1078.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:08:47.475284 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:08:39 UTC], Process Info: Memory Usage [613707776], Memory Size [1030676480], Proportional Set Size: [446589000], Memory % [7.48], CPU Time [768.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:08:47.477653 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:08:42 UTC], Process Info: Memory Usage [580415488], Memory Size [937590784], Proportional Set Size: [420038000], Memory % [7.08], CPU Time [2242.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T08:08:47.479971 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:08:40 UTC], Process Info: Memory Usage [558440448], Memory Size [930906112], Proportional Set Size: [406139000], Memory % [6.81], CPU Time [5671.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T08:08:47.480609 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:08:45 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [211630.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T08:08:47.481216 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:08:43 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51640.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:08:47.481773 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:08:41 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165805000], Memory % [3.16], CPU Time [38909.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T08:08:47.482164 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78301], State: [ok], Delivered in [0.025032799] seconds [----] I, [2016-09-13T08:08:51.703457 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:08:51 UTC]... [----] I, [2016-09-13T08:08:51.708714 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:08:51.730930 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78303], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:08:51.753548 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:08:51 UTC]...Complete [----] I, [2016-09-13T08:08:51.759394 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78304], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:08:51.762351 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:08:51.782253 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78305], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:08:51.824366 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78306], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:08:52.553830 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78303], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.840119366] seconds [----] I, [2016-09-13T08:08:52.554044 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78303], Delivering... [----] I, [2016-09-13T08:08:52.616387 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78303], State: [ok], Delivered in [0.0623294] seconds [----] I, [2016-09-13T08:08:54.610913 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78304], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.874513751] seconds [----] I, [2016-09-13T08:08:54.611110 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78304], Delivering... [----] I, [2016-09-13T08:08:54.614529 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78304], State: [ok], Delivered in [0.003412252] seconds [----] I, [2016-09-13T08:08:56.776903 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:08:57.594016 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78306], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.806281362] seconds [----] I, [2016-09-13T08:08:57.594225 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78306], Delivering... [----] I, [2016-09-13T08:08:57.601626 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036606788635253906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036852359771728516, :pending_vm_jobs=>0.0010230541229248047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006907463073730469} [----] I, [2016-09-13T08:08:57.602028 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78306], State: [ok], Delivered in [0.007791252] seconds [----] I, [2016-09-13T08:08:57.651251 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78305], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.883852348] seconds [----] I, [2016-09-13T08:08:57.651500 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78305], Delivering... [----] I, [2016-09-13T08:08:57.657800 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78305], State: [ok], Delivered in [0.006253402] seconds [----] I, [2016-09-13T08:09:03.167372 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005773067474365234, :worker_monitor=>1.3710582256317139, :worker_dequeue=>0.0062863826751708984, :total_time=>1.3836228847503662} [----] I, [2016-09-13T08:09:06.835624 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:09:06.850902 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78307], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:09:08.177511 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:09:08.703549 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78307], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.862201599] seconds [----] I, [2016-09-13T08:09:08.703827 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78307], Delivering... [----] I, [2016-09-13T08:09:08.710790 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003464937210083008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035240650177001953, :pending_vm_jobs=>0.0008733272552490234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006537437438964844} [----] I, [2016-09-13T08:09:08.711159 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78307], State: [ok], Delivered in [0.007334237] seconds [----] I, [2016-09-13T08:09:19.834680 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007483959197998047, :worker_monitor=>1.5085909366607666, :worker_dequeue=>0.015335798263549805, :total_time=>1.531738042831421} [----] I, [2016-09-13T08:09:21.860626 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:09:21.879908 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78308], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:09:21.930901 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78309], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:09:24.835399 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:09:24 UTC]... [----] I, [2016-09-13T08:09:24.856224 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:09:24 UTC]...Complete [----] I, [2016-09-13T08:09:24.871180 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:09:25.845538 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78309], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.960057638] seconds [----] I, [2016-09-13T08:09:25.845770 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78309], Delivering... [----] I, [2016-09-13T08:09:25.852654 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003681182861328125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003734588623046875, :pending_vm_jobs=>0.0008230209350585938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006498098373413086} [----] I, [2016-09-13T08:09:25.853041 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78309], State: [ok], Delivered in [0.007284842] seconds [----] I, [2016-09-13T08:09:27.759348 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78308], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.894149981] seconds [----] I, [2016-09-13T08:09:27.759570 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78308], Delivering... [----] I, [2016-09-13T08:09:27.764284 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78308], State: [ok], Delivered in [0.004703092] seconds [----] I, [2016-09-13T08:09:36.350046 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0071620941162109375, :worker_monitor=>1.4210519790649414, :worker_dequeue=>0.011068105697631836, :total_time=>1.4396071434020996} [----] I, [2016-09-13T08:09:36.943360 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:09:36.959755 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78310], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:09:41.360122 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:09:41.971068 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78310], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.021742421] seconds [----] I, [2016-09-13T08:09:41.971234 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78310], Delivering... [----] I, [2016-09-13T08:09:41.977461 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031576156616210938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031774044036865234, :pending_vm_jobs=>0.0008115768432617188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005815267562866211} [----] I, [2016-09-13T08:09:41.977829 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78310], State: [ok], Delivered in [0.006590439] seconds [----] I, [2016-09-13T08:09:51.977498 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:09:52.000093 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78311], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:09:52.016787 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78312], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:09:52.033912 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78313], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:09:52.051050 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78314], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:09:52.962596 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:09:52.968203 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0046727657318115234, :worker_monitor=>1.5688505172729492, :worker_dequeue=>0.010329484939575195, :total_time=>1.5841991901397705} [----] I, [2016-09-13T08:09:53.126004 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78311], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.143333747] seconds [----] I, [2016-09-13T08:09:53.126200 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78311], Delivering... [----] I, [2016-09-13T08:09:53.131627 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78314], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.091778523] seconds [----] I, [2016-09-13T08:09:53.131843 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78314], Delivering... [----] I, [2016-09-13T08:09:53.138746 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035560131072998047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035822391510009766, :pending_vm_jobs=>0.0008428096771240234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006478548049926758} [----] I, [2016-09-13T08:09:53.139100 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78314], State: [ok], Delivered in [0.007262443] seconds [----] I, [2016-09-13T08:09:53.206063 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78311], State: [ok], Delivered in [0.079845798] seconds [----] I, [2016-09-13T08:09:54.863144 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78312], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.856767197] seconds [----] I, [2016-09-13T08:09:54.863337 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78312], Delivering... [----] I, [2016-09-13T08:09:54.866753 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78312], State: [ok], Delivered in [0.003395349] seconds [----] I, [2016-09-13T08:09:54.868799 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78313], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.843226432] seconds [----] I, [2016-09-13T08:09:54.868994 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78313], Delivering... [----] I, [2016-09-13T08:09:54.874354 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78313], State: [ok], Delivered in [0.005358714] seconds [----] I, [2016-09-13T08:09:57.969512 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:09:57 UTC]... [----] I, [2016-09-13T08:09:57.989217 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:09:57 UTC]...Complete [----] I, [2016-09-13T08:10:07.064085 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T08:10:07.082659 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78315], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:10:07.103101 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78316], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:10:07.114327 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78317], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:10:07.125739 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78318], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:10:09.799122 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:10:09.806700 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00455927848815918, :worker_monitor=>1.7605457305908203, :worker_dequeue=>0.013580083847045898, :total_time=>1.7789685726165771} [----] I, [2016-09-13T08:10:09.931783 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78318], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.812625034] seconds [----] I, [2016-09-13T08:10:09.931963 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78318], Delivering... [----] I, [2016-09-13T08:10:09.938706 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00342559814453125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003475189208984375, :pending_vm_jobs=>0.0008587837219238281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063512325286865234} [----] I, [2016-09-13T08:10:09.939003 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78318], State: [ok], Delivered in [0.007037169] seconds [----] I, [2016-09-13T08:10:09.948965 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78315], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.876565897] seconds [----] I, [2016-09-13T08:10:09.949128 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78315], Delivering... [----] I, [2016-09-13T08:10:09.951474 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78315], State: [ok], Delivered in [0.002313921] seconds [----] I, [2016-09-13T08:10:09.983367 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78316], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.89582853] seconds [----] I, [2016-09-13T08:10:09.983582 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78316], Delivering... [----] I, [2016-09-13T08:10:09.988948 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78317], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.881142333] seconds [----] I, [2016-09-13T08:10:09.989126 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78317], Delivering... [----] I, [2016-09-13T08:10:09.994614 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78316], State: [ok], Delivered in [0.011008194] seconds [----] I, [2016-09-13T08:10:09.995156 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78317], State: [ok], Delivered in [0.006021915] seconds [----] I, [2016-09-13T08:10:22.136639 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:10:22.148959 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78319], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:10:22.160300 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78320], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:10:26.476011 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:10:26.481847 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003877878189086914, :worker_monitor=>1.517655849456787, :worker_dequeue=>0.010423898696899414, :total_time=>1.532214879989624} [----] I, [2016-09-13T08:10:27.377769 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78320], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.223690093] seconds [----] I, [2016-09-13T08:10:27.377950 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78320], Delivering... [----] I, [2016-09-13T08:10:27.384225 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003124713897705078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003147125244140625, :pending_vm_jobs=>0.0008203983306884766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005915403366088867} [----] I, [2016-09-13T08:10:27.384603 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78320], State: [ok], Delivered in [0.006648276] seconds [----] I, [2016-09-13T08:10:28.069183 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78319], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.928089129] seconds [----] I, [2016-09-13T08:10:28.069391 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78319], Delivering... [----] I, [2016-09-13T08:10:28.074971 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78319], State: [ok], Delivered in [0.005576646] seconds [----] I, [2016-09-13T08:10:31.482387 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:10:31 UTC]... [----] I, [2016-09-13T08:10:31.503224 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:10:31 UTC]...Complete [----] I, [2016-09-13T08:10:37.171200 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:10:37.223899 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78321], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:10:42.810470 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:10:42.813983 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002906322479248047, :worker_monitor=>1.2613592147827148, :worker_dequeue=>0.00626826286315918, :total_time=>1.27073073387146} [----] I, [2016-09-13T08:10:43.115195 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78321], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.939337851] seconds [----] I, [2016-09-13T08:10:43.115370 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78321], Delivering... [----] I, [2016-09-13T08:10:43.121898 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032896995544433594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003309965133666992, :pending_vm_jobs=>0.0008640289306640625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006123781204223633} [----] I, [2016-09-13T08:10:43.122208 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78321], State: [ok], Delivered in [0.006838559] seconds [----] I, [2016-09-13T08:10:52.236865 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:10:52.252330 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78322], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:10:52.269302 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78323], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:10:52.286361 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78324], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:10:52.297783 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78325], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:10:52.845027 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:10:53.578272 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78322], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.336903833] seconds [----] I, [2016-09-13T08:10:53.578497 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78322], Delivering... [----] I, [2016-09-13T08:10:53.618237 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78325], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.32675873] seconds [----] I, [2016-09-13T08:10:53.618451 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78325], Delivering... [----] I, [2016-09-13T08:10:53.625497 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003557920455932617, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003581523895263672, :pending_vm_jobs=>0.0008542537689208984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065844058990478516} [----] I, [2016-09-13T08:10:53.625857 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78325], State: [ok], Delivered in [0.007429636] seconds [----] I, [2016-09-13T08:10:53.646619 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78322], State: [ok], Delivered in [0.068127553] seconds [----] I, [2016-09-13T08:10:55.212525 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78323], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.954513867] seconds [----] I, [2016-09-13T08:10:55.212752 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78323], Delivering... [----] I, [2016-09-13T08:10:55.216224 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78323], State: [ok], Delivered in [0.003492287] seconds [----] I, [2016-09-13T08:10:55.218227 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78324], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.941138621] seconds [----] I, [2016-09-13T08:10:55.218454 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78324], Delivering... [----] I, [2016-09-13T08:10:55.223945 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78324], State: [ok], Delivered in [0.005521362] seconds [----] I, [2016-09-13T08:10:59.270477 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006479978561401367, :worker_monitor=>1.40114426612854, :worker_dequeue=>0.009999513626098633, :total_time=>1.4180519580841064} [----] I, [2016-09-13T08:11:04.270947 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:11:04 UTC]... [----] I, [2016-09-13T08:11:04.287390 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:11:04 UTC]...Complete [----] I, [2016-09-13T08:11:07.308549 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:11:07.326864 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78326], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:11:09.316529 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:11:09.761197 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78326], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.446414634] seconds [----] I, [2016-09-13T08:11:09.761382 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78326], Delivering... [----] I, [2016-09-13T08:11:09.768794 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003725767135620117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037565231323242188, :pending_vm_jobs=>0.0008885860443115234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006905794143676758} [----] I, [2016-09-13T08:11:09.769168 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78326], State: [ok], Delivered in [0.007778964] seconds [----] I, [2016-09-13T08:11:15.559045 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005585193634033203, :worker_monitor=>1.2221825122833252, :worker_dequeue=>0.007349967956542969, :total_time=>1.235426902770996} [----] I, [2016-09-13T08:11:22.338036 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:11:22.355816 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78327], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:11:22.367082 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78328], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:11:25.725990 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:11:25.866268 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78328], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.505295205] seconds [----] I, [2016-09-13T08:11:25.866479 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78328], Delivering... [----] I, [2016-09-13T08:11:25.873803 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003772258758544922, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003802061080932617, :pending_vm_jobs=>0.0008862018585205078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068798065185546875} [----] I, [2016-09-13T08:11:25.874198 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78328], State: [ok], Delivered in [0.007738451] seconds [----] I, [2016-09-13T08:11:28.310296 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78327], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.967572029] seconds [----] I, [2016-09-13T08:11:28.310485 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78327], Delivering... [----] I, [2016-09-13T08:11:28.314980 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78327], State: [ok], Delivered in [0.004491858] seconds [----] I, [2016-09-13T08:11:32.113914 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004008769989013672, :worker_monitor=>1.3674805164337158, :worker_dequeue=>0.01198577880859375, :total_time=>1.3838069438934326} [----] I, [2016-09-13T08:11:37.114481 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:11:37 UTC]... [----] I, [2016-09-13T08:11:37.138802 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:11:37 UTC]...Complete [----] I, [2016-09-13T08:11:37.377316 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:11:37.395850 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78329], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:11:42.169550 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:11:42.984534 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78329], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.601528925] seconds [----] I, [2016-09-13T08:11:42.984702 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78329], Delivering... [----] I, [2016-09-13T08:11:42.990360 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028214454650878906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002839803695678711, :pending_vm_jobs=>0.0007157325744628906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005318403244018555} [----] I, [2016-09-13T08:11:42.990705 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78329], State: [ok], Delivered in [0.006008886] seconds [----] I, [2016-09-13T08:11:48.356400 #2763:34713c] INFO -- : MIQ(MiqServer#validate_worker) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit [----] I, [2016-09-13T08:11:48.368201 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78330], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_uptime_exceeded", {:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T08:11:48.368539 #2763:34713c] INFO -- : MIQ(MiqServer#stop_worker) Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3], status [started]... [----] I, [2016-09-13T08:11:48.379180 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78331], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T08:11:48.432678 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3] is being requested to exit [----] I, [2016-09-13T08:11:48.791824 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:11:48.798129 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006102323532104492, :worker_monitor=>1.6038460731506348, :worker_dequeue=>0.011133909225463867, :total_time=>1.6214323043823242} [----] I, [2016-09-13T08:11:49.425129 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78330], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_uptime_exceeded", {:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [1.066693602] seconds [----] I, [2016-09-13T08:11:49.425317 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78330], Delivering... [----] I, [2016-09-13T08:11:49.430376 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78331], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [1.059593276] seconds [----] I, [2016-09-13T08:11:49.430583 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78331], Delivering... [----] I, [2016-09-13T08:11:49.448356 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_uptime_exceeded"> inputs=<{:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1086, :miq_event_id=>1086, "EventStream::event_stream"=>1086, :event_stream_id=>1086}> [----] I, [2016-09-13T08:11:49.453829 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_stop"> inputs=<{:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1087, :miq_event_id=>1087, "EventStream::event_stream"=>1087, :event_stream_id=>1087}> [----] I, [2016-09-13T08:11:49.483734 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78332], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1086, :miq_event_id=>1086, "EventStream::event_stream"=>1086, :event_stream_id=>1086}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T08:11:49.484113 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78330], State: [ok], Delivered in [0.058790792] seconds [----] I, [2016-09-13T08:11:49.489227 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78333], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1087, :miq_event_id=>1087, "EventStream::event_stream"=>1087, :event_stream_id=>1087}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T08:11:49.489603 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78331], State: [ok], Delivered in [0.059016514] seconds [----] I, [2016-09-13T08:11:52.000302 #5369:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [99], PID [5369], GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:11:41 UTC], Process Info: Memory Usage [592773120], Memory Size [937091072], Proportional Set Size: [427722000], Memory % [7.23], CPU Time [1085.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:11:52.000849 #5369:34713c] INFO -- : EMS [10.16.23.206] as [jdoe] ID [99] PID [5369] GUID [79c8c984-799a-11e6-87c1-fa163e7d01a3] Exit request received. Worker exiting. [----] I, [2016-09-13T08:11:52.406495 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:11:52.426227 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78334], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:11:52.436483 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78335], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:11:52.448026 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78336], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:11:52.465624 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78337], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:11:53.807857 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:11:54.119689 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78332], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1086, :miq_event_id=>1086, "EventStream::event_stream"=>1086, :event_stream_id=>1086}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [4.651337854] seconds [----] I, [2016-09-13T08:11:54.119953 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78332], Delivering... [----] I, [2016-09-13T08:11:54.122390 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1086, :miq_event_id=>1086, "EventStream::event_stream"=>1086, :event_stream_id=>1086} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T08:11:54.124005 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78333], MiqWorker id: [16], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1087, :miq_event_id=>1087, "EventStream::event_stream"=>1087, :event_stream_id=>1087}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [4.654428601] seconds [----] I, [2016-09-13T08:11:54.124177 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78333], Delivering... [----] I, [2016-09-13T08:11:54.125882 #2957:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1087, :miq_event_id=>1087, "EventStream::event_stream"=>1087, :event_stream_id=>1087} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T08:11:54.128363 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1086&MiqEvent%3A%3Amiq_event=1086&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B99%5D%2C%20PID%3A%20%5B5369%5D%2C%20GUID%3A%20%5B79c8c984-799a-11e6-87c1-fa163e7d01a3%5D%20uptime%20has%20reached%20the%20interval%20of%207200%20seconds%2C%20requesting%20worker%20to%20exit&event_stream_id=1086&event_type=evm_worker_uptime_exceeded&miq_event_id=1086&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T08:11:54.130192 #2957:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1087&MiqEvent%3A%3Amiq_event=1087&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B99%5D%2C%20PID%3A%20%5B5369%5D%2C%20GUID%3A%20%5B79c8c984-799a-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1087&event_type=evm_worker_stop&miq_event_id=1087&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T08:11:54.151846 #2957:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1087&MiqEvent%3A%3Amiq_event=1087&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B99%5D%2C%20PID%3A%20%5B5369%5D%2C%20GUID%3A%20%5B79c8c984-799a-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1087&event_type=evm_worker_stop&miq_event_id=1087&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T08:11:54.153269 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1086&MiqEvent%3A%3Amiq_event=1086&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B99%5D%2C%20PID%3A%20%5B5369%5D%2C%20GUID%3A%20%5B79c8c984-799a-11e6-87c1-fa163e7d01a3%5D%20uptime%20has%20reached%20the%20interval%20of%207200%20seconds%2C%20requesting%20worker%20to%20exit&event_stream_id=1086&event_type=evm_worker_uptime_exceeded&miq_event_id=1086&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T08:11:54.199306 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T08:11:54.210658 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T08:11:54.222043 #2957:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_stop] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T08:11:54.233064 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T08:11:54.235975 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T08:11:54.243574 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create] [----] I, [2016-09-13T08:11:54.245024 #2957:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T08:11:54.249502 #2957:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T08:11:54.252166 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 12:11:37", os_priority: 21, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 277401600, memory_size: 578035712, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 202019000, has_active_websocket: true>] [----] I, [2016-09-13T08:11:54.252304 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_stop] [----] I, [2016-09-13T08:11:54.264335 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T08:11:54.270811 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_stop] [----] I, [2016-09-13T08:11:54.270956 #2957:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_stop] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T08:11:54.275768 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T08:11:54.276105 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T08:11:54.276581 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78333], State: [ok], Delivered in [0.152411294] seconds [----] I, [2016-09-13T08:11:54.285843 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T08:11:54.294012 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78334], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.88398437] seconds [----] I, [2016-09-13T08:11:54.294165 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78334], Delivering... [----] I, [2016-09-13T08:11:54.306351 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T08:11:54.311896 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T08:11:54.328760 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T08:11:54.337273 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T08:11:54.342106 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 12:11:37", os_priority: 21, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 277401600, memory_size: 578035712, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 202019000, has_active_websocket: true>] [----] I, [2016-09-13T08:11:54.342360 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_uptime_exceeded] [----] I, [2016-09-13T08:11:54.345195 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78334], State: [ok], Delivered in [0.051011311] seconds [----] I, [2016-09-13T08:11:54.362299 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_uptime_exceeded] [----] I, [2016-09-13T08:11:54.362574 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_uptime_exceeded] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T08:11:54.368225 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78337], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.916229227] seconds [----] I, [2016-09-13T08:11:54.368378 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78337], Delivering... [----] I, [2016-09-13T08:11:54.371098 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T08:11:54.371680 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create] [----] I, [2016-09-13T08:11:54.372505 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78332], State: [ok], Delivered in [0.252543348] seconds [----] I, [2016-09-13T08:11:54.374269 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002993345260620117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030138492584228516, :pending_vm_jobs=>0.0007786750793457031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055315494537353516} [----] I, [2016-09-13T08:11:54.374605 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78337], State: [ok], Delivered in [0.006223411] seconds [----] I, [2016-09-13T08:11:55.552929 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78335], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.121634293] seconds [----] I, [2016-09-13T08:11:55.553157 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78335], Delivering... [----] I, [2016-09-13T08:11:55.556624 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78335], State: [ok], Delivered in [0.003491123] seconds [----] I, [2016-09-13T08:11:55.556972 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78336], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.115133035] seconds [----] I, [2016-09-13T08:11:55.557167 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78336], Delivering... [----] I, [2016-09-13T08:11:55.562539 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78336], State: [ok], Delivered in [0.00538151] seconds [----] I, [2016-09-13T08:12:03.934492 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker.sync_workers) Workers are being synchronized: Current: ["ems_16"], Desired: ["ems_15", "ems_16"] [----] I, [2016-09-13T08:12:04.031351 #2763:34713c] INFO -- : :kill_algorithm: [----] I, [2016-09-13T08:12:04.031507 #2763:34713c] INFO -- : :name: :used_swap_percent_gt_value [----] I, [2016-09-13T08:12:04.031560 #2763:34713c] INFO -- : :value: 80 [----] I, [2016-09-13T08:12:04.031599 #2763:34713c] INFO -- : :miq_server_time_threshold: 120 [----] I, [2016-09-13T08:12:04.031634 #2763:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T08:12:04.031667 #2763:34713c] INFO -- : :poll: 2 [----] I, [2016-09-13T08:12:04.031699 #2763:34713c] INFO -- : :start_algorithm: [----] I, [2016-09-13T08:12:04.031773 #2763:34713c] INFO -- : :name: :used_swap_percent_lt_value [----] I, [2016-09-13T08:12:04.031890 #2763:34713c] INFO -- : :value: 60 [----] I, [2016-09-13T08:12:04.031925 #2763:34713c] INFO -- : :sync_interval: 1800 [----] I, [2016-09-13T08:12:04.031957 #2763:34713c] INFO -- : :wait_for_started_timeout: 600 [----] I, [2016-09-13T08:12:04.419378 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker.close_pg_sockets_inherited_from_parent) Closing socket: 21 [----] I, [2016-09-13T08:12:04.592361 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78338], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T08:12:04.592536 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#start) Worker started: ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3] [----] I, [2016-09-13T08:12:04.864308 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:12:04.865346 #12930:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T08:12:04.865450 #12930:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:12:04.865513 #12930:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:12:04.865554 #12930:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:12:04.865592 #12930:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T08:12:04.865627 #12930:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T08:12:04.865673 #12930:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:12:04.865725 #12930:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T08:12:04.865773 #12930:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:12:04.865811 #12930:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:12:04.865850 #12930:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T08:12:04.865884 #12930:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:12:04.865920 #12930:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T08:12:04.865952 #12930:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:12:04.865987 #12930:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T08:12:04.866019 #12930:34713c] INFO -- : --- [----] I, [2016-09-13T08:12:04.866466 #12930:34713c] INFO -- : :guid: 4846d89a-79ab-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:12:04.866547 #12930:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T08:12:05.204315 #12930:34713c] INFO -- : MIQ(AuthUseridPassword#validation_successful) [ExtManagementSystem] [15], previously valid/invalid on: [2016-09-13 10:11:46 UTC]/[], previous status: [Valid] [----] I, [2016-09-13T08:12:05.236164 #12930:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78339], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 15], "ems_auth_valid", {}] [----] I, [2016-09-13T08:12:05.733352 #12930:34713c] INFO -- : ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner started. ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Zone [default], Role [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket] [----] I, [2016-09-13T08:12:05.733917 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_wait_for_worker_monitor) EMS [10.16.23.206] as [jdoe] Checking that worker monitor has started before doing work [----] I, [2016-09-13T08:12:05.737999 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_wait_for_worker_monitor) EMS [10.16.23.206] as [jdoe] Starting work since worker monitor has started [----] I, [2016-09-13T08:12:05.738118 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_before_work_loop) EMS [10.16.23.206] as [jdoe] Queueing initial refresh for EMS. [----] I, [2016-09-13T08:12:05.760628 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:12:05.764737 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004851818084716797, :worker_monitor=>1.9228191375732422, :worker_dequeue=>0.007268428802490234, :total_time=>1.9353842735290527} [----] I, [2016-09-13T08:12:05.767614 #12930:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78340], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T08:12:05.769814 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#worker_monitor_drb) EMS [10.16.23.206] as [jdoe] Initializing DRb Connection to MiqServer with ID=[1], NAME=[EVM], PID=[2763], GUID=[36647afc-71a3-11e6-838a-fa163e68952f] DRb URI=[druby://127.0.0.1:41718] [----] I, [2016-09-13T08:12:07.476768 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:12:07.487318 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78341], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:12:07.608281 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78338], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [3.043550388] seconds [----] I, [2016-09-13T08:12:07.608475 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78338], Delivering... [----] I, [2016-09-13T08:12:07.613926 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78339], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 15], "ems_auth_valid", {}], Dequeued in: [2.388792205] seconds [----] I, [2016-09-13T08:12:07.614139 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78339], Delivering... [----] I, [2016-09-13T08:12:07.631161 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_start"> inputs=<{:event_details=>"Worker started: ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1088, :miq_event_id=>1088, "EventStream::event_stream"=>1088, :event_stream_id=>1088}> [----] I, [2016-09-13T08:12:07.636732 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"ems_auth_valid"> inputs=<{"MiqEvent::miq_event"=>1089, :miq_event_id=>1089, "EventStream::event_stream"=>1089, :event_stream_id=>1089}> [----] I, [2016-09-13T08:12:07.655256 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78342], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1088, :miq_event_id=>1088, "EventStream::event_stream"=>1088, :event_stream_id=>1088}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T08:12:07.655621 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78338], State: [ok], Delivered in [0.047164089] seconds [----] I, [2016-09-13T08:12:07.660770 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78343], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>15, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1089, :miq_event_id=>1089, "EventStream::event_stream"=>1089, :event_stream_id=>1089}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T08:12:07.661141 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78339], State: [ok], Delivered in [0.047002166] seconds [----] I, [2016-09-13T08:12:10.765173 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:12:10 UTC]... [----] I, [2016-09-13T08:12:10.786310 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:12:10 UTC]...Complete [----] I, [2016-09-13T08:12:10.794245 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:12:10.797353 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=3, priority=200 [----] I, [2016-09-13T08:12:11.579956 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78341], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.097560702] seconds [----] I, [2016-09-13T08:12:11.580117 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78341], Delivering... [----] I, [2016-09-13T08:12:11.586397 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033125877380371094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003330707550048828, :pending_vm_jobs=>0.0007925033569335938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005956888198852539} [----] I, [2016-09-13T08:12:11.586786 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78341], State: [ok], Delivered in [0.006661057] seconds [----] I, [2016-09-13T08:12:11.587344 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78342], MiqWorker id: [16], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1088, :miq_event_id=>1088, "EventStream::event_stream"=>1088, :event_stream_id=>1088}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [3.946795911] seconds [----] I, [2016-09-13T08:12:11.587522 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78342], Delivering... [----] I, [2016-09-13T08:12:11.589321 #2957:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1088, :miq_event_id=>1088, "EventStream::event_stream"=>1088, :event_stream_id=>1088} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T08:12:11.594205 #2957:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1088&MiqEvent%3A%3Amiq_event=1088&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B101%5D%2C%20PID%20%5B12930%5D%2C%20GUID%20%5B4846d89a-79ab-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1088&event_type=evm_worker_start&miq_event_id=1088&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T08:12:11.609263 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78343], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>15, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1089, :miq_event_id=>1089, "EventStream::event_stream"=>1089, :event_stream_id=>1089}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [3.960344668] seconds [----] I, [2016-09-13T08:12:11.609447 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78343], Delivering... [----] I, [2016-09-13T08:12:11.611079 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1089, :miq_event_id=>1089, "EventStream::event_stream"=>1089, :event_stream_id=>1089} for object [ManageIQ::Providers::Hawkular::MiddlewareManager.15] with state [] to Automate [----] I, [2016-09-13T08:12:11.616037 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1089&ExtManagementSystem%3A%3Aext_management_system=15&MiqEvent%3A%3Amiq_event=1089&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1089&event_type=ems_auth_valid&miq_event_id=1089&object_name=Event&vmdb_object_type=ext_management_system] [----] I, [2016-09-13T08:12:11.622194 #2957:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1088&MiqEvent%3A%3Amiq_event=1088&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B101%5D%2C%20PID%20%5B12930%5D%2C%20GUID%20%5B4846d89a-79ab-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1088&event_type=evm_worker_start&miq_event_id=1088&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T08:12:11.644528 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1089&ExtManagementSystem%3A%3Aext_management_system=15&MiqEvent%3A%3Amiq_event=1089&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1089&event_type=ems_auth_valid&miq_event_id=1089&object_name=Event&vmdb_object_type=ext_management_system ManageIQ/System] [----] I, [2016-09-13T08:12:11.700802 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T08:12:11.720960 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T08:12:11.727049 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T08:12:11.740939 #2957:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_start] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T08:12:11.747129 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T08:12:11.759884 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T08:12:11.764964 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T08:12:11.767165 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/ems_auth_valid] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T08:12:11.781235 #2957:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T08:12:11.786368 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T08:12:11.789363 #2957:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T08:12:11.791481 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T08:12:11.793931 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 12:12:10", os_priority: 21, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 277401600, memory_size: 578035712, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 202327000, has_active_websocket: true>] [----] I, [2016-09-13T08:12:11.794171 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_start] [----] I, [2016-09-13T08:12:11.807521 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T08:12:11.815610 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T08:12:11.819695 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#] [----] I, [2016-09-13T08:12:11.819997 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [ems_auth_valid] [----] I, [2016-09-13T08:12:11.837014 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_start] [----] I, [2016-09-13T08:12:11.837274 #2957:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_start] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T08:12:11.841860 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T08:12:11.842395 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T08:12:11.842548 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [ems_auth_valid] [----] I, [2016-09-13T08:12:11.842813 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [ems_auth_valid] Target: ManageIQ::Providers::Hawkular::MiddlewareManager Name: [TT], Id: [15] [----] I, [2016-09-13T08:12:11.843206 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78342], State: [ok], Delivered in [0.255663731] seconds [----] I, [2016-09-13T08:12:11.847636 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T08:12:11.848231 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T08:12:11.849027 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78343], State: [ok], Delivered in [0.239576724] seconds [----] I, [2016-09-13T08:12:15.811162 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=3, priority=200 [----] I, [2016-09-13T08:12:16.153045 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [78340], MiqWorker id: [101], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [10.399262594] seconds [----] I, [2016-09-13T08:12:16.153310 #12930:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78340], Delivering... [----] I, [2016-09-13T08:12:16.166876 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T08:12:16.167067 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T08:12:16.167205 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T08:12:16.167389 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T08:12:16.172301 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:16.454825 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:16.660039 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:16.660224 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:17.290048 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:17.385733 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:17.476283 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:17.789826 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:17.896785 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:17.989237 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:18.080849 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:18.172596 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:18.263941 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:18.356207 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:18.448548 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:18.542549 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:18.635374 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:18.727041 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:18.820773 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:18.913093 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:19.005493 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:19.097061 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:19.188337 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:19.280533 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:12:19.760203 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T08:12:19.760481 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004851818084716797, :collect_inventory_for_targets=>7.3909759521484375e-06, :parse_legacy_inventory=>3.215424060821533, :parse_targeted_inventory=>3.2154433727264404, :save_inventory=>0.3771357536315918, :ems_refresh=>3.5930395126342773} [----] I, [2016-09-13T08:12:19.785637 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T08:12:19.786182 #12930:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78340], State: [ok], Delivered in [3.632891908] seconds [----] I, [2016-09-13T08:12:22.172340 #2763:34713c] INFO -- : MIQ(MiqServer#clean_worker_records) SQL Record for Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [99], PID: [5369], GUID: [79c8c984-799a-11e6-87c1-fa163e7d01a3], Status: [stopped] is being deleted [----] I, [2016-09-13T08:12:22.502199 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:12:22.517147 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78344], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:12:22.540064 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78345], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:12:22.553247 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:12:22.559471 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037059783935546875, :server_monitor=>0.09947896003723145, :worker_monitor=>1.6313073635101318, :worker_dequeue=>0.011005878448486328, :total_time=>1.7458608150482178} [----] I, [2016-09-13T08:12:22.711372 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78345], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.189009147] seconds [----] I, [2016-09-13T08:12:22.711526 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78345], Delivering... [----] I, [2016-09-13T08:12:22.716065 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023505687713623047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002367258071899414, :pending_vm_jobs=>0.0005700588226318359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004253387451171875} [----] I, [2016-09-13T08:12:22.716348 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78345], State: [ok], Delivered in [0.004827666] seconds [----] I, [2016-09-13T08:12:22.717302 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78344], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.210729043] seconds [----] I, [2016-09-13T08:12:22.717549 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78344], Delivering... [----] I, [2016-09-13T08:12:22.722322 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78344], State: [ok], Delivered in [0.004795165] seconds [----] I, [2016-09-13T08:12:37.550988 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:12:37.568656 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78346], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:12:39.090805 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:12:39.097222 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004009246826171875, :worker_monitor=>1.4874286651611328, :worker_dequeue=>0.011330842971801758, :total_time=>1.5030720233917236} [----] I, [2016-09-13T08:12:40.015836 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78346], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.458586203] seconds [----] I, [2016-09-13T08:12:40.016026 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78346], Delivering... [----] I, [2016-09-13T08:12:40.022151 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003325939178466797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033423900604248047, :pending_vm_jobs=>0.0007126331329345703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005789041519165039} [----] I, [2016-09-13T08:12:40.022493 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78346], State: [ok], Delivered in [0.006459394] seconds [----] I, [2016-09-13T08:12:44.097688 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:12:44 UTC]... [----] I, [2016-09-13T08:12:44.118477 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:12:44 UTC]...Complete [----] I, [2016-09-13T08:12:52.579675 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:12:52.592570 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78347], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:12:52.604125 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78348], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:12:52.621084 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78349], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:12:52.644160 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78350], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:12:55.423050 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:12:55.429537 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035495758056640625, :worker_monitor=>1.2638769149780273, :worker_dequeue=>0.011461019515991211, :total_time=>1.2791569232940674} [----] I, [2016-09-13T08:12:55.827388 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78347], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.243194472] seconds [----] I, [2016-09-13T08:12:55.827653 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78347], Delivering... [----] I, [2016-09-13T08:12:55.833113 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78350], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.206403271] seconds [----] I, [2016-09-13T08:12:55.833339 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78350], Delivering... [----] I, [2016-09-13T08:12:55.841440 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004284381866455078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004334688186645508, :pending_vm_jobs=>0.0010590553283691406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007577657699584961} [----] I, [2016-09-13T08:12:55.841886 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78350], State: [ok], Delivered in [0.008542718] seconds [----] I, [2016-09-13T08:12:55.867208 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78348], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.269443823] seconds [----] I, [2016-09-13T08:12:55.867390 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78348], Delivering... [----] I, [2016-09-13T08:12:55.870546 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78348], State: [ok], Delivered in [0.003154477] seconds [----] I, [2016-09-13T08:12:55.895892 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78349], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.284055413] seconds [----] I, [2016-09-13T08:12:55.896086 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78349], Delivering... [----] I, [2016-09-13T08:12:55.901201 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78349], State: [ok], Delivered in [0.005109743] seconds [----] I, [2016-09-13T08:12:55.901526 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78347], State: [ok], Delivered in [0.073815444] seconds [----] I, [2016-09-13T08:13:07.656811 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:13:07.678592 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78351], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:13:11.867580 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:13:11.874622 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003942251205444336, :worker_monitor=>1.3968853950500488, :worker_dequeue=>0.013583660125732422, :total_time=>1.4147047996520996} [----] I, [2016-09-13T08:13:12.204810 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78351], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.541657248] seconds [----] I, [2016-09-13T08:13:12.205027 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78351], Delivering... [----] I, [2016-09-13T08:13:12.211754 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034770965576171875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035004615783691406, :pending_vm_jobs=>0.0008709430694580078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006304025650024414} [----] I, [2016-09-13T08:13:12.212130 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78351], State: [ok], Delivered in [0.00709611] seconds [----] I, [2016-09-13T08:13:16.875272 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:13:16 UTC]... [----] I, [2016-09-13T08:13:16.896000 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:13:16 UTC]...Complete [----] I, [2016-09-13T08:13:22.690060 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:13:22.713216 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78352], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:13:22.736121 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78353], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:13:28.591299 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:13:28.594683 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006889820098876953, :worker_monitor=>1.5393366813659668, :worker_dequeue=>0.006070852279663086, :total_time=>1.5525825023651123} [----] I, [2016-09-13T08:13:28.993547 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78353], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.274677632] seconds [----] I, [2016-09-13T08:13:28.993838 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78353], Delivering... [----] I, [2016-09-13T08:13:29.003874 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005303382873535156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005332231521606445, :pending_vm_jobs=>0.0012674331665039062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009488105773925781} [----] I, [2016-09-13T08:13:29.004301 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78353], State: [ok], Delivered in [0.010464688] seconds [----] I, [2016-09-13T08:13:29.022015 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78352], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.327470479] seconds [----] I, [2016-09-13T08:13:29.022207 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78352], Delivering... [----] I, [2016-09-13T08:13:29.027084 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78352], State: [ok], Delivered in [0.004879953] seconds [----] I, [2016-09-13T08:13:37.746964 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:13:37.758989 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78354], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:13:37.770387 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78355], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:13:37.782005 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78356], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:13:38.622085 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:13:39.396237 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78354], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.64410666] seconds [----] I, [2016-09-13T08:13:39.396470 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78354], Delivering... [----] I, [2016-09-13T08:13:39.397476 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T08:13:39.397688 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5367099392 [----] I, [2016-09-13T08:13:39.397807 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5141139456 [----] I, [2016-09-13T08:13:39.397887 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 225959936 [----] I, [2016-09-13T08:13:39.397957 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T08:13:39.398028 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5087129600 [----] I, [2016-09-13T08:13:39.398100 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T08:13:39.398167 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T08:13:39.398235 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 547590144 [----] I, [2016-09-13T08:13:39.398350 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T08:13:39.398499 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7960936448 [----] I, [2016-09-13T08:13:39.398584 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T08:13:39.398708 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T08:13:39.398875 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T08:13:39.399013 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 12288 [----] I, [2016-09-13T08:13:39.399148 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T08:13:39.399324 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T08:13:39.399546 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T08:13:39.399751 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T08:13:39.399932 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T08:13:39.400064 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T08:13:39.400238 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273825792 [----] I, [2016-09-13T08:13:39.400448 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57053184 [----] I, [2016-09-13T08:13:39.400634 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216772608 [----] I, [2016-09-13T08:13:39.400840 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T08:13:39.400979 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141688832 [----] I, [2016-09-13T08:13:39.401148 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2579832832 [----] I, [2016-09-13T08:13:39.401338 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2258931712 [----] I, [2016-09-13T08:13:39.401563 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T08:13:39.401756 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T08:13:39.401898 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T08:13:39.402048 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37408768 [----] I, [2016-09-13T08:13:39.402220 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102301696 [----] I, [2016-09-13T08:13:39.402380 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53211136 [----] I, [2016-09-13T08:13:39.402622 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111079424 [----] I, [2016-09-13T08:13:39.402804 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155512832 [----] I, [2016-09-13T08:13:39.402937 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T08:13:39.403074 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T08:13:39.403201 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T08:13:39.403329 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T08:13:39.403345 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78355], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.640163389] seconds [----] I, [2016-09-13T08:13:39.403496 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T08:13:39.403675 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T08:13:39.403879 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T08:13:39.404034 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T08:13:39.404190 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T08:13:39.404491 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78355], Delivering... [----] I, [2016-09-13T08:13:39.415902 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:13:28 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [150946.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:13:39.416544 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:13:22 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205294000], Memory % [3.5], CPU Time [240419.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T08:13:39.417015 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:13:26 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [104376.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T08:13:39.417468 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:13:22 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48904.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T08:13:39.417993 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:13:28 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [151861.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:13:39.418536 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:13:27 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162418000], Memory % [3.1], CPU Time [38040.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T08:13:39.419072 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:13:25 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [202849.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T08:13:39.419601 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:13:25 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169070000], Memory % [3.14], CPU Time [51630.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:13:39.420078 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:13:25 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [211675.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T08:13:39.420559 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:13:26 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51655.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:13:39.421009 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:13:18 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165805000], Memory % [3.16], CPU Time [38943.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T08:13:39.423896 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:13:20 UTC], Process Info: Memory Usage [613675008], Memory Size [1028579328], Proportional Set Size: [446133000], Memory % [7.48], CPU Time [779.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:13:39.426135 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:13:19 UTC], Process Info: Memory Usage [597667840], Memory Size [940904448], Proportional Set Size: [429844000], Memory % [7.29], CPU Time [217.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:13:39.429008 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:13:20 UTC], Process Info: Memory Usage [557723648], Memory Size [894418944], Proportional Set Size: [405263000], Memory % [6.8], CPU Time [5722.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T08:13:39.432015 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:13:22 UTC], Process Info: Memory Usage [579964928], Memory Size [907313152], Proportional Set Size: [419590000], Memory % [7.07], CPU Time [2300.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T08:13:39.432536 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78355], State: [ok], Delivered in [0.028926574] seconds [----] I, [2016-09-13T08:13:39.448938 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T08:13:39.449132 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T08:13:39.452670 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T08:13:39.455249 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T08:13:39.456214 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78356], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.680408611] seconds [----] I, [2016-09-13T08:13:39.456379 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78356], Delivering... [----] I, [2016-09-13T08:13:39.458294 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T08:13:39.461271 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T08:13:39.462784 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033419132232666016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003362894058227539, :pending_vm_jobs=>0.0008246898651123047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006001472473144531} [----] I, [2016-09-13T08:13:39.463125 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78356], State: [ok], Delivered in [0.006735147] seconds [----] I, [2016-09-13T08:13:39.464243 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T08:13:39.467317 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 848 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T08:13:39.470296 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T08:13:39.473280 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T08:13:39.476214 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T08:13:39.479215 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T08:13:39.482180 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T08:13:39.485142 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T08:13:39.487981 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:13:39.488132 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:13:39.488241 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T08:13:39.492673 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [211667.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T08:13:39.493108 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78354], State: [ok], Delivered in [0.096653636] seconds [----] I, [2016-09-13T08:13:44.884466 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004400014877319336, :worker_monitor=>1.2371041774749756, :worker_dequeue=>0.013255834579467773, :total_time=>1.2551143169403076} [----] I, [2016-09-13T08:13:49.884943 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:13:49 UTC]... [----] I, [2016-09-13T08:13:49.906851 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:13:49 UTC]...Complete [----] I, [2016-09-13T08:13:49.926152 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T08:13:52.791377 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:13:52.809158 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78357], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:13:52.826539 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78358], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:13:52.855044 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78359], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:13:52.879368 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78360], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:13:54.946729 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:13:55.598055 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78357], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.803901954] seconds [----] I, [2016-09-13T08:13:55.598259 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78357], Delivering... [----] I, [2016-09-13T08:13:55.638013 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78360], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.776776069] seconds [----] I, [2016-09-13T08:13:55.638257 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78360], Delivering... [----] I, [2016-09-13T08:13:55.647353 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004606723785400391, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004631757736206055, :pending_vm_jobs=>0.001127004623413086, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008569478988647461} [----] I, [2016-09-13T08:13:55.647833 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78360], State: [ok], Delivered in [0.009574038] seconds [----] I, [2016-09-13T08:13:55.672071 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78357], State: [ok], Delivered in [0.073792677] seconds [----] I, [2016-09-13T08:13:56.123686 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78358], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.311354023] seconds [----] I, [2016-09-13T08:13:56.123919 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78358], Delivering... [----] I, [2016-09-13T08:13:56.127148 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78358], State: [ok], Delivered in [0.003225756] seconds [----] I, [2016-09-13T08:13:56.129549 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78359], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.295256034] seconds [----] I, [2016-09-13T08:13:56.129775 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78359], Delivering... [----] I, [2016-09-13T08:13:56.134694 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78359], State: [ok], Delivered in [0.004926927] seconds [----] I, [2016-09-13T08:14:01.353449 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003746509552001953, :worker_monitor=>1.3856098651885986, :worker_dequeue=>0.01046299934387207, :total_time=>1.4000844955444336} [----] I, [2016-09-13T08:14:07.889695 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:14:07.906490 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78361], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:14:11.377895 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:14:11.786746 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78361], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.892862516] seconds [----] I, [2016-09-13T08:14:11.786973 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78361], Delivering... [----] I, [2016-09-13T08:14:11.793316 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034646987915039062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034990310668945312, :pending_vm_jobs=>0.000736236572265625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005968332290649414} [----] I, [2016-09-13T08:14:11.793688 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78361], State: [ok], Delivered in [0.00671526] seconds [----] I, [2016-09-13T08:14:17.554603 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004122495651245117, :worker_monitor=>1.1547882556915283, :worker_dequeue=>0.010918617248535156, :total_time=>1.1701850891113281} [----] I, [2016-09-13T08:14:22.555169 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:14:22 UTC]... [----] I, [2016-09-13T08:14:22.569181 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:14:22 UTC]...Complete [----] I, [2016-09-13T08:14:22.915072 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:14:22.935057 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78362], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:14:22.946463 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78363], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:14:27.707880 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:14:27.889321 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78363], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.949266742] seconds [----] I, [2016-09-13T08:14:27.889476 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78363], Delivering... [----] I, [2016-09-13T08:14:27.893705 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022351741790771484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022492408752441406, :pending_vm_jobs=>0.0005295276641845703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003960847854614258} [----] I, [2016-09-13T08:14:27.893958 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78363], State: [ok], Delivered in [0.004484065] seconds [----] I, [2016-09-13T08:14:29.267209 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78362], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.347738937] seconds [----] I, [2016-09-13T08:14:29.267466 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78362], Delivering... [----] I, [2016-09-13T08:14:29.272763 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78362], State: [ok], Delivered in [0.005310087] seconds [----] I, [2016-09-13T08:14:34.298884 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004839420318603516, :worker_monitor=>1.5702524185180664, :worker_dequeue=>0.011510372161865234, :total_time=>1.5869340896606445} [----] I, [2016-09-13T08:14:37.961048 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:14:37.975367 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78364], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:14:39.308563 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:14:39.981232 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78364], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.014148311] seconds [----] I, [2016-09-13T08:14:39.981406 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78364], Delivering... [----] I, [2016-09-13T08:14:39.987629 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00319671630859375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003214120864868164, :pending_vm_jobs=>0.0008275508880615234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058400630950927734} [----] I, [2016-09-13T08:14:39.988022 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78364], State: [ok], Delivered in [0.006601499] seconds [----] I, [2016-09-13T08:14:50.635874 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004229068756103516, :worker_monitor=>1.2890689373016357, :worker_dequeue=>0.010730504989624023, :total_time=>1.3044395446777344} [----] I, [2016-09-13T08:14:52.988338 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:14:53.009958 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78365], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:14:53.021138 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78366], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:14:53.038295 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78367], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:14:53.049654 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78368], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:14:55.636468 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:14:55 UTC]... [----] I, [2016-09-13T08:14:55.649815 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:14:55 UTC]...Complete [----] I, [2016-09-13T08:14:55.662040 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:14:56.153117 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78365], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.159607546] seconds [----] I, [2016-09-13T08:14:56.153399 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78365], Delivering... [----] I, [2016-09-13T08:14:56.158373 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78368], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.114809262] seconds [----] I, [2016-09-13T08:14:56.159572 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78368], Delivering... [----] I, [2016-09-13T08:14:56.166339 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003692150115966797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037245750427246094, :pending_vm_jobs=>0.0007951259613037109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006292819976806641} [----] I, [2016-09-13T08:14:56.166746 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78368], State: [ok], Delivered in [0.007177956] seconds [----] I, [2016-09-13T08:14:56.215466 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78365], State: [ok], Delivered in [0.06205506] seconds [----] I, [2016-09-13T08:14:56.335886 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78366], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.320199368] seconds [----] I, [2016-09-13T08:14:56.336080 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78366], Delivering... [----] I, [2016-09-13T08:14:56.339100 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78366], State: [ok], Delivered in [0.003015664] seconds [----] I, [2016-09-13T08:14:56.370008 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78367], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.340888773] seconds [----] I, [2016-09-13T08:14:56.370176 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78367], Delivering... [----] I, [2016-09-13T08:14:56.374671 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78367], State: [ok], Delivered in [0.004489345] seconds [----] I, [2016-09-13T08:15:07.087186 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004670381546020508, :worker_monitor=>1.384840726852417, :worker_dequeue=>0.011118888854980469, :total_time=>1.4009625911712646} [----] I, [2016-09-13T08:15:08.061569 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:15:08.078307 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78369], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:15:12.097548 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:15:12.292732 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78369], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.223513745] seconds [----] I, [2016-09-13T08:15:12.292916 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78369], Delivering... [----] I, [2016-09-13T08:15:12.298895 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003098726272583008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003117084503173828, :pending_vm_jobs=>0.0007712841033935547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0056493282318115234} [----] I, [2016-09-13T08:15:12.299252 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78369], State: [ok], Delivered in [0.006327572] seconds [----] I, [2016-09-13T08:15:23.100019 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:15:23.114046 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78370], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:15:23.131664 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78371], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:15:23.465638 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:15:23.472197 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0042150020599365234, :worker_monitor=>1.336841106414795, :worker_dequeue=>0.011533260345458984, :total_time=>1.3528733253479004} [----] I, [2016-09-13T08:15:24.400234 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78371], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.280491972] seconds [----] I, [2016-09-13T08:15:24.400468 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78371], Delivering... [----] I, [2016-09-13T08:15:24.407337 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037925243377685547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038170814514160156, :pending_vm_jobs=>0.0008296966552734375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00649261474609375} [----] I, [2016-09-13T08:15:24.407778 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78371], State: [ok], Delivered in [0.007307195] seconds [----] I, [2016-09-13T08:15:26.440190 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78370], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.335442869] seconds [----] I, [2016-09-13T08:15:26.440389 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78370], Delivering... [----] I, [2016-09-13T08:15:26.445184 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78370], State: [ok], Delivered in [0.004796827] seconds [----] I, [2016-09-13T08:15:28.472788 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:15:28 UTC]... [----] I, [2016-09-13T08:15:28.509608 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:15:28 UTC]...Complete [----] I, [2016-09-13T08:15:38.455141 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:15:38.525878 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78372], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:15:39.767343 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:15:39.773671 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004106998443603516, :worker_monitor=>1.1082549095153809, :worker_dequeue=>0.011131048202514648, :total_time=>1.1237847805023193} [----] I, [2016-09-13T08:15:40.504643 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78372], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.997086644] seconds [----] I, [2016-09-13T08:15:40.504839 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78372], Delivering... [----] I, [2016-09-13T08:15:40.510472 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028543472290039062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028760433197021484, :pending_vm_jobs=>0.0007283687591552734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005282878875732422} [----] I, [2016-09-13T08:15:40.510784 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78372], State: [ok], Delivered in [0.005948022] seconds [----] I, [2016-09-13T08:15:53.539321 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:15:53.557592 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78373], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:15:53.578963 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78374], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:15:53.596035 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78375], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:15:53.613251 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78376], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:15:56.110356 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:15:56.115662 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005934000015258789, :worker_monitor=>1.2943840026855469, :worker_dequeue=>0.00962066650390625, :total_time=>1.3103227615356445} [----] I, [2016-09-13T08:15:56.583238 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78373], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.039086751] seconds [----] I, [2016-09-13T08:15:56.583477 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78373], Delivering... [----] I, [2016-09-13T08:15:56.590729 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78376], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.989166659] seconds [----] I, [2016-09-13T08:15:56.590928 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78376], Delivering... [----] I, [2016-09-13T08:15:56.597723 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035789012908935547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003598451614379883, :pending_vm_jobs=>0.0008265972137451172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006378889083862305} [----] I, [2016-09-13T08:15:56.598069 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78376], State: [ok], Delivered in [0.007138116] seconds [----] I, [2016-09-13T08:15:56.626510 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78374], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.061355047] seconds [----] I, [2016-09-13T08:15:56.626640 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78374], Delivering... [----] I, [2016-09-13T08:15:56.628828 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78374], State: [ok], Delivered in [0.00217734] seconds [----] I, [2016-09-13T08:15:56.641821 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78373], State: [ok], Delivered in [0.058360919] seconds [----] I, [2016-09-13T08:15:56.647443 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78375], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.060378705] seconds [----] I, [2016-09-13T08:15:56.647579 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78375], Delivering... [----] I, [2016-09-13T08:15:56.651406 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78375], State: [ok], Delivered in [0.003818057] seconds [----] I, [2016-09-13T08:16:01.116181 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:16:01 UTC]... [----] I, [2016-09-13T08:16:01.133274 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:16:01 UTC]...Complete [----] I, [2016-09-13T08:16:08.625505 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:16:08.653156 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78377], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:16:12.402332 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:16:12.406077 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005589485168457031, :worker_monitor=>1.2233374118804932, :worker_dequeue=>0.00848245620727539, :total_time=>1.237813949584961} [----] I, [2016-09-13T08:16:12.778037 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78377], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.146537036] seconds [----] I, [2016-09-13T08:16:12.778277 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78377], Delivering... [----] I, [2016-09-13T08:16:12.785613 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037043094635009766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003728151321411133, :pending_vm_jobs=>0.0009284019470214844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006833076477050781} [----] I, [2016-09-13T08:16:12.786062 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78377], State: [ok], Delivered in [0.007776952] seconds [----] I, [2016-09-13T08:16:23.665658 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:16:23.697689 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78378], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:16:23.720187 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78379], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:16:28.877271 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:16:28.887228 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004801034927368164, :worker_monitor=>1.4271621704101562, :worker_dequeue=>0.015124320983886719, :total_time=>1.4474740028381348} [----] I, [2016-09-13T08:16:28.903358 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78379], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.20052837] seconds [----] I, [2016-09-13T08:16:28.903563 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78379], Delivering... [----] I, [2016-09-13T08:16:28.910124 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003283977508544922, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033125877380371094, :pending_vm_jobs=>0.0009438991546630859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00616145133972168} [----] I, [2016-09-13T08:16:28.910506 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78379], State: [ok], Delivered in [0.0069363] seconds [----] I, [2016-09-13T08:16:29.766558 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78378], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.096091414] seconds [----] I, [2016-09-13T08:16:29.766779 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78378], Delivering... [----] I, [2016-09-13T08:16:29.771054 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78378], State: [ok], Delivered in [0.004272894] seconds [----] I, [2016-09-13T08:16:33.887790 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:16:33 UTC]... [----] I, [2016-09-13T08:16:33.908942 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:16:33 UTC]...Complete [----] I, [2016-09-13T08:16:38.736058 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:16:38.756663 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78380], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:16:39.048075 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:16:39.951347 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78380], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.209083397] seconds [----] I, [2016-09-13T08:16:39.951623 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78380], Delivering... [----] I, [2016-09-13T08:16:39.958326 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034666061401367188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034914016723632812, :pending_vm_jobs=>0.0008425712585449219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006238222122192383} [----] I, [2016-09-13T08:16:39.958748 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78380], State: [ok], Delivered in [0.007129987] seconds [----] I, [2016-09-13T08:16:45.603612 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004023313522338867, :worker_monitor=>1.5330109596252441, :worker_dequeue=>0.01120758056640625, :total_time=>1.5485219955444336} [----] I, [2016-09-13T08:16:53.768281 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:16:53.784044 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78381], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:16:53.796561 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78382], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:16:53.812810 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78383], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:16:53.835748 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78384], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:16:55.629887 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:16:56.099839 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78381], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.327151473] seconds [----] I, [2016-09-13T08:16:56.100034 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78381], Delivering... [----] I, [2016-09-13T08:16:56.127014 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78384], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.308901412] seconds [----] I, [2016-09-13T08:16:56.127206 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78384], Delivering... [----] I, [2016-09-13T08:16:56.133492 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032396316528320312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032579898834228516, :pending_vm_jobs=>0.0007822513580322266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005848884582519531} [----] I, [2016-09-13T08:16:56.133939 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78384], State: [ok], Delivered in [0.006706333] seconds [----] I, [2016-09-13T08:16:56.149790 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78381], State: [ok], Delivered in [0.049735865] seconds [----] I, [2016-09-13T08:16:56.892994 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78382], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.103769514] seconds [----] I, [2016-09-13T08:16:56.893181 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78382], Delivering... [----] I, [2016-09-13T08:16:56.898514 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78383], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.094619116] seconds [----] I, [2016-09-13T08:16:56.898729 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78383], Delivering... [----] I, [2016-09-13T08:16:56.900798 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78382], State: [ok], Delivered in [0.007608487] seconds [----] I, [2016-09-13T08:16:56.903482 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78383], State: [ok], Delivered in [0.004752379] seconds [----] I, [2016-09-13T08:17:01.936565 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004679203033447266, :worker_monitor=>1.2832615375518799, :worker_dequeue=>0.011135339736938477, :total_time=>1.2994270324707031} [----] I, [2016-09-13T08:17:06.937114 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:17:06 UTC]... [----] I, [2016-09-13T08:17:06.955461 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:17:06 UTC]...Complete [----] I, [2016-09-13T08:17:08.847663 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:17:08.870086 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78385], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:17:11.981669 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:17:12.266123 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78385], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.411832572] seconds [----] I, [2016-09-13T08:17:12.266376 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78385], Delivering... [----] I, [2016-09-13T08:17:12.274039 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004561662673950195, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004586696624755859, :pending_vm_jobs=>0.0008282661437988281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007189512252807617} [----] I, [2016-09-13T08:17:12.274350 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78385], State: [ok], Delivered in [0.008000117] seconds [----] I, [2016-09-13T08:17:18.285403 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0053899288177490234, :worker_monitor=>1.2844901084899902, :worker_dequeue=>0.006571292877197266, :total_time=>1.296792984008789} [----] I, [2016-09-13T08:17:23.882497 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:17:23.898607 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78386], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:17:23.910008 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78387], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:17:28.314880 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:17:28.344569 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78387], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.440299209] seconds [----] I, [2016-09-13T08:17:28.344769 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78387], Delivering... [----] I, [2016-09-13T08:17:28.350804 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031557083129882812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031735897064208984, :pending_vm_jobs=>0.0007648468017578125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005682468414306641} [----] I, [2016-09-13T08:17:28.351150 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78387], State: [ok], Delivered in [0.006378077] seconds [----] I, [2016-09-13T08:17:30.036220 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78386], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.149075555] seconds [----] I, [2016-09-13T08:17:30.036393 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78386], Delivering... [----] I, [2016-09-13T08:17:30.040533 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78386], State: [ok], Delivered in [0.004131214] seconds [----] I, [2016-09-13T08:17:34.524351 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004909515380859375, :worker_monitor=>1.1861863136291504, :worker_dequeue=>0.010720252990722656, :total_time=>1.2021567821502686} [----] I, [2016-09-13T08:17:38.923448 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:17:38.945493 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78388], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:17:39.524833 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:17:39 UTC]... [----] I, [2016-09-13T08:17:39.544257 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:17:39 UTC]...Complete [----] I, [2016-09-13T08:17:39.652917 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:17:40.441885 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78388], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.512301333] seconds [----] I, [2016-09-13T08:17:40.442062 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78388], Delivering... [----] I, [2016-09-13T08:17:40.447920 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003106832504272461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003148317337036133, :pending_vm_jobs=>0.0006985664367675781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055387020111083984} [----] I, [2016-09-13T08:17:40.448320 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78388], State: [ok], Delivered in [0.006232935] seconds [----] I, [2016-09-13T08:17:51.104607 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003790140151977539, :worker_monitor=>1.4004313945770264, :worker_dequeue=>0.011732339859008789, :total_time=>1.416274070739746} [----] I, [2016-09-13T08:17:53.958055 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:17:53.984961 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78389], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:17:53.997500 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78390], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:17:54.013338 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78391], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:17:54.030955 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78392], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:17:56.115857 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:17:56.613811 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78389], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.650545716] seconds [----] I, [2016-09-13T08:17:56.614012 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78389], Delivering... [----] I, [2016-09-13T08:17:56.625496 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78392], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.605911319] seconds [----] I, [2016-09-13T08:17:56.625799 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78392], Delivering... [----] I, [2016-09-13T08:17:56.635738 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00532221794128418, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005354404449462891, :pending_vm_jobs=>0.001222848892211914, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009386062622070312} [----] I, [2016-09-13T08:17:56.636195 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78392], State: [ok], Delivered in [0.01042579] seconds [----] I, [2016-09-13T08:17:56.682531 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78389], State: [ok], Delivered in [0.068441923] seconds [----] I, [2016-09-13T08:17:57.128465 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78390], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.137544837] seconds [----] I, [2016-09-13T08:17:57.128729 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78390], Delivering... [----] I, [2016-09-13T08:17:57.132520 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78390], State: [ok], Delivered in [0.003803] seconds [----] I, [2016-09-13T08:17:57.162232 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78391], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.156237048] seconds [----] I, [2016-09-13T08:17:57.162493 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78391], Delivering... [----] I, [2016-09-13T08:17:57.168274 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78391], State: [ok], Delivered in [0.005808681] seconds [----] I, [2016-09-13T08:18:07.567016 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004350185394287109, :worker_monitor=>1.4162204265594482, :worker_dequeue=>0.011414289474487305, :total_time=>1.4324052333831787} [----] I, [2016-09-13T08:18:09.044482 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T08:18:09.059586 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78393], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [3600] [----] I, [2016-09-13T08:18:09.076717 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78394], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:18:12.567502 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:18:12 UTC]... [----] I, [2016-09-13T08:18:12.584808 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:18:12 UTC]...Complete [----] I, [2016-09-13T08:18:12.592230 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:18:12.779455 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78394], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.712194688] seconds [----] I, [2016-09-13T08:18:12.779643 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78394], Delivering... [----] I, [2016-09-13T08:18:12.786898 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003710508346557617, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037317276000976562, :pending_vm_jobs=>0.0009095668792724609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068552494049072266} [----] I, [2016-09-13T08:18:12.787269 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78394], State: [ok], Delivered in [0.007610526] seconds [----] I, [2016-09-13T08:18:15.208562 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78393], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [3600], Dequeued in: [6.156363088] seconds [----] I, [2016-09-13T08:18:15.208773 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78393], Delivering... [----] I, [2016-09-13T08:18:15.222475 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78393], State: [ok], Delivered in [0.013653362] seconds [----] I, [2016-09-13T08:18:24.071870 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004147768020629883, :worker_monitor=>1.4434547424316406, :worker_dequeue=>0.01218414306640625, :total_time=>1.4600942134857178} [----] I, [2016-09-13T08:18:24.090006 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:18:24.101709 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78395], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:18:24.118811 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78396], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:18:29.084046 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:18:29.890571 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78396], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.782825325] seconds [----] I, [2016-09-13T08:18:29.890786 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78396], Delivering... [----] I, [2016-09-13T08:18:29.897629 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037369728088378906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003756999969482422, :pending_vm_jobs=>0.0007960796356201172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006443977355957031} [----] I, [2016-09-13T08:18:29.898018 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78396], State: [ok], Delivered in [0.007231941] seconds [----] I, [2016-09-13T08:18:30.279337 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78395], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.184156768] seconds [----] I, [2016-09-13T08:18:30.279589 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78395], Delivering... [----] I, [2016-09-13T08:18:30.284655 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78395], State: [ok], Delivered in [0.005052522] seconds [----] I, [2016-09-13T08:18:39.134006 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:18:39.147328 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78397], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:18:39.158909 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78398], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:18:39.176023 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78399], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:18:40.496657 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:18:40.502127 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006445407867431641, :worker_monitor=>1.376495122909546, :worker_dequeue=>0.009923219680786133, :total_time=>1.3932623863220215} [----] I, [2016-09-13T08:18:40.971878 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78397], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.833045587] seconds [----] I, [2016-09-13T08:18:40.972047 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78397], Delivering... [----] I, [2016-09-13T08:18:40.973017 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T08:18:40.973185 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5351591936 [----] I, [2016-09-13T08:18:40.973268 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5125451776 [----] I, [2016-09-13T08:18:40.973342 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 226140160 [----] I, [2016-09-13T08:18:40.973412 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T08:18:40.973513 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5071425536 [----] I, [2016-09-13T08:18:40.973585 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T08:18:40.973655 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T08:18:40.973738 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 547774464 [----] I, [2016-09-13T08:18:40.973817 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T08:18:40.973892 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7888187392 [----] I, [2016-09-13T08:18:40.973962 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T08:18:40.974030 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T08:18:40.974100 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T08:18:40.974168 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 12288 [----] I, [2016-09-13T08:18:40.974236 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T08:18:40.974308 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T08:18:40.974392 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T08:18:40.974492 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T08:18:40.974567 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T08:18:40.974634 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T08:18:40.974713 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273829888 [----] I, [2016-09-13T08:18:40.974787 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57053184 [----] I, [2016-09-13T08:18:40.974853 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216776704 [----] I, [2016-09-13T08:18:40.974915 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T08:18:40.974989 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141688832 [----] I, [2016-09-13T08:18:40.975059 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2596634624 [----] I, [2016-09-13T08:18:40.975124 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2275549184 [----] I, [2016-09-13T08:18:40.975192 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T08:18:40.975256 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T08:18:40.975321 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T08:18:40.975386 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37261312 [----] I, [2016-09-13T08:18:40.975483 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102301696 [----] I, [2016-09-13T08:18:40.975554 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53125120 [----] I, [2016-09-13T08:18:40.975622 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111079424 [----] I, [2016-09-13T08:18:40.975687 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155426816 [----] I, [2016-09-13T08:18:40.975775 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T08:18:40.975850 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T08:18:40.975918 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T08:18:40.975991 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T08:18:40.976060 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T08:18:40.976128 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T08:18:40.976203 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T08:18:40.976272 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 8192 [----] I, [2016-09-13T08:18:40.976337 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T08:18:41.010314 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T08:18:41.010460 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T08:18:41.012598 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T08:18:41.014017 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T08:18:41.015730 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T08:18:41.017347 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T08:18:41.019070 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T08:18:41.020752 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 848 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T08:18:41.022399 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T08:18:41.024116 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T08:18:41.025856 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T08:18:41.027386 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T08:18:41.029048 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T08:18:41.030829 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T08:18:41.032392 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:18:41.032489 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:18:41.032549 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T08:18:41.033486 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78399], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.868509271] seconds [----] I, [2016-09-13T08:18:41.033648 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78399], Delivering... [----] I, [2016-09-13T08:18:41.034949 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [151004.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:18:41.035184 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78397], State: [ok], Delivered in [0.063128927] seconds [----] I, [2016-09-13T08:18:41.039803 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003141164779663086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031583309173583984, :pending_vm_jobs=>0.0008287429809570312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005773305892944336} [----] I, [2016-09-13T08:18:41.040138 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78399], State: [ok], Delivered in [0.00647923] seconds [----] I, [2016-09-13T08:18:45.502812 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:18:45 UTC]... [----] I, [2016-09-13T08:18:45.530739 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:18:45 UTC]...Complete [----] I, [2016-09-13T08:18:45.645802 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:18:46.085014 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78398], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.933518565] seconds [----] I, [2016-09-13T08:18:46.085218 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78398], Delivering... [----] I, [2016-09-13T08:18:46.092966 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:18:38 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [104393.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T08:18:46.093500 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:18:34 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48914.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T08:18:46.094108 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:18:39 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [151016.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:18:46.094653 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:18:38 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169070000], Memory % [3.14], CPU Time [51646.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:18:46.095211 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:18:39 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162418000], Memory % [3.1], CPU Time [38050.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T08:18:46.095767 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:18:39 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205294000], Memory % [3.5], CPU Time [240579.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T08:18:46.096281 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:18:39 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [202884.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T08:18:46.096825 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:18:39 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [151933.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:18:46.099765 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:18:30 UTC], Process Info: Memory Usage [597667840], Memory Size [940904448], Proportional Set Size: [430122000], Memory % [7.29], CPU Time [227.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:18:46.101933 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:18:31 UTC], Process Info: Memory Usage [596942848], Memory Size [926470144], Proportional Set Size: [429793000], Memory % [7.28], CPU Time [843.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:18:46.104070 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:18:30 UTC], Process Info: Memory Usage [557993984], Memory Size [910671872], Proportional Set Size: [405511000], Memory % [6.8], CPU Time [5733.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T08:18:46.106141 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:18:33 UTC], Process Info: Memory Usage [580177920], Memory Size [921468928], Proportional Set Size: [419806000], Memory % [7.07], CPU Time [2310.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T08:18:46.106732 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:18:39 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [211712.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T08:18:46.107238 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:18:39 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51671.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:18:46.107741 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:18:30 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165805000], Memory % [3.16], CPU Time [38954.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T08:18:46.108128 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78398], State: [ok], Delivered in [0.022907522] seconds [----] I, [2016-09-13T08:18:50.672343 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T08:18:54.188726 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:18:54.199035 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78400], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:18:54.211367 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78401], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:18:54.227538 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78402], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:18:54.239128 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78403], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:18:56.967386 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:18:56.974108 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00609135627746582, :worker_monitor=>1.2707114219665527, :worker_dequeue=>0.012145042419433594, :total_time=>1.289320707321167} [----] I, [2016-09-13T08:18:57.159252 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78400], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.965872656] seconds [----] I, [2016-09-13T08:18:57.159451 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78400], Delivering... [----] I, [2016-09-13T08:18:57.193289 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78400], State: [ok], Delivered in [0.033856014] seconds [----] I, [2016-09-13T08:18:57.216329 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78403], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.983789181] seconds [----] I, [2016-09-13T08:18:57.216492 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78403], Delivering... [----] I, [2016-09-13T08:18:57.220964 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023376941680908203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023522377014160156, :pending_vm_jobs=>0.0005774497985839844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004174947738647461} [----] I, [2016-09-13T08:18:57.221250 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78403], State: [ok], Delivered in [0.004761884] seconds [----] I, [2016-09-13T08:18:57.384839 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78401], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.18040754] seconds [----] I, [2016-09-13T08:18:57.385037 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78401], Delivering... [----] I, [2016-09-13T08:18:57.387988 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78401], State: [ok], Delivered in [0.002938544] seconds [----] I, [2016-09-13T08:18:57.399454 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78402], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.180283218] seconds [----] I, [2016-09-13T08:18:57.399670 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78402], Delivering... [----] I, [2016-09-13T08:18:57.404920 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78402], State: [ok], Delivered in [0.005253302] seconds [----] I, [2016-09-13T08:19:09.250473 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T08:19:09.287571 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78404], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:19:09.308150 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78405], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:19:13.579140 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:19:13.585642 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039615631103515625, :worker_monitor=>1.5640063285827637, :worker_dequeue=>0.011496782302856445, :total_time=>1.5797536373138428} [----] I, [2016-09-13T08:19:14.336811 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78405], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.040505537] seconds [----] I, [2016-09-13T08:19:14.337011 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78405], Delivering... [----] I, [2016-09-13T08:19:14.345390 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003595590591430664, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036242008209228516, :pending_vm_jobs=>0.0013294219970703125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007938861846923828} [----] I, [2016-09-13T08:19:14.345953 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78405], State: [ok], Delivered in [0.008911281] seconds [----] I, [2016-09-13T08:19:15.450806 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78404], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.184075688] seconds [----] I, [2016-09-13T08:19:15.450990 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78404], Delivering... [----] I, [2016-09-13T08:19:15.479872 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78406], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T08:19:15.496796 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78407], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T08:19:15.497134 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78404], State: [ok], Delivered in [0.046163959] seconds [----] I, [2016-09-13T08:19:18.586178 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:19:18 UTC]... [----] I, [2016-09-13T08:19:18.605178 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:19:18 UTC]...Complete [----] I, [2016-09-13T08:19:18.623217 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T08:19:18.625314 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T08:19:20.423084 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [78406], MiqWorker id: [101], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [4.956931686] seconds [----] I, [2016-09-13T08:19:20.423296 #12930:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78406], Delivering... [----] I, [2016-09-13T08:19:20.427018 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T08:19:20.427173 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T08:19:20.427296 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T08:19:20.427467 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T08:19:20.427638 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:20.708526 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:20.909369 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:20.909571 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:21.246128 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:21.339678 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:21.348958 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [78407], MiqWorker id: [100], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [5.862721003] seconds [----] I, [2016-09-13T08:19:21.349176 #10859:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78407], Delivering... [----] I, [2016-09-13T08:19:21.353012 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T08:19:21.353212 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T08:19:21.353362 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T08:19:21.353599 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T08:19:21.353782 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:21.429026 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:21.749328 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:21.853392 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:21.945350 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:22.036962 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:22.129799 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:22.222030 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:22.313288 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:22.405452 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:22.499330 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:22.591869 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:22.683841 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:22.775797 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:22.867557 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:22.959001 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:23.053109 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:23.147181 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:23.240214 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:19:23.465376 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T08:19:23.465623 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004851818084716797, :collect_inventory_for_targets=>1.1920928955078125e-05, :parse_legacy_inventory=>6.131563663482666, :parse_targeted_inventory=>6.131617307662964, :save_inventory=>0.498687744140625, :ems_refresh=>6.631195306777954} [----] I, [2016-09-13T08:19:23.509320 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T08:19:23.509760 #12930:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78406], State: [ok], Delivered in [3.0864392] seconds [----] I, [2016-09-13T08:19:24.320978 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T08:19:24.348271 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78408], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:19:24.360029 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78409], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:19:24.370966 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78410], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:19:27.805228 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:28.106800 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:28.106981 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:28.622550 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:28.925084 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:28.925268 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:29.420212 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:29.726250 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:29.726461 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:30.162454 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:19:30.169537 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004057168960571289, :worker_monitor=>1.5107049942016602, :worker_dequeue=>0.012253284454345703, :total_time=>1.5273807048797607} [----] I, [2016-09-13T08:19:30.198218 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:30.496253 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:30.496540 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:30.512995 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78409], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.158757271] seconds [----] I, [2016-09-13T08:19:30.513281 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78409], Delivering... [----] I, [2016-09-13T08:19:30.523828 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005027055740356445, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005065441131591797, :pending_vm_jobs=>0.0014369487762451172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009874343872070312} [----] I, [2016-09-13T08:19:30.524325 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78409], State: [ok], Delivered in [0.01103035] seconds [----] I, [2016-09-13T08:19:30.557483 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78408], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.231029818] seconds [----] I, [2016-09-13T08:19:30.557667 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78408], Delivering... [----] I, [2016-09-13T08:19:30.562744 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78408], State: [ok], Delivered in [0.005048892] seconds [----] I, [2016-09-13T08:19:30.574807 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78410], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.211066915] seconds [----] I, [2016-09-13T08:19:30.575035 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78410], Delivering... [----] I, [2016-09-13T08:19:30.705776 #2937:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 12:19:30 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_16' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 12:19:30.166855') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2927,,2016-09-13 12:19:27 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2936,2016-09-13 12:19:30 UTC,2016-09-13 12:19:30 UTC,COMMIT,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2946,2016-09-13 12:19:30 UTC,2016-09-13 12:19:30 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 12:19:30 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 12:19:30 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 12:19:27 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3, 2986,,2016-09-13 12:19:29 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2997,,2016-09-13 12:19:24 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 12:19:09.314517')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,6, 3011,,2016-09-13 11:55:05 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1465, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,511325, 3030,,2016-09-13 11:24:47 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3283, 3054,,2016-09-13 11:24:43 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3286, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,511324, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,511323, 3160,,2016-09-13 10:54:45 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5085, 10867,,2016-09-13 12:19:21 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,9, 703,,2016-09-13 11:54:59 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1471, 27056,,2016-09-13 11:54:57 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1473, 28888,,2016-09-13 11:55:01 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1469, 12938,,2016-09-13 12:19:23 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,7, 20394,,2016-09-13 11:55:01 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1469, ACTIVITY_STATS_CSV [----] I, [2016-09-13T08:19:30.706154 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78410], State: [ok], Delivered in [0.131113863] seconds [----] I, [2016-09-13T08:19:30.972389 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:31.278390 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:31.278595 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:31.769023 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:32.076722 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:32.076895 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:32.534875 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:32.861935 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:32.862091 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:33.325522 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:33.620452 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:33.620624 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:34.088353 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:34.392265 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:34.392474 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:34.861280 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:35.174688 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:35.174877 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:35.647280 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:35.955320 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:35.955487 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:36.411152 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:36.689944 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:36.690119 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:37.164840 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:37.482814 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:37.483052 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:39.381053 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:19:39.396981 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78411], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:19:40.200976 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:19:40.597124 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78411], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.21254254] seconds [----] I, [2016-09-13T08:19:40.597327 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78411], Delivering... [----] I, [2016-09-13T08:19:40.603651 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033164024353027344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033364295959472656, :pending_vm_jobs=>0.0007901191711425781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059452056884765625} [----] I, [2016-09-13T08:19:40.604104 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78411], State: [ok], Delivered in [0.006780415] seconds [----] I, [2016-09-13T08:19:44.008673 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:44.176990 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:44.312630 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:44.449101 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:44.585819 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:44.722605 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:44.862584 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:44.995392 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:45.131220 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:45.271647 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:45.413282 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:45.547948 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:45.688633 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:45.824295 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:45.961071 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:46.451494 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:46.472239 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00446319580078125, :worker_monitor=>1.246558666229248, :worker_dequeue=>0.0076732635498046875, :total_time=>1.2589747905731201} [----] I, [2016-09-13T08:19:46.603852 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:46.743347 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:46.884252 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:47.026540 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:47.168452 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:47.311642 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:47.453174 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:47.593113 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:47.737491 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:47.875343 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:48.021932 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:48.163935 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:48.300674 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:48.436003 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:48.572376 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:48.715821 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:49.128407 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:49.734031 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:49.870961 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:50.015978 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:50.157355 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:50.297952 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:50.436845 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:50.577891 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:50.721949 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:50.855491 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:50.992946 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:51.130737 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:51.271372 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:51.411796 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:51.472721 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:19:51 UTC]... [----] I, [2016-09-13T08:19:51.517021 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:19:51 UTC]...Complete [----] I, [2016-09-13T08:19:51.554730 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:51.700072 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:51.840759 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:52.256124 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:52.411984 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:52.577073 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:52.716591 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:52.860287 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:52.998377 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:53.140769 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:53.275957 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:53.421935 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:53.560179 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:53.693314 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:53.829476 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:53.969753 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:54.102744 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:54.244315 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:54.382776 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:54.405776 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:19:54.420135 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78412], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:19:54.437097 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78413], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:19:54.465890 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78414], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:19:54.482677 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78415], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:19:54.526482 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:54.871609 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:19:56.610822 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:19:56.777590 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78412], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.367413827] seconds [----] I, [2016-09-13T08:19:56.777813 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78412], Delivering... [----] I, [2016-09-13T08:19:56.791741 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78415], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.32052427] seconds [----] I, [2016-09-13T08:19:56.791967 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78415], Delivering... [----] I, [2016-09-13T08:19:56.798141 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003215312957763672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032341480255126953, :pending_vm_jobs=>0.0007493495941162109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00578618049621582} [----] I, [2016-09-13T08:19:56.798547 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78415], State: [ok], Delivered in [0.006583618] seconds [----] I, [2016-09-13T08:19:56.825791 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78412], State: [ok], Delivered in [0.047950446] seconds [----] I, [2016-09-13T08:19:57.696439 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78413], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.271413711] seconds [----] I, [2016-09-13T08:19:57.696727 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78413], Delivering... [----] I, [2016-09-13T08:19:57.700749 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78413], State: [ok], Delivered in [0.004017599] seconds [----] I, [2016-09-13T08:19:57.752080 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78414], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.307277289] seconds [----] I, [2016-09-13T08:19:57.752313 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78414], Delivering... [----] I, [2016-09-13T08:19:57.757641 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78414], State: [ok], Delivered in [0.00534357] seconds [----] I, [2016-09-13T08:20:01.046128 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:01.186842 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:01.333253 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:01.474572 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:01.610380 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:01.745918 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:01.887045 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:02.027646 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:02.161521 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:02.302540 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:02.440768 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:02.587464 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:02.766580 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:02.907355 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:03.050409 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:03.190037 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:03.283024 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0049207210540771484, :worker_monitor=>1.652649164199829, :worker_dequeue=>0.00732111930847168, :total_time=>1.6652007102966309} [----] I, [2016-09-13T08:20:03.677981 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:03.823995 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:03.962367 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:04.096331 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:04.236487 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:04.381510 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:04.519212 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:04.651664 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:04.789603 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:04.936520 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:05.074589 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:05.211677 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:05.344946 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:05.485765 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:05.626801 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:05.768449 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:05.908917 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:06.333031 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:06.491866 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:06.631968 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:06.774396 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:06.911883 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:07.047335 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:07.183903 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:07.319214 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:07.456213 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:07.600011 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:07.739590 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:07.918804 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:08.056141 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:08.197956 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:08.337543 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:08.476754 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:08.615680 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:09.058100 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:09.215644 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:09.355305 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:09.491631 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:09.493872 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T08:20:09.512080 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78416], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:20:09.523387 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78417], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:20:09.540723 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78418], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:20:09.557754 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78419], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:20:09.626992 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:09.766764 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:09.907164 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:10.045282 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:10.183064 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:10.324792 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:10.462464 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:10.600495 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:10.744319 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:10.888081 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:11.027261 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:11.163332 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:11.302368 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:11.786312 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:13.310392 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:20:13.923836 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78419], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.379245256] seconds [----] I, [2016-09-13T08:20:13.924025 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78419], Delivering... [----] I, [2016-09-13T08:20:13.929651 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029990673065185547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030181407928466797, :pending_vm_jobs=>0.0007004737854003906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00528264045715332} [----] I, [2016-09-13T08:20:13.929970 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78419], State: [ok], Delivered in [0.005944568] seconds [----] I, [2016-09-13T08:20:15.826655 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78416], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.326815856] seconds [----] I, [2016-09-13T08:20:15.826967 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78416], Delivering... [----] I, [2016-09-13T08:20:15.830250 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78416], State: [ok], Delivered in [0.003280209] seconds [----] I, [2016-09-13T08:20:15.855120 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78417], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.339287083] seconds [----] I, [2016-09-13T08:20:15.855390 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78417], Delivering... [----] I, [2016-09-13T08:20:15.867887 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78417], State: [ok], Delivered in [0.012477177] seconds [----] I, [2016-09-13T08:20:15.874101 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78418], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.347324618] seconds [----] I, [2016-09-13T08:20:15.874272 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78418], Delivering... [----] I, [2016-09-13T08:20:15.879677 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78418], State: [ok], Delivered in [0.005341644] seconds [----] I, [2016-09-13T08:20:17.970258 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:18.114627 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:18.262555 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:18.399261 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:18.541364 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:18.690146 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:18.839743 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:18.980794 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:19.121436 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:19.265798 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:19.397857 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:19.537283 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:19.588522 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003529071807861328, :worker_monitor=>1.2551863193511963, :worker_dequeue=>0.00831747055053711, :total_time=>1.2673070430755615} [----] I, [2016-09-13T08:20:19.678819 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:19.820003 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:19.959029 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:20.105503 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:20.550185 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:20.695531 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:20.829234 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:20.965723 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:21.101106 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:21.241070 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:21.386148 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:21.526237 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:21.661410 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:21.799533 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:21.958765 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:22.098173 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:22.243246 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:22.382257 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:22.518726 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:22.654331 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:22.795275 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:23.231055 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:23.392752 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:23.530362 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:23.672158 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:23.854342 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:24.003607 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:24.146869 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:24.278587 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:24.421106 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:24.562394 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:24.567783 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:20:24.589026 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:20:24 UTC]... [----] I, [2016-09-13T08:20:24.592540 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78420], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:20:24.621000 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:20:24 UTC]...Complete [----] I, [2016-09-13T08:20:24.632768 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:20:24.683775 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78421], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:20:24.700100 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:24.835126 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:24.946626 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78420], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.374275736] seconds [----] I, [2016-09-13T08:20:24.946838 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78420], Delivering... [----] I, [2016-09-13T08:20:24.951959 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78420], State: [ok], Delivered in [0.005107222] seconds [----] I, [2016-09-13T08:20:24.982065 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:25.117561 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:25.258214 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:25.394397 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:25.536768 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:25.997746 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:26.164747 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:26.299052 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:26.433473 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:26.572541 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:26.709461 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:26.853204 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:26.987295 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:27.128622 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:27.277831 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:27.421153 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:27.558870 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:27.700952 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:27.842706 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:27.975988 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:28.119186 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:28.266815 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:28.731868 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:29.650352 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:20:30.067046 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78421], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.468863652] seconds [----] I, [2016-09-13T08:20:30.067203 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78421], Delivering... [----] I, [2016-09-13T08:20:30.072971 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002838134765625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028562545776367188, :pending_vm_jobs=>0.0006768703460693359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005475521087646484} [----] I, [2016-09-13T08:20:30.073332 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78421], State: [ok], Delivered in [0.006119218] seconds [----] I, [2016-09-13T08:20:34.902027 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:35.040258 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:35.175873 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:35.314499 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:35.452620 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:35.595657 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:35.734774 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:35.876957 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:36.016296 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:36.153848 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:36.300065 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:36.441246 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:36.495943 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040128231048583984, :worker_monitor=>1.8236560821533203, :worker_dequeue=>0.011518478393554688, :total_time=>1.8395130634307861} [----] I, [2016-09-13T08:20:36.580278 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:36.719601 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:36.852069 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:36.988943 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:37.342268 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:37.492197 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:37.633824 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:37.772714 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:37.909330 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:38.047998 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:38.189392 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:38.337020 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:38.490266 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:38.630709 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:38.770769 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:38.915038 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:39.057822 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:39.195534 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:39.342380 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:39.483024 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:39.621557 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:20:39.696050 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:20:39.724398 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78422], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] E, [2016-09-13T08:20:39.825320 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T08:20:39.825873 #10859:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T08:20:39.826382 #10859:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T08:20:39.826608 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T08:20:39.826829 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T08:20:39.843917 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T08:20:39.844386 #10859:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [78407], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T08:20:39.844810 #10859:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T08:20:39.845214 #10859:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T08:20:39.845544 #10859:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78407], State: [error], Delivered in [78.496357907] seconds [----] I, [2016-09-13T08:20:41.506208 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:20:42.147172 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78422], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.445086985] seconds [----] I, [2016-09-13T08:20:42.147349 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78422], Delivering... [----] I, [2016-09-13T08:20:42.153315 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031430721282958984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031621456146240234, :pending_vm_jobs=>0.0007410049438476562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00561976432800293} [----] I, [2016-09-13T08:20:42.153663 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78422], State: [ok], Delivered in [0.006308022] seconds [----] I, [2016-09-13T08:20:53.558835 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038182735443115234, :server_monitor=>0.13341569900512695, :worker_monitor=>1.8844175338745117, :worker_dequeue=>0.007209300994873047, :total_time=>2.0292203426361084} [----] I, [2016-09-13T08:20:54.733391 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:20:54.752715 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78423], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:20:54.792638 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78424], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:20:54.832735 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78425], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:20:54.867216 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78426], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:20:58.559276 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:20:58 UTC]... [----] I, [2016-09-13T08:20:58.583603 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:20:58 UTC]...Complete [----] I, [2016-09-13T08:20:58.590195 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:20:59.315616 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78423], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.578791817] seconds [----] I, [2016-09-13T08:20:59.315850 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78423], Delivering... [----] I, [2016-09-13T08:20:59.326744 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78426], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.488119975] seconds [----] I, [2016-09-13T08:20:59.326935 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78426], Delivering... [----] I, [2016-09-13T08:20:59.333199 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033195018768310547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003337860107421875, :pending_vm_jobs=>0.0007212162017822266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005888938903808594} [----] I, [2016-09-13T08:20:59.333545 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78426], State: [ok], Delivered in [0.006605844] seconds [----] I, [2016-09-13T08:20:59.372356 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78423], State: [ok], Delivered in [0.056489366] seconds [----] I, [2016-09-13T08:21:01.077087 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78424], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.319273699] seconds [----] I, [2016-09-13T08:21:01.077362 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78424], Delivering... [----] I, [2016-09-13T08:21:01.081246 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78424], State: [ok], Delivered in [0.003881551] seconds [----] I, [2016-09-13T08:21:01.121459 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78425], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.31711439] seconds [----] I, [2016-09-13T08:21:01.121684 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78425], Delivering... [----] I, [2016-09-13T08:21:01.126659 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78425], State: [ok], Delivered in [0.004961511] seconds [----] I, [2016-09-13T08:21:09.881781 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:21:09.909591 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78427], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:21:10.197643 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:21:10.203962 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004094362258911133, :worker_monitor=>1.5808615684509277, :worker_dequeue=>0.011278629302978516, :total_time=>1.5965681076049805} [----] I, [2016-09-13T08:21:10.429919 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78427], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.542523822] seconds [----] I, [2016-09-13T08:21:10.430084 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78427], Delivering... [----] I, [2016-09-13T08:21:10.435821 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003002166748046875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003020048141479492, :pending_vm_jobs=>0.0007226467132568359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0054242610931396484} [----] I, [2016-09-13T08:21:10.436135 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78427], State: [ok], Delivered in [0.006051125] seconds [----] I, [2016-09-13T08:21:24.919637 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:21:24.938373 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78428], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:21:24.949595 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78429], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:21:26.786954 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:21:26.793529 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0042231082916259766, :worker_monitor=>1.5313873291015625, :worker_dequeue=>0.011833429336547852, :total_time=>1.5477733612060547} [----] I, [2016-09-13T08:21:27.555360 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78429], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.610875606] seconds [----] I, [2016-09-13T08:21:27.555556 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78429], Delivering... [----] I, [2016-09-13T08:21:27.561145 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028505325317382812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002868175506591797, :pending_vm_jobs=>0.0006885528564453125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005259513854980469} [----] I, [2016-09-13T08:21:27.561467 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78429], State: [ok], Delivered in [0.005890028] seconds [----] I, [2016-09-13T08:21:28.179679 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78428], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.255044957] seconds [----] I, [2016-09-13T08:21:28.179920 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78428], Delivering... [----] I, [2016-09-13T08:21:28.184855 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78428], State: [ok], Delivered in [0.004932534] seconds [----] I, [2016-09-13T08:21:31.793948 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:21:31 UTC]... [----] I, [2016-09-13T08:21:31.812524 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:21:31 UTC]...Complete [----] I, [2016-09-13T08:21:39.961062 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:21:39.979464 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78430], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:21:43.089454 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:21:43.101458 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003144502639770508, :worker_monitor=>1.2416589260101318, :worker_dequeue=>0.02034592628479004, :total_time=>1.2654712200164795} [----] I, [2016-09-13T08:21:43.281735 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78430], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.315527162] seconds [----] I, [2016-09-13T08:21:43.281897 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78430], Delivering... [----] I, [2016-09-13T08:21:43.287032 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026488304138183594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026640892028808594, :pending_vm_jobs=>0.0006330013275146484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00484156608581543} [----] I, [2016-09-13T08:21:43.287289 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78430], State: [ok], Delivered in [0.005390723] seconds [----] I, [2016-09-13T08:21:54.990278 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:21:55.007303 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78431], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:21:55.025040 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78432], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:21:55.047300 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78433], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:21:55.064405 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78434], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:22:00.158923 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:22:00.165281 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0051572322845458984, :worker_monitor=>1.9106812477111816, :worker_dequeue=>0.011695384979248047, :total_time=>1.9279000759124756} [----] I, [2016-09-13T08:22:00.836396 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78431], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.842050375] seconds [----] I, [2016-09-13T08:22:00.836620 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78431], Delivering... [----] I, [2016-09-13T08:22:00.847541 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78434], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.794816348] seconds [----] I, [2016-09-13T08:22:00.847728 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78434], Delivering... [----] I, [2016-09-13T08:22:00.852713 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027475357055664062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027627944946289062, :pending_vm_jobs=>0.0005407333374023438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004674434661865234} [----] I, [2016-09-13T08:22:00.852971 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78434], State: [ok], Delivered in [0.005274491] seconds [----] I, [2016-09-13T08:22:00.910298 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78431], State: [ok], Delivered in [0.073661296] seconds [----] I, [2016-09-13T08:22:01.436532 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78432], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.42444895] seconds [----] I, [2016-09-13T08:22:01.436799 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78432], Delivering... [----] I, [2016-09-13T08:22:01.440127 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78432], State: [ok], Delivered in [0.003344219] seconds [----] I, [2016-09-13T08:22:01.585130 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78433], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.552486227] seconds [----] I, [2016-09-13T08:22:01.585338 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78433], Delivering... [----] I, [2016-09-13T08:22:01.590051 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78433], State: [ok], Delivered in [0.004719551] seconds [----] I, [2016-09-13T08:22:05.165942 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:22:05 UTC]... [----] I, [2016-09-13T08:22:05.184388 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:22:05 UTC]...Complete [----] I, [2016-09-13T08:22:10.075215 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:22:10.099184 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78435], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:22:10.208222 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:22:10.661791 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78435], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.580533339] seconds [----] I, [2016-09-13T08:22:10.661910 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78435], Delivering... [----] I, [2016-09-13T08:22:10.665565 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002079010009765625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002089977264404297, :pending_vm_jobs=>0.00042700767517089844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0034461021423339844} [----] I, [2016-09-13T08:22:10.665930 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78435], State: [ok], Delivered in [0.003988772] seconds [----] I, [2016-09-13T08:22:16.596878 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025169849395751953, :worker_monitor=>1.3632760047912598, :worker_dequeue=>0.016908884048461914, :total_time=>1.3829514980316162} [----] I, [2016-09-13T08:22:25.110809 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:22:25.124789 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78436], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:22:25.135902 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78437], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:22:26.625226 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:22:26.656173 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78437], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.525745228] seconds [----] I, [2016-09-13T08:22:26.656359 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78437], Delivering... [----] I, [2016-09-13T08:22:26.663284 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003300189971923828, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033206939697265625, :pending_vm_jobs=>0.0007650852203369141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005950212478637695} [----] I, [2016-09-13T08:22:26.663677 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78437], State: [ok], Delivered in [0.007292154] seconds [----] I, [2016-09-13T08:22:28.828534 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78436], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.713313749] seconds [----] I, [2016-09-13T08:22:28.828675 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78436], Delivering... [----] I, [2016-09-13T08:22:28.831525 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78436], State: [ok], Delivered in [0.002868199] seconds [----] I, [2016-09-13T08:22:33.090042 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00488734245300293, :worker_monitor=>1.4411168098449707, :worker_dequeue=>0.007241725921630859, :total_time=>1.453655481338501} [----] I, [2016-09-13T08:22:38.090581 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:22:38 UTC]... [----] I, [2016-09-13T08:22:38.108341 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:22:38 UTC]...Complete [----] I, [2016-09-13T08:22:40.146403 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:22:40.165449 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78438], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:22:43.144317 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:22:43.520812 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78438], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.370088293] seconds [----] I, [2016-09-13T08:22:43.521099 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78438], Delivering... [----] I, [2016-09-13T08:22:43.531321 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005274534225463867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005373239517211914, :pending_vm_jobs=>0.0013158321380615234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00962972640991211} [----] I, [2016-09-13T08:22:43.531890 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78438], State: [ok], Delivered in [0.010765484] seconds [----] I, [2016-09-13T08:22:49.273652 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003626108169555664, :worker_monitor=>1.1074376106262207, :worker_dequeue=>0.0062944889068603516, :total_time=>1.1176550388336182} [----] I, [2016-09-13T08:22:55.174731 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:22:55.203211 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78439], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:22:55.226180 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78440], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:22:55.248951 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78441], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:22:55.271898 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78442], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:22:59.451749 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:22:59.666450 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78439], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.485586122] seconds [----] I, [2016-09-13T08:22:59.666673 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78439], Delivering... [----] I, [2016-09-13T08:22:59.734584 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78439], State: [ok], Delivered in [0.067891002] seconds [----] I, [2016-09-13T08:22:59.780844 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78442], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.526104694] seconds [----] I, [2016-09-13T08:22:59.781035 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78442], Delivering... [----] I, [2016-09-13T08:22:59.788074 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038886070251464844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003911733627319336, :pending_vm_jobs=>0.0008528232574462891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006657600402832031} [----] I, [2016-09-13T08:22:59.788455 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78442], State: [ok], Delivered in [0.0073925] seconds [----] I, [2016-09-13T08:23:01.946184 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78440], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.737344706] seconds [----] I, [2016-09-13T08:23:01.946450 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78440], Delivering... [----] I, [2016-09-13T08:23:01.956857 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78440], State: [ok], Delivered in [0.010428997] seconds [----] I, [2016-09-13T08:23:02.001052 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78441], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.766824182] seconds [----] I, [2016-09-13T08:23:02.001217 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78441], Delivering... [----] I, [2016-09-13T08:23:02.005857 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78441], State: [ok], Delivered in [0.004631829] seconds [----] I, [2016-09-13T08:23:05.739470 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036580562591552734, :worker_monitor=>1.266550064086914, :worker_dequeue=>0.010616779327392578, :total_time=>1.2810585498809814} [----] I, [2016-09-13T08:23:10.283842 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:23:10.297864 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78443], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:23:10.315060 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78444], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:23:10.739991 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:23:10 UTC]... [----] I, [2016-09-13T08:23:10.754997 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:23:10 UTC]...Complete [----] I, [2016-09-13T08:23:10.765869 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:23:10.875315 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78444], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.572053915] seconds [----] I, [2016-09-13T08:23:10.875505 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78444], Delivering... [----] I, [2016-09-13T08:23:10.881708 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031321048736572266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003154754638671875, :pending_vm_jobs=>0.0008022785186767578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005808591842651367} [----] I, [2016-09-13T08:23:10.882049 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78444], State: [ok], Delivered in [0.00654] seconds [----] I, [2016-09-13T08:23:11.058007 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78443], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.768544144] seconds [----] I, [2016-09-13T08:23:11.058200 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78443], Delivering... [----] I, [2016-09-13T08:23:11.058579 #2928:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Starting [----] I, [2016-09-13T08:23:11.063843 #2928:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Complete [----] I, [2016-09-13T08:23:11.064130 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78443], State: [ok], Delivered in [0.005926] seconds [----] I, [2016-09-13T08:23:21.860126 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002594470977783203, :worker_monitor=>1.0626816749572754, :worker_dequeue=>0.005887508392333984, :total_time=>1.0713670253753662} [----] I, [2016-09-13T08:23:25.326614 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:23:25.344212 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78445], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:23:25.367380 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78446], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:23:26.870891 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:23:27.001599 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78446], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.651943426] seconds [----] I, [2016-09-13T08:23:27.001827 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78446], Delivering... [----] I, [2016-09-13T08:23:27.008908 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003176450729370117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031986236572265625, :pending_vm_jobs=>0.0010416507720947266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006704092025756836} [----] I, [2016-09-13T08:23:27.009258 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78446], State: [ok], Delivered in [0.00742668] seconds [----] I, [2016-09-13T08:23:29.133310 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78445], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.8023888] seconds [----] I, [2016-09-13T08:23:29.133543 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78445], Delivering... [----] I, [2016-09-13T08:23:29.138676 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78445], State: [ok], Delivered in [0.005119441] seconds [----] I, [2016-09-13T08:23:38.658954 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004283428192138672, :worker_monitor=>1.7496724128723145, :worker_dequeue=>0.010910987854003906, :total_time=>1.765214204788208} [----] I, [2016-09-13T08:23:40.379229 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:23:40.395877 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78447], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:23:40.422626 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78448], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:23:40.449935 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78449], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:23:43.659533 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:23:43 UTC]... [----] I, [2016-09-13T08:23:43.695370 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:23:43 UTC]...Complete [----] I, [2016-09-13T08:23:43.702392 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:23:44.142559 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78447], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.75897328] seconds [----] I, [2016-09-13T08:23:44.142749 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78447], Delivering... [----] I, [2016-09-13T08:23:44.143771 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T08:23:44.143934 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5367525376 [----] I, [2016-09-13T08:23:44.144017 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5141106688 [----] I, [2016-09-13T08:23:44.144077 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 226418688 [----] I, [2016-09-13T08:23:44.144146 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T08:23:44.144202 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5087080448 [----] I, [2016-09-13T08:23:44.144258 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T08:23:44.144305 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T08:23:44.144357 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 548052992 [----] I, [2016-09-13T08:23:44.144404 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T08:23:44.144493 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8091426816 [----] I, [2016-09-13T08:23:44.144558 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T08:23:44.144605 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T08:23:44.144651 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T08:23:44.144713 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 0 [----] I, [2016-09-13T08:23:44.144794 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T08:23:44.144861 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T08:23:44.144928 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T08:23:44.145004 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T08:23:44.145063 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T08:23:44.145110 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T08:23:44.145155 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273829888 [----] I, [2016-09-13T08:23:44.145202 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57053184 [----] I, [2016-09-13T08:23:44.145251 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216776704 [----] I, [2016-09-13T08:23:44.145320 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T08:23:44.145409 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141688832 [----] I, [2016-09-13T08:23:44.145492 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2580660224 [----] I, [2016-09-13T08:23:44.145541 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2259296256 [----] I, [2016-09-13T08:23:44.145585 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T08:23:44.145657 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T08:23:44.145729 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T08:23:44.145794 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37556224 [----] I, [2016-09-13T08:23:44.145846 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102301696 [----] I, [2016-09-13T08:23:44.145891 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53268480 [----] I, [2016-09-13T08:23:44.145938 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111079424 [----] I, [2016-09-13T08:23:44.145994 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155570176 [----] I, [2016-09-13T08:23:44.146053 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T08:23:44.146100 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T08:23:44.146153 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T08:23:44.146195 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T08:23:44.146255 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T08:23:44.146317 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T08:23:44.146364 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T08:23:44.146407 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T08:23:44.146479 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T08:23:44.183809 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T08:23:44.184046 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T08:23:44.188138 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T08:23:44.191311 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T08:23:44.194939 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T08:23:44.198561 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T08:23:44.200147 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78449], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.771737199] seconds [----] I, [2016-09-13T08:23:44.200449 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78449], Delivering... [----] I, [2016-09-13T08:23:44.202011 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T08:23:44.205509 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 848 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T08:23:44.209081 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T08:23:44.209087 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004786491394042969, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00481724739074707, :pending_vm_jobs=>0.0009245872497558594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007948875427246094} [----] I, [2016-09-13T08:23:44.209492 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78449], State: [ok], Delivered in [0.009063929] seconds [----] I, [2016-09-13T08:23:44.212549 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T08:23:44.216109 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T08:23:44.219507 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T08:23:44.222941 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T08:23:44.226117 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T08:23:44.229272 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1, "smartstate"=>1}} [----] I, [2016-09-13T08:23:44.229513 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:23:44.229718 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T08:23:44.234272 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152027.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:23:44.234616 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78447], State: [ok], Delivered in [0.091845477] seconds [----] I, [2016-09-13T08:23:48.715384 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:23:49.284533 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78448], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.884943588] seconds [----] I, [2016-09-13T08:23:49.284759 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78448], Delivering... [----] I, [2016-09-13T08:23:49.293001 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:23:34 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48922.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T08:23:49.293673 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:23:36 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169070000], Memory % [3.14], CPU Time [51663.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:23:49.294232 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:23:25 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205295000], Memory % [3.5], CPU Time [240695.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T08:23:49.294838 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:23:38 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [202963.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T08:23:49.295458 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:23:37 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162418000], Memory % [3.1], CPU Time [38059.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T08:23:49.296050 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:23:38 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152042.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:23:49.296528 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:23:26 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [104408.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T08:23:49.297036 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:23:38 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [151122.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:23:49.300088 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:23:30 UTC], Process Info: Memory Usage [608399360], Memory Size [1065840640], Proportional Set Size: [440993000], Memory % [7.42], CPU Time [984.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:23:49.302344 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:23:33 UTC], Process Info: Memory Usage [599695360], Memory Size [968343552], Proportional Set Size: [432129000], Memory % [7.31], CPU Time [262.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:23:49.304667 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:23:33 UTC], Process Info: Memory Usage [580407296], Memory Size [936148992], Proportional Set Size: [420030000], Memory % [7.08], CPU Time [2322.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T08:23:49.307077 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:23:30 UTC], Process Info: Memory Usage [558534656], Memory Size [930201600], Proportional Set Size: [406115000], Memory % [6.81], CPU Time [5744.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T08:23:49.307741 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:23:38 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [211789.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T08:23:49.308264 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:23:37 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51718.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:23:49.308800 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:23:30 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165805000], Memory % [3.16], CPU Time [38964.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T08:23:49.309155 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78448], State: [ok], Delivered in [0.024394353] seconds [----] I, [2016-09-13T08:23:53.737614 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T08:23:55.460009 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:23:55.610085 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78450], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:23:55.639220 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78451], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:23:55.678708 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78452], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:23:55.713024 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78453], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:23:56.288565 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:23:56.296214 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003907203674316406, :log_active_servers=>0.01085352897644043, :worker_monitor=>2.544173002243042, :worker_dequeue=>0.014045238494873047, :total_time=>2.573315143585205} [----] I, [2016-09-13T08:23:56.330412 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78450], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.867480704] seconds [----] I, [2016-09-13T08:23:56.330779 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78450], Delivering... [----] I, [2016-09-13T08:23:56.381904 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78453], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.694324104] seconds [----] I, [2016-09-13T08:23:56.382151 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78453], Delivering... [----] I, [2016-09-13T08:23:56.389275 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003761768341064453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003789186477661133, :pending_vm_jobs=>0.0007803440093994141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0066759586334228516} [----] I, [2016-09-13T08:23:56.389672 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78453], State: [ok], Delivered in [0.007523375] seconds [----] I, [2016-09-13T08:23:56.404323 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78450], State: [ok], Delivered in [0.073512647] seconds [----] I, [2016-09-13T08:23:56.456085 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78451], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.840942044] seconds [----] I, [2016-09-13T08:23:56.456265 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78451], Delivering... [----] I, [2016-09-13T08:23:56.459599 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78451], State: [ok], Delivered in [0.003327367] seconds [----] I, [2016-09-13T08:23:56.513601 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78452], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.867065361] seconds [----] I, [2016-09-13T08:23:56.513883 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78452], Delivering... [----] I, [2016-09-13T08:23:56.521221 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78452], State: [ok], Delivered in [0.0073137] seconds [----] I, [2016-09-13T08:24:10.726258 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:24:10.741702 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78454], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:24:13.248612 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:24:13.261552 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005806922912597656, :worker_monitor=>1.7783985137939453, :worker_dequeue=>0.02228093147277832, :total_time=>1.8069775104522705} [----] I, [2016-09-13T08:24:13.519324 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78454], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.787209413] seconds [----] I, [2016-09-13T08:24:13.519636 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78454], Delivering... [----] I, [2016-09-13T08:24:13.528597 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005450010299682617, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005478382110595703, :pending_vm_jobs=>0.0008130073547363281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008388280868530273} [----] I, [2016-09-13T08:24:13.528952 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78454], State: [ok], Delivered in [0.0093364] seconds [----] I, [2016-09-13T08:24:18.262291 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:24:18 UTC]... [----] I, [2016-09-13T08:24:18.284846 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:24:18 UTC]...Complete [----] I, [2016-09-13T08:24:25.754560 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:24:25.782254 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78455], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:24:25.810763 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78456], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:24:29.846772 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:24:29.851381 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00399327278137207, :worker_monitor=>1.4978222846984863, :worker_dequeue=>0.009430408477783203, :total_time=>1.5115113258361816} [----] I, [2016-09-13T08:24:30.622712 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78456], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.83374613] seconds [----] I, [2016-09-13T08:24:30.622937 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78456], Delivering... [----] I, [2016-09-13T08:24:30.630361 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003922224044799805, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0039520263671875, :pending_vm_jobs=>0.0009131431579589844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006976127624511719} [----] I, [2016-09-13T08:24:30.630781 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78456], State: [ok], Delivered in [0.007833477] seconds [----] I, [2016-09-13T08:24:32.348235 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78455], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.588471888] seconds [----] I, [2016-09-13T08:24:32.348478 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78455], Delivering... [----] I, [2016-09-13T08:24:32.354125 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78455], State: [ok], Delivered in [0.00566093] seconds [----] I, [2016-09-13T08:24:40.823961 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:24:40.839594 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78457], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:24:46.052940 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:24:46.058066 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004396915435791016, :worker_monitor=>1.1613521575927734, :worker_dequeue=>0.009019851684570312, :total_time=>1.1750617027282715} [----] I, [2016-09-13T08:24:46.793958 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78457], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.96378309] seconds [----] I, [2016-09-13T08:24:46.794135 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78457], Delivering... [----] I, [2016-09-13T08:24:46.800641 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033850669860839844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034117698669433594, :pending_vm_jobs=>0.0007812976837158203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006152153015136719} [----] I, [2016-09-13T08:24:46.800993 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78457], State: [ok], Delivered in [0.006851588] seconds [----] I, [2016-09-13T08:24:51.058554 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:24:51 UTC]... [----] I, [2016-09-13T08:24:51.073575 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:24:51 UTC]...Complete [----] I, [2016-09-13T08:24:55.857177 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:24:55.873714 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78458], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:24:55.889857 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78459], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:24:55.902194 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78460], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:24:55.913571 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78461], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:24:56.100626 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:24:56.554271 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78458], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.69266671] seconds [----] I, [2016-09-13T08:24:56.554552 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78458], Delivering... [----] I, [2016-09-13T08:24:56.641192 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78458], State: [ok], Delivered in [0.086633967] seconds [----] I, [2016-09-13T08:24:56.685887 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78461], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.778261623] seconds [----] I, [2016-09-13T08:24:56.686093 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78461], Delivering... [----] I, [2016-09-13T08:24:56.693618 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004251718521118164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0042726993560791016, :pending_vm_jobs=>0.0008864402770996094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007118940353393555} [----] I, [2016-09-13T08:24:56.694029 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78461], State: [ok], Delivered in [0.007926829] seconds [----] I, [2016-09-13T08:24:56.760199 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78459], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.881276962] seconds [----] I, [2016-09-13T08:24:56.760407 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78459], Delivering... [----] I, [2016-09-13T08:24:56.768920 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78459], State: [ok], Delivered in [0.008506169] seconds [----] I, [2016-09-13T08:24:56.788727 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78460], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.891120493] seconds [----] I, [2016-09-13T08:24:56.788912 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78460], Delivering... [----] I, [2016-09-13T08:24:56.793838 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78460], State: [ok], Delivered in [0.004897537] seconds [----] I, [2016-09-13T08:25:02.728817 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [100], PID: [10859], GUID: [5b4aad44-79a7-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:25:02.728962 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [100], PID: [10859], GUID: [5b4aad44-79a7-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:25:02.745761 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [101], PID: [12930], GUID: [4846d89a-79ab-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:25:02.745907 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [101], PID: [12930], GUID: [4846d89a-79ab-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:25:02.768624 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:25:02.768773 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:25:02.791625 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:25:02.791820 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:25:02.814592 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:25:02.815314 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:25:02.849595 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:25:02.849854 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:25:02.895043 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:25:02.895221 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:25:02.928639 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:25:02.928838 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:25:02.958107 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:25:02.958296 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:25:02.986034 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:25:02.986686 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:25:03.009354 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:25:03.009664 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:25:03.066485 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:25:03.066779 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:25:03.100968 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:25:03.101267 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:25:03.135054 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:25:03.135250 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:25:03.157320 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:25:03.157532 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:25:03.174006 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004542112350463867, :worker_monitor=>2.049285888671875, :worker_dequeue=>0.012209892272949219, :total_time=>2.06638765335083} [----] I, [2016-09-13T08:25:03.201608 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T08:25:03.201819 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T08:25:03.201920 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T08:25:03.355819 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:25:03.356807 #20386:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T08:25:03.356899 #20386:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:25:03.356952 #20386:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:25:03.356997 #20386:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:25:03.357039 #20386:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T08:25:03.357080 #20386:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T08:25:03.357120 #20386:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:25:03.357160 #20386:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T08:25:03.357199 #20386:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:25:03.357240 #20386:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:25:03.357279 #20386:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:25:03.357317 #20386:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:25:03.357356 #20386:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T08:25:03.357395 #20386:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T08:25:03.357474 #20386:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T08:25:03.357524 #20386:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T08:25:03.357562 #20386:34713c] INFO -- : --- [----] I, [2016-09-13T08:25:03.357943 #20386:34713c] INFO -- : :guid: e5930efc-7974-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:25:03.358013 #20386:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T08:25:03.358149 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T08:25:04.005612 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T08:25:04.005804 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T08:25:04.005886 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T08:25:04.093307 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:25:04.093774 #12930:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T08:25:04.093820 #12930:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:25:04.093844 #12930:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:25:04.093864 #12930:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:25:04.093882 #12930:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T08:25:04.093899 #12930:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T08:25:04.093917 #12930:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:25:04.093934 #12930:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T08:25:04.093950 #12930:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:25:04.093966 #12930:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:25:04.093999 #12930:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T08:25:04.094022 #12930:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:25:04.094040 #12930:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T08:25:04.094057 #12930:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:25:04.094073 #12930:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T08:25:04.094088 #12930:34713c] INFO -- : --- [----] I, [2016-09-13T08:25:04.094301 #12930:34713c] INFO -- : :guid: 4846d89a-79ab-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:25:04.094337 #12930:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T08:25:04.094468 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T08:25:06.547295 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:25:06.547483 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:25:06.547595 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:25:06.711818 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:25:06.712361 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T08:25:06.712436 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:25:06.712483 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:25:06.712513 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:25:06.712539 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T08:25:06.712564 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T08:25:06.712589 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:25:06.712613 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T08:25:06.712638 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:25:06.712662 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:25:06.712704 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:25:06.712733 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:25:06.712757 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T08:25:06.712780 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T08:25:06.712982 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:25:06.713188 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:25:06.758812 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:25:06.758961 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:25:06.759035 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:25:06.901052 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:25:06.901750 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T08:25:06.901815 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:25:06.901856 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:25:06.901886 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:25:06.901916 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T08:25:06.901944 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T08:25:06.901972 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:25:06.901998 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T08:25:06.902025 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:25:06.902053 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:25:06.902078 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:25:06.902104 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:25:06.902129 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T08:25:06.902155 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:25:06.902182 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T08:25:06.902205 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T08:25:06.902456 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:25:06.902576 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:25:06.961538 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:25:06.961663 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:25:06.961734 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:25:07.056148 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:25:07.056612 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T08:25:07.056658 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:25:07.056696 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:25:07.056723 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:25:07.056743 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T08:25:07.056765 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T08:25:07.056785 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:25:07.056805 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T08:25:07.056823 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:25:07.056845 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:25:07.056875 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:25:07.056897 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:25:07.056915 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T08:25:07.056933 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:25:07.056950 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T08:25:07.056968 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T08:25:07.057137 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:25:07.057238 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:25:08.818210 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:25:08.818433 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:25:08.818567 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:25:08.856463 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:25:08.856588 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:25:08.856647 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:25:08.952004 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:25:08.952608 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T08:25:08.952659 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:25:08.952702 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:25:08.952727 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:25:08.952746 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T08:25:08.952766 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T08:25:08.952786 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:25:08.952805 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T08:25:08.952826 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:25:08.952849 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:25:08.952866 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:25:08.952886 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:25:08.952906 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T08:25:08.952923 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:25:08.952940 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T08:25:08.952956 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T08:25:08.953133 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:25:08.953257 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:25:09.001926 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:25:09.002508 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T08:25:09.002559 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:25:09.002587 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:25:09.002609 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:25:09.002631 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T08:25:09.002659 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T08:25:09.002692 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:25:09.002718 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T08:25:09.002738 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:25:09.002757 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:25:09.002775 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:25:09.002794 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:25:09.002811 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T08:25:09.002830 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:25:09.002851 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T08:25:09.002868 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T08:25:09.003055 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:25:09.003190 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:25:10.301696 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T08:25:10.301885 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T08:25:10.301991 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T08:25:10.476156 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:25:10.477156 #10859:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T08:25:10.477244 #10859:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:25:10.477294 #10859:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:25:10.477337 #10859:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:25:10.477380 #10859:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T08:25:10.477447 #10859:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T08:25:10.477508 #10859:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:25:10.477548 #10859:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T08:25:10.477605 #10859:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:25:10.477648 #10859:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:25:10.477706 #10859:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T08:25:10.477754 #10859:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:25:10.477792 #10859:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T08:25:10.477826 #10859:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:25:10.477864 #10859:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T08:25:10.477896 #10859:34713c] INFO -- : --- [----] I, [2016-09-13T08:25:10.478321 #10859:34713c] INFO -- : :guid: 5b4aad44-79a7-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:25:10.478390 #10859:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T08:25:10.478612 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T08:25:10.747877 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:25:10.748109 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:25:10.748220 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:25:10.898115 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:25:10.898955 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T08:25:10.899039 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:25:10.899085 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:25:10.899121 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:25:10.899154 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T08:25:10.899187 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T08:25:10.899222 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:25:10.899256 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T08:25:10.899290 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:25:10.899324 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:25:10.899356 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:25:10.899388 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:25:10.899451 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T08:25:10.899502 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:25:10.899538 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T08:25:10.899569 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T08:25:10.899868 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:25:10.900020 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:25:10.928472 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:25:10.928778 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:25:10.928957 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:25:10.946609 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:25:10.946786 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:25:10.946863 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:25:10.952590 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T08:25:10.952774 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T08:25:10.952857 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T08:25:10.961294 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:25:10.961488 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:25:10.961599 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:25:11.078611 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:25:11.079985 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T08:25:11.080073 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:25:11.080120 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:25:11.080158 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:25:11.080193 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T08:25:11.080226 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T08:25:11.080259 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:25:11.080293 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T08:25:11.080328 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:25:11.080361 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:25:11.080394 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:25:11.080466 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:25:11.080513 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T08:25:11.080547 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T08:25:11.080580 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T08:25:11.080613 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T08:25:11.080646 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T08:25:11.080713 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T08:25:11.080761 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T08:25:11.080799 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T08:25:11.080832 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T08:25:11.080864 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T08:25:11.080897 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T08:25:11.080930 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T08:25:11.080963 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T08:25:11.080996 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T08:25:11.081028 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T08:25:11.081077 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T08:25:11.081124 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T08:25:11.081159 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T08:25:11.081193 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T08:25:11.081227 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T08:25:11.081260 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T08:25:11.081293 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T08:25:11.081326 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T08:25:11.081358 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T08:25:11.081390 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T08:25:11.081449 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T08:25:11.081497 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T08:25:11.081798 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:25:11.081953 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:25:11.082033 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:25:11.090912 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:25:11.091588 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T08:25:11.091668 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:25:11.091738 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:25:11.091778 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:25:11.091813 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T08:25:11.091846 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T08:25:11.091880 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:25:11.091912 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T08:25:11.091944 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:25:11.091975 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:25:11.092019 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:25:11.092056 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:25:11.092087 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T08:25:11.092117 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T08:25:11.092381 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:25:11.092666 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:25:11.105353 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:25:11.105786 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78462], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:25:11.106227 #684:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T08:25:11.106309 #684:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:25:11.106355 #684:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:25:11.106393 #684:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:25:11.106472 #684:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T08:25:11.106520 #684:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T08:25:11.106556 #684:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:25:11.106592 #684:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T08:25:11.106626 #684:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:25:11.106660 #684:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:25:11.106718 #684:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:25:11.106759 #684:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:25:11.106793 #684:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T08:25:11.106828 #684:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T08:25:11.106862 #684:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T08:25:11.106896 #684:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T08:25:11.106928 #684:34713c] INFO -- : --- [----] I, [2016-09-13T08:25:11.107267 #684:34713c] INFO -- : :guid: c253e5f6-7924-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:25:11.107337 #684:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T08:25:11.107496 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T08:25:11.138527 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:25:11.139395 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T08:25:11.139517 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:25:11.139587 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:25:11.139634 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:25:11.139692 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T08:25:11.139737 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T08:25:11.139778 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:25:11.139817 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T08:25:11.139854 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:25:11.139889 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:25:11.139926 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:25:11.139961 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:25:11.139995 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T08:25:11.140027 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:25:11.140064 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T08:25:11.140097 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T08:25:11.140405 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:25:11.140635 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:25:13.409343 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:25:13.765740 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:25:13.765920 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:25:13.766017 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:25:13.955650 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:25:13.956644 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T08:25:13.956751 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:25:13.956804 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:25:13.956845 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:25:13.956884 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T08:25:13.956922 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T08:25:13.956959 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:25:13.956997 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T08:25:13.957037 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:25:13.957073 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:25:13.957111 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:25:13.957145 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:25:13.957181 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T08:25:13.957223 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:25:13.957286 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T08:25:13.957382 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T08:25:13.957795 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:25:13.957963 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:25:14.106032 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78462], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.018126355] seconds [----] I, [2016-09-13T08:25:14.106216 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78462], Delivering... [----] I, [2016-09-13T08:25:14.111092 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028748512268066406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028891563415527344, :pending_vm_jobs=>0.0005421638488769531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004566192626953125} [----] I, [2016-09-13T08:25:14.111390 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78462], State: [ok], Delivered in [0.005188856] seconds [----] I, [2016-09-13T08:25:14.838859 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:25:14.838965 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:25:14.839008 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:25:14.940941 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:25:14.941435 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T08:25:14.941486 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:25:14.941513 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:25:14.941534 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:25:14.941554 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T08:25:14.941573 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T08:25:14.941593 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:25:14.941611 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T08:25:14.941630 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:25:14.941648 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:25:14.941666 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:25:14.941698 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:25:14.941720 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T08:25:14.941738 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T08:25:14.941906 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:25:14.942100 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:25:19.922906 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0046350955963134766, :worker_monitor=>1.4824762344360352, :worker_dequeue=>0.014336347579956055, :total_time=>1.5017473697662354} [----] I, [2016-09-13T08:25:24.923839 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:25:24 UTC]... [----] I, [2016-09-13T08:25:24.946131 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:25:24 UTC]...Complete [----] I, [2016-09-13T08:25:26.118997 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:25:26.141707 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78463], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:25:26.157702 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78464], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:25:29.975609 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:25:30.020697 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78464], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.87126986] seconds [----] I, [2016-09-13T08:25:30.020904 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78464], Delivering... [----] I, [2016-09-13T08:25:30.028202 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0039064884185791016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003931522369384766, :pending_vm_jobs=>0.0009424686431884766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006915569305419922} [----] I, [2016-09-13T08:25:30.028626 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78464], State: [ok], Delivered in [0.007707498] seconds [----] I, [2016-09-13T08:25:30.060247 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78463], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.935399782] seconds [----] I, [2016-09-13T08:25:30.060381 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78463], Delivering... [----] I, [2016-09-13T08:25:30.063038 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78463], State: [ok], Delivered in [0.00264802] seconds [----] I, [2016-09-13T08:25:36.565799 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00558018684387207, :worker_monitor=>1.566556453704834, :worker_dequeue=>0.01049184799194336, :total_time=>1.5832996368408203} [----] I, [2016-09-13T08:25:41.168817 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:25:41.186509 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78465], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:25:41.575489 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:25:42.090785 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78465], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.915715334] seconds [----] I, [2016-09-13T08:25:42.090961 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78465], Delivering... [----] I, [2016-09-13T08:25:42.096968 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031299591064453125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003148317337036133, :pending_vm_jobs=>0.0007648468017578125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005673885345458984} [----] I, [2016-09-13T08:25:42.097318 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78465], State: [ok], Delivered in [0.006349113] seconds [----] I, [2016-09-13T08:25:53.126204 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005518436431884766, :worker_monitor=>1.513808250427246, :worker_dequeue=>0.008402824401855469, :total_time=>1.5281364917755127} [----] I, [2016-09-13T08:25:56.198133 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:25:56.212349 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78466], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:25:56.223710 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78467], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:25:56.240627 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78468], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:25:56.273876 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78469], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:25:58.126896 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:25:58 UTC]... [----] I, [2016-09-13T08:25:58.152867 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:25:58 UTC]...Complete [----] I, [2016-09-13T08:25:58.165127 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:25:58.417095 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78466], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.214662242] seconds [----] I, [2016-09-13T08:25:58.417332 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78466], Delivering... [----] I, [2016-09-13T08:25:58.469787 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78469], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.224142557] seconds [----] I, [2016-09-13T08:25:58.470026 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78469], Delivering... [----] I, [2016-09-13T08:25:58.477245 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037834644317626953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038056373596191406, :pending_vm_jobs=>0.0009088516235351562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006767749786376953} [----] I, [2016-09-13T08:25:58.477600 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78469], State: [ok], Delivered in [0.007593243] seconds [----] I, [2016-09-13T08:25:58.484049 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78466], State: [ok], Delivered in [0.066699707] seconds [----] I, [2016-09-13T08:26:00.177876 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78467], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.960442071] seconds [----] I, [2016-09-13T08:26:00.178050 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78467], Delivering... [----] I, [2016-09-13T08:26:00.181092 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78467], State: [ok], Delivered in [0.003036101] seconds [----] I, [2016-09-13T08:26:00.229460 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78468], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.998523412] seconds [----] I, [2016-09-13T08:26:00.229654 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78468], Delivering... [----] I, [2016-09-13T08:26:00.233759 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78468], State: [ok], Delivered in [0.004101879] seconds [----] I, [2016-09-13T08:26:10.088065 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004247188568115234, :server_monitor=>0.1290416717529297, :worker_monitor=>1.7489356994628906, :worker_dequeue=>0.012254953384399414, :total_time=>1.8948588371276855} [----] I, [2016-09-13T08:26:11.286165 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:26:11.301112 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78470], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:26:15.101622 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:26:15.289391 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78470], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.997208902] seconds [----] I, [2016-09-13T08:26:15.289657 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78470], Delivering... [----] I, [2016-09-13T08:26:15.296556 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003704071044921875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037224292755126953, :pending_vm_jobs=>0.0008120536804199219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00643467903137207} [----] I, [2016-09-13T08:26:15.296894 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78470], State: [ok], Delivered in [0.007252101] seconds [----] I, [2016-09-13T08:26:26.312915 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:26:26.322733 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78471], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:26:26.334369 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78472], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:26:26.495847 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:26:26.501072 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004103899002075195, :worker_monitor=>1.3548479080200195, :worker_dequeue=>0.009279966354370117, :total_time=>1.3685109615325928} [----] I, [2016-09-13T08:26:26.678692 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78472], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.350912373] seconds [----] I, [2016-09-13T08:26:26.678851 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78472], Delivering... [----] I, [2016-09-13T08:26:26.683666 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026395320892333984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026540756225585938, :pending_vm_jobs=>0.0005581378936767578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004548311233520508} [----] I, [2016-09-13T08:26:26.683950 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78472], State: [ok], Delivered in [0.005094096] seconds [----] I, [2016-09-13T08:26:27.358021 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78471], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.039928219] seconds [----] I, [2016-09-13T08:26:27.358270 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78471], Delivering... [----] I, [2016-09-13T08:26:27.364963 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78471], State: [ok], Delivered in [0.006690608] seconds [----] I, [2016-09-13T08:26:31.501596 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:26:31 UTC]... [----] I, [2016-09-13T08:26:31.522884 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:26:31 UTC]...Complete [----] I, [2016-09-13T08:26:41.345614 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:26:41.363274 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78473], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:26:42.853214 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:26:42.858410 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003751039505004883, :worker_monitor=>1.3026843070983887, :worker_dequeue=>0.009269475936889648, :total_time=>1.315964937210083} [----] I, [2016-09-13T08:26:43.766875 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78473], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.415064982] seconds [----] I, [2016-09-13T08:26:43.767057 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78473], Delivering... [----] I, [2016-09-13T08:26:43.773606 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034525394439697266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034737586975097656, :pending_vm_jobs=>0.0007703304290771484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006165742874145508} [----] I, [2016-09-13T08:26:43.774012 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78473], State: [ok], Delivered in [0.006920127] seconds [----] I, [2016-09-13T08:26:56.374462 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:26:56.389396 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78474], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:26:56.418054 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78475], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:26:56.434974 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78476], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:26:56.447076 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78477], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:26:59.215579 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:26:59.222068 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002717256546020508, :worker_monitor=>1.3079802989959717, :worker_dequeue=>0.011560678482055664, :total_time=>1.322469711303711} [----] I, [2016-09-13T08:26:59.938963 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78474], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.561322096] seconds [----] I, [2016-09-13T08:26:59.939189 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78474], Delivering... [----] I, [2016-09-13T08:26:59.944077 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78477], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.503802588] seconds [----] I, [2016-09-13T08:26:59.944275 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78477], Delivering... [----] I, [2016-09-13T08:26:59.951158 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035851001739501953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003606081008911133, :pending_vm_jobs=>0.0009069442749023438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006455183029174805} [----] I, [2016-09-13T08:26:59.951584 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78477], State: [ok], Delivered in [0.007291487] seconds [----] I, [2016-09-13T08:26:59.995202 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78474], State: [ok], Delivered in [0.056007866] seconds [----] I, [2016-09-13T08:27:00.504076 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78475], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.109025341] seconds [----] I, [2016-09-13T08:27:00.504267 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78475], Delivering... [----] I, [2016-09-13T08:27:00.507367 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78475], State: [ok], Delivered in [0.003100084] seconds [----] I, [2016-09-13T08:27:00.515539 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78476], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.089263901] seconds [----] I, [2016-09-13T08:27:00.515758 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78476], Delivering... [----] I, [2016-09-13T08:27:00.520382 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78476], State: [ok], Delivered in [0.004621831] seconds [----] I, [2016-09-13T08:27:04.222714 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:27:04 UTC]... [----] I, [2016-09-13T08:27:04.246605 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:27:04 UTC]...Complete [----] I, [2016-09-13T08:27:11.459100 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:27:11.475282 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78478], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:27:15.703690 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:27:15.710694 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007635354995727539, :worker_monitor=>1.3121371269226074, :worker_dequeue=>0.012471914291381836, :total_time=>1.3325779438018799} [----] I, [2016-09-13T08:27:16.119763 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78478], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.654368048] seconds [----] I, [2016-09-13T08:27:16.119958 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78478], Delivering... [----] I, [2016-09-13T08:27:16.126559 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035576820373535156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035789012908935547, :pending_vm_jobs=>0.0007948875427246094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006242990493774414} [----] I, [2016-09-13T08:27:16.126926 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78478], State: [ok], Delivered in [0.006959633] seconds [----] I, [2016-09-13T08:27:26.487207 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:27:26.507117 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78479], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:27:26.518091 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78480], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:27:32.178094 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:27:32.184742 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0042133331298828125, :worker_monitor=>1.4199419021606445, :worker_dequeue=>0.01181340217590332, :total_time=>1.4362983703613281} [----] I, [2016-09-13T08:27:32.330130 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78480], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.817248252] seconds [----] I, [2016-09-13T08:27:32.330344 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78480], Delivering... [----] I, [2016-09-13T08:27:32.336954 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003355741500854492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033957958221435547, :pending_vm_jobs=>0.0008804798126220703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006200551986694336} [----] I, [2016-09-13T08:27:32.337358 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78480], State: [ok], Delivered in [0.007006247] seconds [----] I, [2016-09-13T08:27:33.644272 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78479], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.152436174] seconds [----] I, [2016-09-13T08:27:33.644490 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78479], Delivering... [----] I, [2016-09-13T08:27:33.649340 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78479], State: [ok], Delivered in [0.004876209] seconds [----] I, [2016-09-13T08:27:37.185522 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:27:37 UTC]... [----] I, [2016-09-13T08:27:37.221207 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:27:37 UTC]...Complete [----] I, [2016-09-13T08:27:41.532877 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:27:41.559925 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78481], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:27:42.251387 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:27:42.392828 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78481], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.849802856] seconds [----] I, [2016-09-13T08:27:42.393008 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78481], Delivering... [----] I, [2016-09-13T08:27:42.399686 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032689571380615234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032880306243896484, :pending_vm_jobs=>0.0008080005645751953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006244659423828125} [----] I, [2016-09-13T08:27:42.400032 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78481], State: [ok], Delivered in [0.007012687] seconds [----] I, [2016-09-13T08:27:48.919559 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004987478256225586, :worker_monitor=>1.643575668334961, :worker_dequeue=>0.011880874633789062, :total_time=>1.6609368324279785} [----] I, [2016-09-13T08:27:56.573846 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:27:56.603027 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78482], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:27:56.631622 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78483], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:27:56.654186 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78484], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:27:56.677481 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78485], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:27:58.940991 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:27:59.563262 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78482], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.984281295] seconds [----] I, [2016-09-13T08:27:59.563477 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78482], Delivering... [----] I, [2016-09-13T08:27:59.569223 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78485], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.90913415] seconds [----] I, [2016-09-13T08:27:59.569509 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78485], Delivering... [----] I, [2016-09-13T08:27:59.579585 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005086183547973633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005115509033203125, :pending_vm_jobs=>0.0013251304626464844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009386062622070312} [----] I, [2016-09-13T08:27:59.580033 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78485], State: [ok], Delivered in [0.010549053] seconds [----] I, [2016-09-13T08:27:59.615788 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78482], State: [ok], Delivered in [0.052308629] seconds [----] I, [2016-09-13T08:28:00.723316 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78483], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.11151766] seconds [----] I, [2016-09-13T08:28:00.723542 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78483], Delivering... [----] I, [2016-09-13T08:28:00.726791 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78483], State: [ok], Delivered in [0.003242002] seconds [----] I, [2016-09-13T08:28:00.740363 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78484], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.09996297] seconds [----] I, [2016-09-13T08:28:00.740628 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78484], Delivering... [----] I, [2016-09-13T08:28:00.745373 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78484], State: [ok], Delivered in [0.004755726] seconds [----] I, [2016-09-13T08:28:05.408518 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006081342697143555, :worker_monitor=>1.44293212890625, :worker_dequeue=>0.011202096939086914, :total_time=>1.4606177806854248} [----] I, [2016-09-13T08:28:10.409069 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:28:10 UTC]... [----] I, [2016-09-13T08:28:10.427591 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:28:10 UTC]...Complete [----] I, [2016-09-13T08:28:11.689512 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:28:11.707570 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78486], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:28:15.570902 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:28:15.746288 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78486], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.04697016] seconds [----] I, [2016-09-13T08:28:15.746499 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78486], Delivering... [----] I, [2016-09-13T08:28:15.752694 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031697750091552734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031888484954833984, :pending_vm_jobs=>0.0008230209350585938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058095455169677734} [----] I, [2016-09-13T08:28:15.753034 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78486], State: [ok], Delivered in [0.006533543] seconds [----] I, [2016-09-13T08:28:21.934812 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007294893264770508, :worker_monitor=>1.337226152420044, :worker_dequeue=>0.012215614318847656, :total_time=>1.357116937637329} [----] I, [2016-09-13T08:28:26.718985 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T08:28:26.736283 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78487], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:28:26.747559 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78488], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:28:26.760130 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78489], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:28:26.770377 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78490], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:28:26.944005 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:28:27.837707 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78488], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.096822552] seconds [----] I, [2016-09-13T08:28:27.837867 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78488], Delivering... [----] I, [2016-09-13T08:28:27.843908 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031044483184814453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031211376190185547, :pending_vm_jobs=>0.0007898807525634766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0056955814361572266} [----] I, [2016-09-13T08:28:27.844228 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78488], State: [ok], Delivered in [0.006357826] seconds [----] I, [2016-09-13T08:28:27.845029 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78490], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.081757725] seconds [----] I, [2016-09-13T08:28:27.845036 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78489], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.094331862] seconds [----] I, [2016-09-13T08:28:27.845195 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78490], Delivering... [----] I, [2016-09-13T08:28:27.845197 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78489], Delivering... [----] I, [2016-09-13T08:28:27.846367 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T08:28:27.846590 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5368102912 [----] I, [2016-09-13T08:28:27.846703 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5141450752 [----] I, [2016-09-13T08:28:27.846786 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 226652160 [----] I, [2016-09-13T08:28:27.846860 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T08:28:27.846931 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5087424512 [----] I, [2016-09-13T08:28:27.847012 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T08:28:27.847088 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T08:28:27.847158 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 548298752 [----] I, [2016-09-13T08:28:27.847229 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T08:28:27.847301 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8000249856 [----] I, [2016-09-13T08:28:27.847373 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T08:28:27.847470 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T08:28:27.847555 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T08:28:27.847627 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 0 [----] I, [2016-09-13T08:28:27.847714 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T08:28:27.847789 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T08:28:27.847859 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T08:28:27.847925 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T08:28:27.847995 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T08:28:27.848063 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T08:28:27.848128 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273842176 [----] I, [2016-09-13T08:28:27.848192 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57053184 [----] I, [2016-09-13T08:28:27.848265 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216788992 [----] I, [2016-09-13T08:28:27.848336 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T08:28:27.848406 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141688832 [----] I, [2016-09-13T08:28:27.848514 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2580398080 [----] I, [2016-09-13T08:28:27.848589 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2258788352 [----] I, [2016-09-13T08:28:27.848655 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T08:28:27.848744 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T08:28:27.848815 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T08:28:27.848893 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37511168 [----] I, [2016-09-13T08:28:27.848963 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102301696 [----] I, [2016-09-13T08:28:27.849037 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53223424 [----] I, [2016-09-13T08:28:27.849106 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111079424 [----] I, [2016-09-13T08:28:27.849173 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155525120 [----] I, [2016-09-13T08:28:27.849238 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T08:28:27.849304 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T08:28:27.849371 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T08:28:27.849461 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T08:28:27.849551 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T08:28:27.849622 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T08:28:27.849704 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T08:28:27.849777 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T08:28:27.849843 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T08:28:27.852750 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:28:19 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169070000], Memory % [3.14], CPU Time [51724.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:28:27.853216 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:28:11 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212540000], Memory % [3.5], CPU Time [48972.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T08:28:27.853764 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:28:11 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205295000], Memory % [3.5], CPU Time [240827.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T08:28:27.854212 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:28:15 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [104475.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T08:28:27.854782 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:28:20 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162420000], Memory % [3.1], CPU Time [38110.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T08:28:27.855328 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:28:18 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [203013.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T08:28:27.855859 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:28:21 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [151198.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:28:27.856305 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:28:21 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152115.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:28:27.859032 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:28:15 UTC], Process Info: Memory Usage [600031232], Memory Size [940474368], Proportional Set Size: [432498000], Memory % [7.31], CPU Time [345.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:28:27.861015 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:28:20 UTC], Process Info: Memory Usage [609120256], Memory Size [1065840640], Proportional Set Size: [441697000], Memory % [7.43], CPU Time [1013.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:28:27.863042 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:28:21 UTC], Process Info: Memory Usage [557658112], Memory Size [894861312], Proportional Set Size: [405379000], Memory % [6.8], CPU Time [5812.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T08:28:27.864931 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:28:13 UTC], Process Info: Memory Usage [580579328], Memory Size [908312576], Proportional Set Size: [420198000], Memory % [7.08], CPU Time [2388.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T08:28:27.865448 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:28:18 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [211841.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T08:28:27.865946 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:28:20 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51751.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:28:27.866398 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:28:19 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165807000], Memory % [3.16], CPU Time [39012.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T08:28:27.866758 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78490], State: [ok], Delivered in [0.021560037] seconds [----] I, [2016-09-13T08:28:27.890697 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78487], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.167772773] seconds [----] I, [2016-09-13T08:28:27.890876 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78487], Delivering... [----] I, [2016-09-13T08:28:27.895066 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78487], State: [ok], Delivered in [0.004181978] seconds [----] I, [2016-09-13T08:28:27.897774 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T08:28:27.897945 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T08:28:27.901409 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T08:28:27.903921 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T08:28:27.906869 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T08:28:27.909793 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T08:28:27.912660 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T08:28:27.915549 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 847 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T08:28:27.918397 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T08:28:27.921254 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T08:28:27.924116 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T08:28:27.926955 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T08:28:27.929868 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T08:28:27.932649 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T08:28:27.935276 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:28:27.935454 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:28:27.935578 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T08:28:27.940243 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [151191.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:28:27.940632 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78489], State: [ok], Delivered in [0.095416555] seconds [----] I, [2016-09-13T08:28:38.170692 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003713846206665039, :worker_monitor=>1.1855230331420898, :worker_dequeue=>0.008777856826782227, :total_time=>1.1982769966125488} [----] I, [2016-09-13T08:28:41.781629 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:28:41.793490 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78491], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:28:43.171163 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:28:43 UTC]... [----] I, [2016-09-13T08:28:43.187728 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:28:43 UTC]...Complete [----] I, [2016-09-13T08:28:43.199011 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:28:43.965310 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78491], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.176909629] seconds [----] I, [2016-09-13T08:28:43.965539 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78491], Delivering... [----] I, [2016-09-13T08:28:43.969968 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002498626708984375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025129318237304688, :pending_vm_jobs=>0.0005130767822265625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00411224365234375} [----] I, [2016-09-13T08:28:43.970231 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78491], State: [ok], Delivered in [0.004711952] seconds [----] I, [2016-09-13T08:28:54.738448 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004098653793334961, :worker_monitor=>1.500765085220337, :worker_dequeue=>0.011453866958618164, :total_time=>1.5166242122650146} [----] I, [2016-09-13T08:28:56.805651 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:28:56.823558 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78492], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:28:56.838396 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78493], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:28:56.855519 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78494], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:28:56.866905 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78495], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:28:59.755819 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T08:28:59.761573 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:29:00.084783 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78492], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.274445908] seconds [----] I, [2016-09-13T08:29:00.084987 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78492], Delivering... [----] I, [2016-09-13T08:29:00.130079 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78495], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.26915002] seconds [----] I, [2016-09-13T08:29:00.130297 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78495], Delivering... [----] I, [2016-09-13T08:29:00.135620 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78492], State: [ok], Delivered in [0.050624037] seconds [----] I, [2016-09-13T08:29:00.136953 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033342838287353516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033559799194335938, :pending_vm_jobs=>0.0008423328399658203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006247520446777344} [----] I, [2016-09-13T08:29:00.137350 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78495], State: [ok], Delivered in [0.007053438] seconds [----] I, [2016-09-13T08:29:01.010120 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78493], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.181063593] seconds [----] I, [2016-09-13T08:29:01.010310 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78493], Delivering... [----] I, [2016-09-13T08:29:01.013385 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78493], State: [ok], Delivered in [0.003072085] seconds [----] I, [2016-09-13T08:29:01.032854 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78494], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.186815769] seconds [----] I, [2016-09-13T08:29:01.033000 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78494], Delivering... [----] I, [2016-09-13T08:29:01.037343 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78494], State: [ok], Delivered in [0.004327163] seconds [----] I, [2016-09-13T08:29:11.156377 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004049539566040039, :worker_monitor=>1.3477721214294434, :worker_dequeue=>0.011704444885253906, :total_time=>1.3638648986816406} [----] I, [2016-09-13T08:29:11.878512 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:29:11.895860 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78496], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:29:16.156975 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:29:16 UTC]... [----] I, [2016-09-13T08:29:16.175727 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:29:16 UTC]...Complete [----] I, [2016-09-13T08:29:16.295643 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:29:17.285644 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78496], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.400962315] seconds [----] I, [2016-09-13T08:29:17.285852 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78496], Delivering... [----] I, [2016-09-13T08:29:17.292028 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003256559371948242, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032761096954345703, :pending_vm_jobs=>0.0007610321044921875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005815744400024414} [----] I, [2016-09-13T08:29:17.292369 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78496], State: [ok], Delivered in [0.006506251] seconds [----] I, [2016-09-13T08:29:26.909234 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:29:26.918826 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78497], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:29:26.943318 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78498], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:29:27.894580 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:29:27.901154 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005122661590576172, :worker_monitor=>1.563279628753662, :worker_dequeue=>0.011733055114746094, :total_time=>1.580437421798706} [----] I, [2016-09-13T08:29:28.167319 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78498], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.243026464] seconds [----] I, [2016-09-13T08:29:28.167564 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78498], Delivering... [----] I, [2016-09-13T08:29:28.175397 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035703182220458984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035898685455322266, :pending_vm_jobs=>0.0009176731109619141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007356166839599609} [----] I, [2016-09-13T08:29:28.175971 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78498], State: [ok], Delivered in [0.008380674] seconds [----] I, [2016-09-13T08:29:28.178555 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78497], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.264462683] seconds [----] I, [2016-09-13T08:29:28.178791 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78497], Delivering... [----] I, [2016-09-13T08:29:28.183547 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78497], State: [ok], Delivered in [0.004743819] seconds [----] I, [2016-09-13T08:29:41.955621 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:29:41.984079 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78499], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:29:44.406391 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:29:44.413027 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041658878326416016, :worker_monitor=>1.4565348625183105, :worker_dequeue=>0.012159585952758789, :total_time=>1.473175048828125} [----] I, [2016-09-13T08:29:44.515824 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78499], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.553854829] seconds [----] I, [2016-09-13T08:29:44.516004 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78499], Delivering... [----] I, [2016-09-13T08:29:44.522327 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033876895904541016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034058094024658203, :pending_vm_jobs=>0.0007684230804443359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059850215911865234} [----] I, [2016-09-13T08:29:44.522715 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78499], State: [ok], Delivered in [0.006685756] seconds [----] I, [2016-09-13T08:29:49.413579 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:29:49 UTC]... [----] I, [2016-09-13T08:29:49.452902 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:29:49 UTC]...Complete [----] I, [2016-09-13T08:29:56.998108 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:29:57.138862 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78500], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:29:57.264652 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78501], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:29:57.284403 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78502], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:29:57.328549 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78503], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:30:01.250908 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:30:01.259746 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036618709564208984, :worker_monitor=>1.753244161605835, :worker_dequeue=>0.014464616775512695, :total_time=>1.7716553211212158} [----] I, [2016-09-13T08:30:01.321696 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78500], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.316908929] seconds [----] I, [2016-09-13T08:30:01.321901 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78500], Delivering... [----] I, [2016-09-13T08:30:01.344896 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78503], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.054174741] seconds [----] I, [2016-09-13T08:30:01.345083 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78503], Delivering... [----] I, [2016-09-13T08:30:01.351436 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033843517303466797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00341033935546875, :pending_vm_jobs=>0.0007891654968261719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005934000015258789} [----] I, [2016-09-13T08:30:01.351834 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78503], State: [ok], Delivered in [0.006721754] seconds [----] I, [2016-09-13T08:30:01.407444 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78501], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.262261761] seconds [----] I, [2016-09-13T08:30:01.407593 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78501], Delivering... [----] I, [2016-09-13T08:30:01.410129 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78501], State: [ok], Delivered in [0.002522538] seconds [----] I, [2016-09-13T08:30:01.412938 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78500], State: [ok], Delivered in [0.09100922] seconds [----] I, [2016-09-13T08:30:01.487339 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78502], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.212524215] seconds [----] I, [2016-09-13T08:30:01.487475 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78502], Delivering... [----] I, [2016-09-13T08:30:01.490333 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78502], State: [ok], Delivered in [0.002852863] seconds [----] I, [2016-09-13T08:30:12.341494 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T08:30:12.367147 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78504], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:30:12.395923 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78505], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:30:12.418951 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78506], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:30:12.458854 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78507], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:30:17.950085 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:30:17.954189 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033845901489257812, :server_monitor=>0.07638096809387207, :worker_monitor=>1.5623524188995361, :worker_dequeue=>0.00759434700012207, :total_time=>1.65004563331604} [----] I, [2016-09-13T08:30:18.727686 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78507], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.299531876] seconds [----] I, [2016-09-13T08:30:18.727918 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78507], Delivering... [----] I, [2016-09-13T08:30:18.734486 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034263134002685547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034613609313964844, :pending_vm_jobs=>0.0008025169372558594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006120920181274414} [----] I, [2016-09-13T08:30:18.734850 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78507], State: [ok], Delivered in [0.006936032] seconds [----] I, [2016-09-13T08:30:19.509799 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78504], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.154590587] seconds [----] I, [2016-09-13T08:30:19.509906 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78504], Delivering... [----] I, [2016-09-13T08:30:19.511434 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78504], State: [ok], Delivered in [0.001511458] seconds [----] I, [2016-09-13T08:30:19.533282 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78505], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.157623259] seconds [----] I, [2016-09-13T08:30:19.533488 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78505], Delivering... [----] I, [2016-09-13T08:30:19.543312 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78505], State: [ok], Delivered in [0.00981454] seconds [----] I, [2016-09-13T08:30:19.571472 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78506], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.169981038] seconds [----] I, [2016-09-13T08:30:19.571655 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78506], Delivering... [----] I, [2016-09-13T08:30:19.581350 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78506], State: [ok], Delivered in [0.009663976] seconds [----] I, [2016-09-13T08:30:22.954684 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:30:22 UTC]... [----] I, [2016-09-13T08:30:22.982799 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:30:22 UTC]...Complete [----] I, [2016-09-13T08:30:27.475076 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:30:27.497192 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78508], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:30:27.528331 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78509], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:30:28.008908 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:30:28.594195 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78509], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.087966086] seconds [----] I, [2016-09-13T08:30:28.594337 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78509], Delivering... [----] I, [2016-09-13T08:30:28.599034 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025010108947753906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025169849395751953, :pending_vm_jobs=>0.0005764961242675781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004363059997558594} [----] I, [2016-09-13T08:30:28.599299 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78509], State: [ok], Delivered in [0.004954759] seconds [----] I, [2016-09-13T08:30:28.622633 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78508], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.140446831] seconds [----] I, [2016-09-13T08:30:28.622796 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78508], Delivering... [----] I, [2016-09-13T08:30:28.626410 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78508], State: [ok], Delivered in [0.003589015] seconds [----] I, [2016-09-13T08:30:35.266579 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004258871078491211, :worker_monitor=>2.2264933586120605, :worker_dequeue=>0.021785497665405273, :total_time=>2.252920150756836} [----] I, [2016-09-13T08:30:42.921864 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:30:42.948690 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78510], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:30:45.292290 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:30:46.040399 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78510], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.10968783] seconds [----] I, [2016-09-13T08:30:46.040642 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78510], Delivering... [----] I, [2016-09-13T08:30:46.047178 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033843517303466797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003403186798095703, :pending_vm_jobs=>0.0008370876312255859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006124734878540039} [----] I, [2016-09-13T08:30:46.047554 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78510], State: [ok], Delivered in [0.006917658] seconds [----] I, [2016-09-13T08:30:56.294349 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:30:56 UTC]... [----] I, [2016-09-13T08:30:56.343019 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:30:56 UTC]...Complete [----] I, [2016-09-13T08:30:57.962149 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:30:57.989032 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78511], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:30:58.006095 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78512], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:30:58.023028 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78513], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:30:58.034387 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78514], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:31:01.367507 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:31:01.754985 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78511], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.788007968] seconds [----] I, [2016-09-13T08:31:01.755209 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78511], Delivering... [----] I, [2016-09-13T08:31:01.772035 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78514], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.743538526] seconds [----] I, [2016-09-13T08:31:01.772241 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78514], Delivering... [----] I, [2016-09-13T08:31:01.780177 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035686492919921875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003652811050415039, :pending_vm_jobs=>0.0009226799011230469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007456064224243164} [----] I, [2016-09-13T08:31:01.780810 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78514], State: [ok], Delivered in [0.008555126] seconds [----] I, [2016-09-13T08:31:01.840315 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78511], State: [ok], Delivered in [0.085083309] seconds [----] I, [2016-09-13T08:31:01.863826 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78512], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.869103122] seconds [----] I, [2016-09-13T08:31:01.864004 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78512], Delivering... [----] I, [2016-09-13T08:31:01.867100 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78512], State: [ok], Delivered in [0.003085394] seconds [----] I, [2016-09-13T08:31:01.961765 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78513], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.947300667] seconds [----] I, [2016-09-13T08:31:01.962025 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78513], Delivering... [----] I, [2016-09-13T08:31:01.967175 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78513], State: [ok], Delivered in [0.005139517] seconds [----] I, [2016-09-13T08:31:07.685099 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035026073455810547, :worker_monitor=>1.2990367412567139, :worker_dequeue=>0.008072376251220703, :total_time=>1.3108940124511719} [----] I, [2016-09-13T08:31:13.046456 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:31:13.066319 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78515], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:31:17.817766 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:31:18.252522 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78515], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.199545827] seconds [----] I, [2016-09-13T08:31:18.252860 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78515], Delivering... [----] I, [2016-09-13T08:31:18.263976 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0055332183837890625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005568027496337891, :pending_vm_jobs=>0.0014634132385253906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010503292083740234} [----] I, [2016-09-13T08:31:18.264568 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78515], State: [ok], Delivered in [0.011700502] seconds [----] I, [2016-09-13T08:31:24.362931 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006570339202880859, :worker_monitor=>1.5205309391021729, :worker_dequeue=>0.011212825775146484, :total_time=>1.5385966300964355} [----] I, [2016-09-13T08:31:28.079673 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:31:28.098140 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78516], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:31:28.110314 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78517], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:31:29.363549 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:31:29 UTC]... [----] I, [2016-09-13T08:31:29.389265 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:31:29 UTC]...Complete [----] I, [2016-09-13T08:31:29.400921 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:31:30.413811 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78517], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.309406923] seconds [----] I, [2016-09-13T08:31:30.414004 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78517], Delivering... [----] I, [2016-09-13T08:31:30.419483 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028977394104003906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002912759780883789, :pending_vm_jobs=>0.0007002353668212891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00510859489440918} [----] I, [2016-09-13T08:31:30.419823 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78517], State: [ok], Delivered in [0.00579972] seconds [----] I, [2016-09-13T08:31:31.984359 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78516], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.899828032] seconds [----] I, [2016-09-13T08:31:31.984647 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78516], Delivering... [----] I, [2016-09-13T08:31:31.990027 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78516], State: [ok], Delivered in [0.005374982] seconds [----] I, [2016-09-13T08:31:40.906096 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003744363784790039, :worker_monitor=>1.4680473804473877, :worker_dequeue=>0.01112985610961914, :total_time=>1.483259916305542} [----] I, [2016-09-13T08:31:43.123822 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:31:43.143993 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78518], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:31:45.915977 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:31:46.493783 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78518], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.36321545] seconds [----] I, [2016-09-13T08:31:46.494037 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78518], Delivering... [----] I, [2016-09-13T08:31:46.502745 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004489421844482422, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004527091979980469, :pending_vm_jobs=>0.0011844635009765625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008260488510131836} [----] I, [2016-09-13T08:31:46.503071 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78518], State: [ok], Delivered in [0.009046445] seconds [----] I, [2016-09-13T08:31:57.553648 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004055023193359375, :worker_monitor=>1.5933072566986084, :worker_dequeue=>0.011656761169433594, :total_time=>1.6093266010284424} [----] I, [2016-09-13T08:31:58.156084 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:31:58.179314 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78519], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:31:58.197990 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78520], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:31:58.213292 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78521], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:31:58.236705 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78522], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:32:02.554213 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:32:02 UTC]... [----] I, [2016-09-13T08:32:02.584880 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:32:02 UTC]...Complete [----] I, [2016-09-13T08:32:02.596010 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:32:02.653695 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78519], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.493652996] seconds [----] I, [2016-09-13T08:32:02.653848 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78519], Delivering... [----] I, [2016-09-13T08:32:02.671294 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78522], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.453162588] seconds [----] I, [2016-09-13T08:32:02.671600 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78522], Delivering... [----] I, [2016-09-13T08:32:02.681385 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004927396774291992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00495600700378418, :pending_vm_jobs=>0.0011963844299316406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009195566177368164} [----] I, [2016-09-13T08:32:02.681870 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78522], State: [ok], Delivered in [0.010272833] seconds [----] I, [2016-09-13T08:32:02.710862 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78519], State: [ok], Delivered in [0.056972056] seconds [----] I, [2016-09-13T08:32:05.122194 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78520], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.937813287] seconds [----] I, [2016-09-13T08:32:05.122393 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78520], Delivering... [----] I, [2016-09-13T08:32:05.125572 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78520], State: [ok], Delivered in [0.003172955] seconds [----] I, [2016-09-13T08:32:05.162055 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78521], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.956559008] seconds [----] I, [2016-09-13T08:32:05.162234 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78521], Delivering... [----] I, [2016-09-13T08:32:05.166773 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78521], State: [ok], Delivered in [0.00452547] seconds [----] I, [2016-09-13T08:32:13.247029 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:32:13.282003 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78523], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:32:14.210216 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:32:14.217908 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035512447357177734, :worker_monitor=>1.5832514762878418, :worker_dequeue=>0.012659549713134766, :total_time=>1.5997135639190674} [----] I, [2016-09-13T08:32:14.785195 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78523], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.532157222] seconds [----] I, [2016-09-13T08:32:14.785385 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78523], Delivering... [----] I, [2016-09-13T08:32:14.791535 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031206607818603516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031404495239257812, :pending_vm_jobs=>0.0007781982421875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005694866180419922} [----] I, [2016-09-13T08:32:14.791834 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78523], State: [ok], Delivered in [0.006455967] seconds [----] I, [2016-09-13T08:32:28.294298 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:32:28.310805 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78524], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:32:28.323093 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78525], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:32:30.900612 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:32:30.907304 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00432586669921875, :worker_monitor=>1.5205256938934326, :worker_dequeue=>0.011922121047973633, :total_time=>1.5371067523956299} [----] I, [2016-09-13T08:32:30.961333 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78525], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.644629633] seconds [----] I, [2016-09-13T08:32:30.961532 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78525], Delivering... [----] I, [2016-09-13T08:32:30.967692 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003078937530517578, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030994415283203125, :pending_vm_jobs=>0.0008065700531005859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057299137115478516} [----] I, [2016-09-13T08:32:30.968047 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78525], State: [ok], Delivered in [0.00650482] seconds [----] I, [2016-09-13T08:32:32.237364 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78524], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.938069252] seconds [----] I, [2016-09-13T08:32:32.237617 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78524], Delivering... [----] I, [2016-09-13T08:32:32.242588 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78524], State: [ok], Delivered in [0.004950077] seconds [----] I, [2016-09-13T08:32:35.907881 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:32:35 UTC]... [----] I, [2016-09-13T08:32:35.928440 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:32:35 UTC]...Complete [----] I, [2016-09-13T08:32:43.335301 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:32:43.354371 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78526], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:32:47.453750 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:32:47.458170 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041925907135009766, :worker_monitor=>1.48409104347229, :worker_dequeue=>0.008060216903686523, :total_time=>1.4966182708740234} [----] I, [2016-09-13T08:32:48.102805 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78526], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.760895168] seconds [----] I, [2016-09-13T08:32:48.103048 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78526], Delivering... [----] I, [2016-09-13T08:32:48.113226 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004415273666381836, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004445314407348633, :pending_vm_jobs=>0.0009064674377441406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0073986053466796875} [----] I, [2016-09-13T08:32:48.113704 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78526], State: [ok], Delivered in [0.010647092] seconds [----] I, [2016-09-13T08:32:58.373159 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:32:58.422973 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78527], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:32:58.439864 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78528], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:32:58.457043 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78529], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:32:58.479966 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78530], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:33:04.255191 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:33:04.265627 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004494667053222656, :worker_monitor=>1.7470145225524902, :worker_dequeue=>0.015837907791137695, :total_time=>1.7676784992218018} [----] I, [2016-09-13T08:33:04.292220 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78527], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.914304462] seconds [----] I, [2016-09-13T08:33:04.292404 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78527], Delivering... [----] I, [2016-09-13T08:33:04.354799 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78527], State: [ok], Delivered in [0.062375837] seconds [----] I, [2016-09-13T08:33:04.412097 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78530], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.949951093] seconds [----] I, [2016-09-13T08:33:04.412301 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78530], Delivering... [----] I, [2016-09-13T08:33:04.420624 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0041768550872802734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004198551177978516, :pending_vm_jobs=>0.0009922981262207031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007870912551879883} [----] I, [2016-09-13T08:33:04.420984 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78530], State: [ok], Delivered in [0.008667459] seconds [----] I, [2016-09-13T08:33:05.355305 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78528], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.92679486] seconds [----] I, [2016-09-13T08:33:05.355548 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78528], Delivering... [----] I, [2016-09-13T08:33:05.358891 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78528], State: [ok], Delivered in [0.003340909] seconds [----] I, [2016-09-13T08:33:05.400704 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78529], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.952865852] seconds [----] I, [2016-09-13T08:33:05.400923 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78529], Delivering... [----] I, [2016-09-13T08:33:05.405754 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78529], State: [ok], Delivered in [0.004824352] seconds [----] I, [2016-09-13T08:33:09.266222 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:33:09 UTC]... [----] I, [2016-09-13T08:33:09.303106 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:33:09 UTC]...Complete [----] I, [2016-09-13T08:33:13.492264 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:33:13.520779 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78531], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:33:14.338019 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:33:14.429906 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78531], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.930657537] seconds [----] I, [2016-09-13T08:33:14.430124 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78531], Delivering... [----] I, [2016-09-13T08:33:14.437664 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0039021968841552734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003928422927856445, :pending_vm_jobs=>0.0008945465087890625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0071048736572265625} [----] I, [2016-09-13T08:33:14.438071 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78531], State: [ok], Delivered in [0.007940865] seconds [----] I, [2016-09-13T08:33:21.104879 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004173994064331055, :server_monitor=>0.09652161598205566, :worker_monitor=>1.6486725807189941, :worker_dequeue=>0.009725332260131836, :total_time=>1.7594637870788574} [----] I, [2016-09-13T08:33:28.533408 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T08:33:28.584495 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78532], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:33:28.601399 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78533], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:33:28.618731 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78534], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:33:28.635728 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78535], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:33:31.130804 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:33:31.373296 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78533], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.78258432] seconds [----] I, [2016-09-13T08:33:31.373519 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78533], Delivering... [----] I, [2016-09-13T08:33:31.380825 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003293752670288086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033130645751953125, :pending_vm_jobs=>0.0007841587066650391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006829977035522461} [----] I, [2016-09-13T08:33:31.381264 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78533], State: [ok], Delivered in [0.007719222] seconds [----] I, [2016-09-13T08:33:31.424480 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78534], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.818597547] seconds [----] I, [2016-09-13T08:33:31.424681 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78534], Delivering... [----] I, [2016-09-13T08:33:31.425749 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T08:33:31.425936 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5359525888 [----] I, [2016-09-13T08:33:31.426023 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5132681216 [----] I, [2016-09-13T08:33:31.426096 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 226844672 [----] I, [2016-09-13T08:33:31.426168 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T08:33:31.426235 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5078650880 [----] I, [2016-09-13T08:33:31.426305 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T08:33:31.426369 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T08:33:31.426496 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 548524032 [----] I, [2016-09-13T08:33:31.426585 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T08:33:31.426671 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7896952832 [----] I, [2016-09-13T08:33:31.426744 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T08:33:31.426808 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T08:33:31.426872 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T08:33:31.426938 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T08:33:31.426999 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T08:33:31.427064 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T08:33:31.427126 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T08:33:31.427189 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T08:33:31.427253 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T08:33:31.427320 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T08:33:31.427382 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273854464 [----] I, [2016-09-13T08:33:31.427485 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57065472 [----] I, [2016-09-13T08:33:31.427560 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216788992 [----] I, [2016-09-13T08:33:31.427626 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T08:33:31.427712 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141705216 [----] I, [2016-09-13T08:33:31.427785 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2589310976 [----] I, [2016-09-13T08:33:31.427851 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2267508736 [----] I, [2016-09-13T08:33:31.427916 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T08:33:31.427978 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T08:33:31.428042 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T08:33:31.428104 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37593088 [----] I, [2016-09-13T08:33:31.428170 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102301696 [----] I, [2016-09-13T08:33:31.428243 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53174272 [----] I, [2016-09-13T08:33:31.428311 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111112192 [----] I, [2016-09-13T08:33:31.428376 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155475968 [----] I, [2016-09-13T08:33:31.428469 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T08:33:31.428547 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T08:33:31.428616 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T08:33:31.428700 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T08:33:31.428773 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T08:33:31.428837 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T08:33:31.428901 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T08:33:31.428970 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T08:33:31.429032 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T08:33:31.465574 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T08:33:31.465704 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T08:33:31.467593 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T08:33:31.468923 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T08:33:31.470569 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T08:33:31.472119 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T08:33:31.473740 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T08:33:31.475300 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 847 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T08:33:31.476870 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T08:33:31.478363 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T08:33:31.479875 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.7 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T08:33:31.481396 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T08:33:31.482908 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T08:33:31.484377 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T08:33:31.486215 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:33:31.486289 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:33:31.486344 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T08:33:31.488582 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152163.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:33:31.488830 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78534], State: [ok], Delivered in [0.064171248] seconds [----] I, [2016-09-13T08:33:31.533392 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78535], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.909224775] seconds [----] I, [2016-09-13T08:33:31.533615 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78535], Delivering... [----] I, [2016-09-13T08:33:31.540931 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:33:20 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169070000], Memory % [3.14], CPU Time [51739.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:33:31.541386 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:33:11 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [48979.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T08:33:31.541943 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:33:13 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205295000], Memory % [3.5], CPU Time [240992.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T08:33:31.542382 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:33:15 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347147000], Memory % [5.04], CPU Time [104494.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T08:33:31.542920 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:33:18 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162420000], Memory % [3.1], CPU Time [38120.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T08:33:31.543384 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:33:20 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358681000], Memory % [5.28], CPU Time [203054.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T08:33:31.543915 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:33:20 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [151250.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:33:31.544333 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:33:20 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152172.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:33:31.547182 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:33:15 UTC], Process Info: Memory Usage [600031232], Memory Size [940474368], Proportional Set Size: [432504000], Memory % [7.31], CPU Time [355.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:33:31.549217 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:33:11 UTC], Process Info: Memory Usage [598573056], Memory Size [929099776], Proportional Set Size: [431396000], Memory % [7.3], CPU Time [1076.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:33:31.551223 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:33:11 UTC], Process Info: Memory Usage [557928448], Memory Size [910589952], Proportional Set Size: [405619000], Memory % [6.8], CPU Time [5824.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T08:33:31.553143 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:33:14 UTC], Process Info: Memory Usage [580792320], Memory Size [921419776], Proportional Set Size: [420397000], Memory % [7.08], CPU Time [2399.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T08:33:31.553680 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:33:20 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [211889.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T08:33:31.554170 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:33:18 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51766.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:33:31.554628 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:33:19 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165806000], Memory % [3.16], CPU Time [39022.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T08:33:31.554957 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78535], State: [ok], Delivered in [0.021343003] seconds [----] I, [2016-09-13T08:33:32.515820 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78532], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.977397132] seconds [----] I, [2016-09-13T08:33:32.515964 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78532], Delivering... [----] I, [2016-09-13T08:33:32.519380 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78532], State: [ok], Delivered in [0.003407278] seconds [----] I, [2016-09-13T08:33:37.597835 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004163980484008789, :worker_monitor=>1.4461054801940918, :worker_dequeue=>0.01237630844116211, :total_time=>1.4629511833190918} [----] I, [2016-09-13T08:33:42.598383 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:33:42 UTC]... [----] I, [2016-09-13T08:33:42.614631 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:33:42 UTC]...Complete [----] I, [2016-09-13T08:33:43.649547 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:33:43.666619 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78536], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:33:47.640600 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:33:47.707060 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78536], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.050698518] seconds [----] I, [2016-09-13T08:33:47.707247 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78536], Delivering... [----] I, [2016-09-13T08:33:47.713995 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035965442657470703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003659486770629883, :pending_vm_jobs=>0.0008535385131835938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006356716156005859} [----] I, [2016-09-13T08:33:47.714372 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78536], State: [ok], Delivered in [0.007122969] seconds [----] I, [2016-09-13T08:33:54.029186 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00637364387512207, :worker_monitor=>1.363506555557251, :worker_dequeue=>0.011243820190429688, :total_time=>1.3815491199493408} [----] I, [2016-09-13T08:33:58.678600 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:33:58.723967 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78537], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:33:58.746662 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78538], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:33:58.764353 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78539], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:33:58.774942 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78540], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:33:59.038762 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:33:59.598592 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78537], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.916260905] seconds [----] I, [2016-09-13T08:33:59.598850 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78537], Delivering... [----] I, [2016-09-13T08:33:59.632589 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78540], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.862739666] seconds [----] I, [2016-09-13T08:33:59.632832 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78540], Delivering... [----] I, [2016-09-13T08:33:59.639582 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036623477935791016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036802291870117188, :pending_vm_jobs=>0.0007958412170410156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063190460205078125} [----] I, [2016-09-13T08:33:59.639969 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78540], State: [ok], Delivered in [0.007115426] seconds [----] I, [2016-09-13T08:33:59.678256 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78537], State: [ok], Delivered in [0.079390912] seconds [----] I, [2016-09-13T08:33:59.701597 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78538], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.971866434] seconds [----] I, [2016-09-13T08:33:59.701896 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78538], Delivering... [----] I, [2016-09-13T08:33:59.706944 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78538], State: [ok], Delivered in [0.005042478] seconds [----] I, [2016-09-13T08:33:59.746758 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78539], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.992220046] seconds [----] I, [2016-09-13T08:33:59.746950 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78539], Delivering... [----] I, [2016-09-13T08:33:59.751728 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78539], State: [ok], Delivered in [0.004759211] seconds [----] I, [2016-09-13T08:34:04.061216 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T08:34:10.474999 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004628419876098633, :worker_monitor=>1.3819780349731445, :worker_dequeue=>0.011038064956665039, :total_time=>1.397968053817749} [----] I, [2016-09-13T08:34:13.786560 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T08:34:13.821244 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78541], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:34:13.843978 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78542], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:34:15.475598 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:34:15 UTC]... [----] I, [2016-09-13T08:34:15.495233 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:34:15 UTC]...Complete [----] I, [2016-09-13T08:34:15.506109 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:34:15.902791 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78542], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.072523053] seconds [----] I, [2016-09-13T08:34:15.902994 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78542], Delivering... [----] I, [2016-09-13T08:34:15.909148 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003281831741333008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033028125762939453, :pending_vm_jobs=>0.0007014274597167969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005766391754150391} [----] I, [2016-09-13T08:34:15.909515 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78542], State: [ok], Delivered in [0.006518967] seconds [----] I, [2016-09-13T08:34:17.792912 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78541], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.989681525] seconds [----] I, [2016-09-13T08:34:17.793105 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78541], Delivering... [----] I, [2016-09-13T08:34:17.835339 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78543], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T08:34:17.856339 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78544], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T08:34:17.856818 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78541], State: [ok], Delivered in [0.063705523] seconds [----] I, [2016-09-13T08:34:20.619603 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T08:34:20.621926 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T08:34:21.794071 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [78544], MiqWorker id: [100], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [3.952093361] seconds [----] I, [2016-09-13T08:34:21.794302 #10859:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78544], Delivering... [----] I, [2016-09-13T08:34:21.798492 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T08:34:21.798696 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T08:34:21.798853 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T08:34:21.799046 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T08:34:21.799206 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:22.227897 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:22.523865 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:22.524063 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:23.030529 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:23.335617 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:23.335835 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:23.834506 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:24.133335 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:24.133495 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:24.600055 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:24.895383 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:24.895604 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:25.394174 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:25.588205 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [78543], MiqWorker id: [101], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [7.779067044] seconds [----] I, [2016-09-13T08:34:25.588460 #12930:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78543], Delivering... [----] I, [2016-09-13T08:34:25.592686 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T08:34:25.592887 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T08:34:25.593049 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T08:34:25.593245 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T08:34:25.593467 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:25.722196 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:25.722382 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:25.881196 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:26.089405 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:26.089618 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:26.209853 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:26.418622 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:26.523526 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:26.530070 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:26.530251 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:26.615388 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:26.938065 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:27.004342 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:27.045217 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:27.066230 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007067441940307617, :worker_monitor=>1.4275987148284912, :worker_dequeue=>0.008965015411376953, :total_time=>1.4439070224761963} [----] I, [2016-09-13T08:34:27.138039 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:27.230193 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:27.322608 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:27.322833 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:27.322873 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:27.416307 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:27.509444 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:27.602299 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:27.695666 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:27.788296 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:27.817060 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:27.881324 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:27.974888 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:28.068589 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:28.122830 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:28.123041 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:28.163220 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:28.257451 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:28.350497 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:28.442719 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:34:28.594042 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:28.682472 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T08:34:28.682753 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004851818084716797, :collect_inventory_for_targets=>2.0742416381835938e-05, :parse_legacy_inventory=>9.084765434265137, :parse_targeted_inventory=>9.084843397140503, :save_inventory=>0.634443998336792, :ems_refresh=>9.720679521560669} [----] I, [2016-09-13T08:34:28.709398 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T08:34:28.710099 #12930:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78543], State: [ok], Delivered in [3.121635669] seconds [----] I, [2016-09-13T08:34:28.856693 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:34:28.902885 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78545], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:34:28.917500 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:28.917718 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:28.925641 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78546], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:34:29.396740 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:29.695972 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:29.696115 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:30.168487 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:30.476802 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:30.476913 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:30.967772 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:31.269222 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:31.269464 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:31.767097 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:32.069684 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:32.069858 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:32.077359 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:34:32.563767 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:32.722957 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:32.857515 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:32.902296 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78546], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.992843568] seconds [----] I, [2016-09-13T08:34:32.902552 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78546], Delivering... [----] I, [2016-09-13T08:34:32.909936 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004145145416259766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004166126251220703, :pending_vm_jobs=>0.0008606910705566406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0069315433502197266} [----] I, [2016-09-13T08:34:32.910304 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78546], State: [ok], Delivered in [0.007745005] seconds [----] I, [2016-09-13T08:34:32.931292 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78545], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.069384749] seconds [----] I, [2016-09-13T08:34:32.931572 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78545], Delivering... [----] I, [2016-09-13T08:34:32.936660 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78545], State: [ok], Delivered in [0.005097922] seconds [----] I, [2016-09-13T08:34:32.994658 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:33.130547 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:33.270521 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:33.409121 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:33.541590 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:33.682605 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:33.827781 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:33.966356 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:34.102026 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:34.233888 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:34.368319 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:34.508820 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:34.857727 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:35.014018 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:35.149627 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:35.292504 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:35.429818 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:35.564183 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:35.698106 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:41.869630 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:42.012949 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:42.163902 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:42.302274 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:42.449278 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:42.588142 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:42.735257 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:42.880497 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:43.017718 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:43.161119 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:43.580945 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:43.726637 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:43.771796 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004128217697143555, :worker_monitor=>1.6470041275024414, :worker_dequeue=>0.014808416366577148, :total_time=>1.6662464141845703} [----] I, [2016-09-13T08:34:43.858408 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:43.938276 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:34:43.953881 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78547], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:34:43.992810 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:44.128232 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:44.281247 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:44.422402 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:44.562680 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:44.702811 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:44.843879 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:44.979886 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:45.123002 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:45.268277 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:45.410248 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:45.547879 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:45.700953 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:45.845723 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:46.304190 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:46.475376 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:46.609846 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:46.747161 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:46.881768 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:47.056021 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:47.199234 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:47.339912 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:47.479878 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:47.613366 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:47.756049 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:47.892816 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:48.028797 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:48.168711 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:48.303893 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:48.437126 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:48.574757 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:48.772383 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:34:48 UTC]... [----] I, [2016-09-13T08:34:48.816798 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:34:48 UTC]...Complete [----] I, [2016-09-13T08:34:48.828213 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:34:48.984406 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:49.131208 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78547], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.18702209] seconds [----] I, [2016-09-13T08:34:49.131405 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78547], Delivering... [----] I, [2016-09-13T08:34:49.134398 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:49.137732 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032804012298583984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033028125762939453, :pending_vm_jobs=>0.0007977485656738281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005861759185791016} [----] I, [2016-09-13T08:34:49.138094 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78547], State: [ok], Delivered in [0.006692504] seconds [----] I, [2016-09-13T08:34:49.267807 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:49.399078 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:49.740259 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:49.873554 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:50.012876 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:50.156056 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:50.298861 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:50.445150 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:50.578082 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:50.716173 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:50.859055 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:51.000315 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:51.147160 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:51.283611 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:51.423782 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:51.816524 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:51.968799 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:52.113630 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:52.257774 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:52.395673 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:52.539288 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:52.688620 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:52.823356 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:52.965080 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:53.141874 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:53.286828 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:53.432923 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:53.575945 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:53.715680 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:53.854219 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:53.992719 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:54.129663 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:54.641547 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:54.840182 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:54.981525 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:55.122295 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:55.267195 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:55.409342 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:55.545958 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:55.685928 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:55.825012 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:55.965293 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:56.169742 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:56.317859 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:56.458203 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:56.602729 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:56.738884 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:56.881554 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:57.018075 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:57.590238 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:57.764145 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:57.897986 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:58.036757 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:58.178589 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:58.325814 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:58.457600 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:58.596608 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:58.738472 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:58.883781 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:58.965923 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:34:58.982537 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78548], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:34:58.993855 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78549], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:34:59.011099 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78550], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:34:59.022397 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78551], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:34:59.024696 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:59.165151 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:59.307256 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:59.451634 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:59.587621 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:59.733818 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:34:59.868042 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:00.215039 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:00.367576 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:00.440064 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:35:00.446774 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004316091537475586, :worker_monitor=>1.578324317932129, :worker_dequeue=>0.012174367904663086, :total_time=>1.595198154449463} [----] I, [2016-09-13T08:35:00.505639 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:00.644712 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:00.786054 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:00.924702 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:01.183356 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:01.252317 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78548], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.28126219] seconds [----] I, [2016-09-13T08:35:01.252612 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78548], Delivering... [----] I, [2016-09-13T08:35:01.314607 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78551], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.297568627] seconds [----] I, [2016-09-13T08:35:01.314837 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78551], Delivering... [----] I, [2016-09-13T08:35:01.323462 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:01.323635 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003573894500732422, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035970211029052734, :pending_vm_jobs=>0.0013818740844726562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008342266082763672} [----] I, [2016-09-13T08:35:01.324170 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78551], State: [ok], Delivered in [0.009306639] seconds [----] I, [2016-09-13T08:35:01.333498 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78548], State: [ok], Delivered in [0.08081224] seconds [----] I, [2016-09-13T08:35:01.461935 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:01.596924 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:01.742106 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:01.881454 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:02.024027 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:02.159351 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:02.315584 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:02.459312 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:02.597151 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:03.045735 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78549], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.057721891] seconds [----] I, [2016-09-13T08:35:03.045865 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78549], Delivering... [----] I, [2016-09-13T08:35:03.047904 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78549], State: [ok], Delivered in [0.002039839] seconds [----] I, [2016-09-13T08:35:03.063044 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78550], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.061367778] seconds [----] I, [2016-09-13T08:35:03.063226 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78550], Delivering... [----] I, [2016-09-13T08:35:03.067516 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78550], State: [ok], Delivered in [0.004289335] seconds [----] I, [2016-09-13T08:35:03.103243 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:03.246267 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:03.383955 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:03.523928 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:03.663145 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:03.801863 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:03.940744 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:04.078928 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:04.224564 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:04.364500 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:04.502954 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:04.637405 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:04.801802 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:04.946972 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:05.081967 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:05.222107 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:05.361253 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:05.720736 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:05.922405 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:06.067489 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:06.205316 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:06.341033 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:06.478871 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:06.617940 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:06.803622 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:06.952372 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:07.097288 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:07.236130 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:07.377301 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:07.514277 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:07.657841 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:07.800910 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:07.940187 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:08.078631 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:08.592598 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:08.759301 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:08.897591 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:09.042501 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:09.183800 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:09.326208 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:09.461626 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:09.607173 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:09.751497 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:14.038862 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:35:14.062866 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78552], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:35:15.900040 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:16.034319 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:16.173832 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:16.312821 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:16.462607 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:16.605269 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:16.640533 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:35:16.647323 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0044803619384765625, :worker_monitor=>1.1474511623382568, :worker_dequeue=>0.012020111083984375, :total_time=>1.1643052101135254} [----] I, [2016-09-13T08:35:16.770283 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:16.938306 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:17.283004 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:17.443621 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:17.485849 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78552], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.436827137] seconds [----] I, [2016-09-13T08:35:17.486022 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78552], Delivering... [----] I, [2016-09-13T08:35:17.492046 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032188892364501953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032367706298828125, :pending_vm_jobs=>0.0007104873657226562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005697011947631836} [----] I, [2016-09-13T08:35:17.492394 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78552], State: [ok], Delivered in [0.006364247] seconds [----] I, [2016-09-13T08:35:17.583209 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:17.735975 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:17.872220 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:18.006146 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:18.147134 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:18.291791 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:18.432172 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:18.578031 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:18.715657 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:18.860080 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:18.998588 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:19.138350 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:19.282893 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:19.426258 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:19.569488 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:19.904855 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:20.071138 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:20.215939 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:20.355122 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:20.494121 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:20.633715 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:20.773867 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:20.908029 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:21.066752 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:21.202505 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:21.342447 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:21.481357 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:21.623066 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:21.647820 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:35:21 UTC]... [----] I, [2016-09-13T08:35:21.668288 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:35:21 UTC]...Complete [----] I, [2016-09-13T08:35:21.766751 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:22.110380 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:22.251524 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:35:22.394098 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T08:35:22.590995 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T08:35:22.591317 #10859:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T08:35:22.591667 #10859:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T08:35:22.591809 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T08:35:22.591931 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T08:35:22.617050 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T08:35:22.617394 #10859:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [78544], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T08:35:22.617697 #10859:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T08:35:22.617930 #10859:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T08:35:22.618116 #10859:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78544], State: [error], Delivered in [60.823837893] seconds [----] I, [2016-09-13T08:35:29.076473 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:35:29.091385 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78553], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:35:29.108585 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78554], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:35:33.260535 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:35:33.266855 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003945350646972656, :worker_monitor=>1.3752379417419434, :worker_dequeue=>0.011372566223144531, :total_time=>1.3909153938293457} [----] I, [2016-09-13T08:35:33.589382 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78554], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.489254378] seconds [----] I, [2016-09-13T08:35:33.589727 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78554], Delivering... [----] I, [2016-09-13T08:35:33.598021 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004945278167724609, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0050504207611083984, :pending_vm_jobs=>0.0008473396301269531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007823944091796875} [----] I, [2016-09-13T08:35:33.598411 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78554], State: [ok], Delivered in [0.008721935] seconds [----] I, [2016-09-13T08:35:36.183271 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78553], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.099107862] seconds [----] I, [2016-09-13T08:35:36.183485 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78553], Delivering... [----] I, [2016-09-13T08:35:36.188128 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78553], State: [ok], Delivered in [0.004659732] seconds [----] I, [2016-09-13T08:35:44.125056 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:35:44.148813 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78555], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:35:49.655666 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:35:49.661652 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004136085510253906, :worker_monitor=>1.3517208099365234, :worker_dequeue=>0.010263919830322266, :total_time=>1.3664727210998535} [----] I, [2016-09-13T08:35:49.697591 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78555], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.563304664] seconds [----] I, [2016-09-13T08:35:49.697810 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78555], Delivering... [----] I, [2016-09-13T08:35:49.704110 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033147335052490234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033638477325439453, :pending_vm_jobs=>0.0007402896881103516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00592350959777832} [----] I, [2016-09-13T08:35:49.704474 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78555], State: [ok], Delivered in [0.006624485] seconds [----] I, [2016-09-13T08:35:54.662070 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:35:54 UTC]... [----] I, [2016-09-13T08:35:54.680482 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:35:54 UTC]...Complete [----] I, [2016-09-13T08:35:59.166508 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:35:59.183459 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78556], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:35:59.194734 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78557], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:35:59.206374 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78558], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:35:59.217590 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78559], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:35:59.705057 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:35:59.806684 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78556], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.635129983] seconds [----] I, [2016-09-13T08:35:59.806871 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78556], Delivering... [----] I, [2016-09-13T08:35:59.818102 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78559], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.605235557] seconds [----] I, [2016-09-13T08:35:59.818254 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78559], Delivering... [----] I, [2016-09-13T08:35:59.822915 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002534151077270508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025484561920166016, :pending_vm_jobs=>0.0005612373352050781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004340171813964844} [----] I, [2016-09-13T08:35:59.823181 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78559], State: [ok], Delivered in [0.0049258] seconds [----] I, [2016-09-13T08:35:59.869460 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78556], State: [ok], Delivered in [0.062495366] seconds [----] I, [2016-09-13T08:36:00.270761 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78557], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.081440169] seconds [----] I, [2016-09-13T08:36:00.270896 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78557], Delivering... [----] I, [2016-09-13T08:36:00.276200 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78557], State: [ok], Delivered in [0.005276579] seconds [----] I, [2016-09-13T08:36:00.315744 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78558], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.115691989] seconds [----] I, [2016-09-13T08:36:00.315999 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78558], Delivering... [----] I, [2016-09-13T08:36:00.321681 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78558], State: [ok], Delivered in [0.005661161] seconds [----] I, [2016-09-13T08:36:06.571222 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0048520565032958984, :worker_monitor=>1.847404956817627, :worker_dequeue=>0.00820016860961914, :total_time=>1.860779047012329} [----] I, [2016-09-13T08:36:14.228060 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:36:14.269701 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78560], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:36:16.597176 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:36:16.967089 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78560], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.732947032] seconds [----] I, [2016-09-13T08:36:16.967286 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78560], Delivering... [----] I, [2016-09-13T08:36:16.973237 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031752586364746094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031931400299072266, :pending_vm_jobs=>0.0007154941558837891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005617380142211914} [----] I, [2016-09-13T08:36:16.973667 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78560], State: [ok], Delivered in [0.006360386] seconds [----] I, [2016-09-13T08:36:22.913878 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004050493240356445, :worker_monitor=>1.2986667156219482, :worker_dequeue=>0.007004499435424805, :total_time=>1.3100225925445557} [----] I, [2016-09-13T08:36:27.914365 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:36:27 UTC]... [----] I, [2016-09-13T08:36:27.938220 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:36:27 UTC]...Complete [----] I, [2016-09-13T08:36:29.280943 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:36:29.298201 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78561], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:36:29.309446 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78562], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:36:33.099215 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:36:33.390031 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78562], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.087225442] seconds [----] I, [2016-09-13T08:36:33.390210 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78562], Delivering... [----] I, [2016-09-13T08:36:33.396483 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003320932388305664, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003342151641845703, :pending_vm_jobs=>0.0007913112640380859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005875587463378906} [----] I, [2016-09-13T08:36:33.396811 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78562], State: [ok], Delivered in [0.006598215] seconds [----] I, [2016-09-13T08:36:33.412604 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78561], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.128034131] seconds [----] I, [2016-09-13T08:36:33.412832 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78561], Delivering... [----] I, [2016-09-13T08:36:33.417223 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78561], State: [ok], Delivered in [0.004381747] seconds [----] I, [2016-09-13T08:36:39.982023 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00402379035949707, :worker_monitor=>1.8591814041137695, :worker_dequeue=>0.011726140975952148, :total_time=>1.8753552436828613} [----] I, [2016-09-13T08:36:44.319618 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:36:44.339886 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78563], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:36:44.991690 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:36:45.178706 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78563], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.853078662] seconds [----] I, [2016-09-13T08:36:45.178890 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78563], Delivering... [----] I, [2016-09-13T08:36:45.185507 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003464221954345703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003485441207885742, :pending_vm_jobs=>0.0007567405700683594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006229400634765625} [----] I, [2016-09-13T08:36:45.185974 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78563], State: [ok], Delivered in [0.007057366] seconds [----] I, [2016-09-13T08:36:56.434674 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00402069091796875, :worker_monitor=>1.4018731117248535, :worker_dequeue=>0.01145482063293457, :total_time=>1.4176456928253174} [----] I, [2016-09-13T08:36:59.348372 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:36:59.368141 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78564], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:36:59.378382 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78565], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:36:59.401673 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78566], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:36:59.412746 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78567], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:37:01.435316 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:37:01 UTC]... [----] I, [2016-09-13T08:37:01.470598 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:37:01 UTC]...Complete [----] I, [2016-09-13T08:37:01.487868 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:37:02.293310 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78564], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.940327923] seconds [----] I, [2016-09-13T08:37:02.293554 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78564], Delivering... [----] I, [2016-09-13T08:37:02.321461 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78567], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.914220948] seconds [----] I, [2016-09-13T08:37:02.321609 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78567], Delivering... [----] I, [2016-09-13T08:37:02.326003 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022704601287841797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002285003662109375, :pending_vm_jobs=>0.0005834102630615234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004095315933227539} [----] I, [2016-09-13T08:37:02.326278 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78567], State: [ok], Delivered in [0.004666163] seconds [----] I, [2016-09-13T08:37:02.350203 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78564], State: [ok], Delivered in [0.0566343] seconds [----] I, [2016-09-13T08:37:03.516281 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78565], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.142944899] seconds [----] I, [2016-09-13T08:37:03.516515 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78565], Delivering... [----] I, [2016-09-13T08:37:03.519852 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78565], State: [ok], Delivered in [0.003331571] seconds [----] I, [2016-09-13T08:37:03.562074 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78566], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.176040737] seconds [----] I, [2016-09-13T08:37:03.562262 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78566], Delivering... [----] I, [2016-09-13T08:37:03.567241 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78566], State: [ok], Delivered in [0.004939879] seconds [----] I, [2016-09-13T08:37:13.124014 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006361722946166992, :worker_monitor=>1.5869638919830322, :worker_dequeue=>0.011070966720581055, :total_time=>1.6048173904418945} [----] I, [2016-09-13T08:37:14.425272 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:37:14.447440 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78568], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:37:18.130798 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:37:18.499201 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78568], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.0673002] seconds [----] I, [2016-09-13T08:37:18.499380 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78568], Delivering... [----] I, [2016-09-13T08:37:18.505568 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032417774200439453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032596588134765625, :pending_vm_jobs=>0.0008232593536376953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057833194732666016} [----] I, [2016-09-13T08:37:18.505913 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78568], State: [ok], Delivered in [0.006528504] seconds [----] I, [2016-09-13T08:37:29.455286 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041081905364990234, :server_monitor=>0.101898193359375, :worker_monitor=>1.1852443218231201, :worker_dequeue=>0.010954141616821289, :total_time=>1.3025505542755127} [----] I, [2016-09-13T08:37:29.458744 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:37:29.482040 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78569], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:37:29.510737 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78570], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:37:34.459921 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:37:34 UTC]... [----] I, [2016-09-13T08:37:34.550669 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:37:34 UTC]...Complete [----] I, [2016-09-13T08:37:34.561222 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:37:34.944903 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78570], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.457287778] seconds [----] I, [2016-09-13T08:37:34.945145 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78570], Delivering... [----] I, [2016-09-13T08:37:34.953209 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004481792449951172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004507541656494141, :pending_vm_jobs=>0.0011475086212158203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007627964019775391} [----] I, [2016-09-13T08:37:34.953601 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78570], State: [ok], Delivered in [0.008464925] seconds [----] I, [2016-09-13T08:37:36.985071 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78569], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.521961467] seconds [----] I, [2016-09-13T08:37:36.985257 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78569], Delivering... [----] I, [2016-09-13T08:37:36.989504 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78569], State: [ok], Delivered in [0.004236342] seconds [----] I, [2016-09-13T08:37:44.522310 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:37:44.539020 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78571], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:37:46.078264 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:37:46.087906 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036776065826416016, :worker_monitor=>1.4850568771362305, :worker_dequeue=>0.014476537704467773, :total_time=>1.5035216808319092} [----] I, [2016-09-13T08:37:46.099774 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78571], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.570505717] seconds [----] I, [2016-09-13T08:37:46.099945 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78571], Delivering... [----] I, [2016-09-13T08:37:46.105787 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003021240234375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003038644790649414, :pending_vm_jobs=>0.0007417201995849609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005501270294189453} [----] I, [2016-09-13T08:37:46.106116 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78571], State: [ok], Delivered in [0.006175139] seconds [----] I, [2016-09-13T08:37:59.551016 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:37:59.562706 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78572], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:37:59.580018 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78573], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:37:59.596922 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78574], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:37:59.608203 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78575], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:38:02.572619 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:38:02.579165 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007402658462524414, :worker_monitor=>1.4386231899261475, :worker_dequeue=>0.011760711669921875, :total_time=>1.4580576419830322} [----] I, [2016-09-13T08:38:03.165594 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78572], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.610872005] seconds [----] I, [2016-09-13T08:38:03.165940 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78572], Delivering... [----] I, [2016-09-13T08:38:03.226402 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78575], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.623313765] seconds [----] I, [2016-09-13T08:38:03.226726 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78575], Delivering... [----] I, [2016-09-13T08:38:03.235805 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004609823226928711, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0046460628509521484, :pending_vm_jobs=>0.0011594295501708984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008512735366821289} [----] I, [2016-09-13T08:38:03.236267 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78575], State: [ok], Delivered in [0.009533404] seconds [----] I, [2016-09-13T08:38:03.254493 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78572], State: [ok], Delivered in [0.088542741] seconds [----] I, [2016-09-13T08:38:04.094742 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78573], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.525788204] seconds [----] I, [2016-09-13T08:38:04.094971 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78573], Delivering... [----] I, [2016-09-13T08:38:04.098775 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78573], State: [ok], Delivered in [0.003809825] seconds [----] I, [2016-09-13T08:38:04.134822 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78574], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.547757432] seconds [----] I, [2016-09-13T08:38:04.135024 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78574], Delivering... [----] I, [2016-09-13T08:38:04.140780 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78574], State: [ok], Delivered in [0.005743496] seconds [----] I, [2016-09-13T08:38:07.579688 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:38:07 UTC]... [----] I, [2016-09-13T08:38:07.602938 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:38:07 UTC]...Complete [----] I, [2016-09-13T08:38:14.619857 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:38:14.637349 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78576], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:38:19.347329 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:38:19.351320 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003945827484130859, :worker_monitor=>1.6918988227844238, :worker_dequeue=>0.009327888488769531, :total_time=>1.7054460048675537} [----] I, [2016-09-13T08:38:19.369045 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78576], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.743097499] seconds [----] I, [2016-09-13T08:38:19.369207 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78576], Delivering... [----] I, [2016-09-13T08:38:19.374900 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003065347671508789, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003081798553466797, :pending_vm_jobs=>0.0006847381591796875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005361318588256836} [----] I, [2016-09-13T08:38:19.375258 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78576], State: [ok], Delivered in [0.006028055] seconds [----] I, [2016-09-13T08:38:29.649321 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T08:38:29.666201 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78577], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:38:29.677363 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78578], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:38:29.689665 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78579], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:38:29.700281 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78580], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:38:36.137821 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:38:36.145131 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.008150577545166016, :worker_monitor=>1.6216471195220947, :worker_dequeue=>0.013010263442993164, :total_time=>1.6431224346160889} [----] I, [2016-09-13T08:38:36.530432 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78578], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.858752492] seconds [----] I, [2016-09-13T08:38:36.530548 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78578], Delivering... [----] I, [2016-09-13T08:38:36.534385 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021181106567382812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021321773529052734, :pending_vm_jobs=>0.00043702125549316406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0035872459411621094} [----] I, [2016-09-13T08:38:36.534621 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78578], State: [ok], Delivered in [0.00407003] seconds [----] I, [2016-09-13T08:38:36.535497 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78579], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.854050249] seconds [----] I, [2016-09-13T08:38:36.535757 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78579], Delivering... [----] I, [2016-09-13T08:38:36.536901 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T08:38:36.537023 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5372420096 [----] I, [2016-09-13T08:38:36.537080 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5145305088 [----] I, [2016-09-13T08:38:36.537147 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 227115008 [----] I, [2016-09-13T08:38:36.537205 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T08:38:36.537255 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5091254272 [----] I, [2016-09-13T08:38:36.537301 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T08:38:36.537346 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T08:38:36.537407 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 548794368 [----] I, [2016-09-13T08:38:36.537492 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T08:38:36.537556 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8080433152 [----] I, [2016-09-13T08:38:36.537601 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T08:38:36.537659 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T08:38:36.537704 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T08:38:36.537746 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T08:38:36.537788 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T08:38:36.537827 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T08:38:36.537869 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T08:38:36.537912 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T08:38:36.537953 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T08:38:36.537995 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T08:38:36.538037 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273850368 [----] I, [2016-09-13T08:38:36.538082 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57061376 [----] I, [2016-09-13T08:38:36.538124 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216788992 [----] I, [2016-09-13T08:38:36.538167 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T08:38:36.538221 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141705216 [----] I, [2016-09-13T08:38:36.538277 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2574852096 [----] I, [2016-09-13T08:38:36.538322 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2252779520 [----] I, [2016-09-13T08:38:36.538364 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T08:38:36.538407 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T08:38:36.538477 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T08:38:36.538523 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37855232 [----] I, [2016-09-13T08:38:36.538572 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102301696 [----] I, [2016-09-13T08:38:36.538616 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53317632 [----] I, [2016-09-13T08:38:36.538670 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111112192 [----] I, [2016-09-13T08:38:36.538715 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155619328 [----] I, [2016-09-13T08:38:36.538757 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T08:38:36.538799 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T08:38:36.538839 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T08:38:36.538882 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T08:38:36.538923 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T08:38:36.538974 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T08:38:36.539018 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T08:38:36.539060 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T08:38:36.539101 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T08:38:36.569900 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T08:38:36.570096 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T08:38:36.572923 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T08:38:36.574574 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T08:38:36.576536 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T08:38:36.578963 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T08:38:36.581877 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T08:38:36.584380 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 847 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T08:38:36.586982 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T08:38:36.589854 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T08:38:36.592670 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T08:38:36.595660 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T08:38:36.598561 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T08:38:36.601557 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T08:38:36.604504 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:38:36.604620 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:38:36.604725 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T08:38:36.608459 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152258.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:38:36.608791 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78579], State: [ok], Delivered in [0.073062262] seconds [----] I, [2016-09-13T08:38:37.267917 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78577], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.613977219] seconds [----] I, [2016-09-13T08:38:37.268122 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78577], Delivering... [----] I, [2016-09-13T08:38:37.273324 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78577], State: [ok], Delivered in [0.005192282] seconds [----] I, [2016-09-13T08:38:41.146067 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:38:41 UTC]... [----] I, [2016-09-13T08:38:41.169385 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:38:41 UTC]...Complete [----] I, [2016-09-13T08:38:41.181974 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:38:41.598018 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78580], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [11.904386973] seconds [----] I, [2016-09-13T08:38:41.598198 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78580], Delivering... [----] I, [2016-09-13T08:38:41.606318 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:38:29 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205295000], Memory % [3.5], CPU Time [241117.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T08:38:41.606951 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:38:35 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152268.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:38:41.607464 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:38:27 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347147000], Memory % [5.04], CPU Time [104511.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T08:38:41.608114 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:38:34 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162420000], Memory % [3.1], CPU Time [38131.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T08:38:41.608707 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:38:34 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358681000], Memory % [5.28], CPU Time [203130.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T08:38:41.609243 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:38:35 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [151357.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:38:41.609830 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:38:32 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169070000], Memory % [3.14], CPU Time [51754.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:38:41.610299 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:38:35 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [48988.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T08:38:41.613246 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:38:32 UTC], Process Info: Memory Usage [609550336], Memory Size [1064988672], Proportional Set Size: [442136000], Memory % [7.43], CPU Time [1221.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:38:41.615448 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:38:29 UTC], Process Info: Memory Usage [600260608], Memory Size [955154432], Proportional Set Size: [432746000], Memory % [7.32], CPU Time [396.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:38:41.617702 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:38:34 UTC], Process Info: Memory Usage [581013504], Memory Size [936099840], Proportional Set Size: [420622000], Memory % [7.08], CPU Time [2410.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T08:38:41.619886 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:38:31 UTC], Process Info: Memory Usage [558469120], Memory Size [929497088], Proportional Set Size: [406092000], Memory % [6.81], CPU Time [5836.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T08:38:41.620451 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:38:34 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [211963.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T08:38:41.621001 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:38:33 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51782.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:38:41.621485 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:38:31 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165806000], Memory % [3.16], CPU Time [39032.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T08:38:41.621858 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78580], State: [ok], Delivered in [0.023656022] seconds [----] I, [2016-09-13T08:38:44.711641 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:38:44.735117 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78581], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:38:46.196129 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:38:46.295288 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78581], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.577697536] seconds [----] I, [2016-09-13T08:38:46.295528 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78581], Delivering... [----] I, [2016-09-13T08:38:46.302716 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035643577575683594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035953521728515625, :pending_vm_jobs=>0.0009570121765136719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006729602813720703} [----] I, [2016-09-13T08:38:46.303041 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78581], State: [ok], Delivered in [0.007531301] seconds [----] I, [2016-09-13T08:38:52.800363 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035355091094970703, :worker_monitor=>1.5850858688354492, :worker_dequeue=>0.010570049285888672, :total_time=>1.5994813442230225} [----] I, [2016-09-13T08:38:59.748128 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:38:59.786923 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78582], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:38:59.838332 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78583], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:38:59.873339 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78584], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:38:59.895502 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78585], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:39:02.822988 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:39:02.895196 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78582], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.142063255] seconds [----] I, [2016-09-13T08:39:02.895513 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78582], Delivering... [----] I, [2016-09-13T08:39:02.970557 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78582], State: [ok], Delivered in [0.075143744] seconds [----] I, [2016-09-13T08:39:03.003598 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78585], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.124098827] seconds [----] I, [2016-09-13T08:39:03.003812 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78585], Delivering... [----] I, [2016-09-13T08:39:03.009980 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003092527389526367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031499862670898438, :pending_vm_jobs=>0.0007948875427246094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005812644958496094} [----] I, [2016-09-13T08:39:03.010326 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78585], State: [ok], Delivered in [0.00651939] seconds [----] I, [2016-09-13T08:39:04.420607 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78583], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.627808724] seconds [----] I, [2016-09-13T08:39:04.420842 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78583], Delivering... [----] I, [2016-09-13T08:39:04.427399 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78584], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.580666815] seconds [----] I, [2016-09-13T08:39:04.427604 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78584], Delivering... [----] I, [2016-09-13T08:39:04.428825 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78583], State: [ok], Delivered in [0.007977991] seconds [----] I, [2016-09-13T08:39:04.432286 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78584], State: [ok], Delivered in [0.004673581] seconds [----] I, [2016-09-13T08:39:07.847303 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T08:39:09.482254 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0046117305755615234, :log_active_servers=>0.012584686279296875, :worker_monitor=>1.6228041648864746, :worker_dequeue=>0.011661052703857422, :total_time=>1.652031660079956} [----] I, [2016-09-13T08:39:14.482803 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:39:14 UTC]... [----] I, [2016-09-13T08:39:14.500762 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:39:14 UTC]...Complete [----] I, [2016-09-13T08:39:14.907879 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:39:14.923701 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78586], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:39:19.537317 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:39:19.930051 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78586], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.016103725] seconds [----] I, [2016-09-13T08:39:19.930325 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78586], Delivering... [----] I, [2016-09-13T08:39:19.938395 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004446506500244141, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004472970962524414, :pending_vm_jobs=>0.0009198188781738281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0075643062591552734} [----] I, [2016-09-13T08:39:19.938795 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78586], State: [ok], Delivered in [0.008477005] seconds [----] I, [2016-09-13T08:39:26.024316 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00591731071472168, :worker_monitor=>1.4620726108551025, :worker_dequeue=>0.011220216751098633, :total_time=>1.4801647663116455} [----] I, [2016-09-13T08:39:29.935246 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:39:29.952373 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78587], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:39:29.963669 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78588], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:39:31.141131 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:39:31.209978 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78588], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.252463195] seconds [----] I, [2016-09-13T08:39:31.210160 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78588], Delivering... [----] I, [2016-09-13T08:39:31.216610 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033960342407226562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034170150756835938, :pending_vm_jobs=>0.0008089542388916016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006067037582397461} [----] I, [2016-09-13T08:39:31.217027 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78588], State: [ok], Delivered in [0.006854939] seconds [----] I, [2016-09-13T08:39:31.546528 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78587], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.607383996] seconds [----] I, [2016-09-13T08:39:31.546700 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78587], Delivering... [----] I, [2016-09-13T08:39:31.550563 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78587], State: [ok], Delivered in [0.00385179] seconds [----] I, [2016-09-13T08:39:42.665859 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003736257553100586, :worker_monitor=>1.4797277450561523, :worker_dequeue=>0.01271677017211914, :total_time=>1.4965033531188965} [----] I, [2016-09-13T08:39:44.973502 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:39:44.986936 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78589], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:39:47.666651 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:39:47 UTC]... [----] I, [2016-09-13T08:39:47.683900 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:39:47 UTC]...Complete [----] I, [2016-09-13T08:39:47.696200 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:39:48.159562 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78589], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.179231906] seconds [----] I, [2016-09-13T08:39:48.159865 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78589], Delivering... [----] I, [2016-09-13T08:39:48.168193 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004248857498168945, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004282236099243164, :pending_vm_jobs=>0.0010097026824951172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007778644561767578} [----] I, [2016-09-13T08:39:48.168918 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78589], State: [ok], Delivered in [0.009013109] seconds [----] I, [2016-09-13T08:39:59.227849 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004858493804931641, :worker_monitor=>1.4943926334381104, :worker_dequeue=>0.008473873138427734, :total_time=>1.508037805557251} [----] I, [2016-09-13T08:39:59.999447 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 8. [----] I, [2016-09-13T08:40:00.045110 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78590], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:40:00.056218 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78591], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:40:00.073453 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78592], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:40:00.084766 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78593], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:40:00.096082 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78594], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:40:00.107697 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78595], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:40:00.119339 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78596], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:40:04.234811 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 7 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:40:04.307880 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78590], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.304453667] seconds [----] I, [2016-09-13T08:40:04.308021 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78590], Delivering... [----] I, [2016-09-13T08:40:04.347822 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78590], State: [ok], Delivered in [0.039785607] seconds [----] I, [2016-09-13T08:40:04.364808 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78593], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.285815774] seconds [----] I, [2016-09-13T08:40:04.364912 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78593], Delivering... [----] I, [2016-09-13T08:40:04.368332 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0017895698547363281, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0018007755279541016, :pending_vm_jobs=>0.0004105567932128906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003202199935913086} [----] I, [2016-09-13T08:40:04.368540 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78593], State: [ok], Delivered in [0.003625063] seconds [----] I, [2016-09-13T08:40:04.662333 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78591], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.611619308] seconds [----] I, [2016-09-13T08:40:04.662574 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78591], Delivering... [----] I, [2016-09-13T08:40:04.666211 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78591], State: [ok], Delivered in [0.003636157] seconds [----] I, [2016-09-13T08:40:04.685839 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78592], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.621554836] seconds [----] I, [2016-09-13T08:40:04.686150 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78592], Delivering... [----] I, [2016-09-13T08:40:04.694324 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78592], State: [ok], Delivered in [0.008154112] seconds [----] I, [2016-09-13T08:40:04.730688 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78594], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.641159459] seconds [----] I, [2016-09-13T08:40:04.730886 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78594], Delivering... [----] I, [2016-09-13T08:40:04.733372 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78594], State: [ok], Delivered in [0.002477367] seconds [----] I, [2016-09-13T08:40:04.753490 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78595], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.652482671] seconds [----] I, [2016-09-13T08:40:04.753722 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78595], Delivering... [----] I, [2016-09-13T08:40:04.766390 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78595], State: [ok], Delivered in [0.012646179] seconds [----] I, [2016-09-13T08:40:04.816531 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78596], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.703440422] seconds [----] I, [2016-09-13T08:40:04.816750 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78596], Delivering... [----] I, [2016-09-13T08:40:04.822154 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78596], State: [ok], Delivered in [0.005392057] seconds [----] I, [2016-09-13T08:40:15.179645 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:40:15.233917 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78597], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:40:15.721123 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:40:15.727218 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002705812454223633, :worker_monitor=>1.3975813388824463, :worker_dequeue=>0.010725736618041992, :total_time=>1.4112329483032227} [----] I, [2016-09-13T08:40:16.474101 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78597], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.28496799] seconds [----] I, [2016-09-13T08:40:16.474256 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78597], Delivering... [----] I, [2016-09-13T08:40:16.479094 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025730133056640625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025899410247802734, :pending_vm_jobs=>0.0005862712860107422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004559516906738281} [----] I, [2016-09-13T08:40:16.479373 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78597], State: [ok], Delivered in [0.005110475] seconds [----] I, [2016-09-13T08:40:20.727809 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:40:20 UTC]... [----] I, [2016-09-13T08:40:20.754365 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:40:20 UTC]...Complete [----] I, [2016-09-13T08:40:30.244408 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:40:30.262078 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78598], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:40:30.273236 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78599], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:40:31.999397 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:40:32.004552 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004871368408203125, :worker_monitor=>1.1964426040649414, :worker_dequeue=>0.009109258651733398, :total_time=>1.210756540298462} [----] I, [2016-09-13T08:40:32.582120 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78599], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.314840757] seconds [----] I, [2016-09-13T08:40:32.582310 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78599], Delivering... [----] I, [2016-09-13T08:40:32.589038 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003472566604614258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003495454788208008, :pending_vm_jobs=>0.0008351802825927734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063440799713134766} [----] I, [2016-09-13T08:40:32.589371 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78599], State: [ok], Delivered in [0.007061121] seconds [----] I, [2016-09-13T08:40:34.880265 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78598], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.631716592] seconds [----] I, [2016-09-13T08:40:34.880431 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78598], Delivering... [----] I, [2016-09-13T08:40:34.884176 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78598], State: [ok], Delivered in [0.003754926] seconds [----] I, [2016-09-13T08:40:45.283819 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:40:45.302098 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78600], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:40:48.468348 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:40:48.473102 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003957509994506836, :worker_monitor=>1.322676420211792, :worker_dequeue=>0.008673906326293945, :total_time=>1.3356268405914307} [----] I, [2016-09-13T08:40:48.703389 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78600], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.413641292] seconds [----] I, [2016-09-13T08:40:48.703795 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78600], Delivering... [----] I, [2016-09-13T08:40:48.716028 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.006258249282836914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.006326198577880859, :pending_vm_jobs=>0.00156402587890625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.011540889739990234} [----] I, [2016-09-13T08:40:48.716654 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78600], State: [ok], Delivered in [0.01286891] seconds [----] I, [2016-09-13T08:40:53.473702 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:40:53 UTC]... [----] I, [2016-09-13T08:40:53.490701 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:40:53 UTC]...Complete [----] I, [2016-09-13T08:41:00.313876 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:41:00.348035 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78601], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:41:00.370929 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78602], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:41:00.387817 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78603], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:41:00.406097 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78604], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:41:05.113099 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:41:05.117525 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005632638931274414, :worker_monitor=>1.5757298469543457, :worker_dequeue=>0.007882833480834961, :total_time=>1.589578628540039} [----] I, [2016-09-13T08:41:05.822554 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78601], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.502873287] seconds [----] I, [2016-09-13T08:41:05.822784 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78601], Delivering... [----] I, [2016-09-13T08:41:05.890968 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78601], State: [ok], Delivered in [0.068166384] seconds [----] I, [2016-09-13T08:41:05.902722 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78604], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.509573074] seconds [----] I, [2016-09-13T08:41:05.902907 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78604], Delivering... [----] I, [2016-09-13T08:41:05.909186 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033266544342041016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003371715545654297, :pending_vm_jobs=>0.0007338523864746094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005927085876464844} [----] I, [2016-09-13T08:41:05.909528 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78604], State: [ok], Delivered in [0.006615941] seconds [----] I, [2016-09-13T08:41:08.023946 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78602], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.670373201] seconds [----] I, [2016-09-13T08:41:08.024172 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78602], Delivering... [----] I, [2016-09-13T08:41:08.032893 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78602], State: [ok], Delivered in [0.008698195] seconds [----] I, [2016-09-13T08:41:08.045616 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78603], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.666986785] seconds [----] I, [2016-09-13T08:41:08.045853 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78603], Delivering... [----] I, [2016-09-13T08:41:08.051565 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78603], State: [ok], Delivered in [0.005715117] seconds [----] I, [2016-09-13T08:41:15.416207 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:41:15.435006 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78605], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:41:21.616137 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:41:21.622940 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038290023803710938, :worker_monitor=>1.4558942317962646, :worker_dequeue=>0.01214909553527832, :total_time=>1.4721786975860596} [----] I, [2016-09-13T08:41:22.029497 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78605], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.606932478] seconds [----] I, [2016-09-13T08:41:22.029693 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78605], Delivering... [----] I, [2016-09-13T08:41:22.036018 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030946731567382812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031142234802246094, :pending_vm_jobs=>0.0008561611175537109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005935192108154297} [----] I, [2016-09-13T08:41:22.036471 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78605], State: [ok], Delivered in [0.006722975] seconds [----] I, [2016-09-13T08:41:26.623645 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:41:26 UTC]... [----] I, [2016-09-13T08:41:26.646448 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:41:26 UTC]...Complete [----] I, [2016-09-13T08:41:30.446657 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:41:30.464010 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78606], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:41:30.486784 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78607], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:41:31.674090 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:41:32.127677 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78607], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.657881867] seconds [----] I, [2016-09-13T08:41:32.127879 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78607], Delivering... [----] I, [2016-09-13T08:41:32.134386 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029594898223876953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002981901168823242, :pending_vm_jobs=>0.0007371902465820312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006116390228271484} [----] I, [2016-09-13T08:41:32.134877 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78607], State: [ok], Delivered in [0.007004407] seconds [----] I, [2016-09-13T08:41:32.150362 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78606], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.699138798] seconds [----] I, [2016-09-13T08:41:32.150606 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78606], Delivering... [----] I, [2016-09-13T08:41:32.156223 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78606], State: [ok], Delivered in [0.005613098] seconds [----] I, [2016-09-13T08:41:38.061141 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00440526008605957, :worker_monitor=>1.3681912422180176, :worker_dequeue=>0.006866931915283203, :total_time=>1.3797962665557861} [----] I, [2016-09-13T08:41:45.500966 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:41:45.527317 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78608], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:41:48.226375 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:41:48.270541 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78608], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.760069553] seconds [----] I, [2016-09-13T08:41:48.270802 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78608], Delivering... [----] I, [2016-09-13T08:41:48.278927 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0040967464447021484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004155397415161133, :pending_vm_jobs=>0.0010592937469482422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007686614990234375} [----] I, [2016-09-13T08:41:48.279338 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78608], State: [ok], Delivered in [0.008547247] seconds [----] I, [2016-09-13T08:41:54.919170 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004579782485961914, :worker_monitor=>1.6686720848083496, :worker_dequeue=>0.011466026306152344, :total_time=>1.6850626468658447} [----] I, [2016-09-13T08:41:59.919677 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:41:59 UTC]... [----] I, [2016-09-13T08:41:59.932839 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:41:59 UTC]...Complete [----] I, [2016-09-13T08:42:00.543273 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:42:00.578873 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78609], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:42:00.590138 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78610], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:42:00.607353 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78611], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:42:00.619164 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78612], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:42:04.960357 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:42:05.270653 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78609], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.720702967] seconds [----] I, [2016-09-13T08:42:05.270951 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78609], Delivering... [----] I, [2016-09-13T08:42:05.299246 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78612], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.686511199] seconds [----] I, [2016-09-13T08:42:05.299490 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78612], Delivering... [----] I, [2016-09-13T08:42:05.306968 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003818035125732422, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003841876983642578, :pending_vm_jobs=>0.0009157657623291016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006945133209228516} [----] I, [2016-09-13T08:42:05.307346 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78612], State: [ok], Delivered in [0.007882691] seconds [----] I, [2016-09-13T08:42:05.345016 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78610], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.760956355] seconds [----] I, [2016-09-13T08:42:05.345258 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78610], Delivering... [----] I, [2016-09-13T08:42:05.349256 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78610], State: [ok], Delivered in [0.004007934] seconds [----] I, [2016-09-13T08:42:05.362105 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78609], State: [ok], Delivered in [0.091161284] seconds [----] I, [2016-09-13T08:42:05.407743 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78611], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.809710723] seconds [----] I, [2016-09-13T08:42:05.407932 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78611], Delivering... [----] I, [2016-09-13T08:42:05.413371 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78611], State: [ok], Delivered in [0.00542427] seconds [----] I, [2016-09-13T08:42:11.514969 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038030147552490234, :worker_monitor=>1.531071662902832, :worker_dequeue=>0.012440919876098633, :total_time=>1.547731637954712} [----] I, [2016-09-13T08:42:15.634718 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:42:15.659167 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78613], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:42:16.528996 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:42:17.435898 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78613], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.795852405] seconds [----] I, [2016-09-13T08:42:17.436126 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78613], Delivering... [----] I, [2016-09-13T08:42:17.444468 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00418853759765625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004216432571411133, :pending_vm_jobs=>0.0011005401611328125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00786280632019043} [----] I, [2016-09-13T08:42:17.444900 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78613], State: [ok], Delivered in [0.008764295] seconds [----] I, [2016-09-13T08:42:27.944328 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004004955291748047, :worker_monitor=>1.371509313583374, :worker_dequeue=>0.01204061508178711, :total_time=>1.387862205505371} [----] I, [2016-09-13T08:42:30.670440 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:42:30.687736 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78614], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:42:30.699041 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78615], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:42:32.944932 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:42:32 UTC]... [----] I, [2016-09-13T08:42:32.968065 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:42:32 UTC]...Complete [----] I, [2016-09-13T08:42:32.987219 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:42:33.576140 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78615], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.882998147] seconds [----] I, [2016-09-13T08:42:33.576332 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78615], Delivering... [----] I, [2016-09-13T08:42:33.582660 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003438234329223633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034699440002441406, :pending_vm_jobs=>0.0008206367492675781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005957365036010742} [----] I, [2016-09-13T08:42:33.582981 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78615], State: [ok], Delivered in [0.00664735] seconds [----] I, [2016-09-13T08:42:35.476532 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78614], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.801756362] seconds [----] I, [2016-09-13T08:42:35.476737 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78614], Delivering... [----] I, [2016-09-13T08:42:35.481838 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78614], State: [ok], Delivered in [0.005098476] seconds [----] I, [2016-09-13T08:42:44.672034 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003976583480834961, :worker_monitor=>1.6384904384613037, :worker_dequeue=>0.011123180389404297, :total_time=>1.6538949012756348} [----] I, [2016-09-13T08:42:45.711760 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:42:45.738702 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78616], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:42:49.823160 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:42:50.580526 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78616], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.862801629] seconds [----] I, [2016-09-13T08:42:50.580724 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78616], Delivering... [----] I, [2016-09-13T08:42:50.586585 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00315093994140625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003171682357788086, :pending_vm_jobs=>0.0007035732269287109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005482912063598633} [----] I, [2016-09-13T08:42:50.586877 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78616], State: [ok], Delivered in [0.00615936] seconds [----] I, [2016-09-13T08:43:00.759610 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:43:00.779518 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78617], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:43:00.814110 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78618], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:43:00.842245 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78619], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:43:00.859747 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78620], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:43:01.501751 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:43:01.507861 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006505012512207031, :worker_monitor=>1.6439390182495117, :worker_dequeue=>0.011059045791625977, :total_time=>1.6619181632995605} [----] I, [2016-09-13T08:43:01.779506 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78617], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.015287886] seconds [----] I, [2016-09-13T08:43:01.779657 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78617], Delivering... [----] I, [2016-09-13T08:43:01.785272 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78620], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.939542541] seconds [----] I, [2016-09-13T08:43:01.785452 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78620], Delivering... [----] I, [2016-09-13T08:43:01.791343 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031223297119140625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003165721893310547, :pending_vm_jobs=>0.0006837844848632812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005516529083251953} [----] I, [2016-09-13T08:43:01.791679 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78620], State: [ok], Delivered in [0.006246405] seconds [----] I, [2016-09-13T08:43:01.813521 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78617], State: [ok], Delivered in [0.033863502] seconds [----] I, [2016-09-13T08:43:02.608534 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78618], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.823640573] seconds [----] I, [2016-09-13T08:43:02.608791 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78618], Delivering... [----] I, [2016-09-13T08:43:02.612972 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78618], State: [ok], Delivered in [0.004161972] seconds [----] I, [2016-09-13T08:43:02.654066 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78619], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.827804419] seconds [----] I, [2016-09-13T08:43:02.654272 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78619], Delivering... [----] I, [2016-09-13T08:43:02.659671 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78619], State: [ok], Delivered in [0.00537611] seconds [----] I, [2016-09-13T08:43:06.508289 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:43:06 UTC]... [----] I, [2016-09-13T08:43:06.528091 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:43:06 UTC]...Complete [----] I, [2016-09-13T08:43:15.873637 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:43:15.893996 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78621], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:43:18.104656 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:43:18.108305 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004837989807128906, :worker_monitor=>1.5374538898468018, :worker_dequeue=>0.006664752960205078, :total_time=>1.5492751598358154} [----] I, [2016-09-13T08:43:18.922903 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78621], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.041240441] seconds [----] I, [2016-09-13T08:43:18.923159 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78621], Delivering... [----] I, [2016-09-13T08:43:18.933411 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0050318241119384766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005127668380737305, :pending_vm_jobs=>0.0013196468353271484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00968790054321289} [----] I, [2016-09-13T08:43:18.933867 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78621], State: [ok], Delivered in [0.010697856] seconds [----] I, [2016-09-13T08:43:30.906683 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T08:43:30.934851 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78622], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:43:30.974555 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78623], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:43:31.003060 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78624], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:43:31.019997 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78625], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:43:34.461467 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:43:34.466334 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004499197006225586, :worker_monitor=>1.3035314083099365, :worker_dequeue=>0.008848905563354492, :total_time=>1.3171813488006592} [----] I, [2016-09-13T08:43:35.042997 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78623], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.101886867] seconds [----] I, [2016-09-13T08:43:35.043163 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78623], Delivering... [----] I, [2016-09-13T08:43:35.049387 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003155231475830078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003174304962158203, :pending_vm_jobs=>0.0007278919219970703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005902767181396484} [----] I, [2016-09-13T08:43:35.049799 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78623], State: [ok], Delivered in [0.006627027] seconds [----] I, [2016-09-13T08:43:35.094640 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78624], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.115177894] seconds [----] I, [2016-09-13T08:43:35.094870 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78624], Delivering... [----] I, [2016-09-13T08:43:35.096109 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T08:43:35.096371 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5368627200 [----] I, [2016-09-13T08:43:35.096536 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5141319680 [----] I, [2016-09-13T08:43:35.096724 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 227307520 [----] I, [2016-09-13T08:43:35.096845 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T08:43:35.096948 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5087252480 [----] I, [2016-09-13T08:43:35.097046 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T08:43:35.097147 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T08:43:35.097242 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 548999168 [----] I, [2016-09-13T08:43:35.097344 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T08:43:35.097472 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7989350400 [----] I, [2016-09-13T08:43:35.097593 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T08:43:35.097717 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T08:43:35.097830 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T08:43:35.097928 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 12288 [----] I, [2016-09-13T08:43:35.098027 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T08:43:35.098120 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T08:43:35.098214 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T08:43:35.098306 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T08:43:35.098409 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T08:43:35.098549 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T08:43:35.098669 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273838080 [----] I, [2016-09-13T08:43:35.098783 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57036800 [----] I, [2016-09-13T08:43:35.098885 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216801280 [----] I, [2016-09-13T08:43:35.099796 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6242304 [----] I, [2016-09-13T08:43:35.099932 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141713408 [----] I, [2016-09-13T08:43:35.100040 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2579214336 [----] I, [2016-09-13T08:43:35.100141 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2256936960 [----] I, [2016-09-13T08:43:35.100263 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T08:43:35.100368 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T08:43:35.100513 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T08:43:35.100630 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37777408 [----] I, [2016-09-13T08:43:35.100744 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102301696 [----] I, [2016-09-13T08:43:35.100854 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53354496 [----] I, [2016-09-13T08:43:35.100951 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111112192 [----] I, [2016-09-13T08:43:35.101044 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155656192 [----] I, [2016-09-13T08:43:35.101142 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T08:43:35.101235 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T08:43:35.101330 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T08:43:35.101455 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T08:43:35.101573 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T08:43:35.101703 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T08:43:35.101813 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T08:43:35.101916 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T08:43:35.102017 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T08:43:35.106719 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78625], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.099015125] seconds [----] I, [2016-09-13T08:43:35.106916 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78625], Delivering... [----] I, [2016-09-13T08:43:35.120864 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:43:28 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347147000], Memory % [5.04], CPU Time [104570.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T08:43:35.121473 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:43:34 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [151420.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:43:35.121980 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:43:34 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169070000], Memory % [3.14], CPU Time [51801.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:43:35.122434 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:43:24 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212539000], Memory % [3.5], CPU Time [49023.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T08:43:35.122938 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:43:31 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162420000], Memory % [3.1], CPU Time [38164.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T08:43:35.123455 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:43:30 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205295000], Memory % [3.5], CPU Time [241239.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T08:43:35.123963 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:43:32 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358681000], Memory % [5.28], CPU Time [203173.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T08:43:35.124473 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:43:34 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152336.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:43:35.127889 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:43:30 UTC], Process Info: Memory Usage [597467136], Memory Size [926224384], Proportional Set Size: [430018000], Memory % [7.28], CPU Time [452.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:43:35.130161 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:43:33 UTC], Process Info: Memory Usage [609550336], Memory Size [1064988672], Proportional Set Size: [442136000], Memory % [7.43], CPU Time [1231.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:43:35.132537 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:43:24 UTC], Process Info: Memory Usage [580595712], Memory Size [908967936], Proportional Set Size: [420214000], Memory % [7.08], CPU Time [2460.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T08:43:35.134814 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:43:32 UTC], Process Info: Memory Usage [557752320], Memory Size [894418944], Proportional Set Size: [405264000], Memory % [6.8], CPU Time [5878.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T08:43:35.135358 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:43:32 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [211998.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T08:43:35.135895 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:43:32 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51829.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:43:35.136330 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:43:31 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165806000], Memory % [3.16], CPU Time [39066.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T08:43:35.136705 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78625], State: [ok], Delivered in [0.029788952] seconds [----] I, [2016-09-13T08:43:35.191329 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T08:43:35.191578 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T08:43:35.196042 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T08:43:35.199352 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T08:43:35.203238 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T08:43:35.207002 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T08:43:35.211246 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T08:43:35.214971 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 849 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T08:43:35.218449 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T08:43:35.221907 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T08:43:35.225293 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.7 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T08:43:35.228834 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T08:43:35.232778 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T08:43:35.236085 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T08:43:35.238815 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:43:35.238951 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:43:35.239013 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T08:43:35.241839 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152329.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:43:35.242170 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78624], State: [ok], Delivered in [0.147315832] seconds [----] I, [2016-09-13T08:43:35.734369 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78622], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.822525385] seconds [----] I, [2016-09-13T08:43:35.734563 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78622], Delivering... [----] I, [2016-09-13T08:43:35.739215 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78622], State: [ok], Delivered in [0.004628516] seconds [----] I, [2016-09-13T08:43:39.466981 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:43:39 UTC]... [----] I, [2016-09-13T08:43:39.494856 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:43:39 UTC]...Complete [----] I, [2016-09-13T08:43:46.030721 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:43:46.054357 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78626], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:43:51.173440 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:43:51.177041 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041027069091796875, :worker_monitor=>1.6264541149139404, :worker_dequeue=>0.006497621536254883, :total_time=>1.6373224258422852} [----] I, [2016-09-13T08:43:51.340364 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78626], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.305929716] seconds [----] I, [2016-09-13T08:43:51.340562 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78626], Delivering... [----] I, [2016-09-13T08:43:51.345954 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028624534606933594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029447078704833984, :pending_vm_jobs=>0.0006856918334960938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005044221878051758} [----] I, [2016-09-13T08:43:51.346237 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78626], State: [ok], Delivered in [0.005673903] seconds [----] I, [2016-09-13T08:44:01.062938 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:44:01.083064 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78627], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:44:01.118747 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78628], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:44:01.147252 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78629], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:44:01.170158 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78630], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:44:01.278050 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:44:01.450455 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78627], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.382666777] seconds [----] I, [2016-09-13T08:44:01.450671 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78627], Delivering... [----] I, [2016-09-13T08:44:01.455868 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78630], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.30407133] seconds [----] I, [2016-09-13T08:44:01.456057 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78630], Delivering... [----] I, [2016-09-13T08:44:01.462955 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035610198974609375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003579854965209961, :pending_vm_jobs=>0.0008971691131591797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006556034088134766} [----] I, [2016-09-13T08:44:01.463315 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78630], State: [ok], Delivered in [0.007247089] seconds [----] I, [2016-09-13T08:44:01.501566 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78627], State: [ok], Delivered in [0.050892933] seconds [----] I, [2016-09-13T08:44:02.867019 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78629], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.74123068] seconds [----] I, [2016-09-13T08:44:02.867152 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78629], Delivering... [----] I, [2016-09-13T08:44:02.870573 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78629], State: [ok], Delivered in [0.003415513] seconds [----] I, [2016-09-13T08:44:02.873294 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78628], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.785757894] seconds [----] I, [2016-09-13T08:44:02.873644 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78628], Delivering... [----] I, [2016-09-13T08:44:02.878991 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78628], State: [ok], Delivered in [0.005371785] seconds [----] I, [2016-09-13T08:44:07.672836 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004426717758178711, :worker_monitor=>1.3763182163238525, :worker_dequeue=>0.006956577301025391, :total_time=>1.3880391120910645} [----] I, [2016-09-13T08:44:12.673325 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:44:12 UTC]... [----] I, [2016-09-13T08:44:12.718654 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:44:12 UTC]...Complete [----] I, [2016-09-13T08:44:12.737686 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T08:44:16.186358 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:44:16.217288 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78631], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:44:17.758406 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:44:17.935739 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78631], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.738360364] seconds [----] I, [2016-09-13T08:44:17.935880 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78631], Delivering... [----] I, [2016-09-13T08:44:17.940527 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002579212188720703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025937557220458984, :pending_vm_jobs=>0.0005235671997070312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004380702972412109} [----] I, [2016-09-13T08:44:17.940807 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78631], State: [ok], Delivered in [0.004924081] seconds [----] I, [2016-09-13T08:44:24.194551 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005532979965209961, :worker_monitor=>1.415210485458374, :worker_dequeue=>0.009881019592285156, :total_time=>1.4310920238494873} [----] I, [2016-09-13T08:44:31.237707 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:44:31.256900 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78632], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:44:31.280149 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78633], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:44:34.213059 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:44:34.691474 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78633], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.42655806] seconds [----] I, [2016-09-13T08:44:34.691668 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78633], Delivering... [----] I, [2016-09-13T08:44:34.696531 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025985240936279297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002620220184326172, :pending_vm_jobs=>0.0006160736083984375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004591464996337891} [----] I, [2016-09-13T08:44:34.696840 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78633], State: [ok], Delivered in [0.005165387] seconds [----] I, [2016-09-13T08:44:35.971778 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78632], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.72785058] seconds [----] I, [2016-09-13T08:44:35.971987 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78632], Delivering... [----] I, [2016-09-13T08:44:35.976322 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78632], State: [ok], Delivered in [0.004335818] seconds [----] I, [2016-09-13T08:44:40.436856 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004343986511230469, :worker_monitor=>1.2083256244659424, :worker_dequeue=>0.006429195404052734, :total_time=>1.219364881515503} [----] I, [2016-09-13T08:44:45.437458 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:44:45 UTC]... [----] I, [2016-09-13T08:44:45.474198 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:44:45 UTC]...Complete [----] I, [2016-09-13T08:44:46.297627 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:44:46.319798 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78634], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:44:50.502250 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:44:50.857951 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78634], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.551336321] seconds [----] I, [2016-09-13T08:44:50.858261 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78634], Delivering... [----] I, [2016-09-13T08:44:50.867923 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004756450653076172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004786014556884766, :pending_vm_jobs=>0.0015149116516113281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009084224700927734} [----] I, [2016-09-13T08:44:50.868601 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78634], State: [ok], Delivered in [0.010334341] seconds [----] I, [2016-09-13T08:44:56.680112 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003715991973876953, :worker_monitor=>1.157590627670288, :worker_dequeue=>0.008062601089477539, :total_time=>1.1696662902832031} [----] I, [2016-09-13T08:45:01.331843 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:45:01.360302 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78635], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:45:01.383139 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78636], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:45:01.400327 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78637], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:45:01.423207 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78638], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:45:01.790374 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:45:01.932073 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78635], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.594864188] seconds [----] I, [2016-09-13T08:45:01.932321 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78635], Delivering... [----] I, [2016-09-13T08:45:01.971890 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78638], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.566292918] seconds [----] I, [2016-09-13T08:45:01.972041 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78638], Delivering... [----] I, [2016-09-13T08:45:01.977378 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002689838409423828, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027534961700439453, :pending_vm_jobs=>0.0007238388061523438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005033016204833984} [----] I, [2016-09-13T08:45:01.977758 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78638], State: [ok], Delivered in [0.005700383] seconds [----] I, [2016-09-13T08:45:02.000248 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78635], State: [ok], Delivered in [0.067902745] seconds [----] I, [2016-09-13T08:45:03.116090 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78636], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.750174837] seconds [----] I, [2016-09-13T08:45:03.116266 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78636], Delivering... [----] I, [2016-09-13T08:45:03.118662 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78636], State: [ok], Delivered in [0.002409248] seconds [----] I, [2016-09-13T08:45:03.126047 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78637], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.735244977] seconds [----] I, [2016-09-13T08:45:03.126258 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78637], Delivering... [----] I, [2016-09-13T08:45:03.133471 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78637], State: [ok], Delivered in [0.007112603] seconds [----] I, [2016-09-13T08:45:13.066585 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003195524215698242, :worker_monitor=>1.238292932510376, :worker_dequeue=>0.007330417633056641, :total_time=>1.249040126800537} [----] I, [2016-09-13T08:45:16.434045 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:45:16.452185 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78639], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:45:18.067158 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:45:18 UTC]... [----] I, [2016-09-13T08:45:18.109144 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:45:18 UTC]...Complete [----] I, [2016-09-13T08:45:18.130930 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:45:18.166652 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78639], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.727505392] seconds [----] I, [2016-09-13T08:45:18.166827 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78639], Delivering... [----] I, [2016-09-13T08:45:18.173077 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032892227172851562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033066272735595703, :pending_vm_jobs=>0.0008077621459960938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005899667739868164} [----] I, [2016-09-13T08:45:18.173434 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78639], State: [ok], Delivered in [0.006577398] seconds [----] I, [2016-09-13T08:45:30.039057 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005148172378540039, :worker_monitor=>1.8697080612182617, :worker_dequeue=>0.008388519287109375, :total_time=>1.883568525314331} [----] I, [2016-09-13T08:45:31.459192 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:45:31.482867 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78640], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:45:31.511483 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78641], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:45:35.053379 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:45:35.213385 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78641], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.727192366] seconds [----] I, [2016-09-13T08:45:35.213598 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78641], Delivering... [----] I, [2016-09-13T08:45:35.220696 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033943653106689453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034165382385253906, :pending_vm_jobs=>0.001096963882446289, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00670623779296875} [----] I, [2016-09-13T08:45:35.221091 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78641], State: [ok], Delivered in [0.007483009] seconds [----] I, [2016-09-13T08:45:36.220264 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78640], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.758247289] seconds [----] I, [2016-09-13T08:45:36.220515 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78640], Delivering... [----] I, [2016-09-13T08:45:36.227152 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78640], State: [ok], Delivered in [0.006605872] seconds [----] I, [2016-09-13T08:45:46.122678 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005949735641479492, :worker_monitor=>1.0385980606079102, :worker_dequeue=>0.006031036376953125, :total_time=>1.051030158996582} [----] I, [2016-09-13T08:45:46.732213 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:45:46.777217 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78642], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:45:51.123192 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:45:51 UTC]... [----] I, [2016-09-13T08:45:51.148583 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:45:51 UTC]...Complete [----] I, [2016-09-13T08:45:51.161126 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:45:51.314856 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78642], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.552529281] seconds [----] I, [2016-09-13T08:45:51.315064 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78642], Delivering... [----] I, [2016-09-13T08:45:51.323357 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00401759147644043, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004042863845825195, :pending_vm_jobs=>0.0010535717010498047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007692575454711914} [----] I, [2016-09-13T08:45:51.323871 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78642], State: [ok], Delivered in [0.008795787] seconds [----] I, [2016-09-13T08:46:01.800950 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:46:01.834515 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78643], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:46:01.868977 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78644], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:46:01.925785 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78645], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:46:01.971762 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78646], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:46:02.950534 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:46:02.956257 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004124879837036133, :worker_monitor=>1.7563791275024414, :worker_dequeue=>0.010506868362426758, :total_time=>1.7713055610656738} [----] I, [2016-09-13T08:46:03.344728 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78643], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.536867685] seconds [----] I, [2016-09-13T08:46:03.344941 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78643], Delivering... [----] I, [2016-09-13T08:46:03.377043 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78646], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.443141907] seconds [----] I, [2016-09-13T08:46:03.377171 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78646], Delivering... [----] I, [2016-09-13T08:46:03.383859 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036656856536865234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003718137741088867, :pending_vm_jobs=>0.0009264945983886719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00642704963684082} [----] I, [2016-09-13T08:46:03.384094 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78643], State: [ok], Delivered in [0.039137178] seconds [----] I, [2016-09-13T08:46:03.384146 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78646], State: [ok], Delivered in [0.006969425] seconds [----] I, [2016-09-13T08:46:03.432752 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78644], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.591811486] seconds [----] I, [2016-09-13T08:46:03.432920 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78644], Delivering... [----] I, [2016-09-13T08:46:03.436017 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78644], State: [ok], Delivered in [0.003070548] seconds [----] I, [2016-09-13T08:46:03.451912 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78645], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.572334021] seconds [----] I, [2016-09-13T08:46:03.452045 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78645], Delivering... [----] I, [2016-09-13T08:46:03.458261 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78645], State: [ok], Delivered in [0.006143465] seconds [----] I, [2016-09-13T08:46:16.983719 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:46:16.996013 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78647], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:46:19.632283 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:46:19.637639 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004566669464111328, :worker_monitor=>1.4945409297943115, :worker_dequeue=>0.009621143341064453, :total_time=>1.5091123580932617} [----] I, [2016-09-13T08:46:19.682978 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78647], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.69532469] seconds [----] I, [2016-09-13T08:46:19.683140 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78647], Delivering... [----] I, [2016-09-13T08:46:19.688399 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027761459350585938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027923583984375, :pending_vm_jobs=>0.0006647109985351562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004931449890136719} [----] I, [2016-09-13T08:46:19.688750 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78647], State: [ok], Delivered in [0.005603713] seconds [----] I, [2016-09-13T08:46:24.638198 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:46:24 UTC]... [----] I, [2016-09-13T08:46:24.665144 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:46:24 UTC]...Complete [----] I, [2016-09-13T08:46:32.004130 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:46:32.019646 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78648], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:46:32.042124 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78649], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:46:36.372774 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:46:36.377398 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040090084075927734, :worker_monitor=>1.6577377319335938, :worker_dequeue=>0.008443593978881836, :total_time=>1.6704494953155518} [----] I, [2016-09-13T08:46:36.560561 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78648], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.553449531] seconds [----] I, [2016-09-13T08:46:36.560704 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78648], Delivering... [----] I, [2016-09-13T08:46:36.563795 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78648], State: [ok], Delivered in [0.003084233] seconds [----] I, [2016-09-13T08:46:36.573030 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78649], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.547466902] seconds [----] I, [2016-09-13T08:46:36.573298 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78649], Delivering... [----] I, [2016-09-13T08:46:36.584285 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005463838577270508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005496978759765625, :pending_vm_jobs=>0.001407623291015625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010265350341796875} [----] I, [2016-09-13T08:46:36.584790 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78649], State: [ok], Delivered in [0.011472818] seconds [----] I, [2016-09-13T08:46:47.052659 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:46:47.069338 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78650], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:46:52.877717 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:46:52.883711 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004601716995239258, :worker_monitor=>1.4652628898620605, :worker_dequeue=>0.010889768600463867, :total_time=>1.4811310768127441} [----] I, [2016-09-13T08:46:52.938588 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78650], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.882260846] seconds [----] I, [2016-09-13T08:46:52.938825 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78650], Delivering... [----] I, [2016-09-13T08:46:52.944863 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003218412399291992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003237485885620117, :pending_vm_jobs=>0.0007510185241699219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00567936897277832} [----] I, [2016-09-13T08:46:52.945215 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78650], State: [ok], Delivered in [0.00637465] seconds [----] I, [2016-09-13T08:46:57.884379 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:46:57 UTC]... [----] I, [2016-09-13T08:46:57.922959 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:46:57 UTC]...Complete [----] I, [2016-09-13T08:47:02.078238 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:47:02.098222 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78651], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:47:02.115320 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78652], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:47:02.138310 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78653], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:47:02.166921 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78654], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:47:02.948976 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:47:03.030083 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78651], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.947181813] seconds [----] I, [2016-09-13T08:47:03.030253 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78651], Delivering... [----] I, [2016-09-13T08:47:03.053077 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78654], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.908991152] seconds [----] I, [2016-09-13T08:47:03.053357 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78654], Delivering... [----] I, [2016-09-13T08:47:03.059987 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034368038177490234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003459453582763672, :pending_vm_jobs=>0.0007891654968261719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006098031997680664} [----] I, [2016-09-13T08:47:03.060357 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78654], State: [ok], Delivered in [0.007005833] seconds [----] I, [2016-09-13T08:47:03.098373 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78651], State: [ok], Delivered in [0.068091083] seconds [----] I, [2016-09-13T08:47:03.693602 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78652], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.589800545] seconds [----] I, [2016-09-13T08:47:03.693815 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78652], Delivering... [----] I, [2016-09-13T08:47:03.701232 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78652], State: [ok], Delivered in [0.007399165] seconds [----] I, [2016-09-13T08:47:03.709760 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78653], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.585131366] seconds [----] I, [2016-09-13T08:47:03.709959 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78653], Delivering... [----] I, [2016-09-13T08:47:03.715561 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78653], State: [ok], Delivered in [0.005589021] seconds [----] I, [2016-09-13T08:47:09.448213 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035741329193115234, :worker_monitor=>1.4774634838104248, :worker_dequeue=>0.012480497360229492, :total_time=>1.4938886165618896} [----] I, [2016-09-13T08:47:17.179275 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:47:17.197837 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78655], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:47:19.587198 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:47:20.187584 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78655], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.002519301] seconds [----] I, [2016-09-13T08:47:20.187772 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78655], Delivering... [----] I, [2016-09-13T08:47:20.193688 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029265880584716797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002947092056274414, :pending_vm_jobs=>0.0007774829864501953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005564451217651367} [----] I, [2016-09-13T08:47:20.194039 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78655], State: [ok], Delivered in [0.006243975] seconds [----] I, [2016-09-13T08:47:26.240478 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004157066345214844, :worker_monitor=>1.628706932067871, :worker_dequeue=>0.006546735763549805, :total_time=>1.639726161956787} [----] I, [2016-09-13T08:47:31.240996 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:47:31 UTC]... [----] I, [2016-09-13T08:47:31.265799 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:47:31 UTC]...Complete [----] I, [2016-09-13T08:47:32.210182 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:47:32.225763 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78656], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:47:32.243218 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78657], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:47:36.304380 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:47:36.335143 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78657], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.105057005] seconds [----] I, [2016-09-13T08:47:36.335317 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78657], Delivering... [----] I, [2016-09-13T08:47:36.341659 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003301382064819336, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033235549926757812, :pending_vm_jobs=>0.0008437633514404297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059604644775390625} [----] I, [2016-09-13T08:47:36.341953 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78657], State: [ok], Delivered in [0.006636038] seconds [----] I, [2016-09-13T08:47:36.826111 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78656], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.61229117] seconds [----] I, [2016-09-13T08:47:36.826293 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78656], Delivering... [----] I, [2016-09-13T08:47:36.831047 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78656], State: [ok], Delivered in [0.004743742] seconds [----] I, [2016-09-13T08:47:42.868376 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038416385650634766, :worker_monitor=>1.5378661155700684, :worker_dequeue=>0.015380859375, :total_time=>1.5580737590789795} [----] I, [2016-09-13T08:47:47.257050 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:47:47.294930 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78658], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:47:47.885875 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:47:48.420283 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78658], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.156601502] seconds [----] I, [2016-09-13T08:47:48.420450 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78658], Delivering... [----] I, [2016-09-13T08:47:48.425596 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002634763717651367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026526451110839844, :pending_vm_jobs=>0.0006897449493408203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0048449039459228516} [----] I, [2016-09-13T08:47:48.425938 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78658], State: [ok], Delivered in [0.005501277] seconds [----] I, [2016-09-13T08:47:59.421940 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003496408462524414, :worker_monitor=>1.383002519607544, :worker_dequeue=>0.009307384490966797, :total_time=>1.3961303234100342} [----] I, [2016-09-13T08:48:02.308355 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:48:02.334983 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78659], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:48:02.357748 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78660], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:48:02.382077 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78661], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:48:02.404780 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78662], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:48:04.422645 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:48:04 UTC]... [----] I, [2016-09-13T08:48:04.473763 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:48:04 UTC]...Complete [----] I, [2016-09-13T08:48:04.485122 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:48:04.552751 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78659], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.239520376] seconds [----] I, [2016-09-13T08:48:04.552955 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78659], Delivering... [----] I, [2016-09-13T08:48:04.571171 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78662], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.183984861] seconds [----] I, [2016-09-13T08:48:04.571329 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78662], Delivering... [----] I, [2016-09-13T08:48:04.576437 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027403831481933594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027561187744140625, :pending_vm_jobs=>0.0006313323974609375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00477290153503418} [----] I, [2016-09-13T08:48:04.576727 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78662], State: [ok], Delivered in [0.005397901] seconds [----] I, [2016-09-13T08:48:04.610710 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78659], State: [ok], Delivered in [0.057740183] seconds [----] I, [2016-09-13T08:48:06.944032 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78660], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.603130459] seconds [----] I, [2016-09-13T08:48:06.944272 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78660], Delivering... [----] I, [2016-09-13T08:48:06.948088 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78660], State: [ok], Delivered in [0.003809738] seconds [----] I, [2016-09-13T08:48:06.959964 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78661], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.596156034] seconds [----] I, [2016-09-13T08:48:06.960174 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78661], Delivering... [----] I, [2016-09-13T08:48:06.965288 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78661], State: [ok], Delivered in [0.005107003] seconds [----] I, [2016-09-13T08:48:16.306821 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005869388580322266, :server_monitor=>0.11797213554382324, :worker_monitor=>1.670992136001587, :worker_dequeue=>0.007812023162841797, :total_time=>1.8030285835266113} [----] I, [2016-09-13T08:48:17.415739 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:48:17.468473 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78663], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:48:21.313971 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:48:21.713718 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78663], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.291621565] seconds [----] I, [2016-09-13T08:48:21.713851 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78663], Delivering... [----] I, [2016-09-13T08:48:21.718173 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023679733276367188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00238037109375, :pending_vm_jobs=>0.0005209445953369141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004086971282958984} [----] I, [2016-09-13T08:48:21.718445 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78663], State: [ok], Delivered in [0.004572546] seconds [----] I, [2016-09-13T08:48:32.481259 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T08:48:32.484521 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004658699035644531, :worker_monitor=>1.1278305053710938, :worker_dequeue=>0.016158342361450195, :total_time=>1.1489875316619873} [----] I, [2016-09-13T08:48:32.496859 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78664], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:48:32.520125 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78665], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:48:32.537082 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78666], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:48:32.554845 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78667], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:48:37.485187 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:48:37 UTC]... [----] I, [2016-09-13T08:48:37.502575 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:48:37 UTC]...Complete [----] I, [2016-09-13T08:48:37.510562 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:48:37.862868 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78665], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.360316089] seconds [----] I, [2016-09-13T08:48:37.863053 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78665], Delivering... [----] I, [2016-09-13T08:48:37.869473 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033299922943115234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033516883850097656, :pending_vm_jobs=>0.0008676052093505859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006018400192260742} [----] I, [2016-09-13T08:48:37.869837 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78665], State: [ok], Delivered in [0.006779335] seconds [----] I, [2016-09-13T08:48:37.874714 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78666], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.348794909] seconds [----] I, [2016-09-13T08:48:37.874986 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78666], Delivering... [----] I, [2016-09-13T08:48:37.876556 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T08:48:37.876839 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5354549248 [----] I, [2016-09-13T08:48:37.876969 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5127049216 [----] I, [2016-09-13T08:48:37.877089 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 227500032 [----] I, [2016-09-13T08:48:37.877209 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T08:48:37.877323 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5073022976 [----] I, [2016-09-13T08:48:37.877468 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T08:48:37.877589 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T08:48:37.877728 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 549117952 [----] I, [2016-09-13T08:48:37.877843 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T08:48:37.877962 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7872471040 [----] I, [2016-09-13T08:48:37.878075 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T08:48:37.878188 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T08:48:37.878302 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T08:48:37.878447 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 0 [----] I, [2016-09-13T08:48:37.878577 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T08:48:37.878710 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T08:48:37.878828 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T08:48:37.878964 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T08:48:37.879077 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T08:48:37.879186 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T08:48:37.879300 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273805312 [----] I, [2016-09-13T08:48:37.879447 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57012224 [----] I, [2016-09-13T08:48:37.879564 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216793088 [----] I, [2016-09-13T08:48:37.879694 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6225920 [----] I, [2016-09-13T08:48:37.879808 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141062144 [----] I, [2016-09-13T08:48:37.879924 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2595160064 [----] I, [2016-09-13T08:48:37.880039 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2272698368 [----] I, [2016-09-13T08:48:37.880153 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T08:48:37.880559 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T08:48:37.880798 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T08:48:37.880986 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36999168 [----] I, [2016-09-13T08:48:37.881128 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T08:48:37.881256 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53063680 [----] I, [2016-09-13T08:48:37.881387 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111046656 [----] I, [2016-09-13T08:48:37.881570 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155361280 [----] I, [2016-09-13T08:48:37.881727 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T08:48:37.881858 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T08:48:37.881995 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T08:48:37.882119 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T08:48:37.882241 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T08:48:37.882366 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T08:48:37.882581 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T08:48:37.882737 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T08:48:37.882861 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T08:48:37.921251 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T08:48:37.921559 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T08:48:37.925499 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T08:48:37.928871 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T08:48:37.933835 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T08:48:37.936777 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T08:48:37.939918 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T08:48:37.942795 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 848 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T08:48:37.945669 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T08:48:37.948528 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T08:48:37.951197 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T08:48:37.953980 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T08:48:37.956810 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T08:48:37.961823 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T08:48:37.965663 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:48:37.965879 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:48:37.966057 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T08:48:37.972497 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [358685000], Memory % [3.38], CPU Time [151480.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:48:37.972994 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78666], State: [ok], Delivered in [0.097979122] seconds [----] I, [2016-09-13T08:48:40.063407 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78664], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.576563089] seconds [----] I, [2016-09-13T08:48:40.063741 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78664], Delivering... [----] I, [2016-09-13T08:48:40.071636 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78664], State: [ok], Delivered in [0.007849349] seconds [----] I, [2016-09-13T08:48:42.520928 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:48:42.965687 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78667], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [10.423045448] seconds [----] I, [2016-09-13T08:48:42.965814 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78667], Delivering... [----] I, [2016-09-13T08:48:42.970365 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:48:31 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152395.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:48:42.970679 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:48:28 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347151000], Memory % [5.04], CPU Time [104587.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T08:48:42.970966 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:48:31 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169070000], Memory % [3.14], CPU Time [51816.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:48:42.971250 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:48:17 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205295000], Memory % [3.5], CPU Time [241378.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T08:48:42.971498 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:48:24 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212543000], Memory % [3.5], CPU Time [49030.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T08:48:42.971805 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:48:29 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162420000], Memory % [3.1], CPU Time [38174.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T08:48:42.972080 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:48:31 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358685000], Memory % [5.28], CPU Time [203206.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T08:48:42.972348 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:48:31 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [151487.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:48:42.974039 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:48:30 UTC], Process Info: Memory Usage [597467136], Memory Size [926224384], Proportional Set Size: [430024000], Memory % [7.28], CPU Time [462.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:48:42.975224 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:48:22 UTC], Process Info: Memory Usage [557752320], Memory Size [909623296], Proportional Set Size: [405496000], Memory % [6.8], CPU Time [5888.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T08:48:42.976310 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:48:24 UTC], Process Info: Memory Usage [580825088], Memory Size [923648000], Proportional Set Size: [420442000], Memory % [7.08], CPU Time [2471.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T08:48:42.976636 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:48:31 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [212032.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T08:48:42.976937 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:48:29 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177792000], Memory % [3.2], CPU Time [51843.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:48:42.977184 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:48:31 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165808000], Memory % [3.16], CPU Time [39076.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T08:48:42.978294 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:48:24 UTC], Process Info: Memory Usage [597426176], Memory Size [926470144], Proportional Set Size: [430300000], Memory % [7.28], CPU Time [1291.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:48:42.978564 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78667], State: [ok], Delivered in [0.012736857] seconds [----] I, [2016-09-13T08:48:47.567893 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:48:47.589640 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78668], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:48:48.970133 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:48:48.973706 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00415492057800293, :worker_monitor=>1.4380161762237549, :worker_dequeue=>0.006415128707885742, :total_time=>1.4488568305969238} [----] I, [2016-09-13T08:48:49.074309 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78668], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.497843187] seconds [----] I, [2016-09-13T08:48:49.074442 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78668], Delivering... [----] I, [2016-09-13T08:48:49.078089 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020499229431152344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002070903778076172, :pending_vm_jobs=>0.0004115104675292969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003438234329223633} [----] I, [2016-09-13T08:48:49.078303 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78668], State: [ok], Delivered in [0.003872501] seconds [----] I, [2016-09-13T08:49:02.604645 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:49:02.617154 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78669], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:49:02.634209 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78670], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:49:02.645794 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78671], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:49:02.657128 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78672], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:49:05.515245 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:49:05.522222 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0042874813079833984, :worker_monitor=>1.5041635036468506, :worker_dequeue=>0.011049509048461914, :total_time=>1.5198817253112793} [----] I, [2016-09-13T08:49:06.201143 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78669], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.593588638] seconds [----] I, [2016-09-13T08:49:06.201298 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78669], Delivering... [----] I, [2016-09-13T08:49:06.243208 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78669], State: [ok], Delivered in [0.041883283] seconds [----] I, [2016-09-13T08:49:06.254265 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78672], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.602753744] seconds [----] I, [2016-09-13T08:49:06.254404 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78672], Delivering... [----] I, [2016-09-13T08:49:06.258210 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020630359649658203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021212100982666016, :pending_vm_jobs=>0.0004184246063232422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0035059452056884766} [----] I, [2016-09-13T08:49:06.258407 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78672], State: [ok], Delivered in [0.004003737] seconds [----] I, [2016-09-13T08:49:07.171905 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78670], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.550858265] seconds [----] I, [2016-09-13T08:49:07.172105 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78670], Delivering... [----] I, [2016-09-13T08:49:07.175510 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78670], State: [ok], Delivered in [0.00339985] seconds [----] I, [2016-09-13T08:49:07.206473 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78671], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.567163016] seconds [----] I, [2016-09-13T08:49:07.206712 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78671], Delivering... [----] I, [2016-09-13T08:49:07.212176 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78671], State: [ok], Delivered in [0.005458289] seconds [----] I, [2016-09-13T08:49:10.522747 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:49:10 UTC]... [----] I, [2016-09-13T08:49:10.548998 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:49:10 UTC]...Complete [----] I, [2016-09-13T08:49:15.647225 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T08:49:17.669173 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T08:49:17.692491 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78673], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:49:17.771774 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78674], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:49:22.784039 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:49:22.788746 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.008032560348510742, :worker_monitor=>2.1171321868896484, :worker_dequeue=>0.008653879165649414, :total_time=>2.1341969966888428} [----] I, [2016-09-13T08:49:23.437691 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78674], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.735194996] seconds [----] I, [2016-09-13T08:49:23.437881 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78674], Delivering... [----] I, [2016-09-13T08:49:23.444246 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034868717193603516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003506183624267578, :pending_vm_jobs=>0.0007221698760986328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006021976470947266} [----] I, [2016-09-13T08:49:23.444618 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78674], State: [ok], Delivered in [0.006716845] seconds [----] I, [2016-09-13T08:49:25.283593 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78673], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.60206763] seconds [----] I, [2016-09-13T08:49:25.283800 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78673], Delivering... [----] I, [2016-09-13T08:49:25.363944 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78675], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T08:49:25.421979 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78676], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T08:49:25.422345 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78673], State: [ok], Delivered in [0.138535056] seconds [----] I, [2016-09-13T08:49:27.805071 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T08:49:27.807684 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T08:49:30.572178 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [78675], MiqWorker id: [101], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [5.268616282] seconds [----] I, [2016-09-13T08:49:30.572501 #12930:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78675], Delivering... [----] I, [2016-09-13T08:49:30.578511 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T08:49:30.578842 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T08:49:30.579051 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T08:49:30.579301 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T08:49:30.579574 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:30.876082 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:31.094063 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:31.094237 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:31.420840 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:31.513444 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:31.602840 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:31.967014 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:32.079877 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:32.177781 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:32.275089 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:32.372717 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:32.468465 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:32.561746 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:32.655373 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:32.750317 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:32.784673 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T08:49:32.809041 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78677], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:49:32.818310 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:49:32.825718 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T08:49:32.845106 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78678], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:49:32.858517 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:32.873802 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78679], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:49:32.954759 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:33.052976 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:33.148027 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:33.241579 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:33.339278 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:33.431814 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:33.524246 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T08:49:33.764639 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T08:49:33.764878 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004851818084716797, :collect_inventory_for_targets=>2.6464462280273438e-05, :parse_legacy_inventory=>12.134312152862549, :parse_targeted_inventory=>12.134416103363037, :save_inventory=>0.7699649333953857, :ems_refresh=>12.906284809112549} [----] I, [2016-09-13T08:49:33.787757 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T08:49:33.788149 #12930:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78675], State: [ok], Delivered in [3.215701651] seconds [----] I, [2016-09-13T08:49:34.319875 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78677], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.529888048] seconds [----] I, [2016-09-13T08:49:34.320105 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78677], Delivering... [----] I, [2016-09-13T08:49:34.326144 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78677], State: [ok], Delivered in [0.006021013] seconds [----] I, [2016-09-13T08:49:34.343947 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [78676], MiqWorker id: [100], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [8.97327021] seconds [----] I, [2016-09-13T08:49:34.344227 #10859:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78676], Delivering... [----] I, [2016-09-13T08:49:34.348744 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T08:49:34.348956 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T08:49:34.349123 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T08:49:34.349312 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T08:49:34.349512 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:34.784946 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:35.081803 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:35.082082 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:35.580477 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:35.878667 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:35.878818 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:36.364088 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:36.667500 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:36.667716 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:37.155751 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:37.453576 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:37.453847 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:37.940568 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:38.239495 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:38.239644 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:38.708564 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:38.997169 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:38.997341 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:39.460336 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:39.778081 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:39.778271 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:40.249831 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:40.312071 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:49:40.322934 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003926753997802734, :worker_monitor=>2.4722189903259277, :worker_dequeue=>0.020096540451049805, :total_time=>2.496629238128662} [----] I, [2016-09-13T08:49:40.411396 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78679], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.55933134] seconds [----] I, [2016-09-13T08:49:40.411705 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78679], Delivering... [----] I, [2016-09-13T08:49:40.422619 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005442380905151367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005470991134643555, :pending_vm_jobs=>0.0013926029205322266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010315418243408203} [----] I, [2016-09-13T08:49:40.423126 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78679], State: [ok], Delivered in [0.011403331] seconds [----] I, [2016-09-13T08:49:40.552457 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:40.552670 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:40.565271 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78678], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.751399691] seconds [----] I, [2016-09-13T08:49:40.565491 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78678], Delivering... [----] I, [2016-09-13T08:49:40.663147 #2937:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 12:49:40 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_16' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 12:49:40.319561') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2927,,2016-09-13 12:49:38 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2936,,2016-09-13 12:49:40 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2946,2016-09-13 12:49:40 UTC,2016-09-13 12:49:40 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 12:49:40 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 12:49:39 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2975,,2016-09-13 12:49:39 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2986,,2016-09-13 12:49:37 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2997,,2016-09-13 12:49:32 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 12:49:17.778395')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,7, 3011,,2016-09-13 12:25:06 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1473, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,513135, 3030,,2016-09-13 11:24:47 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5093, 3054,,2016-09-13 12:25:11 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1469, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,513134, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,513133, 3160,,2016-09-13 12:25:14 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1465, 10867,,2016-09-13 12:49:34 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,6, 703,,2016-09-13 12:25:11 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1469, 27056,,2016-09-13 11:54:57 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3283, 28888,,2016-09-13 11:55:01 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3279, 12938,,2016-09-13 12:49:33 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,6, 20394,,2016-09-13 12:25:03 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1477, ACTIVITY_STATS_CSV [----] I, [2016-09-13T08:49:40.663565 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78678], State: [ok], Delivered in [0.098093463] seconds [----] I, [2016-09-13T08:49:41.020686 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:41.321016 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:41.321297 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:41.776116 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:42.073956 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:42.074196 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:42.572808 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:42.877861 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:42.877987 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:43.388114 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:43.694238 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:43.694584 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:44.166654 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:44.484334 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:44.484543 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:45.016897 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:45.176827 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:45.311373 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:45.323477 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:49:45 UTC]... [----] I, [2016-09-13T08:49:45.353788 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:49:45 UTC]...Complete [----] I, [2016-09-13T08:49:45.448832 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:45.582034 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:45.720860 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:45.855048 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:45.992027 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:46.131707 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:46.267352 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:46.397876 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:46.534733 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:46.669898 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:46.802881 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:46.936801 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:47.408374 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:47.567533 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:47.709557 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:47.887719 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:49:48.063106 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78680], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:49:50.377615 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:49:50.664439 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78680], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.768640136] seconds [----] I, [2016-09-13T08:49:50.664772 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78680], Delivering... [----] I, [2016-09-13T08:49:50.674306 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004786252975463867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004861116409301758, :pending_vm_jobs=>0.0011973381042480469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009006500244140625} [----] I, [2016-09-13T08:49:50.674846 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78680], State: [ok], Delivered in [0.010075252] seconds [----] I, [2016-09-13T08:49:53.866236 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:54.003981 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:54.141940 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:54.284262 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:54.433822 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:54.573456 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:54.714068 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:54.861735 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:54.999728 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:55.146447 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:55.285402 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:55.425221 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:55.562069 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:55.711079 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:56.161748 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:56.318375 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:56.456515 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:56.608183 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:56.749375 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:56.887079 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:56.993161 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002816438674926758, :worker_monitor=>1.597590684890747, :worker_dequeue=>0.006850719451904297, :total_time=>1.6074748039245605} [----] I, [2016-09-13T08:49:57.029184 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:57.169649 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:57.310940 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:57.454555 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:57.601243 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:57.742705 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:57.887562 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:58.035524 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:58.181693 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:58.358303 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:58.505406 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:59.018651 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:59.167745 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:59.306756 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:59.446716 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:59.588944 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:59.754900 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:49:59.892783 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:00.034737 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:00.176240 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:00.314386 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:00.454073 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:00.592689 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:00.734155 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:00.872583 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:01.012841 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:01.154879 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:01.294019 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:01.746504 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:01.896247 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:02.037290 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:02.172041 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:02.309961 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:02.450659 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:02.585286 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:02.761167 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:02.899504 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:03.040259 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:03.073839 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 9. [----] I, [2016-09-13T08:50:03.091066 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78681], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:50:03.113770 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78682], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:50:03.148337 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78683], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:50:03.173837 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:03.228883 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78684], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:50:03.314816 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:03.382627 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78685], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:50:03.412121 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78686], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:50:03.422390 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78687], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:50:03.458937 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:03.593805 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:03.655606 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78688], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:50:03.673973 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78689], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:50:03.730310 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:03.872697 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:04.017250 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:04.391651 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:04.540561 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:04.677086 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:04.850088 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:07.019477 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 9 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:50:07.645831 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78681], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.567584119] seconds [----] I, [2016-09-13T08:50:07.646061 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78681], Delivering... [----] I, [2016-09-13T08:50:07.725901 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78681], State: [ok], Delivered in [0.079787461] seconds [----] I, [2016-09-13T08:50:07.776901 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78684], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.621836173] seconds [----] I, [2016-09-13T08:50:07.777024 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78684], Delivering... [----] I, [2016-09-13T08:50:07.780610 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020017623901367188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020122528076171875, :pending_vm_jobs=>0.00044035911560058594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0033638477325439453} [----] I, [2016-09-13T08:50:07.780842 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78684], State: [ok], Delivered in [0.003811913] seconds [----] I, [2016-09-13T08:50:08.085735 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78682], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.989754657] seconds [----] I, [2016-09-13T08:50:08.085907 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78682], Delivering... [----] I, [2016-09-13T08:50:08.089143 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78682], State: [ok], Delivered in [0.003226223] seconds [----] I, [2016-09-13T08:50:08.182935 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78683], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.06059685] seconds [----] I, [2016-09-13T08:50:08.183068 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78683], Delivering... [----] I, [2016-09-13T08:50:08.186539 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78683], State: [ok], Delivered in [0.003434002] seconds [----] I, [2016-09-13T08:50:08.308553 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78685], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.07359362] seconds [----] I, [2016-09-13T08:50:08.308740 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78685], Delivering... [----] I, [2016-09-13T08:50:08.310944 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78685], State: [ok], Delivered in [0.00219778] seconds [----] I, [2016-09-13T08:50:08.314206 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78686], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.926233128] seconds [----] I, [2016-09-13T08:50:08.314363 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78686], Delivering... [----] I, [2016-09-13T08:50:08.324085 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78686], State: [ok], Delivered in [0.009698748] seconds [----] I, [2016-09-13T08:50:08.371494 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78687], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.953989993] seconds [----] I, [2016-09-13T08:50:08.371688 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78687], Delivering... [----] I, [2016-09-13T08:50:08.376946 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78687], State: [ok], Delivered in [0.005255888] seconds [----] I, [2016-09-13T08:50:08.394304 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78688], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.968393253] seconds [----] I, [2016-09-13T08:50:08.394511 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78688], Delivering... [----] I, [2016-09-13T08:50:08.457613 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78690], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 12:50:08 UTC] [----] I, [2016-09-13T08:50:08.463049 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78689], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.80369026] seconds [----] I, [2016-09-13T08:50:08.463278 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78689], Delivering... [----] I, [2016-09-13T08:50:08.480228 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78691], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 12:50:08 UTC] [----] I, [2016-09-13T08:50:08.480565 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78688], State: [ok], Delivered in [0.086041167] seconds [----] I, [2016-09-13T08:50:08.580766 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78692], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 12:50:08 UTC] [----] I, [2016-09-13T08:50:08.691743 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78693], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 12:50:08 UTC] [----] I, [2016-09-13T08:50:08.692122 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78689], State: [ok], Delivered in [0.228832188] seconds [----] I, [2016-09-13T08:50:11.014942 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:11.173671 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:11.308822 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:11.444966 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:11.588683 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:11.728108 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:11.865588 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:12.010667 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:12.147208 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:12.279759 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:12.419100 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:12.563579 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:12.707963 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:13.175813 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:13.333958 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:13.471227 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:13.609917 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:13.843278 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:13.984785 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:14.126010 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:14.262591 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:14.388403 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:50:14.395159 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0024971961975097656, :worker_monitor=>2.352083683013916, :worker_dequeue=>0.012044429779052734, :total_time=>2.366833209991455} [----] I, [2016-09-13T08:50:14.401546 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:14.538468 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:14.687365 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:14.713023 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78690], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 12:50:08 UTC], Dequeued in: [6.31203245] seconds [----] I, [2016-09-13T08:50:14.713197 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78690], Delivering... [----] I, [2016-09-13T08:50:14.713575 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 12:50:08 UTC]... [----] I, [2016-09-13T08:50:14.717617 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T08:50:14.721011 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 12:50:08 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T08:50:14.721329 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78690], State: [ok], Delivered in [0.00812368] seconds [----] I, [2016-09-13T08:50:14.753062 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78691], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 12:50:08 UTC], Dequeued in: [6.289349495] seconds [----] I, [2016-09-13T08:50:14.753260 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78691], Delivering... [----] I, [2016-09-13T08:50:14.753548 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 12:50:08 UTC]... [----] I, [2016-09-13T08:50:14.756103 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T08:50:14.758315 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 12:50:08 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T08:50:14.758700 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78691], State: [ok], Delivered in [0.005431832] seconds [----] I, [2016-09-13T08:50:14.793060 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78692], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 12:50:08 UTC], Dequeued in: [6.319563672] seconds [----] I, [2016-09-13T08:50:14.793246 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78692], Delivering... [----] I, [2016-09-13T08:50:14.793636 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 12:50:08 UTC]... [----] I, [2016-09-13T08:50:14.796132 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T08:50:14.798701 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78693], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 12:50:08 UTC], Dequeued in: [6.211536828] seconds [----] I, [2016-09-13T08:50:14.798874 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78693], Delivering... [----] I, [2016-09-13T08:50:14.799153 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 12:50:08 UTC]... [----] I, [2016-09-13T08:50:14.801617 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T08:50:14.838676 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:14.875180 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 12:50:08 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T08:50:14.875548 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78693], State: [ok], Delivered in [0.076660472] seconds [----] I, [2016-09-13T08:50:14.879199 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 12:50:08 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T08:50:14.879580 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78692], State: [ok], Delivered in [0.086327308] seconds [----] I, [2016-09-13T08:50:14.977895 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:15.118675 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:15.255756 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:15.393449 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:15.535476 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:15.988373 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:16.154051 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:16.299174 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:16.445223 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:16.585402 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:16.725565 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:16.863206 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:17.002124 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:17.150674 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:17.289196 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:17.432634 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:17.573470 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:17.711285 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:17.857929 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:18.006397 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:18.148513 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:18.292040 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:18.685735 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:50:18.763641 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78694], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:50:18.793953 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:18.952973 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:19.100484 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:19.232787 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:19.377124 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:19.395712 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:50:19 UTC]... [----] I, [2016-09-13T08:50:19.420412 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:50:19 UTC]...Complete [----] I, [2016-09-13T08:50:19.514941 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:19.600847 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:50:19.658272 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:19.801745 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:19.878409 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78694], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.178119093] seconds [----] I, [2016-09-13T08:50:19.878741 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78694], Delivering... [----] I, [2016-09-13T08:50:19.888981 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005117177963256836, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005152225494384766, :pending_vm_jobs=>0.0013415813446044922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009666919708251953} [----] I, [2016-09-13T08:50:19.889527 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78694], State: [ok], Delivered in [0.010783484] seconds [----] I, [2016-09-13T08:50:19.937475 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:20.072129 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:20.211924 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:20.344954 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:20.489220 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:20.631382 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:20.788724 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:20.926353 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:21.067707 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:21.484186 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:21.647371 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:21.780375 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:27.960854 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:28.100554 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:28.246355 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:28.388695 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:28.528981 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:28.665851 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:28.808781 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:28.949140 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:29.090649 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:29.230480 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:29.367260 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:29.510654 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:29.652164 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:29.792717 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:30.165627 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:30.318095 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:30.472301 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:30.610201 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:30.747206 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:30.891908 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:31.027095 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:31.221986 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:31.369986 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:31.510120 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:31.653250 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:31.771224 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003544330596923828, :worker_monitor=>2.117952585220337, :worker_dequeue=>0.00748443603515625, :total_time=>2.129254102706909} [----] I, [2016-09-13T08:50:31.808150 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:31.952673 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:32.083520 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:32.225093 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:32.364464 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:32.506375 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:32.951011 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:33.108818 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:33.254771 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:33.392852 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:33.539767 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:33.699749 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:33.776054 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:50:33.788140 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78695], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:50:33.822613 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78696], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:50:33.843182 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:33.988405 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:34.127935 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:34.289407 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:34.429623 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:34.567238 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:34.714796 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:34.850780 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:34.986207 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:35.131587 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:35.270105 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:35.692802 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:35.839731 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:35.976761 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:36.112732 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:36.255358 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:36.402018 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:36.537709 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:36.676644 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:36.779461 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:50:36.816670 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:36.963405 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:37.059116 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78696], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.265497743] seconds [----] I, [2016-09-13T08:50:37.059371 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78696], Delivering... [----] I, [2016-09-13T08:50:37.067018 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00423884391784668, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00426483154296875, :pending_vm_jobs=>0.0011336803436279297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0071713924407958984} [----] I, [2016-09-13T08:50:37.067375 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78696], State: [ok], Delivered in [0.008017772] seconds [----] I, [2016-09-13T08:50:37.104377 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:37.248411 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:37.390351 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:37.527340 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:37.666854 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:37.811057 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:37.949443 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:38.412772 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:38.580698 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:38.717002 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:39.127862 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78695], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.347381095] seconds [----] I, [2016-09-13T08:50:39.128071 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78695], Delivering... [----] I, [2016-09-13T08:50:39.133707 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78695], State: [ok], Delivered in [0.00560967] seconds [----] I, [2016-09-13T08:50:44.873725 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:45.012655 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:45.150695 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:45.286750 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:45.419525 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:45.559760 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:45.697522 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:45.844294 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:45.985529 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:46.128088 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:46.267989 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:46.408409 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:46.544651 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T08:50:46.701719 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T08:50:46.895947 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T08:50:46.896277 #10859:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T08:50:46.896637 #10859:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T08:50:46.896756 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T08:50:46.896871 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T08:50:46.944381 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T08:50:46.944941 #10859:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [78676], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T08:50:46.945314 #10859:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T08:50:46.945799 #10859:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T08:50:46.946111 #10859:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78676], State: [error], Delivered in [72.601878266] seconds [----] I, [2016-09-13T08:50:48.531808 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004187345504760742, :worker_monitor=>1.7145411968231201, :worker_dequeue=>0.007954597473144531, :total_time=>1.7269790172576904} [----] I, [2016-09-13T08:50:48.837504 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:50:48.852805 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78697], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:50:53.532303 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:50:53 UTC]... [----] I, [2016-09-13T08:50:53.568139 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:50:53 UTC]...Complete [----] I, [2016-09-13T08:50:53.578159 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:50:54.179286 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78697], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.336374796] seconds [----] I, [2016-09-13T08:50:54.179528 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78697], Delivering... [----] I, [2016-09-13T08:50:54.187019 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0039031505584716797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003926753997802734, :pending_vm_jobs=>0.0009796619415283203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007033348083496094} [----] I, [2016-09-13T08:50:54.187384 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78697], State: [ok], Delivered in [0.007852749] seconds [----] I, [2016-09-13T08:51:03.861632 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:51:03.888066 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78698], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:51:03.929919 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78699], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:51:03.955812 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78700], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:51:03.990319 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78701], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:51:05.618811 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:51:05.626574 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037376880645751953, :worker_monitor=>2.014726400375366, :worker_dequeue=>0.014346599578857422, :total_time=>2.033137798309326} [----] I, [2016-09-13T08:51:06.248214 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78698], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.382211653] seconds [----] I, [2016-09-13T08:51:06.248350 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78698], Delivering... [----] I, [2016-09-13T08:51:06.270233 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78701], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.30888005] seconds [----] I, [2016-09-13T08:51:06.270395 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78701], Delivering... [----] I, [2016-09-13T08:51:06.278983 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0046215057373046875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004644632339477539, :pending_vm_jobs=>0.0011637210845947266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008175134658813477} [----] I, [2016-09-13T08:51:06.279388 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78701], State: [ok], Delivered in [0.008969918] seconds [----] I, [2016-09-13T08:51:06.287726 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78699], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.394943283] seconds [----] I, [2016-09-13T08:51:06.287936 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78699], Delivering... [----] I, [2016-09-13T08:51:06.290403 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78699], State: [ok], Delivered in [0.002512252] seconds [----] I, [2016-09-13T08:51:06.321747 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78698], State: [ok], Delivered in [0.0733681] seconds [----] I, [2016-09-13T08:51:06.350106 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78700], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.41212497] seconds [----] I, [2016-09-13T08:51:06.350370 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78700], Delivering... [----] I, [2016-09-13T08:51:06.354045 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78700], State: [ok], Delivered in [0.003648235] seconds [----] I, [2016-09-13T08:51:19.007244 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:51:19.030074 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78702], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:51:22.422749 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:51:22.430348 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004552602767944336, :server_monitor=>0.13866448402404785, :worker_monitor=>1.6149094104766846, :worker_dequeue=>0.01352071762084961, :total_time=>1.7720139026641846} [----] I, [2016-09-13T08:51:22.819524 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78702], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.806298183] seconds [----] I, [2016-09-13T08:51:22.819759 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78702], Delivering... [----] I, [2016-09-13T08:51:22.825572 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003070831298828125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003088712692260742, :pending_vm_jobs=>0.0006220340728759766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0053768157958984375} [----] I, [2016-09-13T08:51:22.825913 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78702], State: [ok], Delivered in [0.006165139] seconds [----] I, [2016-09-13T08:51:27.430879 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:51:27 UTC]... [----] I, [2016-09-13T08:51:27.464742 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:51:27 UTC]...Complete [----] I, [2016-09-13T08:51:34.038755 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:51:34.054144 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78703], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:51:34.081914 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78704], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:51:39.076353 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:51:39.080676 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004085540771484375, :worker_monitor=>1.5509116649627686, :worker_dequeue=>0.012069463729858398, :total_time=>1.5674176216125488} [----] I, [2016-09-13T08:51:39.447980 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78704], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.387436734] seconds [----] I, [2016-09-13T08:51:39.448193 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78704], Delivering... [----] I, [2016-09-13T08:51:39.455564 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037386417388916016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037870407104492188, :pending_vm_jobs=>0.0009374618530273438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0069293975830078125} [----] I, [2016-09-13T08:51:39.455984 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78704], State: [ok], Delivered in [0.007785679] seconds [----] I, [2016-09-13T08:51:39.533744 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78703], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.490308669] seconds [----] I, [2016-09-13T08:51:39.533870 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78703], Delivering... [----] I, [2016-09-13T08:51:39.536756 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78703], State: [ok], Delivered in [0.002871746] seconds [----] I, [2016-09-13T08:51:49.093495 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:51:49.110162 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78705], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:51:55.831969 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:51:55.841367 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006243705749511719, :worker_monitor=>1.7117908000946045, :worker_dequeue=>0.016343355178833008, :total_time=>1.7347393035888672} [----] I, [2016-09-13T08:51:56.103969 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78705], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.006819972] seconds [----] I, [2016-09-13T08:51:56.104143 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78705], Delivering... [----] I, [2016-09-13T08:51:56.111043 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00318145751953125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032186508178710938, :pending_vm_jobs=>0.0010027885437011719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065233707427978516} [----] I, [2016-09-13T08:51:56.111494 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78705], State: [ok], Delivered in [0.007307916] seconds [----] I, [2016-09-13T08:52:00.841987 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:52:00 UTC]... [----] I, [2016-09-13T08:52:00.863864 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:52:00 UTC]...Complete [----] I, [2016-09-13T08:52:04.118175 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:52:04.138557 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78706], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:52:04.173375 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78707], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:52:04.195530 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78708], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:52:04.218439 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78709], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:52:05.898107 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:52:06.195377 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78706], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.073312563] seconds [----] I, [2016-09-13T08:52:06.195567 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78706], Delivering... [----] I, [2016-09-13T08:52:06.241942 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78706], State: [ok], Delivered in [0.046322576] seconds [----] I, [2016-09-13T08:52:06.281143 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78709], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.080413876] seconds [----] I, [2016-09-13T08:52:06.281308 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78709], Delivering... [----] I, [2016-09-13T08:52:06.286521 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002782583236694336, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002798318862915039, :pending_vm_jobs=>0.0006098747253417969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004862785339355469} [----] I, [2016-09-13T08:52:06.286924 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78709], State: [ok], Delivered in [0.005604388] seconds [----] I, [2016-09-13T08:52:06.635548 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78707], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.49130539] seconds [----] I, [2016-09-13T08:52:06.635698 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78707], Delivering... [----] I, [2016-09-13T08:52:06.640363 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78707], State: [ok], Delivered in [0.004649551] seconds [----] I, [2016-09-13T08:52:06.698303 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78708], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.517894946] seconds [----] I, [2016-09-13T08:52:06.698446 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78708], Delivering... [----] I, [2016-09-13T08:52:06.701520 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78708], State: [ok], Delivered in [0.003079244] seconds [----] I, [2016-09-13T08:52:12.096874 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0026602745056152344, :worker_monitor=>1.1794979572296143, :worker_dequeue=>0.012210845947265625, :total_time=>1.1945934295654297} [----] I, [2016-09-13T08:52:19.228904 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:52:19.247179 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78710], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:52:22.199863 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:52:22.253171 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78710], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.019854014] seconds [----] I, [2016-09-13T08:52:22.253318 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78710], Delivering... [----] I, [2016-09-13T08:52:22.259384 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003267049789428711, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003284931182861328, :pending_vm_jobs=>0.0007174015045166016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00572967529296875} [----] I, [2016-09-13T08:52:22.259756 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78710], State: [ok], Delivered in [0.006424835] seconds [----] I, [2016-09-13T08:52:28.980978 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00429844856262207, :worker_monitor=>1.7657310962677002, :worker_dequeue=>0.005983829498291016, :total_time=>1.7762327194213867} [----] I, [2016-09-13T08:52:33.981525 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:52:33 UTC]... [----] I, [2016-09-13T08:52:34.007326 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:52:33 UTC]...Complete [----] I, [2016-09-13T08:52:34.258198 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:52:34.293410 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78711], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:52:34.310266 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78712], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:52:39.042040 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:52:39.465175 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78712], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.166087446] seconds [----] I, [2016-09-13T08:52:39.465496 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78712], Delivering... [----] I, [2016-09-13T08:52:39.475497 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005154848098754883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00528264045715332, :pending_vm_jobs=>0.0013191699981689453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009449958801269531} [----] I, [2016-09-13T08:52:39.475977 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78712], State: [ok], Delivered in [0.010514189] seconds [----] I, [2016-09-13T08:52:40.053580 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78711], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.789194677] seconds [----] I, [2016-09-13T08:52:40.053793 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78711], Delivering... [----] I, [2016-09-13T08:52:40.058232 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78711], State: [ok], Delivered in [0.004426805] seconds [----] I, [2016-09-13T08:52:45.895781 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004100799560546875, :worker_monitor=>1.83534574508667, :worker_dequeue=>0.0066525936126708984, :total_time=>1.8464672565460205} [----] I, [2016-09-13T08:52:49.323258 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:52:49.364157 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78713], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:52:50.903763 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:52:51.009606 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78713], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.676537927] seconds [----] I, [2016-09-13T08:52:51.009769 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78713], Delivering... [----] I, [2016-09-13T08:52:51.015151 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002850055694580078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002868175506591797, :pending_vm_jobs=>0.0006618499755859375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005053043365478516} [----] I, [2016-09-13T08:52:51.015525 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78713], State: [ok], Delivered in [0.005751923] seconds [----] I, [2016-09-13T08:53:02.306708 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0031723976135253906, :worker_monitor=>1.362755298614502, :worker_dequeue=>0.012578725814819336, :total_time=>1.3787808418273926} [----] I, [2016-09-13T08:53:04.377756 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:53:04.392937 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78714], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:53:04.428168 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78715], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:53:04.473151 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78716], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:53:04.507378 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78717], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:53:07.307302 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:53:07 UTC]... [----] I, [2016-09-13T08:53:07.325299 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:53:07 UTC]...Complete [----] I, [2016-09-13T08:53:07.337113 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:53:07.701745 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78714], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.319217827] seconds [----] I, [2016-09-13T08:53:07.702012 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78714], Delivering... [----] I, [2016-09-13T08:53:07.752879 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78714], State: [ok], Delivered in [0.050879555] seconds [----] I, [2016-09-13T08:53:07.798755 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78717], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.316775474] seconds [----] I, [2016-09-13T08:53:07.798911 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78717], Delivering... [----] I, [2016-09-13T08:53:07.803493 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024182796478271484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002437114715576172, :pending_vm_jobs=>0.0005803108215332031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004282474517822266} [----] I, [2016-09-13T08:53:07.803739 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78717], State: [ok], Delivered in [0.004841008] seconds [----] I, [2016-09-13T08:53:10.193085 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78715], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.794280288] seconds [----] I, [2016-09-13T08:53:10.193312 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78715], Delivering... [----] I, [2016-09-13T08:53:10.196724 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78715], State: [ok], Delivered in [0.003406808] seconds [----] I, [2016-09-13T08:53:10.250659 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78716], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.814170674] seconds [----] I, [2016-09-13T08:53:10.250880 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78716], Delivering... [----] I, [2016-09-13T08:53:10.256681 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78716], State: [ok], Delivered in [0.00579316] seconds [----] I, [2016-09-13T08:53:19.138134 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005700826644897461, :worker_monitor=>1.761946439743042, :worker_dequeue=>0.011387348175048828, :total_time=>1.779494285583496} [----] I, [2016-09-13T08:53:19.524191 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:53:19.548561 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78718], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:53:24.267723 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:53:24.970315 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78718], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.439907343] seconds [----] I, [2016-09-13T08:53:24.970479 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78718], Delivering... [----] I, [2016-09-13T08:53:24.974990 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023517608642578125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002438068389892578, :pending_vm_jobs=>0.0005624294281005859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004195690155029297} [----] I, [2016-09-13T08:53:24.975222 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78718], State: [ok], Delivered in [0.00474346] seconds [----] I, [2016-09-13T08:53:34.566198 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T08:53:34.589066 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78719], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:53:34.615955 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78720], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:53:34.644759 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78721], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:53:34.684647 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78722], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:53:35.708315 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:53:35.712982 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003627777099609375, :worker_monitor=>1.4032583236694336, :worker_dequeue=>0.008540153503417969, :total_time=>1.415743112564087} [----] I, [2016-09-13T08:53:36.137347 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78720], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.540340801] seconds [----] I, [2016-09-13T08:53:36.137494 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78720], Delivering... [----] I, [2016-09-13T08:53:36.141911 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024144649505615234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024330615997314453, :pending_vm_jobs=>0.0005412101745605469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004140377044677734} [----] I, [2016-09-13T08:53:36.142253 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78720], State: [ok], Delivered in [0.004745841] seconds [----] I, [2016-09-13T08:53:36.182771 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78721], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.562971416] seconds [----] I, [2016-09-13T08:53:36.182898 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78721], Delivering... [----] I, [2016-09-13T08:53:36.183737 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T08:53:36.183860 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5367943168 [----] I, [2016-09-13T08:53:36.183920 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5140152320 [----] I, [2016-09-13T08:53:36.183971 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 227790848 [----] I, [2016-09-13T08:53:36.184020 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T08:53:36.184066 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5086117888 [----] I, [2016-09-13T08:53:36.184108 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T08:53:36.184164 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T08:53:36.184209 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 549408768 [----] I, [2016-09-13T08:53:36.184254 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T08:53:36.184299 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8060915712 [----] I, [2016-09-13T08:53:36.184344 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T08:53:36.184389 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T08:53:36.184449 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T08:53:36.184504 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T08:53:36.184554 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T08:53:36.184612 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T08:53:36.184662 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T08:53:36.184704 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T08:53:36.184772 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T08:53:36.184824 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T08:53:36.184866 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273805312 [----] I, [2016-09-13T08:53:36.184910 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57012224 [----] I, [2016-09-13T08:53:36.184952 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216793088 [----] I, [2016-09-13T08:53:36.184996 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T08:53:36.185039 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141062144 [----] I, [2016-09-13T08:53:36.185080 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2581483520 [----] I, [2016-09-13T08:53:36.185122 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2258731008 [----] I, [2016-09-13T08:53:36.185167 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T08:53:36.185210 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T08:53:36.185250 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T08:53:36.185293 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37261312 [----] I, [2016-09-13T08:53:36.185342 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T08:53:36.185387 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53387264 [----] I, [2016-09-13T08:53:36.185448 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111046656 [----] I, [2016-09-13T08:53:36.185504 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155684864 [----] I, [2016-09-13T08:53:36.185549 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T08:53:36.185601 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T08:53:36.185648 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T08:53:36.185692 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T08:53:36.185736 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T08:53:36.185781 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T08:53:36.185820 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T08:53:36.185864 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 8192 [----] I, [2016-09-13T08:53:36.185905 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T08:53:36.212020 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T08:53:36.212168 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T08:53:36.214597 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T08:53:36.216311 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T08:53:36.218312 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T08:53:36.220297 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T08:53:36.222278 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T08:53:36.224260 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 848 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T08:53:36.226358 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T08:53:36.228693 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T08:53:36.231614 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T08:53:36.233845 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T08:53:36.235765 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T08:53:36.237579 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T08:53:36.239526 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:53:36.239645 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:53:36.239723 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T08:53:36.242363 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [202019000], Memory % [5.27], CPU Time [152491.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T08:53:36.242610 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78721], State: [ok], Delivered in [0.059686527] seconds [----] I, [2016-09-13T08:53:36.285988 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78722], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.635438259] seconds [----] I, [2016-09-13T08:53:36.286175 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78722], Delivering... [----] I, [2016-09-13T08:53:36.291266 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:53:35 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152499.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:53:36.291655 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:53:34 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205295000], Memory % [3.5], CPU Time [241514.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T08:53:36.291930 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:53:28 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347151000], Memory % [5.04], CPU Time [104603.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T08:53:36.292239 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:53:33 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162420000], Memory % [3.1], CPU Time [38183.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T08:53:36.292552 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:53:24 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212543000], Memory % [3.5], CPU Time [49039.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T08:53:36.292864 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:53:35 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [151582.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:53:36.293167 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:53:34 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358685000], Memory % [5.28], CPU Time [203287.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T08:53:36.293478 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:53:32 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169070000], Memory % [3.14], CPU Time [51832.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:53:36.295314 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:53:27 UTC], Process Info: Memory Usage [608608256], Memory Size [1064882176], Proportional Set Size: [441255000], Memory % [7.42], CPU Time [1438.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:53:36.296594 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:53:35 UTC], Process Info: Memory Usage [581062656], Memory Size [938852352], Proportional Set Size: [420675000], Memory % [7.08], CPU Time [2484.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T08:53:36.297789 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:53:32 UTC], Process Info: Memory Usage [558563328], Memory Size [929497088], Proportional Set Size: [406093000], Memory % [6.81], CPU Time [5900.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T08:53:36.298127 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:53:34 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [212115.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T08:53:36.298445 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:53:33 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177793000], Memory % [3.2], CPU Time [51858.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:53:36.298745 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:53:32 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165808000], Memory % [3.16], CPU Time [39085.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T08:53:36.300000 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:53:34 UTC], Process Info: Memory Usage [597696512], Memory Size [940904448], Proportional Set Size: [430255000], Memory % [7.29], CPU Time [502.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:53:36.300232 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78722], State: [ok], Delivered in [0.014068856] seconds [----] I, [2016-09-13T08:53:37.325942 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78719], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.755444912] seconds [----] I, [2016-09-13T08:53:37.326130 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78719], Delivering... [----] I, [2016-09-13T08:53:37.331469 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78719], State: [ok], Delivered in [0.005299953] seconds [----] I, [2016-09-13T08:53:40.713507 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:53:40 UTC]... [----] I, [2016-09-13T08:53:40.742793 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:53:40 UTC]...Complete [----] I, [2016-09-13T08:53:49.700270 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:53:49.725896 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78723], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:53:52.051390 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:53:52.055633 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0028688907623291016, :worker_monitor=>1.2641174793243408, :worker_dequeue=>0.007639408111572266, :total_time=>1.2748422622680664} [----] I, [2016-09-13T08:53:52.429073 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78723], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.720544618] seconds [----] I, [2016-09-13T08:53:52.429289 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78723], Delivering... [----] I, [2016-09-13T08:53:52.437170 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038595199584960938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038886070251464844, :pending_vm_jobs=>0.0012242794036865234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007391691207885742} [----] I, [2016-09-13T08:53:52.437563 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78723], State: [ok], Delivered in [0.008274778] seconds [----] I, [2016-09-13T08:54:04.738694 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:54:04.765972 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78724], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:54:04.794716 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78725], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:54:04.823094 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78726], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:54:04.851081 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78727], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:54:08.514119 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:54:08.518225 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004067182540893555, :worker_monitor=>1.416741132736206, :worker_dequeue=>0.0074274539947509766, :total_time=>1.4285216331481934} [----] I, [2016-09-13T08:54:08.560456 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78724], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.816918557] seconds [----] I, [2016-09-13T08:54:08.560694 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78724], Delivering... [----] I, [2016-09-13T08:54:08.628825 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78724], State: [ok], Delivered in [0.068103769] seconds [----] I, [2016-09-13T08:54:08.663330 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78727], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.832943631] seconds [----] I, [2016-09-13T08:54:08.663562 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78727], Delivering... [----] I, [2016-09-13T08:54:08.670985 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038290023803710938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038557052612304688, :pending_vm_jobs=>0.000904083251953125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00699305534362793} [----] I, [2016-09-13T08:54:08.671381 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78727], State: [ok], Delivered in [0.007822604] seconds [----] I, [2016-09-13T08:54:10.503157 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78725], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.731739275] seconds [----] I, [2016-09-13T08:54:10.503334 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78725], Delivering... [----] I, [2016-09-13T08:54:10.506761 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78725], State: [ok], Delivered in [0.003423631] seconds [----] I, [2016-09-13T08:54:10.520403 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78726], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.717284622] seconds [----] I, [2016-09-13T08:54:10.520646 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78726], Delivering... [----] I, [2016-09-13T08:54:10.526172 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78726], State: [ok], Delivered in [0.005536232] seconds [----] I, [2016-09-13T08:54:13.519061 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:54:13 UTC]... [----] I, [2016-09-13T08:54:13.548626 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:54:13 UTC]...Complete [----] I, [2016-09-13T08:54:18.586737 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T08:54:19.863189 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:54:19.885774 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78728], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:54:25.243157 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:54:25.249765 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0034837722778320312, :worker_monitor=>1.6368937492370605, :worker_dequeue=>0.011816263198852539, :total_time=>1.6524484157562256} [----] I, [2016-09-13T08:54:25.600465 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78728], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.733408119] seconds [----] I, [2016-09-13T08:54:25.600674 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78728], Delivering... [----] I, [2016-09-13T08:54:25.607120 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003233671188354492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003253936767578125, :pending_vm_jobs=>0.0008373260498046875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006036520004272461} [----] I, [2016-09-13T08:54:25.607762 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78728], State: [ok], Delivered in [0.007073525] seconds [----] I, [2016-09-13T08:54:34.894859 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:54:34.920273 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78729], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:54:34.953299 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78730], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:54:35.442377 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:54:35.686199 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78730], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.760410251] seconds [----] I, [2016-09-13T08:54:35.686392 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78730], Delivering... [----] I, [2016-09-13T08:54:35.693339 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035238265991210938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035505294799804688, :pending_vm_jobs=>0.0008614063262939453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006485700607299805} [----] I, [2016-09-13T08:54:35.693702 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78730], State: [ok], Delivered in [0.007304072] seconds [----] I, [2016-09-13T08:54:37.691738 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78729], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.792546167] seconds [----] I, [2016-09-13T08:54:37.691875 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78729], Delivering... [----] I, [2016-09-13T08:54:37.695253 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78729], State: [ok], Delivered in [0.003371865] seconds [----] I, [2016-09-13T08:54:42.460891 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006108760833740234, :worker_monitor=>1.986990213394165, :worker_dequeue=>0.012879371643066406, :total_time=>2.006467819213867} [----] I, [2016-09-13T08:54:47.461471 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:54:47 UTC]... [----] I, [2016-09-13T08:54:47.489813 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:54:47 UTC]...Complete [----] I, [2016-09-13T08:54:49.965200 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:54:49.987039 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78731], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:54:52.511947 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:54:52.747189 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78731], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.775141767] seconds [----] I, [2016-09-13T08:54:52.747447 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78731], Delivering... [----] I, [2016-09-13T08:54:52.755629 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0040435791015625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004069328308105469, :pending_vm_jobs=>0.001071929931640625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0075473785400390625} [----] I, [2016-09-13T08:54:52.756031 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78731], State: [ok], Delivered in [0.008604921] seconds [----] I, [2016-09-13T08:54:59.236095 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004170656204223633, :worker_monitor=>1.705657720565796, :worker_dequeue=>0.008913278579711914, :total_time=>1.719099760055542} [----] I, [2016-09-13T08:55:04.996077 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:55:05.025841 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78732], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:55:05.094279 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78733], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:55:05.162738 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78734], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:55:05.178753 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78735], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:55:09.272805 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:55:09.973520 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78732], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.974531273] seconds [----] I, [2016-09-13T08:55:09.973685 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78732], Delivering... [----] I, [2016-09-13T08:55:10.058920 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78732], State: [ok], Delivered in [0.085193532] seconds [----] I, [2016-09-13T08:55:10.093470 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78735], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.925458881] seconds [----] I, [2016-09-13T08:55:10.093694 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78735], Delivering... [----] I, [2016-09-13T08:55:10.100604 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036382675170898438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003658771514892578, :pending_vm_jobs=>0.0008516311645507812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006499528884887695} [----] I, [2016-09-13T08:55:10.100992 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78735], State: [ok], Delivered in [0.007297534] seconds [----] I, [2016-09-13T08:55:10.933305 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78733], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.90243426] seconds [----] I, [2016-09-13T08:55:10.933457 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78733], Delivering... [----] I, [2016-09-13T08:55:10.935768 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78733], State: [ok], Delivered in [0.002330023] seconds [----] I, [2016-09-13T08:55:10.984899 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78734], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.879631545] seconds [----] I, [2016-09-13T08:55:10.985046 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78734], Delivering... [----] I, [2016-09-13T08:55:10.988588 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78734], State: [ok], Delivered in [0.003530171] seconds [----] I, [2016-09-13T08:55:15.482129 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [101], PID: [12930], GUID: [4846d89a-79ab-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:55:15.482326 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [101], PID: [12930], GUID: [4846d89a-79ab-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:55:15.499312 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [100], PID: [10859], GUID: [5b4aad44-79a7-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:55:15.499622 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [100], PID: [10859], GUID: [5b4aad44-79a7-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:55:15.534330 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:55:15.534562 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:55:15.562053 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:55:15.562223 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:55:15.619360 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:55:15.619593 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:55:15.647376 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:55:15.647558 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:55:15.682352 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:55:15.682570 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:55:15.705291 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:55:15.705519 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:55:15.785219 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:55:15.785454 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:55:15.842332 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:55:15.842562 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:55:15.865321 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:55:15.865537 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:55:15.962455 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:55:15.962681 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:55:16.013774 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:55:16.013969 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:55:16.110910 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:55:16.111109 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:55:16.202154 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T08:55:16.202344 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T08:55:16.215933 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004029750823974609, :worker_monitor=>1.9206407070159912, :worker_dequeue=>0.010458946228027344, :total_time=>1.935487985610962} [----] I, [2016-09-13T08:55:16.739822 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:55:16.739954 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:55:16.740022 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:55:16.885404 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:55:16.886223 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T08:55:16.886299 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:55:16.886340 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:55:16.886377 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:55:16.886412 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T08:55:16.886493 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T08:55:16.886533 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:55:16.886566 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T08:55:16.886624 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:55:16.886663 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:55:16.886696 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:55:16.886728 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:55:16.886761 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T08:55:16.886791 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T08:55:16.887050 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:55:16.887309 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:55:17.098372 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:55:17.098572 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:55:17.098690 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:55:17.125793 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:55:17.125943 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:55:17.126037 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:55:17.276085 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:55:17.276956 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T08:55:17.277039 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:55:17.277085 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:55:17.277125 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:55:17.277161 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T08:55:17.277195 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T08:55:17.277228 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:55:17.277262 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T08:55:17.277296 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:55:17.277345 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:55:17.277383 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:55:17.277442 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:55:17.277494 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T08:55:17.277536 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:55:17.277570 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T08:55:17.277623 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T08:55:17.277919 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:55:17.278067 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:55:17.326803 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:55:17.327451 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T08:55:17.327515 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:55:17.327551 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:55:17.327603 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:55:17.327650 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T08:55:17.327678 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T08:55:17.327705 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:55:17.327731 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T08:55:17.327758 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:55:17.327783 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:55:17.327808 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:55:17.327835 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:55:17.327863 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T08:55:17.327888 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:55:17.327912 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T08:55:17.327936 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T08:55:17.328179 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:55:17.328316 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:55:17.395021 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T08:55:17.395191 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T08:55:17.395301 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T08:55:17.590353 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:55:17.591383 #10859:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T08:55:17.591496 #10859:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:55:17.591554 #10859:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:55:17.591617 #10859:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:55:17.591657 #10859:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T08:55:17.591697 #10859:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T08:55:17.591732 #10859:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:55:17.591772 #10859:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T08:55:17.591836 #10859:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:55:17.591901 #10859:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:55:17.591965 #10859:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T08:55:17.592034 #10859:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:55:17.592099 #10859:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T08:55:17.592170 #10859:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:55:17.592229 #10859:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T08:55:17.592265 #10859:34713c] INFO -- : --- [----] I, [2016-09-13T08:55:17.592856 #10859:34713c] INFO -- : :guid: 5b4aad44-79a7-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:55:17.592937 #10859:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T08:55:17.593182 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T08:55:18.155728 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:55:18.155962 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:55:18.156100 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:55:18.478396 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:55:18.479980 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T08:55:18.480112 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:55:18.480186 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:55:18.480257 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:55:18.480319 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T08:55:18.480377 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T08:55:18.480479 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:55:18.480553 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T08:55:18.480641 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:55:18.480714 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:55:18.480775 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:55:18.480872 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:55:18.480951 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T08:55:18.481017 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:55:18.481079 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T08:55:18.481142 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T08:55:18.481726 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:55:18.482010 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:55:19.141123 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:55:19.141256 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:55:19.141326 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:55:19.297180 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:55:19.298595 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T08:55:19.298728 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:55:19.298806 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:55:19.298871 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:55:19.298934 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T08:55:19.298994 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T08:55:19.299056 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:55:19.299115 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T08:55:19.299174 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:55:19.299230 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:55:19.299290 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:55:19.299351 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:55:19.299437 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T08:55:19.299511 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:55:19.299562 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T08:55:19.299630 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T08:55:19.300035 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:55:19.300232 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:55:20.073595 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:55:20.073791 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:55:20.073878 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:55:20.189933 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:55:20.190130 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:55:20.190209 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:55:20.194331 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:55:20.194951 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T08:55:20.195007 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:55:20.195038 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:55:20.195065 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:55:20.195089 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T08:55:20.195113 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T08:55:20.195138 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:55:20.195161 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T08:55:20.195184 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:55:20.195207 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:55:20.195230 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:55:20.195253 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:55:20.195277 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T08:55:20.195299 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T08:55:20.195525 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:55:20.195781 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:55:20.302624 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:55:20.303551 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T08:55:20.303635 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:55:20.303669 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:55:20.303694 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:55:20.303718 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T08:55:20.303740 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T08:55:20.303762 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:55:20.303785 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T08:55:20.303806 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:55:20.303828 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:55:20.303849 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:55:20.303871 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:55:20.303893 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T08:55:20.303927 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T08:55:20.303952 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T08:55:20.303977 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T08:55:20.303999 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T08:55:20.304020 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T08:55:20.304042 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T08:55:20.304064 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T08:55:20.304086 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T08:55:20.304108 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T08:55:20.304129 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T08:55:20.304150 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T08:55:20.304171 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T08:55:20.304192 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T08:55:20.304214 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T08:55:20.304236 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T08:55:20.304258 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T08:55:20.304279 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T08:55:20.304301 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T08:55:20.304322 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T08:55:20.304343 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T08:55:20.304363 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T08:55:20.304384 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T08:55:20.304409 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T08:55:20.304477 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T08:55:20.304503 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T08:55:20.304524 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T08:55:20.304735 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:55:20.304847 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:55:20.304899 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:55:20.327852 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78736], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:55:21.216690 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:55:21 UTC]... [----] I, [2016-09-13T08:55:21.258759 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:55:21 UTC]...Complete [----] I, [2016-09-13T08:55:21.270129 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:55:21.540377 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78736], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.231239844] seconds [----] I, [2016-09-13T08:55:21.540640 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78736], Delivering... [----] I, [2016-09-13T08:55:21.546706 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003258943557739258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032753944396972656, :pending_vm_jobs=>0.0007452964782714844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005736112594604492} [----] I, [2016-09-13T08:55:21.547041 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78736], State: [ok], Delivered in [0.006446109] seconds [----] I, [2016-09-13T08:55:23.248279 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T08:55:23.248504 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T08:55:23.248648 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T08:55:23.427992 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:55:23.428873 #684:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T08:55:23.428957 #684:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:55:23.429004 #684:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:55:23.429043 #684:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:55:23.429079 #684:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T08:55:23.429115 #684:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T08:55:23.429149 #684:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:55:23.429183 #684:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T08:55:23.429216 #684:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:55:23.429249 #684:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:55:23.429280 #684:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:55:23.429313 #684:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:55:23.429346 #684:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T08:55:23.429378 #684:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T08:55:23.429410 #684:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T08:55:23.429527 #684:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T08:55:23.429572 #684:34713c] INFO -- : --- [----] I, [2016-09-13T08:55:23.429930 #684:34713c] INFO -- : :guid: c253e5f6-7924-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:55:23.429995 #684:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T08:55:23.430119 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T08:55:24.194698 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:55:24.194830 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:55:24.194899 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:55:24.260727 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:55:24.260904 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:55:24.261001 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:55:24.309985 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T08:55:24.310237 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T08:55:24.310439 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T08:55:24.341717 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:55:24.342410 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T08:55:24.342492 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:55:24.342534 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:55:24.342571 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:55:24.342625 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T08:55:24.342666 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T08:55:24.342702 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:55:24.342735 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T08:55:24.342769 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:55:24.342800 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:55:24.342829 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:55:24.342860 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:55:24.342892 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T08:55:24.342923 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:55:24.342953 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T08:55:24.342980 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T08:55:24.343225 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:55:24.343348 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:55:24.516598 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:55:24.516745 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:55:24.516821 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:55:24.537888 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:55:24.538732 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T08:55:24.538803 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:55:24.538841 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:55:24.538874 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:55:24.538908 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T08:55:24.538939 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T08:55:24.538972 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:55:24.539002 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T08:55:24.539034 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:55:24.539066 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:55:24.539096 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:55:24.539125 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:55:24.539161 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T08:55:24.539194 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:55:24.539230 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T08:55:24.539258 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T08:55:24.539550 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:55:24.539706 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:55:24.554836 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:55:24.556368 #12930:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T08:55:24.556524 #12930:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:55:24.556660 #12930:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:55:24.556742 #12930:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:55:24.556830 #12930:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T08:55:24.556903 #12930:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T08:55:24.556979 #12930:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:55:24.557050 #12930:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T08:55:24.557125 #12930:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:55:24.557204 #12930:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:55:24.557281 #12930:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T08:55:24.557377 #12930:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:55:24.557517 #12930:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T08:55:24.557632 #12930:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:55:24.557715 #12930:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T08:55:24.557786 #12930:34713c] INFO -- : --- [----] I, [2016-09-13T08:55:24.558508 #12930:34713c] INFO -- : :guid: 4846d89a-79ab-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:55:24.558652 #12930:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T08:55:24.558934 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T08:55:24.698264 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:55:24.699675 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T08:55:24.699831 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:55:24.699916 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:55:24.699994 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:55:24.700064 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T08:55:24.700135 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T08:55:24.700205 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:55:24.700275 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T08:55:24.700348 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:55:24.700445 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:55:24.700540 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:55:24.700642 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:55:24.700727 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T08:55:24.700796 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T08:55:24.701345 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:55:24.701866 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:55:25.214191 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T08:55:25.214377 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T08:55:25.214543 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T08:55:25.367278 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:55:25.367999 #20386:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T08:55:25.368069 #20386:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:55:25.368104 #20386:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:55:25.368131 #20386:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:55:25.368158 #20386:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T08:55:25.368183 #20386:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T08:55:25.368208 #20386:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:55:25.368233 #20386:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T08:55:25.368258 #20386:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:55:25.368282 #20386:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:55:25.368305 #20386:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:55:25.368330 #20386:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:55:25.368354 #20386:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T08:55:25.368378 #20386:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T08:55:25.368402 #20386:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T08:55:25.368455 #20386:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T08:55:25.368485 #20386:34713c] INFO -- : --- [----] I, [2016-09-13T08:55:25.368764 #20386:34713c] INFO -- : :guid: e5930efc-7974-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:55:25.368813 #20386:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T08:55:25.368916 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T08:55:27.558403 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T08:55:27.558665 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T08:55:27.558783 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T08:55:27.781281 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T08:55:27.782396 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T08:55:27.782517 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T08:55:27.782574 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T08:55:27.782647 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T08:55:27.782696 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T08:55:27.782741 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T08:55:27.782787 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T08:55:27.782830 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T08:55:27.782873 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T08:55:27.782918 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T08:55:27.782963 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T08:55:27.783008 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T08:55:27.783079 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T08:55:27.783128 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T08:55:27.783174 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T08:55:27.783217 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T08:55:27.783664 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T08:55:27.783876 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T08:55:32.959166 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004967212677001953, :server_monitor=>0.1734771728515625, :worker_monitor=>1.476346492767334, :worker_dequeue=>0.011534452438354492, :total_time=>1.6667897701263428} [----] I, [2016-09-13T08:55:35.341484 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:55:35.367195 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78737], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:55:35.384850 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78738], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:55:37.973061 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:55:38.339111 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78738], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.965471045] seconds [----] I, [2016-09-13T08:55:38.339250 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78738], Delivering... [----] I, [2016-09-13T08:55:38.343466 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023169517517089844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023336410522460938, :pending_vm_jobs=>0.00047469139099121094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0039746761322021484} [----] I, [2016-09-13T08:55:38.343734 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78738], State: [ok], Delivered in [0.004489692] seconds [----] I, [2016-09-13T08:55:38.438236 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78737], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.091260398] seconds [----] I, [2016-09-13T08:55:38.438549 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78737], Delivering... [----] I, [2016-09-13T08:55:38.443666 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78737], State: [ok], Delivered in [0.005146015] seconds [----] I, [2016-09-13T08:55:49.465724 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004059791564941406, :worker_monitor=>1.4597511291503906, :worker_dequeue=>0.006165742874145508, :total_time=>1.470339298248291} [----] I, [2016-09-13T08:55:50.396964 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:55:50.428825 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78739], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:55:54.466148 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:55:54 UTC]... [----] I, [2016-09-13T08:55:54.485984 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:55:54 UTC]...Complete [----] I, [2016-09-13T08:55:54.495398 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:55:54.565966 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78739], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.165591058] seconds [----] I, [2016-09-13T08:55:54.566090 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78739], Delivering... [----] I, [2016-09-13T08:55:54.569864 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021178722381591797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002129793167114258, :pending_vm_jobs=>0.00045490264892578125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0035407543182373047} [----] I, [2016-09-13T08:55:54.570073 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78739], State: [ok], Delivered in [0.003983386] seconds [----] I, [2016-09-13T08:56:05.443564 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:56:05.468864 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78740], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:56:05.499304 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78741], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:56:05.537852 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78742], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:56:05.566241 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78743], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:56:06.450472 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:56:06.456625 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004024028778076172, :worker_monitor=>1.92256760597229, :worker_dequeue=>0.011026859283447266, :total_time=>1.9380419254302979} [----] I, [2016-09-13T08:56:06.665839 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78740], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.215403843] seconds [----] I, [2016-09-13T08:56:06.665974 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78740], Delivering... [----] I, [2016-09-13T08:56:06.723049 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78740], State: [ok], Delivered in [0.057040371] seconds [----] I, [2016-09-13T08:56:06.757077 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78743], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.211929611] seconds [----] I, [2016-09-13T08:56:06.757170 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78743], Delivering... [----] I, [2016-09-13T08:56:06.760340 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0017306804656982422, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0017418861389160156, :pending_vm_jobs=>0.00042700767517089844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0029840469360351562} [----] I, [2016-09-13T08:56:06.760528 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78743], State: [ok], Delivered in [0.003347242] seconds [----] I, [2016-09-13T08:56:08.540380 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78741], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.06681241] seconds [----] I, [2016-09-13T08:56:08.540640 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78741], Delivering... [----] I, [2016-09-13T08:56:08.544045 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78741], State: [ok], Delivered in [0.00341007] seconds [----] I, [2016-09-13T08:56:08.609108 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78742], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.100189998] seconds [----] I, [2016-09-13T08:56:08.609296 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78742], Delivering... [----] I, [2016-09-13T08:56:08.614628 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78742], State: [ok], Delivered in [0.005283233] seconds [----] I, [2016-09-13T08:56:20.575814 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:56:20.591190 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78744], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:56:22.734665 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:56:22.738534 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0032684803009033203, :worker_monitor=>1.2385005950927734, :worker_dequeue=>0.00693964958190918, :total_time=>1.2490699291229248} [----] I, [2016-09-13T08:56:22.894847 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78744], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.315323371] seconds [----] I, [2016-09-13T08:56:22.895043 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78744], Delivering... [----] I, [2016-09-13T08:56:22.901624 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035276412963867188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035474300384521484, :pending_vm_jobs=>0.0008099079132080078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006182670593261719} [----] I, [2016-09-13T08:56:22.901975 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78744], State: [ok], Delivered in [0.006927433] seconds [----] I, [2016-09-13T08:56:27.739044 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:56:27 UTC]... [----] I, [2016-09-13T08:56:27.774269 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:56:27 UTC]...Complete [----] I, [2016-09-13T08:56:35.600296 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:56:35.620820 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78745], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:56:35.649021 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78746], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:56:39.377258 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:56:39.383727 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005051612854003906, :worker_monitor=>1.4359569549560547, :worker_dequeue=>0.01167607307434082, :total_time=>1.4529473781585693} [----] I, [2016-09-13T08:56:40.043659 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78746], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.417152193] seconds [----] I, [2016-09-13T08:56:40.043831 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78746], Delivering... [----] I, [2016-09-13T08:56:40.050792 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037229061126708984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037436485290527344, :pending_vm_jobs=>0.0008597373962402344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006632804870605469} [----] I, [2016-09-13T08:56:40.051166 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78746], State: [ok], Delivered in [0.007323196] seconds [----] I, [2016-09-13T08:56:41.666714 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78745], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.061731355] seconds [----] I, [2016-09-13T08:56:41.666944 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78745], Delivering... [----] I, [2016-09-13T08:56:41.671404 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78745], State: [ok], Delivered in [0.004478528] seconds [----] I, [2016-09-13T08:56:50.661151 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:56:50.677744 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78747], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:56:56.452117 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:56:56.457535 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00725555419921875, :worker_monitor=>2.0112695693969727, :worker_dequeue=>0.009828567504882812, :total_time=>2.0288918018341064} [----] I, [2016-09-13T08:56:56.770398 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78747], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.104192114] seconds [----] I, [2016-09-13T08:56:56.770669 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78747], Delivering... [----] I, [2016-09-13T08:56:56.777830 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037488937377929688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037772655487060547, :pending_vm_jobs=>0.0009148120880126953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0067365169525146484} [----] I, [2016-09-13T08:56:56.778236 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78747], State: [ok], Delivered in [0.007558195] seconds [----] I, [2016-09-13T08:57:01.458384 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:57:01 UTC]... [----] I, [2016-09-13T08:57:01.484699 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:57:01 UTC]...Complete [----] I, [2016-09-13T08:57:05.688111 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:57:05.702156 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78748], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:57:05.731628 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78749], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:57:05.753472 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78750], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:57:05.782400 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78751], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:57:06.517859 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:57:07.234806 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78748], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.542679134] seconds [----] I, [2016-09-13T08:57:07.235052 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78748], Delivering... [----] I, [2016-09-13T08:57:07.261938 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78751], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.503640348] seconds [----] I, [2016-09-13T08:57:07.262105 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78751], Delivering... [----] I, [2016-09-13T08:57:07.267027 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027055740356445312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002721071243286133, :pending_vm_jobs=>0.0006268024444580078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004629373550415039} [----] I, [2016-09-13T08:57:07.267317 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78751], State: [ok], Delivered in [0.005214539] seconds [----] I, [2016-09-13T08:57:07.319512 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78748], State: [ok], Delivered in [0.08437308] seconds [----] I, [2016-09-13T08:57:08.833660 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78749], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.126820345] seconds [----] I, [2016-09-13T08:57:08.833864 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78749], Delivering... [----] I, [2016-09-13T08:57:08.837246 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78749], State: [ok], Delivered in [0.003372299] seconds [----] I, [2016-09-13T08:57:08.844833 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78750], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.107070894] seconds [----] I, [2016-09-13T08:57:08.844984 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78750], Delivering... [----] I, [2016-09-13T08:57:08.849033 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78750], State: [ok], Delivered in [0.004047093] seconds [----] I, [2016-09-13T08:57:13.033471 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003969907760620117, :worker_monitor=>1.4843478202819824, :worker_dequeue=>0.01938939094543457, :total_time=>1.5081307888031006} [----] I, [2016-09-13T08:57:20.796944 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:57:20.816491 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78752], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:57:23.056220 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:57:23.404885 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78752], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.601481042] seconds [----] I, [2016-09-13T08:57:23.405027 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78752], Delivering... [----] I, [2016-09-13T08:57:23.409216 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022993087768554688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002312898635864258, :pending_vm_jobs=>0.0004925727844238281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0039327144622802734} [----] I, [2016-09-13T08:57:23.409501 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78752], State: [ok], Delivered in [0.004471948] seconds [----] I, [2016-09-13T08:57:29.746989 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004019260406494141, :worker_monitor=>1.6646838188171387, :worker_dequeue=>0.013731241226196289, :total_time=>1.6827447414398193} [----] I, [2016-09-13T08:57:34.747765 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:57:34 UTC]... [----] I, [2016-09-13T08:57:34.771909 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:57:34 UTC]...Complete [----] I, [2016-09-13T08:57:35.830051 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:57:35.849530 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78753], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:57:35.884089 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78754], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:57:39.890310 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:57:40.598965 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78754], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.743698756] seconds [----] I, [2016-09-13T08:57:40.599107 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78754], Delivering... [----] I, [2016-09-13T08:57:40.603183 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022428035736083984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002256631851196289, :pending_vm_jobs=>0.00048351287841796875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038340091705322266} [----] I, [2016-09-13T08:57:40.603451 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78754], State: [ok], Delivered in [0.004319879] seconds [----] I, [2016-09-13T08:57:41.975187 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78753], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.140481382] seconds [----] I, [2016-09-13T08:57:41.975319 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78753], Delivering... [----] I, [2016-09-13T08:57:41.978873 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78753], State: [ok], Delivered in [0.003533907] seconds [----] I, [2016-09-13T08:57:47.539121 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004054546356201172, :worker_monitor=>2.6282882690429688, :worker_dequeue=>0.012152910232543945, :total_time=>2.6448144912719727} [----] I, [2016-09-13T08:57:50.901524 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:57:50.930561 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78755], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:57:52.548958 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:57:52.673244 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78755], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.765757155] seconds [----] I, [2016-09-13T08:57:52.673367 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78755], Delivering... [----] I, [2016-09-13T08:57:52.676973 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0019960403442382812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002007722854614258, :pending_vm_jobs=>0.00041556358337402344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003360271453857422} [----] I, [2016-09-13T08:57:52.677180 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78755], State: [ok], Delivered in [0.003811242] seconds [----] I, [2016-09-13T08:58:04.340941 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004183053970336914, :worker_monitor=>1.7594003677368164, :worker_dequeue=>0.011775493621826172, :total_time=>1.7756774425506592} [----] I, [2016-09-13T08:58:05.945764 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:58:05.959927 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78756], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:58:05.976993 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78757], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:58:06.011484 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78758], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:58:06.028392 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78759], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:58:09.341559 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:58:09 UTC]... [----] I, [2016-09-13T08:58:09.359813 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:58:09 UTC]...Complete [----] I, [2016-09-13T08:58:09.374326 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:58:09.805851 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78756], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.856540445] seconds [----] I, [2016-09-13T08:58:09.806040 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78756], Delivering... [----] I, [2016-09-13T08:58:09.863103 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78756], State: [ok], Delivered in [0.057030191] seconds [----] I, [2016-09-13T08:58:09.914320 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78759], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.896590446] seconds [----] I, [2016-09-13T08:58:09.914483 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78759], Delivering... [----] I, [2016-09-13T08:58:09.919057 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002433300018310547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002447843551635742, :pending_vm_jobs=>0.0005815029144287109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0042552947998046875} [----] I, [2016-09-13T08:58:09.919360 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78759], State: [ok], Delivered in [0.004876634] seconds [----] I, [2016-09-13T08:58:12.097319 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78757], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.13317953] seconds [----] I, [2016-09-13T08:58:12.097610 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78757], Delivering... [----] I, [2016-09-13T08:58:12.101132 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78757], State: [ok], Delivered in [0.003556576] seconds [----] I, [2016-09-13T08:58:12.143230 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78758], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.160218703] seconds [----] I, [2016-09-13T08:58:12.143460 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78758], Delivering... [----] I, [2016-09-13T08:58:12.148361 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78758], State: [ok], Delivered in [0.004920694] seconds [----] I, [2016-09-13T08:58:21.042054 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:58:21.068949 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78760], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:58:21.114374 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78761], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:58:21.279507 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:58:21.283546 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004015684127807617, :worker_monitor=>1.8707597255706787, :worker_dequeue=>0.0072896480560302734, :total_time=>1.88236665725708} [----] I, [2016-09-13T08:58:22.022956 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78760], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.972426226] seconds [----] I, [2016-09-13T08:58:22.023104 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78760], Delivering... [----] I, [2016-09-13T08:58:22.028356 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002855062484741211, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028717517852783203, :pending_vm_jobs=>0.0006606578826904297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004935503005981445} [----] I, [2016-09-13T08:58:22.028690 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78760], State: [ok], Delivered in [0.005560531] seconds [----] I, [2016-09-13T08:58:24.166219 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78761], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.093117778] seconds [----] I, [2016-09-13T08:58:24.166410 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78761], Delivering... [----] I, [2016-09-13T08:58:24.171352 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78761], State: [ok], Delivered in [0.004923307] seconds [----] I, [2016-09-13T08:58:36.126552 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:58:36.160412 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78762], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:58:36.188616 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78763], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:58:36.206071 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78764], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:58:37.934340 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:58:37.940112 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004319667816162109, :server_monitor=>0.10043001174926758, :worker_monitor=>1.51230788230896, :worker_dequeue=>0.010391712188720703, :total_time=>1.6278107166290283} [----] I, [2016-09-13T08:58:38.161505 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78762], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.028894633] seconds [----] I, [2016-09-13T08:58:38.161714 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78762], Delivering... [----] I, [2016-09-13T08:58:38.167228 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78763], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.00220863] seconds [----] I, [2016-09-13T08:58:38.167526 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78763], Delivering... [----] I, [2016-09-13T08:58:38.168059 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003358125686645508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003377676010131836, :pending_vm_jobs=>0.0007741451263427734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00599217414855957} [----] I, [2016-09-13T08:58:38.168376 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78762], State: [ok], Delivered in [0.006656862] seconds [----] I, [2016-09-13T08:58:38.168914 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T08:58:38.169222 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5367689216 [----] I, [2016-09-13T08:58:38.169403 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5139668992 [----] I, [2016-09-13T08:58:38.169604 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 228020224 [----] I, [2016-09-13T08:58:38.169696 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T08:58:38.169771 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5085634560 [----] I, [2016-09-13T08:58:38.169840 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T08:58:38.169909 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T08:58:38.169979 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 549650432 [----] I, [2016-09-13T08:58:38.170098 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T08:58:38.170241 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7981473792 [----] I, [2016-09-13T08:58:38.170374 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T08:58:38.170564 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T08:58:38.170725 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T08:58:38.170865 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 16384 [----] I, [2016-09-13T08:58:38.171001 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T08:58:38.171126 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T08:58:38.171252 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T08:58:38.171383 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T08:58:38.171594 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T08:58:38.171745 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T08:58:38.171880 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273817600 [----] I, [2016-09-13T08:58:38.172014 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57012224 [----] I, [2016-09-13T08:58:38.172150 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216805376 [----] I, [2016-09-13T08:58:38.172282 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6160384 [----] I, [2016-09-13T08:58:38.172446 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141062144 [----] I, [2016-09-13T08:58:38.172634 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2582011904 [----] I, [2016-09-13T08:58:38.172798 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2259017728 [----] I, [2016-09-13T08:58:38.172937 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T08:58:38.173061 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T08:58:38.173181 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T08:58:38.173303 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37212160 [----] I, [2016-09-13T08:58:38.173450 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T08:58:38.173621 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53170176 [----] I, [2016-09-13T08:58:38.173768 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111046656 [----] I, [2016-09-13T08:58:38.173918 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155467776 [----] I, [2016-09-13T08:58:38.174043 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T08:58:38.174169 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T08:58:38.174294 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T08:58:38.174406 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T08:58:38.174614 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T08:58:38.174761 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T08:58:38.174900 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T08:58:38.175032 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 8192 [----] I, [2016-09-13T08:58:38.175167 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T08:58:38.218609 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T08:58:38.218792 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T08:58:38.221951 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T08:58:38.224247 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T08:58:38.227890 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T08:58:38.231291 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T08:58:38.234068 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T08:58:38.236822 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 848 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T08:58:38.239439 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T08:58:38.242475 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T08:58:38.245028 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.7 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T08:58:38.247654 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T08:58:38.250273 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 174 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T08:58:38.252867 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T08:58:38.255266 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:58:38.255399 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T08:58:38.255529 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T08:58:38.259345 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152576.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:58:38.259735 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78763], State: [ok], Delivered in [0.092217374] seconds [----] I, [2016-09-13T08:58:42.940676 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:58:42 UTC]... [----] I, [2016-09-13T08:58:42.966497 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:58:42 UTC]...Complete [----] I, [2016-09-13T08:58:42.978070 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:58:43.246860 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78764], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.054540683] seconds [----] I, [2016-09-13T08:58:43.247057 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78764], Delivering... [----] I, [2016-09-13T08:58:43.255955 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:58:36 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205295000], Memory % [3.5], CPU Time [241649.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T08:58:43.256455 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:58:29 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347151000], Memory % [5.04], CPU Time [104674.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T08:58:43.257013 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:58:37 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152584.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:58:43.257454 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:58:37 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212543000], Memory % [3.5], CPU Time [49091.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T08:58:43.257986 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:58:37 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162421000], Memory % [3.1], CPU Time [38243.0], CPU % [0.08], Priority [27] [----] I, [2016-09-13T08:58:43.258535 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:58:37 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [151659.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T08:58:43.259075 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:58:36 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358685000], Memory % [5.28], CPU Time [203336.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T08:58:43.259626 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:58:37 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169070000], Memory % [3.14], CPU Time [51901.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:58:43.262784 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:58:35 UTC], Process Info: Memory Usage [598245376], Memory Size [927567872], Proportional Set Size: [430792000], Memory % [7.29], CPU Time [580.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:58:43.265020 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:58:27 UTC], Process Info: Memory Usage [609308672], Memory Size [1064882176], Proportional Set Size: [441939000], Memory % [7.43], CPU Time [1467.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T08:58:43.267238 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:58:33 UTC], Process Info: Memory Usage [557576192], Memory Size [894418944], Proportional Set Size: [405307000], Memory % [6.8], CPU Time [5973.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T08:58:43.269316 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:58:35 UTC], Process Info: Memory Usage [579928064], Memory Size [907526144], Proportional Set Size: [419568000], Memory % [7.07], CPU Time [2551.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T08:58:43.269883 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:58:36 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [212163.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T08:58:43.270373 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:58:34 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177794000], Memory % [3.2], CPU Time [51914.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T08:58:43.270853 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 12:58:32 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165809000], Memory % [3.16], CPU Time [39137.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T08:58:43.271188 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78764], State: [ok], Delivered in [0.024124134] seconds [----] I, [2016-09-13T08:58:51.216093 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:58:51.235381 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78765], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:58:51.286875 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78766], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:58:51.338359 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78767], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:58:51.372277 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78768], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:58:54.634682 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:58:54.642650 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004189491271972656, :worker_monitor=>1.6096534729003906, :worker_dequeue=>0.014429330825805664, :total_time=>1.6285881996154785} [----] I, [2016-09-13T08:58:55.412713 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78765], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.190525168] seconds [----] I, [2016-09-13T08:58:55.412909 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78765], Delivering... [----] I, [2016-09-13T08:58:55.419459 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003440380096435547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003459930419921875, :pending_vm_jobs=>0.0008280277252197266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006135225296020508} [----] I, [2016-09-13T08:58:55.419856 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78765], State: [ok], Delivered in [0.006931757] seconds [----] I, [2016-09-13T08:58:55.430034 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78766], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.190546811] seconds [----] I, [2016-09-13T08:58:55.430231 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78766], Delivering... [----] I, [2016-09-13T08:58:55.469520 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78766], State: [ok], Delivered in [0.039274439] seconds [----] I, [2016-09-13T08:58:57.304209 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78767], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.010234585] seconds [----] I, [2016-09-13T08:58:57.304456 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78767], Delivering... [----] I, [2016-09-13T08:58:57.308175 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78767], State: [ok], Delivered in [0.003713544] seconds [----] I, [2016-09-13T08:58:57.321186 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78768], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.972327027] seconds [----] I, [2016-09-13T08:58:57.321392 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78768], Delivering... [----] I, [2016-09-13T08:58:57.326407 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78768], State: [ok], Delivered in [0.005007531] seconds [----] I, [2016-09-13T08:59:06.387321 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:59:06.417555 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78769], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:59:11.626321 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:59:11.632985 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037114620208740234, :worker_monitor=>1.9450962543487549, :worker_dequeue=>0.01175236701965332, :total_time=>1.9608583450317383} [----] I, [2016-09-13T08:59:12.366144 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78769], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.969541115] seconds [----] I, [2016-09-13T08:59:12.366337 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78769], Delivering... [----] I, [2016-09-13T08:59:12.373636 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036690235137939453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036878585815429688, :pending_vm_jobs=>0.0008504390716552734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0067484378814697266} [----] I, [2016-09-13T08:59:12.374110 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78769], State: [ok], Delivered in [0.007739365] seconds [----] I, [2016-09-13T08:59:16.633590 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:59:16 UTC]... [----] I, [2016-09-13T08:59:16.658654 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:59:16 UTC]...Complete [----] I, [2016-09-13T08:59:21.432855 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T08:59:21.451490 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78770], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:59:21.468841 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78771], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:59:21.685256 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T08:59:21.687972 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:59:22.611954 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78770], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.175632529] seconds [----] I, [2016-09-13T08:59:22.612131 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78770], Delivering... [----] I, [2016-09-13T08:59:22.618491 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034220218658447266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034410953521728516, :pending_vm_jobs=>0.0007953643798828125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005991935729980469} [----] I, [2016-09-13T08:59:22.618896 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78770], State: [ok], Delivered in [0.006727264] seconds [----] I, [2016-09-13T08:59:24.406149 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78771], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.952144195] seconds [----] I, [2016-09-13T08:59:24.406330 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78771], Delivering... [----] I, [2016-09-13T08:59:24.410823 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78771], State: [ok], Delivered in [0.00447381] seconds [----] I, [2016-09-13T08:59:28.157901 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030062198638916016, :worker_monitor=>1.4515316486358643, :worker_dequeue=>0.011574506759643555, :total_time=>1.466362714767456} [----] I, [2016-09-13T08:59:36.479948 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T08:59:36.503284 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78772], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:59:38.280629 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:59:38.760339 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78772], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.275771657] seconds [----] I, [2016-09-13T08:59:38.760473 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78772], Delivering... [----] I, [2016-09-13T08:59:38.764051 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00199127197265625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002003192901611328, :pending_vm_jobs=>0.0004057884216308594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0033469200134277344} [----] I, [2016-09-13T08:59:38.764289 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78772], State: [ok], Delivered in [0.00381435] seconds [----] I, [2016-09-13T08:59:44.923146 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007059812545776367, :worker_monitor=>1.613102912902832, :worker_dequeue=>0.014859437942504883, :total_time=>1.6354706287384033} [----] I, [2016-09-13T08:59:49.923790 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:59:49 UTC]... [----] I, [2016-09-13T08:59:49.949381 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 12:59:49 UTC]...Complete [----] I, [2016-09-13T08:59:51.518555 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T08:59:51.537871 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78773], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:59:51.566958 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78774], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:59:51.589321 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78775], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:59:51.611989 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78776], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T08:59:54.989122 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T08:59:55.899536 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78773], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.373426721] seconds [----] I, [2016-09-13T08:59:55.899775 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78773], Delivering... [----] I, [2016-09-13T08:59:55.906280 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003465890884399414, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034847259521484375, :pending_vm_jobs=>0.0007846355438232422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006116151809692383} [----] I, [2016-09-13T08:59:55.906623 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78773], State: [ok], Delivered in [0.006848842] seconds [----] I, [2016-09-13T08:59:55.916505 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78774], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.373288375] seconds [----] I, [2016-09-13T08:59:55.916734 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78774], Delivering... [----] I, [2016-09-13T08:59:55.979374 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78774], State: [ok], Delivered in [0.062616973] seconds [----] I, [2016-09-13T08:59:57.542002 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78775], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.9654924] seconds [----] I, [2016-09-13T08:59:57.542218 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78775], Delivering... [----] I, [2016-09-13T08:59:57.545642 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78775], State: [ok], Delivered in [0.003426325] seconds [----] I, [2016-09-13T08:59:57.550828 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78776], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.952437596] seconds [----] I, [2016-09-13T08:59:57.551023 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78776], Delivering... [----] I, [2016-09-13T08:59:57.555980 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78776], State: [ok], Delivered in [0.004951693] seconds [----] I, [2016-09-13T09:00:01.491173 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0034637451171875, :worker_monitor=>1.4839286804199219, :worker_dequeue=>0.007491588592529297, :total_time=>1.495147943496704} [----] I, [2016-09-13T09:00:06.624360 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T09:00:06.658631 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78777], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:00:06.675538 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78778], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:00:06.693188 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78779], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:00:06.721361 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78780], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:00:06.723176 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget] [----] I, [2016-09-13T09:00:06.744938 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78781], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473775200] [----] I, [2016-09-13T09:00:06.745183 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T09:00:06.747715 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget] [----] I, [2016-09-13T09:00:06.761861 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78782], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473775200] [----] I, [2016-09-13T09:00:06.762088 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T09:00:11.513586 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:00:12.070493 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78777], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.440604345] seconds [----] I, [2016-09-13T09:00:12.070702 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78777], Delivering... [----] I, [2016-09-13T09:00:12.076403 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031223297119140625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031404495239257812, :pending_vm_jobs=>0.0008034706115722656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0053958892822265625} [----] I, [2016-09-13T09:00:12.076733 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78777], State: [ok], Delivered in [0.006070597] seconds [----] I, [2016-09-13T09:00:12.687609 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78778], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.02367264] seconds [----] I, [2016-09-13T09:00:12.687813 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78778], Delivering... [----] I, [2016-09-13T09:00:12.690452 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78778], State: [ok], Delivered in [0.002612989] seconds [----] I, [2016-09-13T09:00:12.716129 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78779], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.035345936] seconds [----] I, [2016-09-13T09:00:12.716304 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78779], Delivering... [----] I, [2016-09-13T09:00:12.729680 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78779], State: [ok], Delivered in [0.013343303] seconds [----] I, [2016-09-13T09:00:12.898784 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78780], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.193366227] seconds [----] I, [2016-09-13T09:00:12.898971 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78780], Delivering... [----] I, [2016-09-13T09:00:12.904888 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78780], State: [ok], Delivered in [0.005903671] seconds [----] I, [2016-09-13T09:00:12.927955 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78781], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473775200], Dequeued in: [6.202554056] seconds [----] I, [2016-09-13T09:00:12.928135 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78781], Delivering... [----] I, [2016-09-13T09:00:12.937921 #2928:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered Hosts] invoking action: [generate_widget] for target: [rss_newest_hosts] [----] I, [2016-09-13T09:00:12.951759 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78782], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473775200], Dequeued in: [6.201760179] seconds [----] I, [2016-09-13T09:00:12.951944 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78782], Delivering... [----] I, [2016-09-13T09:00:12.961281 #2937:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered VMs] invoking action: [generate_widget] for target: [rss_newest_vms] [----] I, [2016-09-13T09:00:12.984269 #2928:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [219], Name: [Generate Widget: 'EVM: Recently Discovered Hosts'] for: [1] groups [----] I, [2016-09-13T09:00:13.001382 #2937:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [220], Name: [Generate Widget: 'EVM: Recently Discovered VMs'] for: [1] groups [----] I, [2016-09-13T09:00:13.030241 #2928:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered Hosts] ID: [18] Queueing Content Generation [----] I, [2016-09-13T09:00:13.082822 #2937:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered VMs] ID: [19] Queueing Content Generation [----] I, [2016-09-13T09:00:13.146191 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78783], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T09:00:13.146478 #2928:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered Hosts] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered Hosts] [----] I, [2016-09-13T09:00:13.156790 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78784], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T09:00:13.157032 #2937:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered VMs] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered VMs] [----] I, [2016-09-13T09:00:13.179517 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78781], State: [ok], Delivered in [0.251313318] seconds [----] I, [2016-09-13T09:00:13.191257 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78782], State: [ok], Delivered in [0.239278849] seconds [----] I, [2016-09-13T09:00:17.541641 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=reporting, wcount=2, priority=200 [----] I, [2016-09-13T09:00:17.544762 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0027399063110351562, :worker_monitor=>1.0162465572357178, :worker_dequeue=>0.008317232131958008, :total_time=>1.0275144577026367} [----] I, [2016-09-13T09:00:19.324268 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [78783], MiqWorker id: [18], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [6.287146274] seconds [----] I, [2016-09-13T09:00:19.324550 #2978:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78783], Delivering... [----] I, [2016-09-13T09:00:19.352993 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T09:00:19.408054 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T09:00:19.408730 #2978:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78783], State: [ok], Delivered in [0.084171396] seconds [----] I, [2016-09-13T09:00:19.412969 #2978:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [78783], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T09:00:19.413246 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [18], MiqTask ID: [219], Status: [ok] [----] I, [2016-09-13T09:00:19.422299 #2978:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [219] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T09:00:19.488477 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [78784], MiqWorker id: [18], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [6.39776342] seconds [----] I, [2016-09-13T09:00:19.488705 #2978:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78784], Delivering... [----] I, [2016-09-13T09:00:19.523398 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T09:00:19.573747 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T09:00:19.574347 #2978:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78784], State: [ok], Delivered in [0.085613011] seconds [----] I, [2016-09-13T09:00:19.578280 #2978:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [78784], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T09:00:19.578603 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [19], MiqTask ID: [220], Status: [ok] [----] I, [2016-09-13T09:00:19.587191 #2978:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [220] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T09:00:21.778525 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:00:21.803387 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78785], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:00:21.836334 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78786], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:00:21.843784 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered Hosts] with id: [18] [----] I, [2016-09-13T09:00:21.844033 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_18 [----] I, [2016-09-13T09:00:21.849193 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T09:00:21.849937 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 14:00:00 UTC [----] I, [2016-09-13T09:00:21.852583 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered Hosts] schedule updated to run at 2016-09-13 14:00:00 UTC with interval 3600 [----] I, [2016-09-13T09:00:21.853163 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered VMs] with id: [19] [----] I, [2016-09-13T09:00:21.853357 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_19 [----] I, [2016-09-13T09:00:21.857624 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T09:00:21.857976 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 14:00:00 UTC [----] I, [2016-09-13T09:00:21.859618 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered VMs] schedule updated to run at 2016-09-13 14:00:00 UTC with interval 3600 [----] I, [2016-09-13T09:00:22.545272 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:00:22 UTC]... [----] I, [2016-09-13T09:00:22.567622 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:00:22 UTC]...Complete [----] I, [2016-09-13T09:00:22.581314 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:00:23.197266 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78785], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.411269723] seconds [----] I, [2016-09-13T09:00:23.197603 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78785], Delivering... [----] I, [2016-09-13T09:00:23.209556 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00653076171875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0065805912017822266, :pending_vm_jobs=>0.0014638900756835938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.01134490966796875} [----] I, [2016-09-13T09:00:23.210129 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78785], State: [ok], Delivered in [0.012571545] seconds [----] I, [2016-09-13T09:00:25.265142 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78786], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.458586241] seconds [----] I, [2016-09-13T09:00:25.265294 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78786], Delivering... [----] I, [2016-09-13T09:00:25.268926 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78786], State: [ok], Delivered in [0.003620186] seconds [----] I, [2016-09-13T09:00:34.095623 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0026712417602539062, :worker_monitor=>1.4708807468414307, :worker_dequeue=>0.012756824493408203, :total_time=>1.4865977764129639} [----] I, [2016-09-13T09:00:36.863685 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:00:36.883224 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78787], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:00:39.209007 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:00:39.283922 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78787], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.414879881] seconds [----] I, [2016-09-13T09:00:39.284225 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78787], Delivering... [----] I, [2016-09-13T09:00:39.291910 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004285335540771484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0043087005615234375, :pending_vm_jobs=>0.0008456707000732422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007151126861572266} [----] I, [2016-09-13T09:00:39.292289 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78787], State: [ok], Delivered in [0.008103974] seconds [----] I, [2016-09-13T09:00:50.559273 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037775039672851562, :worker_monitor=>1.3137626647949219, :worker_dequeue=>0.0062580108642578125, :total_time=>1.3240525722503662} [----] I, [2016-09-13T09:00:52.152154 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:00:52.174689 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78788], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:00:52.192090 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78789], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:00:52.208908 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78790], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:00:52.225757 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78791], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:00:55.559711 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:00:55 UTC]... [----] I, [2016-09-13T09:00:55.574553 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:00:55 UTC]...Complete [----] I, [2016-09-13T09:00:55.582493 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:00:56.472341 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78788], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.311603092] seconds [----] I, [2016-09-13T09:00:56.472600 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78788], Delivering... [----] I, [2016-09-13T09:00:56.478938 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032808780670166016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003300189971923828, :pending_vm_jobs=>0.0007989406585693359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005955934524536133} [----] I, [2016-09-13T09:00:56.479315 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78788], State: [ok], Delivered in [0.006732433] seconds [----] I, [2016-09-13T09:00:56.495196 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78789], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.316869275] seconds [----] I, [2016-09-13T09:00:56.495394 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78789], Delivering... [----] I, [2016-09-13T09:00:56.557836 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78789], State: [ok], Delivered in [0.062415707] seconds [----] I, [2016-09-13T09:00:58.380765 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78790], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.183856818] seconds [----] I, [2016-09-13T09:00:58.380968 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78790], Delivering... [----] I, [2016-09-13T09:00:58.388821 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78790], State: [ok], Delivered in [0.007819711] seconds [----] I, [2016-09-13T09:00:58.426583 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78791], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.211036977] seconds [----] I, [2016-09-13T09:00:58.426765 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78791], Delivering... [----] I, [2016-09-13T09:00:58.431557 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78791], State: [ok], Delivered in [0.004776991] seconds [----] I, [2016-09-13T09:01:07.236303 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:01:07.265767 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78792], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:01:07.317301 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78793], id: [], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:01:07.380863 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:01:07.385676 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00415492057800293, :worker_monitor=>1.7655034065246582, :worker_dequeue=>0.008968353271484375, :total_time=>1.7789068222045898} [----] I, [2016-09-13T09:01:07.523124 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78792], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.280272663] seconds [----] I, [2016-09-13T09:01:07.523288 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78792], Delivering... [----] I, [2016-09-13T09:01:07.528609 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028274059295654297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028722286224365234, :pending_vm_jobs=>0.0006380081176757812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0049495697021484375} [----] I, [2016-09-13T09:01:07.528953 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78792], State: [ok], Delivered in [0.00564879] seconds [----] I, [2016-09-13T09:01:07.568411 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78793], MiqWorker id: [14], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.283652618] seconds [----] I, [2016-09-13T09:01:07.568585 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78793], Delivering... [----] I, [2016-09-13T09:01:22.331729 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:01:22.408301 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78794], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:01:22.477962 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78795], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:01:24.661701 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:01:24.667601 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004881858825683594, :worker_monitor=>2.231149673461914, :worker_dequeue=>0.010254859924316406, :total_time=>2.2465922832489014} [----] I, [2016-09-13T09:01:24.748045 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78794], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.410215538] seconds [----] I, [2016-09-13T09:01:24.748216 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78794], Delivering... [----] I, [2016-09-13T09:01:24.753763 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003033161163330078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003051280975341797, :pending_vm_jobs=>0.0006167888641357422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005170345306396484} [----] I, [2016-09-13T09:01:24.754071 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78794], State: [ok], Delivered in [0.005854187] seconds [----] I, [2016-09-13T09:01:25.857142 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78795], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.444882926] seconds [----] I, [2016-09-13T09:01:25.857340 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78795], Delivering... [----] I, [2016-09-13T09:01:25.862910 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78795], State: [ok], Delivered in [0.005543291] seconds [----] I, [2016-09-13T09:01:29.668074 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:01:29 UTC]... [----] I, [2016-09-13T09:01:29.802878 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:01:29 UTC]...Complete [----] I, [2016-09-13T09:01:37.489534 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:01:37.583888 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78796], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:01:42.059779 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:01:42.067091 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003766775131225586, :server_monitor=>0.13739824295043945, :worker_monitor=>2.0586016178131104, :worker_dequeue=>0.015014886856079102, :total_time=>2.215135335922241} [----] I, [2016-09-13T09:01:43.066025 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78796], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.569751008] seconds [----] I, [2016-09-13T09:01:43.066191 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78796], Delivering... [----] I, [2016-09-13T09:01:43.071853 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027074813842773438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027251243591308594, :pending_vm_jobs=>0.0006368160247802734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005269765853881836} [----] I, [2016-09-13T09:01:43.072241 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78796], State: [ok], Delivered in [0.006023155] seconds [----] I, [2016-09-13T09:01:52.594193 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:01:52.623573 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78797], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:01:52.663523 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78798], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:01:52.717914 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78799], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:01:52.760381 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78800], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:02:00.464902 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:02:00.470679 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006054401397705078, :worker_monitor=>3.3536815643310547, :worker_dequeue=>0.010730981826782227, :total_time=>3.370865821838379} [----] I, [2016-09-13T09:02:01.072861 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78797], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.473239829] seconds [----] I, [2016-09-13T09:02:01.073100 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78797], Delivering... [----] I, [2016-09-13T09:02:01.080925 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038802623748779297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00390934944152832, :pending_vm_jobs=>0.0013844966888427734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007398366928100586} [----] I, [2016-09-13T09:02:01.081486 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78797], State: [ok], Delivered in [0.008361413] seconds [----] I, [2016-09-13T09:02:01.272089 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78798], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.644760046] seconds [----] I, [2016-09-13T09:02:01.272366 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78798], Delivering... [----] I, [2016-09-13T09:02:01.352883 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78798], State: [ok], Delivered in [0.080505535] seconds [----] I, [2016-09-13T09:02:02.090974 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78799], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [9.422798901] seconds [----] I, [2016-09-13T09:02:02.091133 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78799], Delivering... [----] I, [2016-09-13T09:02:02.093749 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78799], State: [ok], Delivered in [0.00261208] seconds [----] I, [2016-09-13T09:02:02.191898 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78800], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [9.466724811] seconds [----] I, [2016-09-13T09:02:02.192046 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78800], Delivering... [----] I, [2016-09-13T09:02:02.195182 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78800], State: [ok], Delivered in [0.003132645] seconds [----] I, [2016-09-13T09:02:05.471128 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:02:05 UTC]... [----] I, [2016-09-13T09:02:05.612037 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:02:05 UTC]...Complete [----] I, [2016-09-13T09:02:07.772890 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:02:07.857407 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78801], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:02:10.638353 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:02:11.312314 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78801], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.532950745] seconds [----] I, [2016-09-13T09:02:11.312660 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78801], Delivering... [----] I, [2016-09-13T09:02:11.321347 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005215644836425781, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005244731903076172, :pending_vm_jobs=>0.0009055137634277344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008169174194335938} [----] I, [2016-09-13T09:02:11.321758 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78801], State: [ok], Delivered in [0.009124821] seconds [----] I, [2016-09-13T09:02:18.461730 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003957033157348633, :worker_monitor=>2.7919089794158936, :worker_dequeue=>0.02079296112060547, :total_time=>2.8169686794281006} [----] I, [2016-09-13T09:02:22.866976 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:02:23.048929 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78802], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:02:23.080851 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78803], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:02:23.475330 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:02:23.567804 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78802], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.695106573] seconds [----] I, [2016-09-13T09:02:23.568179 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78802], Delivering... [----] I, [2016-09-13T09:02:23.582622 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0074803829193115234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.007524013519287109, :pending_vm_jobs=>0.0019054412841796875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.013639211654663086} [----] I, [2016-09-13T09:02:23.583352 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78802], State: [ok], Delivered in [0.01515887] seconds [----] I, [2016-09-13T09:02:26.356225 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78803], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.302984673] seconds [----] I, [2016-09-13T09:02:26.356536 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78803], Delivering... [----] I, [2016-09-13T09:02:26.363398 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78803], State: [ok], Delivered in [0.006855102] seconds [----] I, [2016-09-13T09:02:35.351029 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030486583709716797, :worker_monitor=>1.827826738357544, :worker_dequeue=>0.016745567321777344, :total_time=>1.8478691577911377} [----] I, [2016-09-13T09:02:38.095819 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:02:38.124680 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78804], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:02:40.351703 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:02:40 UTC]... [----] I, [2016-09-13T09:02:40.374396 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:02:40 UTC]...Complete [----] I, [2016-09-13T09:02:40.459809 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:02:40.645198 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78804], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.540818316] seconds [----] I, [2016-09-13T09:02:40.645365 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78804], Delivering... [----] I, [2016-09-13T09:02:40.650297 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027093887329101562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002728700637817383, :pending_vm_jobs=>0.0005967617034912109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004616975784301758} [----] I, [2016-09-13T09:02:40.650629 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78804], State: [ok], Delivered in [0.005250058] seconds [----] I, [2016-09-13T09:02:53.145341 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:02:53.253035 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78805], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:02:53.259690 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:02:53.263240 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005964517593383789, :worker_monitor=>2.757747173309326, :worker_dequeue=>0.006367683410644531, :total_time=>2.7704620361328125} [----] I, [2016-09-13T09:02:53.316086 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78806], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:02:53.376110 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78807], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:02:53.433505 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78808], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:02:53.559508 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78805], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.408094482] seconds [----] I, [2016-09-13T09:02:53.559825 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78805], Delivering... [----] I, [2016-09-13T09:02:53.569721 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0050275325775146484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005053281784057617, :pending_vm_jobs=>0.0012884140014648438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009260177612304688} [----] I, [2016-09-13T09:02:53.570191 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78805], State: [ok], Delivered in [0.01038228] seconds [----] I, [2016-09-13T09:02:55.660511 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78793], State: [ok], Delivered in [108.091857434] seconds [----] I, [2016-09-13T09:02:58.272776 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:02:58.774808 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78806], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.517536592] seconds [----] I, [2016-09-13T09:02:58.775089 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78806], Delivering... [----] I, [2016-09-13T09:02:58.842918 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78806], State: [ok], Delivered in [0.067823689] seconds [----] I, [2016-09-13T09:02:58.894338 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78807], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.57252331] seconds [----] I, [2016-09-13T09:02:58.894544 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78807], Delivering... [----] I, [2016-09-13T09:02:58.898129 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78807], State: [ok], Delivered in [0.003546917] seconds [----] I, [2016-09-13T09:02:58.959225 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78808], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.575599246] seconds [----] I, [2016-09-13T09:02:58.959405 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78808], Delivering... [----] I, [2016-09-13T09:02:58.964087 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78808], State: [ok], Delivered in [0.00465037] seconds [----] I, [2016-09-13T09:03:08.449086 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:03:08.478958 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78809], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:03:10.086077 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:03:10.089994 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005597829818725586, :worker_monitor=>1.7820367813110352, :worker_dequeue=>0.00699925422668457, :total_time=>1.7950553894042969} [----] I, [2016-09-13T09:03:10.966368 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78809], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.509673697] seconds [----] I, [2016-09-13T09:03:10.966564 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78809], Delivering... [----] I, [2016-09-13T09:03:10.971319 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025691986083984375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002584695816040039, :pending_vm_jobs=>0.0005884170532226562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0044481754302978516} [----] I, [2016-09-13T09:03:10.971634 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78809], State: [ok], Delivered in [0.005076453] seconds [----] I, [2016-09-13T09:03:15.090598 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:03:15 UTC]... [----] I, [2016-09-13T09:03:15.117106 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:03:15 UTC]...Complete [----] I, [2016-09-13T09:03:23.496481 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:03:23.532319 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78810], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:03:23.568459 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78811], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:03:26.889086 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:03:26.895704 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004189014434814453, :worker_monitor=>1.7215650081634521, :worker_dequeue=>0.011703252792358398, :total_time=>1.7377488613128662} [----] I, [2016-09-13T09:03:27.098138 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78810], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.594796643] seconds [----] I, [2016-09-13T09:03:27.098317 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78810], Delivering... [----] I, [2016-09-13T09:03:27.104733 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003297567367553711, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003320932388305664, :pending_vm_jobs=>0.0008099079132080078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060198307037353516} [----] I, [2016-09-13T09:03:27.105108 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78810], State: [ok], Delivered in [0.00678441] seconds [----] I, [2016-09-13T09:03:29.092250 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78811], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.556467136] seconds [----] I, [2016-09-13T09:03:29.092373 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78811], Delivering... [----] I, [2016-09-13T09:03:29.095399 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78811], State: [ok], Delivered in [0.003016814] seconds [----] I, [2016-09-13T09:03:38.578288 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:03:38.595179 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78812], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:03:38.606620 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78813], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:03:38.680824 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78814], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:03:43.654782 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:03:43.661574 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00370025634765625, :server_monitor=>0.08573365211486816, :worker_monitor=>1.62544846534729, :worker_dequeue=>0.01201772689819336, :total_time=>1.7273571491241455} [----] I, [2016-09-13T09:03:44.166947 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78812], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.583452984] seconds [----] I, [2016-09-13T09:03:44.167161 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78812], Delivering... [----] I, [2016-09-13T09:03:44.176154 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004467487335205078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004494428634643555, :pending_vm_jobs=>0.0012087821960449219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00851750373840332} [----] I, [2016-09-13T09:03:44.176634 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78812], State: [ok], Delivered in [0.009460472] seconds [----] I, [2016-09-13T09:03:44.224059 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78813], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.62503408] seconds [----] I, [2016-09-13T09:03:44.224256 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78813], Delivering... [----] I, [2016-09-13T09:03:44.225309 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T09:03:44.225481 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5357707264 [----] I, [2016-09-13T09:03:44.225565 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5129486336 [----] I, [2016-09-13T09:03:44.225626 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 228220928 [----] I, [2016-09-13T09:03:44.225676 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T09:03:44.225725 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5075476480 [----] I, [2016-09-13T09:03:44.225774 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T09:03:44.225820 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T09:03:44.226024 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 550260736 [----] I, [2016-09-13T09:03:44.226088 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T09:03:44.226134 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7875993600 [----] I, [2016-09-13T09:03:44.226177 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T09:03:44.226220 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T09:03:44.226262 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T09:03:44.226306 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 491520 [----] I, [2016-09-13T09:03:44.226349 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T09:03:44.226394 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T09:03:44.226473 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T09:03:44.226526 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T09:03:44.226588 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T09:03:44.226640 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T09:03:44.226686 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 274227200 [----] I, [2016-09-13T09:03:44.226849 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57217024 [----] I, [2016-09-13T09:03:44.226910 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217010176 [----] I, [2016-09-13T09:03:44.226955 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T09:03:44.226998 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141275136 [----] I, [2016-09-13T09:03:44.227042 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2591940608 [----] I, [2016-09-13T09:03:44.227084 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2268540928 [----] I, [2016-09-13T09:03:44.227127 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T09:03:44.227171 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T09:03:44.227214 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T09:03:44.227256 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37007360 [----] I, [2016-09-13T09:03:44.227299 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T09:03:44.227340 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53039104 [----] I, [2016-09-13T09:03:44.227509 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111251456 [----] I, [2016-09-13T09:03:44.227577 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155336704 [----] I, [2016-09-13T09:03:44.227643 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T09:03:44.227695 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T09:03:44.227743 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T09:03:44.227789 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T09:03:44.227832 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T09:03:44.227876 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T09:03:44.227919 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T09:03:44.227961 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T09:03:44.228003 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T09:03:44.275345 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T09:03:44.275526 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T09:03:44.278266 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T09:03:44.280526 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T09:03:44.282969 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T09:03:44.285222 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T09:03:44.288184 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T09:03:44.290608 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 849 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T09:03:44.293176 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T09:03:44.295715 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T09:03:44.298393 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.7 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T09:03:44.300906 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T09:03:44.303323 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 183 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T09:03:44.305807 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T09:03:44.308103 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:03:44.308208 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:03:44.308282 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T09:03:44.311912 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358685000], Memory % [5.28], CPU Time [204909.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:03:44.312201 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78813], State: [ok], Delivered in [0.087932636] seconds [----] I, [2016-09-13T09:03:48.662101 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:03:48 UTC]... [----] I, [2016-09-13T09:03:48.680893 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:03:48 UTC]...Complete [----] I, [2016-09-13T09:03:48.694705 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:03:49.355439 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78814], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [10.744913237] seconds [----] I, [2016-09-13T09:03:49.355609 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78814], Delivering... [----] I, [2016-09-13T09:03:49.361123 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:03:43 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [151721.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:03:49.361532 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:03:38 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205295000], Memory % [3.5], CPU Time [241811.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T09:03:49.361881 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:03:41 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347151000], Memory % [5.04], CPU Time [104690.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T09:03:49.362209 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:03:43 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152653.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:03:49.362526 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:03:37 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212544000], Memory % [3.5], CPU Time [49099.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T09:03:49.362908 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:03:41 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162422000], Memory % [3.1], CPU Time [38253.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T09:03:49.363269 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:03:41 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358685000], Memory % [5.28], CPU Time [204918.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:03:49.363647 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:03:41 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169070000], Memory % [3.14], CPU Time [51934.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:03:49.365664 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:03:35 UTC], Process Info: Memory Usage [598245376], Memory Size [927567872], Proportional Set Size: [430795000], Memory % [7.29], CPU Time [592.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:03:49.367101 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:03:38 UTC], Process Info: Memory Usage [598417408], Memory Size [928026624], Proportional Set Size: [431304000], Memory % [7.3], CPU Time [1525.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:03:49.368598 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:03:33 UTC], Process Info: Memory Usage [558075904], Memory Size [911114240], Proportional Set Size: [405788000], Memory % [6.8], CPU Time [5986.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T09:03:49.369990 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:03:35 UTC], Process Info: Memory Usage [580157440], Memory Size [922206208], Proportional Set Size: [419792000], Memory % [7.07], CPU Time [2563.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T09:03:49.370338 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:03:41 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [212207.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T09:03:49.370715 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:03:41 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177794000], Memory % [3.2], CPU Time [51931.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:03:49.371025 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:03:32 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165809000], Memory % [3.16], CPU Time [39148.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T09:03:49.371260 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78814], State: [ok], Delivered in [0.015654126] seconds [----] I, [2016-09-13T09:03:53.691304 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:03:53.709668 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78815], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:03:53.712394 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:03:53.727029 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78816], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:03:53.755358 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78817], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:03:53.772623 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78818], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:03:53.795923 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78815], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.096957264] seconds [----] I, [2016-09-13T09:03:53.796138 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78815], Delivering... [----] I, [2016-09-13T09:03:53.803091 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035762786865234375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003705739974975586, :pending_vm_jobs=>0.0008573532104492188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00647425651550293} [----] I, [2016-09-13T09:03:53.803462 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78815], State: [ok], Delivered in [0.007294103] seconds [----] I, [2016-09-13T09:04:00.129454 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:04:00.135501 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004004478454589844, :worker_monitor=>1.3995516300201416, :worker_dequeue=>0.011429309844970703, :total_time=>1.4152848720550537} [----] I, [2016-09-13T09:04:00.395511 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78816], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.680555539] seconds [----] I, [2016-09-13T09:04:00.395674 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78816], Delivering... [----] I, [2016-09-13T09:04:00.442913 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78816], State: [ok], Delivered in [0.047210459] seconds [----] I, [2016-09-13T09:04:02.413083 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78817], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.679136011] seconds [----] I, [2016-09-13T09:04:02.413259 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78817], Delivering... [----] I, [2016-09-13T09:04:02.418531 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78817], State: [ok], Delivered in [0.005081528] seconds [----] I, [2016-09-13T09:04:02.470123 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78818], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.707884394] seconds [----] I, [2016-09-13T09:04:02.470321 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78818], Delivering... [----] I, [2016-09-13T09:04:02.475165 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78818], State: [ok], Delivered in [0.004848226] seconds [----] I, [2016-09-13T09:04:08.784339 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T09:04:08.806962 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78819], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:04:08.835514 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78820], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:04:10.157996 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:04:10.527293 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78819], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.736240171] seconds [----] I, [2016-09-13T09:04:10.527529 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78819], Delivering... [----] I, [2016-09-13T09:04:10.534802 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038080215454101562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038340091705322266, :pending_vm_jobs=>0.0009038448333740234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068264007568359375} [----] I, [2016-09-13T09:04:10.535247 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78819], State: [ok], Delivered in [0.007704738] seconds [----] I, [2016-09-13T09:04:11.532942 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78820], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.709509342] seconds [----] I, [2016-09-13T09:04:11.533127 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78820], Delivering... [----] I, [2016-09-13T09:04:11.562339 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78821], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T09:04:11.619122 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78822], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T09:04:11.619540 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78820], State: [ok], Delivered in [0.086403327] seconds [----] I, [2016-09-13T09:04:16.431636 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T09:04:16.433020 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T09:04:16.433132 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0034880638122558594, :worker_monitor=>1.252002239227295, :worker_dequeue=>0.0069580078125, :total_time=>1.262756586074829} [----] I, [2016-09-13T09:04:18.870804 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [78822], MiqWorker id: [100], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [7.301725414] seconds [----] I, [2016-09-13T09:04:18.871035 #10859:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78822], Delivering... [----] I, [2016-09-13T09:04:18.875687 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T09:04:18.875905 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T09:04:18.876063 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T09:04:18.876250 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T09:04:18.876475 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:19.323348 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:19.634252 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:19.634440 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:20.106489 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:20.434850 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:20.435108 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:20.969842 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:21.315371 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:21.315541 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:21.433704 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:04:21 UTC]... [----] I, [2016-09-13T09:04:21.452751 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:04:21 UTC]...Complete [----] I, [2016-09-13T09:04:21.468159 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T09:04:21.796669 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:22.121758 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:22.121997 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:22.616229 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:23.851121 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:04:23.869955 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78823], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:04:23.881466 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78824], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:04:25.841887 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [78821], MiqWorker id: [101], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [14.292778856] seconds [----] I, [2016-09-13T09:04:25.842101 #12930:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78821], Delivering... [----] I, [2016-09-13T09:04:25.846168 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T09:04:25.846362 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T09:04:25.846539 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T09:04:25.846747 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T09:04:25.846947 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:26.133626 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:26.335347 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:26.335583 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:26.485832 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T09:04:26.491196 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:04:26.658346 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:26.738729 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78823], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.881600201] seconds [----] I, [2016-09-13T09:04:26.738846 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78823], Delivering... [----] I, [2016-09-13T09:04:26.742548 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020415782928466797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020551681518554688, :pending_vm_jobs=>0.0004467964172363281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003486156463623047} [----] I, [2016-09-13T09:04:26.742803 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78823], State: [ok], Delivered in [0.003939525] seconds [----] I, [2016-09-13T09:04:26.751000 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:26.755584 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78824], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.881462819] seconds [----] I, [2016-09-13T09:04:26.755692 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78824], Delivering... [----] I, [2016-09-13T09:04:26.758515 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78824], State: [ok], Delivered in [0.002813076] seconds [----] I, [2016-09-13T09:04:26.864572 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:27.172603 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:27.276536 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:27.369304 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:27.460971 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:27.552639 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:27.646004 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:27.748053 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:27.846806 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:27.938449 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:28.029837 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:28.121225 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:28.214367 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:28.307072 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:28.399594 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:28.492174 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:28.585266 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:28.679384 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:04:28.930277 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:28.930525 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:28.968091 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T09:04:28.968495 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004851818084716797, :collect_inventory_for_targets=>3.457069396972656e-05, :parse_legacy_inventory=>15.111979484558105, :parse_targeted_inventory=>15.112106800079346, :save_inventory=>0.9133577346801758, :ems_refresh=>16.027920246124268} [----] I, [2016-09-13T09:04:29.013233 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T09:04:29.013716 #12930:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78821], State: [ok], Delivered in [3.171605932] seconds [----] I, [2016-09-13T09:04:29.415196 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:29.753867 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:29.755121 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:30.219732 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:30.522247 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:30.522521 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:31.010026 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:31.310015 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:31.310246 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:31.780649 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:32.083243 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:32.083383 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:32.584837 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:32.927696 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:32.927832 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:33.011680 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035753250122070312, :worker_monitor=>1.5010294914245605, :worker_dequeue=>0.009153604507446289, :total_time=>1.514031171798706} [----] I, [2016-09-13T09:04:33.485834 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:33.798524 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:33.798785 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:34.323851 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:34.636530 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:34.636732 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:35.127127 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:35.412313 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:35.412486 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:35.871658 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:36.026466 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:36.186814 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:36.320219 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:36.459237 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:36.594832 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:36.735235 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:36.876688 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:37.010065 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:37.143332 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:37.278975 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:37.412801 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:37.555571 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:37.701753 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:37.839390 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:38.237651 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:38.419289 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:38.565821 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:38.703765 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:38.838316 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:38.897933 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:04:38.917505 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78825], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:04:38.981582 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:39.142015 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:39.276933 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:39.417206 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:39.572542 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:39.723444 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:43.105189 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:04:43.887970 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78825], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.983556746] seconds [----] I, [2016-09-13T09:04:43.888141 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78825], Delivering... [----] I, [2016-09-13T09:04:43.893328 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002716064453125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027916431427001953, :pending_vm_jobs=>0.0006368160247802734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0048635005950927734} [----] I, [2016-09-13T09:04:43.893676 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78825], State: [ok], Delivered in [0.005516641] seconds [----] I, [2016-09-13T09:04:45.887881 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:46.031762 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:46.175258 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:46.315760 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:46.457651 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:46.602703 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:47.099209 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:47.258654 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:47.399277 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:47.540674 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:47.686142 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:47.820936 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:47.964106 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:48.107180 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:48.256250 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:48.395652 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:48.541456 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:48.684601 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:48.826230 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:48.960514 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:49.096033 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:49.231896 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:49.365752 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:49.373439 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004635810852050781, :worker_monitor=>1.2470319271087646, :worker_dequeue=>0.011562108993530273, :total_time=>1.2634422779083252} [----] I, [2016-09-13T09:04:49.785025 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:49.937234 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:50.076368 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:50.209663 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:50.345232 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:50.524995 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:50.671307 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:50.803286 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:50.935162 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:51.069664 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:51.210943 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:51.355148 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:51.493761 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:51.630073 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:51.772155 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:51.920116 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:52.063411 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:52.535132 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:52.695935 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:52.831736 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:52.976148 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:53.136448 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:53.279311 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:53.419611 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:53.563880 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:53.702519 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:53.840640 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:53.930408 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:04:53.950567 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78826], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:04:53.962192 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78827], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:04:53.973512 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78828], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:04:53.982265 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:54.002812 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78829], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:04:54.126386 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:54.261377 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:54.373958 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:04:54 UTC]... [----] I, [2016-09-13T09:04:54.390970 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:04:54 UTC]...Complete [----] I, [2016-09-13T09:04:54.403393 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:04:54.414296 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:54.755542 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:54.904933 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:54.973930 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78826], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.037697146] seconds [----] I, [2016-09-13T09:04:54.974139 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78826], Delivering... [----] I, [2016-09-13T09:04:54.981444 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036842823028564453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037107467651367188, :pending_vm_jobs=>0.0009686946868896484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00688481330871582} [----] I, [2016-09-13T09:04:54.981838 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78826], State: [ok], Delivered in [0.007697695] seconds [----] I, [2016-09-13T09:04:55.008050 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78827], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.053724148] seconds [----] I, [2016-09-13T09:04:55.008219 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78827], Delivering... [----] I, [2016-09-13T09:04:55.043328 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:55.047647 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78827], State: [ok], Delivered in [0.039406224] seconds [----] I, [2016-09-13T09:04:55.483851 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:55.635983 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:55.777333 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:55.915626 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:56.054655 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:56.202916 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:56.353340 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:56.498322 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:56.648277 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:56.791134 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:04:56.900249 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78828], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.932669233] seconds [----] I, [2016-09-13T09:04:56.900510 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78828], Delivering... [----] I, [2016-09-13T09:04:56.904321 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78828], State: [ok], Delivered in [0.003811824] seconds [----] I, [2016-09-13T09:04:56.956636 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78829], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.968931146] seconds [----] I, [2016-09-13T09:04:56.956800 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78829], Delivering... [----] I, [2016-09-13T09:04:56.960152 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78829], State: [ok], Delivered in [0.003348269] seconds [----] I, [2016-09-13T09:05:02.961195 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:03.098340 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:03.239399 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:03.398718 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:03.539470 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:03.688598 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:03.826143 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:04.153757 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:04.302006 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:04.450566 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:04.596632 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:04.763625 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:04.903593 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:05.040695 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:05.189408 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:05.336477 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:05.483904 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:05.629159 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:05.778404 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:05.922047 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:05.958310 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041196346282958984, :worker_monitor=>1.518183708190918, :worker_dequeue=>0.007397890090942383, :total_time=>1.5300006866455078} [----] I, [2016-09-13T09:05:06.061982 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:06.205656 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:06.349481 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:06.489514 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:06.826804 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:06.994069 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:07.138728 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:07.281633 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:07.422685 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:07.564977 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:07.704685 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:07.856205 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:08.005031 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:08.147490 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:08.288970 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:08.433638 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:08.572828 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:08.720891 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:08.866833 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:09.013245 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:09.016344 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:05:09.038196 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78830], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:05:09.153364 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:09.700351 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:09.868043 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:10.012625 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:10.148717 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:10.293585 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:10.442064 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:10.579474 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:10.728891 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:10.872678 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:10.969902 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:05:11.016114 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:11.117881 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78830], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.094921434] seconds [----] I, [2016-09-13T09:05:11.118011 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78830], Delivering... [----] I, [2016-09-13T09:05:11.122233 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022957324981689453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023093223571777344, :pending_vm_jobs=>0.0005083084106445312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0039844512939453125} [----] I, [2016-09-13T09:05:11.122578 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78830], State: [ok], Delivered in [0.004550686] seconds [----] I, [2016-09-13T09:05:11.164985 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:11.308170 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:11.447858 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:11.585688 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:11.724970 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:11.867523 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:12.019197 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:12.496973 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:12.665613 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:12.814335 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:12.961386 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:13.097722 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:13.238173 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:13.375380 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:13.518817 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:13.663681 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:13.800787 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:13.942357 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:14.091644 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:14.233645 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:14.380575 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:14.523775 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:14.663560 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:14.806194 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:15.264030 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:15.434870 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:15.575859 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:15.727193 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:15.873159 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:16.022165 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:16.173161 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:16.351400 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:16.494150 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:16.645066 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:16.788234 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:16.931325 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:17.082057 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:17.228843 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:17.365439 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:17.519087 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:17.661276 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:18.135958 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:18.323690 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:18.458971 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:18.603491 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:18.749806 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:18.896611 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:19.038496 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:19.180148 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:19.341276 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:19.487082 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:19.631696 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:19.775234 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:19.925768 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:20.066322 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:20.215961 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:20.354480 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:20.488205 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:21.070453 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:21.262501 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:21.403758 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:21.553024 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:21.710108 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:21.858023 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:22.007711 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:22.149225 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:22.302337 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:22.455655 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:22.601872 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:22.612355 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00388336181640625, :worker_monitor=>1.612208366394043, :worker_dequeue=>0.007476329803466797, :total_time=>1.6238861083984375} [----] I, [2016-09-13T09:05:22.748912 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:22.911185 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:23.061592 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:23.207906 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:23.357046 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:23.500446 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:24.006471 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:24.053023 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:05:24.089942 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78831], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:05:24.119481 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78832], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:05:24.165278 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:24.313939 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:24.455144 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:24.591163 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:24.732686 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:24.875762 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:25.018974 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:25.162862 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:25.305378 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:25.447897 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:25.588199 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:25.731134 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:25.870666 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:26.010702 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:26.152277 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:05:26.295625 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T09:05:26.501170 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T09:05:26.501539 #10859:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T09:05:26.501881 #10859:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T09:05:26.501988 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T09:05:26.502100 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T09:05:26.529772 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T09:05:26.530216 #10859:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [78822], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T09:05:26.530591 #10859:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T09:05:26.530997 #10859:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T09:05:26.531277 #10859:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78822], State: [error], Delivered in [67.660219136] seconds [----] I, [2016-09-13T09:05:27.612908 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:05:27 UTC]... [----] I, [2016-09-13T09:05:27.638078 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:05:27 UTC]...Complete [----] I, [2016-09-13T09:05:27.649478 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:05:28.299696 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78831], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.231902077] seconds [----] I, [2016-09-13T09:05:28.299907 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78831], Delivering... [----] I, [2016-09-13T09:05:28.305085 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002686023712158203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002704143524169922, :pending_vm_jobs=>0.0006005764007568359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004806995391845703} [----] I, [2016-09-13T09:05:28.305450 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78831], State: [ok], Delivered in [0.005518076] seconds [----] I, [2016-09-13T09:05:30.078529 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78832], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.981931457] seconds [----] I, [2016-09-13T09:05:30.078753 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78832], Delivering... [----] I, [2016-09-13T09:05:30.083397 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78832], State: [ok], Delivered in [0.004641446] seconds [----] I, [2016-09-13T09:05:39.139735 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:05:39.182608 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78833], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:05:39.557296 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:05:39.564086 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0044786930084228516, :worker_monitor=>1.8628449440002441, :worker_dequeue=>0.012182950973510742, :total_time=>1.8798425197601318} [----] I, [2016-09-13T09:05:40.412372 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78833], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.261876414] seconds [----] I, [2016-09-13T09:05:40.412655 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78833], Delivering... [----] I, [2016-09-13T09:05:40.420709 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004189968109130859, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004254817962646484, :pending_vm_jobs=>0.0009658336639404297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007607936859130859} [----] I, [2016-09-13T09:05:40.421072 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78833], State: [ok], Delivered in [0.008410669] seconds [----] I, [2016-09-13T09:05:54.195783 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:05:54.224706 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78834], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:05:54.253219 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78835], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:05:54.282075 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78836], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:05:54.310612 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78837], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:05:56.342805 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:05:56.349623 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0029015541076660156, :worker_monitor=>1.6291117668151855, :worker_dequeue=>0.012450218200683594, :total_time=>1.6446974277496338} [----] I, [2016-09-13T09:05:56.586098 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78834], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.383997755] seconds [----] I, [2016-09-13T09:05:56.586400 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78834], Delivering... [----] I, [2016-09-13T09:05:56.594647 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0048482418060302734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0048732757568359375, :pending_vm_jobs=>0.0008449554443359375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007654428482055664} [----] I, [2016-09-13T09:05:56.595040 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78834], State: [ok], Delivered in [0.008659953] seconds [----] I, [2016-09-13T09:05:56.608901 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78835], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.380123336] seconds [----] I, [2016-09-13T09:05:56.609140 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78835], Delivering... [----] I, [2016-09-13T09:05:56.665739 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78835], State: [ok], Delivered in [0.056544702] seconds [----] I, [2016-09-13T09:05:57.192059 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78836], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.933541658] seconds [----] I, [2016-09-13T09:05:57.192282 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78836], Delivering... [----] I, [2016-09-13T09:05:57.196710 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78836], State: [ok], Delivered in [0.004390023] seconds [----] I, [2016-09-13T09:05:57.249357 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78837], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.958813211] seconds [----] I, [2016-09-13T09:05:57.249682 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78837], Delivering... [----] I, [2016-09-13T09:05:57.254986 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78837], State: [ok], Delivered in [0.005329597] seconds [----] I, [2016-09-13T09:06:01.350163 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:06:01 UTC]... [----] I, [2016-09-13T09:06:01.368972 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:06:01 UTC]...Complete [----] I, [2016-09-13T09:06:09.329798 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:06:09.347716 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78838], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:06:13.114234 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:06:13.123960 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004027605056762695, :worker_monitor=>1.6977527141571045, :worker_dequeue=>0.016727924346923828, :total_time=>1.7188360691070557} [----] I, [2016-09-13T09:06:13.773573 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78838], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.437736734] seconds [----] I, [2016-09-13T09:06:13.773829 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78838], Delivering... [----] I, [2016-09-13T09:06:13.782927 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0047054290771484375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004731178283691406, :pending_vm_jobs=>0.0011572837829589844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008606433868408203} [----] I, [2016-09-13T09:06:13.783397 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78838], State: [ok], Delivered in [0.009570851] seconds [----] I, [2016-09-13T09:06:24.359160 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:06:24.373146 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78839], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:06:24.391712 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78840], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:06:29.407503 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:06:29.414318 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004140615463256836, :worker_monitor=>1.2393758296966553, :worker_dequeue=>0.013917684555053711, :total_time=>1.2577910423278809} [----] I, [2016-09-13T09:06:29.898930 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78840], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.520494947] seconds [----] I, [2016-09-13T09:06:29.899098 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78840], Delivering... [----] I, [2016-09-13T09:06:29.905286 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032646656036376953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003284454345703125, :pending_vm_jobs=>0.0006992816925048828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005835294723510742} [----] I, [2016-09-13T09:06:29.905706 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78840], State: [ok], Delivered in [0.006593099] seconds [----] I, [2016-09-13T09:06:30.321780 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78839], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.957421344] seconds [----] I, [2016-09-13T09:06:30.321901 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78839], Delivering... [----] I, [2016-09-13T09:06:30.325212 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78839], State: [ok], Delivered in [0.003304103] seconds [----] I, [2016-09-13T09:06:34.414938 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:06:34 UTC]... [----] I, [2016-09-13T09:06:34.437541 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:06:34 UTC]...Complete [----] I, [2016-09-13T09:06:39.403931 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:06:39.441982 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78841], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:06:39.469289 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:06:39.967599 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78841], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.559007234] seconds [----] I, [2016-09-13T09:06:39.967740 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78841], Delivering... [----] I, [2016-09-13T09:06:39.973879 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00360870361328125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003631591796875, :pending_vm_jobs=>0.0008611679077148438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00586247444152832} [----] I, [2016-09-13T09:06:39.974138 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78841], State: [ok], Delivered in [0.006394725] seconds [----] I, [2016-09-13T09:06:45.965405 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039386749267578125, :worker_monitor=>1.4757373332977295, :worker_dequeue=>0.011425971984863281, :total_time=>1.4913785457611084} [----] I, [2016-09-13T09:06:54.454213 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:06:54.470636 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78842], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:06:54.483658 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78843], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:06:54.510852 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78844], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:06:54.527875 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78845], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:06:56.123911 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:06:56.150739 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78842], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.691866331] seconds [----] I, [2016-09-13T09:06:56.150940 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78842], Delivering... [----] I, [2016-09-13T09:06:56.220879 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78842], State: [ok], Delivered in [0.069914997] seconds [----] I, [2016-09-13T09:06:56.247785 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78845], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.730571548] seconds [----] I, [2016-09-13T09:06:56.247943 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78845], Delivering... [----] I, [2016-09-13T09:06:56.253728 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028874874114990234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029060840606689453, :pending_vm_jobs=>0.0008018016815185547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0054438114166259766} [----] I, [2016-09-13T09:06:56.254061 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78845], State: [ok], Delivered in [0.006105738] seconds [----] I, [2016-09-13T09:06:57.551092 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78844], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.062650798] seconds [----] I, [2016-09-13T09:06:57.551323 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78844], Delivering... [----] I, [2016-09-13T09:06:57.555669 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78844], State: [ok], Delivered in [0.004348768] seconds [----] I, [2016-09-13T09:06:57.568577 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78843], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.094329596] seconds [----] I, [2016-09-13T09:06:57.568843 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78843], Delivering... [----] I, [2016-09-13T09:06:57.579701 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78843], State: [ok], Delivered in [0.010868666] seconds [----] I, [2016-09-13T09:07:03.072227 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004350185394287109, :worker_monitor=>1.925154685974121, :worker_dequeue=>0.011133670806884766, :total_time=>1.941054344177246} [----] I, [2016-09-13T09:07:08.072856 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:07:08 UTC]... [----] I, [2016-09-13T09:07:08.103837 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:07:08 UTC]...Complete [----] I, [2016-09-13T09:07:09.540647 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:07:09.566852 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78846], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:07:13.132712 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:07:13.195795 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78846], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.649024078] seconds [----] I, [2016-09-13T09:07:13.196017 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78846], Delivering... [----] I, [2016-09-13T09:07:13.204060 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004317522048950195, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00434112548828125, :pending_vm_jobs=>0.0009357929229736328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00760340690612793} [----] I, [2016-09-13T09:07:13.204465 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78846], State: [ok], Delivered in [0.008407963] seconds [----] I, [2016-09-13T09:07:19.581696 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004261493682861328, :worker_monitor=>1.4287400245666504, :worker_dequeue=>0.007845640182495117, :total_time=>1.4411442279815674} [----] I, [2016-09-13T09:07:24.579111 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:07:24.601223 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78847], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:07:24.624174 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78848], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:07:29.611571 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:07:29.744165 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78848], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.136783248] seconds [----] I, [2016-09-13T09:07:29.744374 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78848], Delivering... [----] I, [2016-09-13T09:07:29.752347 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003495454788208008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035202503204345703, :pending_vm_jobs=>0.001115560531616211, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0074613094329833984} [----] I, [2016-09-13T09:07:29.752815 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78848], State: [ok], Delivered in [0.0084347] seconds [----] I, [2016-09-13T09:07:31.298452 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78847], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.714557815] seconds [----] I, [2016-09-13T09:07:31.298657 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78847], Delivering... [----] I, [2016-09-13T09:07:31.302620 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78847], State: [ok], Delivered in [0.003971916] seconds [----] I, [2016-09-13T09:07:36.185097 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004785776138305664, :worker_monitor=>1.5480725765228271, :worker_dequeue=>0.011136770248413086, :total_time=>1.564443826675415} [----] I, [2016-09-13T09:07:39.636454 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:07:39.655883 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78849], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:07:41.185750 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:07:41 UTC]... [----] I, [2016-09-13T09:07:41.205794 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:07:41 UTC]...Complete [----] I, [2016-09-13T09:07:41.216470 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:07:41.886101 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78849], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.243983601] seconds [----] I, [2016-09-13T09:07:41.886283 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78849], Delivering... [----] I, [2016-09-13T09:07:41.892665 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003297090530395508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003318309783935547, :pending_vm_jobs=>0.0008103847503662109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00598597526550293} [----] I, [2016-09-13T09:07:41.893014 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78849], State: [ok], Delivered in [0.006721487] seconds [----] I, [2016-09-13T09:07:52.899060 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040891170501708984, :server_monitor=>0.10788893699645996, :worker_monitor=>1.5421061515808105, :worker_dequeue=>0.007996082305908203, :total_time=>1.6625690460205078} [----] I, [2016-09-13T09:07:54.667129 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:07:54.686520 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78850], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:07:54.703629 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78851], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:07:54.747852 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78852], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:07:54.767665 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78853], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:07:57.911237 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:07:58.068290 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78850], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.396175252] seconds [----] I, [2016-09-13T09:07:58.068554 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78850], Delivering... [----] I, [2016-09-13T09:07:58.102199 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78853], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.348190929] seconds [----] I, [2016-09-13T09:07:58.102454 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78853], Delivering... [----] I, [2016-09-13T09:07:58.109505 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003503561019897461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035598278045654297, :pending_vm_jobs=>0.0009229183197021484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006531238555908203} [----] I, [2016-09-13T09:07:58.109817 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78853], State: [ok], Delivered in [0.007400029] seconds [----] I, [2016-09-13T09:07:58.142178 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78850], State: [ok], Delivered in [0.073603272] seconds [----] I, [2016-09-13T09:07:58.433950 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78851], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.741892764] seconds [----] I, [2016-09-13T09:07:58.434212 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78851], Delivering... [----] I, [2016-09-13T09:07:58.439035 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78851], State: [ok], Delivered in [0.004822967] seconds [----] I, [2016-09-13T09:07:58.474344 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78852], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.762335711] seconds [----] I, [2016-09-13T09:07:58.474636 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78852], Delivering... [----] I, [2016-09-13T09:07:58.480321 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78852], State: [ok], Delivered in [0.005727728] seconds [----] I, [2016-09-13T09:08:09.380849 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004137516021728516, :worker_monitor=>1.424499750137329, :worker_dequeue=>0.017841815948486328, :total_time=>1.4468574523925781} [----] I, [2016-09-13T09:08:09.779910 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:08:09.793768 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78854], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:08:14.381579 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:08:14 UTC]... [----] I, [2016-09-13T09:08:14.393717 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:08:14 UTC]...Complete [----] I, [2016-09-13T09:08:14.409364 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:08:15.251278 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78854], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.465339651] seconds [----] I, [2016-09-13T09:08:15.251531 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78854], Delivering... [----] I, [2016-09-13T09:08:15.258675 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003804922103881836, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038259029388427734, :pending_vm_jobs=>0.0008535385131835938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006664276123046875} [----] I, [2016-09-13T09:08:15.259016 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78854], State: [ok], Delivered in [0.007501216] seconds [----] I, [2016-09-13T09:08:24.805728 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:08:24.822278 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78855], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:08:24.833730 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78856], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:08:26.038300 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:08:26.045516 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003845691680908203, :worker_monitor=>1.5961589813232422, :worker_dequeue=>0.01259613037109375, :total_time=>1.6128921508789062} [----] I, [2016-09-13T09:08:26.366872 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78856], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.539398816] seconds [----] I, [2016-09-13T09:08:26.367108 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78856], Delivering... [----] I, [2016-09-13T09:08:26.374142 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035817623138427734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003655672073364258, :pending_vm_jobs=>0.0009169578552246094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0066106319427490234} [----] I, [2016-09-13T09:08:26.374551 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78856], State: [ok], Delivered in [0.007431649] seconds [----] I, [2016-09-13T09:08:28.555533 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78855], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.745251817] seconds [----] I, [2016-09-13T09:08:28.555772 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78855], Delivering... [----] I, [2016-09-13T09:08:28.561278 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78855], State: [ok], Delivered in [0.005515148] seconds [----] I, [2016-09-13T09:08:39.845144 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:08:39.864037 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78857], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:08:39.875196 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78858], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:08:39.919799 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78859], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:08:42.713261 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:08:42.716755 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004405021667480469, :worker_monitor=>1.6169443130493164, :worker_dequeue=>0.0063934326171875, :total_time=>1.6280126571655273} [----] I, [2016-09-13T09:08:43.491449 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78857], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.64159376] seconds [----] I, [2016-09-13T09:08:43.491652 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78857], Delivering... [----] I, [2016-09-13T09:08:43.492895 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T09:08:43.493098 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5371527168 [----] I, [2016-09-13T09:08:43.493210 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5142818816 [----] I, [2016-09-13T09:08:43.493296 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 228708352 [----] I, [2016-09-13T09:08:43.493377 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1321205760 [----] I, [2016-09-13T09:08:43.493491 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5088763904 [----] I, [2016-09-13T09:08:43.493596 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T09:08:43.493683 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T09:08:43.493759 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 550588416 [----] I, [2016-09-13T09:08:43.493834 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T09:08:43.493903 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8067100672 [----] I, [2016-09-13T09:08:43.493973 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T09:08:43.494047 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T09:08:43.494121 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T09:08:43.494190 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T09:08:43.494260 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T09:08:43.494334 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T09:08:43.494409 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T09:08:43.494522 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T09:08:43.494630 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T09:08:43.494700 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T09:08:43.494770 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 274046976 [----] I, [2016-09-13T09:08:43.494841 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57229312 [----] I, [2016-09-13T09:08:43.494917 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216817664 [----] I, [2016-09-13T09:08:43.494984 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6209536 [----] I, [2016-09-13T09:08:43.495058 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141934592 [----] I, [2016-09-13T09:08:43.495130 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2578509824 [----] I, [2016-09-13T09:08:43.495210 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2254815232 [----] I, [2016-09-13T09:08:43.495286 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T09:08:43.495360 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T09:08:43.495453 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T09:08:43.495557 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37572608 [----] I, [2016-09-13T09:08:43.495635 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T09:08:43.495706 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53276672 [----] I, [2016-09-13T09:08:43.495778 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111284224 [----] I, [2016-09-13T09:08:43.495852 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155574272 [----] I, [2016-09-13T09:08:43.495922 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T09:08:43.495997 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T09:08:43.496069 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T09:08:43.496137 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T09:08:43.496209 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T09:08:43.496278 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T09:08:43.496349 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T09:08:43.496441 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T09:08:43.496529 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T09:08:43.502865 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78858], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.634560842] seconds [----] I, [2016-09-13T09:08:43.503052 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78858], Delivering... [----] I, [2016-09-13T09:08:43.514447 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:08:42 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152751.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:08:43.515219 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:08:41 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [104708.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T09:08:43.516091 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:08:41 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169070000], Memory % [3.14], CPU Time [51951.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:08:43.516890 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:08:37 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212541000], Memory % [3.5], CPU Time [49107.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T09:08:43.517777 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:08:41 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162422000], Memory % [3.1], CPU Time [38263.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T09:08:43.518614 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:08:39 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205295000], Memory % [3.5], CPU Time [241941.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T09:08:43.519442 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:08:40 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [205012.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:08:43.520256 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:08:42 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [151830.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:08:43.524511 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:08:36 UTC], Process Info: Memory Usage [609284096], Memory Size [1064947712], Proportional Set Size: [441913000], Memory % [7.43], CPU Time [1676.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:08:43.526759 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:08:39 UTC], Process Info: Memory Usage [598474752], Memory Size [942247936], Proportional Set Size: [431019000], Memory % [7.3], CPU Time [631.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:08:43.529023 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:08:36 UTC], Process Info: Memory Usage [580386816], Memory Size [936886272], Proportional Set Size: [420013000], Memory % [7.08], CPU Time [2575.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T09:08:43.531286 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:08:33 UTC], Process Info: Memory Usage [558882816], Memory Size [931545088], Proportional Set Size: [406484000], Memory % [6.81], CPU Time [5997.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T09:08:43.531971 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:08:40 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [212275.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T09:08:43.532623 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:08:42 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177794000], Memory % [3.2], CPU Time [51947.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:08:43.533132 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:08:32 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165808000], Memory % [3.16], CPU Time [39158.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T09:08:43.533491 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78858], State: [ok], Delivered in [0.030408519] seconds [----] I, [2016-09-13T09:08:43.546129 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T09:08:43.546343 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T09:08:43.550648 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T09:08:43.553724 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T09:08:43.557525 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T09:08:43.559719 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78859], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.679057576] seconds [----] I, [2016-09-13T09:08:43.559883 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78859], Delivering... [----] I, [2016-09-13T09:08:43.561128 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T09:08:43.564815 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T09:08:43.566405 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00331878662109375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033423900604248047, :pending_vm_jobs=>0.0008182525634765625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006147146224975586} [----] I, [2016-09-13T09:08:43.566765 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78859], State: [ok], Delivered in [0.006872522] seconds [----] I, [2016-09-13T09:08:43.568329 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 849 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T09:08:43.571876 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T09:08:43.575468 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T09:08:43.578998 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T09:08:43.582435 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T09:08:43.585859 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T09:08:43.589126 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T09:08:43.592083 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:08:43.592248 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:08:43.592358 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T09:08:43.596952 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [200501000], Memory % [3.38], CPU Time [152740.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:08:43.597345 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78857], State: [ok], Delivered in [0.105677885] seconds [----] I, [2016-09-13T09:08:47.717341 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:08:47 UTC]... [----] I, [2016-09-13T09:08:47.748461 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:08:47 UTC]...Complete [----] I, [2016-09-13T09:08:54.931686 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:08:54.948234 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78860], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:08:54.965558 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78861], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:08:54.982499 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78862], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:08:54.994148 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78863], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:08:59.379621 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:08:59.390186 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0062787532806396484, :worker_monitor=>1.4791669845581055, :worker_dequeue=>0.01904916763305664, :total_time=>1.5048136711120605} [----] I, [2016-09-13T09:08:59.698037 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78860], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.761749277] seconds [----] I, [2016-09-13T09:08:59.698257 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78860], Delivering... [----] I, [2016-09-13T09:08:59.726443 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78863], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.738736593] seconds [----] I, [2016-09-13T09:08:59.726758 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78863], Delivering... [----] I, [2016-09-13T09:08:59.736925 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005240201950073242, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005273580551147461, :pending_vm_jobs=>0.0011990070343017578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009423017501831055} [----] I, [2016-09-13T09:08:59.737444 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78863], State: [ok], Delivered in [0.010659701] seconds [----] I, [2016-09-13T09:08:59.770512 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78860], State: [ok], Delivered in [0.07219264] seconds [----] I, [2016-09-13T09:09:01.699228 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78861], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.745791228] seconds [----] I, [2016-09-13T09:09:01.699363 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78861], Delivering... [----] I, [2016-09-13T09:09:01.704241 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78861], State: [ok], Delivered in [0.004875495] seconds [----] I, [2016-09-13T09:09:01.725965 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78862], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.752427407] seconds [----] I, [2016-09-13T09:09:01.726102 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78862], Delivering... [----] I, [2016-09-13T09:09:01.729969 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78862], State: [ok], Delivered in [0.003860083] seconds [----] I, [2016-09-13T09:09:10.005873 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:09:10.017145 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78864], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:09:15.722015 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:09:15.727744 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005872011184692383, :worker_monitor=>1.2920737266540527, :worker_dequeue=>0.009947061538696289, :total_time=>1.308377981185913} [----] I, [2016-09-13T09:09:15.910132 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78864], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.898132129] seconds [----] I, [2016-09-13T09:09:15.910325 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78864], Delivering... [----] I, [2016-09-13T09:09:15.917114 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003502368927001953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035262107849121094, :pending_vm_jobs=>0.0008111000061035156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006357908248901367} [----] I, [2016-09-13T09:09:15.917472 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78864], State: [ok], Delivered in [0.007120839] seconds [----] I, [2016-09-13T09:09:20.728179 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:09:20 UTC]... [----] I, [2016-09-13T09:09:20.742705 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:09:20 UTC]...Complete [----] I, [2016-09-13T09:09:25.029393 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:09:25.057877 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78865], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:09:25.074640 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78866], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:09:25.762451 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:09:25.811926 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78866], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.748075] seconds [----] I, [2016-09-13T09:09:25.812110 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78866], Delivering... [----] I, [2016-09-13T09:09:25.817667 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78865], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.783360501] seconds [----] I, [2016-09-13T09:09:25.817843 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78865], Delivering... [----] I, [2016-09-13T09:09:25.819247 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036699771881103516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036923885345458984, :pending_vm_jobs=>0.0009100437164306641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0066890716552734375} [----] I, [2016-09-13T09:09:25.819625 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78866], State: [ok], Delivered in [0.007511762] seconds [----] I, [2016-09-13T09:09:25.823390 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78865], State: [ok], Delivered in [0.005529378] seconds [----] I, [2016-09-13T09:09:30.784259 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T09:09:32.272523 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003991365432739258, :log_active_servers=>0.01078939437866211, :worker_monitor=>1.475691556930542, :worker_dequeue=>0.012204885482788086, :total_time=>1.5030555725097656} [----] I, [2016-09-13T09:09:40.088442 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:09:40.109365 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78867], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:09:42.295620 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:09:43.058068 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78867], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.962778477] seconds [----] I, [2016-09-13T09:09:43.058260 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78867], Delivering... [----] I, [2016-09-13T09:09:43.065096 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00350189208984375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035333633422851562, :pending_vm_jobs=>0.0008761882781982422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006334781646728516} [----] I, [2016-09-13T09:09:43.065470 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78867], State: [ok], Delivered in [0.007176164] seconds [----] I, [2016-09-13T09:09:48.542518 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0049517154693603516, :worker_monitor=>1.2166430950164795, :worker_dequeue=>0.016850709915161133, :total_time=>1.2389609813690186} [----] I, [2016-09-13T09:09:53.543092 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:09:53 UTC]... [----] I, [2016-09-13T09:09:53.572323 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:09:53 UTC]...Complete [----] I, [2016-09-13T09:09:55.125070 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:09:55.143555 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78868], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:09:55.154697 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78869], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:09:55.166343 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78870], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:09:55.177643 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78871], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:09:58.716132 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:09:58.951478 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78868], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.822148106] seconds [----] I, [2016-09-13T09:09:58.951763 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78868], Delivering... [----] I, [2016-09-13T09:09:58.978086 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78871], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.806389562] seconds [----] I, [2016-09-13T09:09:58.978303 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78871], Delivering... [----] I, [2016-09-13T09:09:58.986088 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003966331481933594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0039904117584228516, :pending_vm_jobs=>0.0010864734649658203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007266044616699219} [----] I, [2016-09-13T09:09:58.986556 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78871], State: [ok], Delivered in [0.008231574] seconds [----] I, [2016-09-13T09:09:59.012317 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78869], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.8634712] seconds [----] I, [2016-09-13T09:09:59.012530 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78869], Delivering... [----] I, [2016-09-13T09:09:59.015794 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78869], State: [ok], Delivered in [0.003266696] seconds [----] I, [2016-09-13T09:09:59.029200 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78868], State: [ok], Delivered in [0.077427554] seconds [----] I, [2016-09-13T09:09:59.040915 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78870], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.880066914] seconds [----] I, [2016-09-13T09:09:59.041099 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78870], Delivering... [----] I, [2016-09-13T09:09:59.046597 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78870], State: [ok], Delivered in [0.005476734] seconds [----] I, [2016-09-13T09:10:05.272705 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037992000579833984, :worker_monitor=>1.5344107151031494, :worker_dequeue=>0.011293649673461914, :total_time=>1.5497634410858154} [----] I, [2016-09-13T09:10:10.187667 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T09:10:10.201473 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78872], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:10:10.213146 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78873], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:10:10.224311 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78874], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:10:10.235874 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78875], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:10:10.286682 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:10:10.310242 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78875], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.080881592] seconds [----] I, [2016-09-13T09:10:10.310484 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78875], Delivering... [----] I, [2016-09-13T09:10:10.317937 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0039670467376708984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003989458084106445, :pending_vm_jobs=>0.0009670257568359375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006991147994995117} [----] I, [2016-09-13T09:10:10.318312 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78875], State: [ok], Delivered in [0.007859321] seconds [----] I, [2016-09-13T09:10:11.081977 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78872], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.888526756] seconds [----] I, [2016-09-13T09:10:11.082170 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78872], Delivering... [----] I, [2016-09-13T09:10:11.085056 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78872], State: [ok], Delivered in [0.002868592] seconds [----] I, [2016-09-13T09:10:11.099004 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78873], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.892483138] seconds [----] I, [2016-09-13T09:10:11.099196 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78873], Delivering... [----] I, [2016-09-13T09:10:11.110340 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78874], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.892125316] seconds [----] I, [2016-09-13T09:10:11.110573 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78874], Delivering... [----] I, [2016-09-13T09:10:11.111363 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78873], State: [ok], Delivered in [0.011999491] seconds [----] I, [2016-09-13T09:10:11.116645 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78874], State: [ok], Delivered in [0.0060724] seconds [----] I, [2016-09-13T09:10:21.496880 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004678249359130859, :worker_monitor=>1.1753761768341064, :worker_dequeue=>0.0068645477294921875, :total_time=>1.1873652935028076} [----] I, [2016-09-13T09:10:25.246887 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:10:25.270348 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78876], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:10:25.299023 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78877], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:10:26.497479 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:10:26 UTC]... [----] I, [2016-09-13T09:10:26.517099 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:10:26 UTC]...Complete [----] I, [2016-09-13T09:10:26.534175 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:10:27.493727 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78877], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.218676677] seconds [----] I, [2016-09-13T09:10:27.493943 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78877], Delivering... [----] I, [2016-09-13T09:10:27.501077 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037093162536621094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038056373596191406, :pending_vm_jobs=>0.0008666515350341797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0067005157470703125} [----] I, [2016-09-13T09:10:27.501470 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78877], State: [ok], Delivered in [0.007483896] seconds [----] I, [2016-09-13T09:10:29.184961 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78876], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.931494687] seconds [----] I, [2016-09-13T09:10:29.185149 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78876], Delivering... [----] I, [2016-09-13T09:10:29.190230 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78876], State: [ok], Delivered in [0.005053717] seconds [----] I, [2016-09-13T09:10:38.227827 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004914760589599609, :worker_monitor=>1.6551470756530762, :worker_dequeue=>0.006508350372314453, :total_time=>1.6669020652770996} [----] I, [2016-09-13T09:10:40.309003 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:10:40.322198 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78878], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:10:43.237331 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:10:43.528079 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78878], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.214769665] seconds [----] I, [2016-09-13T09:10:43.528267 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78878], Delivering... [----] I, [2016-09-13T09:10:43.534884 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003366708755493164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033915042877197266, :pending_vm_jobs=>0.0008420944213867188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006178855895996094} [----] I, [2016-09-13T09:10:43.535243 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78878], State: [ok], Delivered in [0.006973612] seconds [----] I, [2016-09-13T09:10:54.818263 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0042345523834228516, :worker_monitor=>1.540151834487915, :worker_dequeue=>0.00747990608215332, :total_time=>1.5522425174713135} [----] I, [2016-09-13T09:10:55.335145 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:10:55.350495 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78879], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:10:55.361749 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78880], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:10:55.380113 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78881], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:10:55.390592 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78882], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:10:59.818771 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:10:59 UTC]... [----] I, [2016-09-13T09:10:59.843301 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:10:59 UTC]...Complete [----] I, [2016-09-13T09:10:59.956404 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:11:00.694469 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78879], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.354823345] seconds [----] I, [2016-09-13T09:11:00.694645 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78879], Delivering... [----] I, [2016-09-13T09:11:00.739195 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78879], State: [ok], Delivered in [0.044506803] seconds [----] I, [2016-09-13T09:11:00.761995 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78882], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.376195502] seconds [----] I, [2016-09-13T09:11:00.762169 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78882], Delivering... [----] I, [2016-09-13T09:11:00.768135 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032558441162109375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032761096954345703, :pending_vm_jobs=>0.0006320476531982422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055959224700927734} [----] I, [2016-09-13T09:11:00.768465 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78882], State: [ok], Delivered in [0.00627956] seconds [----] I, [2016-09-13T09:11:02.271124 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78880], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.91518947] seconds [----] I, [2016-09-13T09:11:02.271324 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78880], Delivering... [----] I, [2016-09-13T09:11:02.274820 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78880], State: [ok], Delivered in [0.00347814] seconds [----] I, [2016-09-13T09:11:02.322682 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78881], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.95349487] seconds [----] I, [2016-09-13T09:11:02.322881 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78881], Delivering... [----] I, [2016-09-13T09:11:02.328518 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78881], State: [ok], Delivered in [0.005623403] seconds [----] I, [2016-09-13T09:11:10.415220 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:11:10.447998 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78883], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:11:11.617490 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:11:11.624639 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004122734069824219, :worker_monitor=>1.6300699710845947, :worker_dequeue=>0.012850284576416016, :total_time=>1.647420883178711} [----] I, [2016-09-13T09:11:11.860887 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78883], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.436392939] seconds [----] I, [2016-09-13T09:11:11.861146 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78883], Delivering... [----] I, [2016-09-13T09:11:11.868705 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004283428192138672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00430607795715332, :pending_vm_jobs=>0.0008974075317382812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007124900817871094} [----] I, [2016-09-13T09:11:11.869136 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78883], State: [ok], Delivered in [0.007982177] seconds [----] I, [2016-09-13T09:11:25.459262 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:11:25.470503 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78884], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:11:25.493605 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78885], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:11:28.304136 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:11:28.311355 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004777669906616211, :worker_monitor=>1.6279306411743164, :worker_dequeue=>0.012385129928588867, :total_time=>1.6454060077667236} [----] I, [2016-09-13T09:11:28.985897 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78885], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.510769294] seconds [----] I, [2016-09-13T09:11:28.986111 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78885], Delivering... [----] I, [2016-09-13T09:11:28.993107 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003707408905029297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037539005279541016, :pending_vm_jobs=>0.0008575916290283203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065839290618896484} [----] I, [2016-09-13T09:11:28.993569 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78885], State: [ok], Delivered in [0.007420573] seconds [----] I, [2016-09-13T09:11:29.384889 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78884], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.921406629] seconds [----] I, [2016-09-13T09:11:29.385093 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78884], Delivering... [----] I, [2016-09-13T09:11:29.390626 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78884], State: [ok], Delivered in [0.00552278] seconds [----] I, [2016-09-13T09:11:33.311959 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:11:33 UTC]... [----] I, [2016-09-13T09:11:33.334336 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:11:33 UTC]...Complete [----] I, [2016-09-13T09:11:40.504228 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:11:40.528675 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78886], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:11:45.015566 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:11:45.024898 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004780769348144531, :worker_monitor=>1.6263947486877441, :worker_dequeue=>0.01721954345703125, :total_time=>1.6488313674926758} [----] I, [2016-09-13T09:11:45.105801 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78886], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.593791445] seconds [----] I, [2016-09-13T09:11:45.105984 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78886], Delivering... [----] I, [2016-09-13T09:11:45.112216 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003294229507446289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033147335052490234, :pending_vm_jobs=>0.0007407665252685547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005881547927856445} [----] I, [2016-09-13T09:11:45.112592 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78886], State: [ok], Delivered in [0.006603527] seconds [----] I, [2016-09-13T09:11:55.543500 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:11:55.562997 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78887], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:11:55.580168 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78888], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:11:55.598411 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78889], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:11:55.614324 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78890], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:12:01.298553 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:12:01.302219 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038139820098876953, :server_monitor=>0.07630658149719238, :worker_monitor=>1.1555454730987549, :worker_dequeue=>0.0065495967864990234, :total_time=>1.2427716255187988} [----] I, [2016-09-13T09:12:02.296332 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78887], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.748275181] seconds [----] I, [2016-09-13T09:12:02.296538 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78887], Delivering... [----] I, [2016-09-13T09:12:02.305674 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78890], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.701133665] seconds [----] I, [2016-09-13T09:12:02.305797 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78890], Delivering... [----] I, [2016-09-13T09:12:02.310315 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002044200897216797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020563602447509766, :pending_vm_jobs=>0.0008878707885742188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004263639450073242} [----] I, [2016-09-13T09:12:02.310578 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78890], State: [ok], Delivered in [0.004769405] seconds [----] I, [2016-09-13T09:12:02.351240 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78887], State: [ok], Delivered in [0.054675934] seconds [----] I, [2016-09-13T09:12:02.534402 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78888], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.965174344] seconds [----] I, [2016-09-13T09:12:02.534599 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78888], Delivering... [----] I, [2016-09-13T09:12:02.537233 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78888], State: [ok], Delivered in [0.002636199] seconds [----] I, [2016-09-13T09:12:02.621121 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78889], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.032267287] seconds [----] I, [2016-09-13T09:12:02.621302 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78889], Delivering... [----] I, [2016-09-13T09:12:02.625730 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78889], State: [ok], Delivered in [0.004416195] seconds [----] I, [2016-09-13T09:12:06.302768 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:12:06 UTC]... [----] I, [2016-09-13T09:12:06.334298 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:12:06 UTC]...Complete [----] I, [2016-09-13T09:12:10.625881 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:12:10.648819 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78891], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:12:11.360062 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:12:11.414448 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78891], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.784283484] seconds [----] I, [2016-09-13T09:12:11.414622 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78891], Delivering... [----] I, [2016-09-13T09:12:11.420988 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003114461898803711, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00313568115234375, :pending_vm_jobs=>0.0009205341339111328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006059169769287109} [----] I, [2016-09-13T09:12:11.421330 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78891], State: [ok], Delivered in [0.006709429] seconds [----] I, [2016-09-13T09:12:18.384868 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004287242889404297, :worker_monitor=>2.0005388259887695, :worker_dequeue=>0.012516260147094727, :total_time=>2.017660617828369} [----] I, [2016-09-13T09:12:25.662983 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:12:25.683229 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78892], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:12:25.706117 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78893], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:12:28.421947 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:12:28.540575 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78893], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.851423328] seconds [----] I, [2016-09-13T09:12:28.540739 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78893], Delivering... [----] I, [2016-09-13T09:12:28.546933 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003139019012451172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031638145446777344, :pending_vm_jobs=>0.0008261203765869141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058553218841552734} [----] I, [2016-09-13T09:12:28.547296 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78893], State: [ok], Delivered in [0.006550052] seconds [----] I, [2016-09-13T09:12:29.723191 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78892], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.055016256] seconds [----] I, [2016-09-13T09:12:29.723339 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78892], Delivering... [----] I, [2016-09-13T09:12:29.726994 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78892], State: [ok], Delivered in [0.003661296] seconds [----] I, [2016-09-13T09:12:34.727408 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004612445831298828, :worker_monitor=>1.2812628746032715, :worker_dequeue=>0.008078575134277344, :total_time=>1.2943542003631592} [----] I, [2016-09-13T09:12:39.727967 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:12:39 UTC]... [----] I, [2016-09-13T09:12:39.751857 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:12:39 UTC]...Complete [----] I, [2016-09-13T09:12:40.719143 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:12:40.741932 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78894], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:12:44.775505 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:12:44.849034 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78894], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.123233884] seconds [----] I, [2016-09-13T09:12:44.849236 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78894], Delivering... [----] I, [2016-09-13T09:12:44.856316 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003670215606689453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003741741180419922, :pending_vm_jobs=>0.0008463859558105469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006619453430175781} [----] I, [2016-09-13T09:12:44.856703 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78894], State: [ok], Delivered in [0.007459492] seconds [----] I, [2016-09-13T09:12:51.259622 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004236936569213867, :worker_monitor=>1.4630117416381836, :worker_dequeue=>0.012578487396240234, :total_time=>1.480172872543335} [----] I, [2016-09-13T09:12:55.754943 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:12:55.769140 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78895], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:12:55.780550 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78896], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:12:55.797673 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78897], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:12:55.808988 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78898], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:12:56.270015 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:12:56.730628 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78895], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.970777154] seconds [----] I, [2016-09-13T09:12:56.730850 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78895], Delivering... [----] I, [2016-09-13T09:12:56.757835 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78898], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.954651323] seconds [----] I, [2016-09-13T09:12:56.758036 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78898], Delivering... [----] I, [2016-09-13T09:12:56.765155 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036003589630126953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003624439239501953, :pending_vm_jobs=>0.0009467601776123047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006703615188598633} [----] I, [2016-09-13T09:12:56.765562 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78898], State: [ok], Delivered in [0.007506773] seconds [----] I, [2016-09-13T09:12:56.786373 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78895], State: [ok], Delivered in [0.055518317] seconds [----] I, [2016-09-13T09:12:56.820816 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78896], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.046321705] seconds [----] I, [2016-09-13T09:12:56.821020 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78896], Delivering... [----] I, [2016-09-13T09:12:56.829380 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78896], State: [ok], Delivered in [0.008355194] seconds [----] I, [2016-09-13T09:12:56.872260 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78897], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.083763102] seconds [----] I, [2016-09-13T09:12:56.872483 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78897], Delivering... [----] I, [2016-09-13T09:12:56.877716 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78897], State: [ok], Delivered in [0.005252901] seconds [----] I, [2016-09-13T09:13:07.704109 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.008986949920654297, :worker_monitor=>1.2730064392089844, :worker_dequeue=>0.011241912841796875, :total_time=>1.2938053607940674} [----] I, [2016-09-13T09:13:10.823117 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:13:10.843637 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78899], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:13:12.704617 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:13:12 UTC]... [----] I, [2016-09-13T09:13:12.723350 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:13:12 UTC]...Complete [----] I, [2016-09-13T09:13:12.734363 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:13:12.913506 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78899], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.083021651] seconds [----] I, [2016-09-13T09:13:12.913709 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78899], Delivering... [----] I, [2016-09-13T09:13:12.920336 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035293102264404297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035562515258789062, :pending_vm_jobs=>0.0007016658782958984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006232738494873047} [----] I, [2016-09-13T09:13:12.920735 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78899], State: [ok], Delivered in [0.007023954] seconds [----] I, [2016-09-13T09:13:24.051753 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005303144454956055, :worker_monitor=>1.2782785892486572, :worker_dequeue=>0.011035919189453125, :total_time=>1.2949919700622559} [----] I, [2016-09-13T09:13:25.854969 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:13:25.879762 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78900], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:13:25.924263 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78901], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:13:29.062311 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:13:29.975199 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78901], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.089063494] seconds [----] I, [2016-09-13T09:13:29.975359 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78901], Delivering... [----] I, [2016-09-13T09:13:29.981191 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030808448791503906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031011104583740234, :pending_vm_jobs=>0.0007538795471191406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005467891693115234} [----] I, [2016-09-13T09:13:29.981486 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78901], State: [ok], Delivered in [0.006125772] seconds [----] I, [2016-09-13T09:13:30.003482 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78900], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.143428083] seconds [----] I, [2016-09-13T09:13:30.003725 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78900], Delivering... [----] I, [2016-09-13T09:13:30.008576 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78900], State: [ok], Delivered in [0.004847492] seconds [----] I, [2016-09-13T09:13:40.477364 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006158351898193359, :worker_monitor=>1.3648197650909424, :worker_dequeue=>0.018458843231201172, :total_time=>1.3897452354431152} [----] I, [2016-09-13T09:13:40.937313 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:13:40.980783 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78902], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:13:40.998287 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78903], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:13:41.009856 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78904], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:13:45.478075 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:13:45 UTC]... [----] I, [2016-09-13T09:13:45.495443 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:13:45 UTC]...Complete [----] I, [2016-09-13T09:13:45.506742 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:13:46.095620 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78902], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.153619942] seconds [----] I, [2016-09-13T09:13:46.095781 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78902], Delivering... [----] I, [2016-09-13T09:13:46.096739 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T09:13:46.096890 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5369479168 [----] I, [2016-09-13T09:13:46.096964 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5140586496 [----] I, [2016-09-13T09:13:46.097026 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 228892672 [----] I, [2016-09-13T09:13:46.097100 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1323302912 [----] I, [2016-09-13T09:13:46.097169 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5086539776 [----] I, [2016-09-13T09:13:46.097228 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T09:13:46.097283 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T09:13:46.097338 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 550772736 [----] I, [2016-09-13T09:13:46.097391 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T09:13:46.097480 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7986614272 [----] I, [2016-09-13T09:13:46.097558 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T09:13:46.097619 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T09:13:46.097672 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T09:13:46.097727 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T09:13:46.097781 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T09:13:46.097831 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T09:13:46.097882 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T09:13:46.097933 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T09:13:46.097984 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T09:13:46.098036 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T09:13:46.098087 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 274046976 [----] I, [2016-09-13T09:13:46.098152 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57229312 [----] I, [2016-09-13T09:13:46.098208 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216817664 [----] I, [2016-09-13T09:13:46.098260 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T09:13:46.098325 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141934592 [----] I, [2016-09-13T09:13:46.098387 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2579406848 [----] I, [2016-09-13T09:13:46.098470 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2255527936 [----] I, [2016-09-13T09:13:46.098549 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T09:13:46.098611 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T09:13:46.098672 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T09:13:46.098726 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37519360 [----] I, [2016-09-13T09:13:46.098777 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T09:13:46.098827 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53223424 [----] I, [2016-09-13T09:13:46.098880 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111284224 [----] I, [2016-09-13T09:13:46.098935 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155521024 [----] I, [2016-09-13T09:13:46.098986 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T09:13:46.099052 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T09:13:46.099111 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T09:13:46.099170 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T09:13:46.099223 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T09:13:46.099276 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T09:13:46.099325 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T09:13:46.099375 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T09:13:46.099452 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T09:13:46.135701 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T09:13:46.135866 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T09:13:46.138646 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T09:13:46.140628 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T09:13:46.142859 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T09:13:46.145167 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T09:13:46.147504 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T09:13:46.149815 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 849 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T09:13:46.152117 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T09:13:46.154390 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T09:13:46.156641 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T09:13:46.158858 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T09:13:46.160859 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T09:13:46.163026 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T09:13:46.165165 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:13:46.165276 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:13:46.165376 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T09:13:46.168543 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [202019000], Memory % [3.36], CPU Time [151890.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:13:46.168869 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78902], State: [ok], Delivered in [0.073080722] seconds [----] I, [2016-09-13T09:13:46.169971 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78904], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.165996411] seconds [----] I, [2016-09-13T09:13:46.170148 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78904], Delivering... [----] I, [2016-09-13T09:13:46.176855 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034956932067871094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035676956176757812, :pending_vm_jobs=>0.0008637905120849609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006349325180053711} [----] I, [2016-09-13T09:13:46.177222 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78904], State: [ok], Delivered in [0.007061985] seconds [----] I, [2016-09-13T09:13:50.522937 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:13:51.090120 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78903], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [10.106273102] seconds [----] I, [2016-09-13T09:13:51.090331 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78903], Delivering... [----] I, [2016-09-13T09:13:51.099455 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:13:37 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212541000], Memory % [3.5], CPU Time [49145.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T09:13:51.100243 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:13:40 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169070000], Memory % [3.14], CPU Time [51999.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:13:51.100915 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:13:25 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205295000], Memory % [3.5], CPU Time [242063.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T09:13:51.101593 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:13:39 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [205046.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:13:51.102235 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:13:39 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162422000], Memory % [3.1], CPU Time [38298.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T09:13:51.102859 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:13:40 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152815.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:13:51.103388 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:13:40 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [151899.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:13:51.103931 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:13:30 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [104774.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T09:13:51.107190 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:13:30 UTC], Process Info: Memory Usage [597368832], Memory Size [925552640], Proportional Set Size: [429939000], Memory % [7.28], CPU Time [707.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:13:51.109621 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:13:37 UTC], Process Info: Memory Usage [609284096], Memory Size [1064947712], Proportional Set Size: [441913000], Memory % [7.43], CPU Time [1689.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:13:51.111860 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:13:36 UTC], Process Info: Memory Usage [579952640], Memory Size [907657216], Proportional Set Size: [419581000], Memory % [7.07], CPU Time [2630.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T09:13:51.114000 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:13:34 UTC], Process Info: Memory Usage [557895680], Memory Size [896286720], Proportional Set Size: [405640000], Memory % [6.8], CPU Time [6052.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T09:13:51.114587 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:13:39 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [212315.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T09:13:51.115133 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:13:37 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177794000], Memory % [3.2], CPU Time [51996.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:13:51.115641 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:13:33 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165808000], Memory % [3.16], CPU Time [39193.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T09:13:51.116013 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78903], State: [ok], Delivered in [0.025677952] seconds [----] I, [2016-09-13T09:13:56.028274 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:13:56.038043 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78905], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:13:56.049668 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78906], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:13:56.066810 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78907], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:13:56.078038 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78908], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:13:56.651927 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:13:56.656852 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0027756690979003906, :worker_monitor=>1.1147949695587158, :worker_dequeue=>0.009079933166503906, :total_time=>1.1268713474273682} [----] I, [2016-09-13T09:13:57.124135 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78905], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.092947251] seconds [----] I, [2016-09-13T09:13:57.124359 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78905], Delivering... [----] I, [2016-09-13T09:13:57.181252 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78908], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.109089934] seconds [----] I, [2016-09-13T09:13:57.181542 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78908], Delivering... [----] I, [2016-09-13T09:13:57.186957 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78905], State: [ok], Delivered in [0.062587432] seconds [----] I, [2016-09-13T09:13:57.188992 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003934144973754883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003954648971557617, :pending_vm_jobs=>0.0009813308715820312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0070002079010009766} [----] I, [2016-09-13T09:13:57.189364 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78908], State: [ok], Delivered in [0.007854098] seconds [----] I, [2016-09-13T09:13:57.211880 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78906], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.170859768] seconds [----] I, [2016-09-13T09:13:57.212070 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78906], Delivering... [----] I, [2016-09-13T09:13:57.215113 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78907], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.157925808] seconds [----] I, [2016-09-13T09:13:57.215314 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78907], Delivering... [----] I, [2016-09-13T09:13:57.215514 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78906], State: [ok], Delivered in [0.003437801] seconds [----] I, [2016-09-13T09:13:57.221119 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78907], State: [ok], Delivered in [0.005789952] seconds [----] I, [2016-09-13T09:14:11.087031 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:14:11.112568 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78909], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:14:13.120143 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:14:13.127474 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004960298538208008, :worker_monitor=>1.3227157592773438, :worker_dequeue=>0.012369155883789062, :total_time=>1.3404057025909424} [----] I, [2016-09-13T09:14:13.403936 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78909], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.30873492] seconds [----] I, [2016-09-13T09:14:13.404125 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78909], Delivering... [----] I, [2016-09-13T09:14:13.410110 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003076791763305664, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003097057342529297, :pending_vm_jobs=>0.000720977783203125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005548238754272461} [----] I, [2016-09-13T09:14:13.410477 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78909], State: [ok], Delivered in [0.006320255] seconds [----] I, [2016-09-13T09:14:18.128035 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:14:18 UTC]... [----] I, [2016-09-13T09:14:18.146483 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:14:18 UTC]...Complete [----] I, [2016-09-13T09:14:26.124494 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:14:26.142880 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78910], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:14:26.152271 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78911], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:14:29.435290 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:14:29.442674 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0027532577514648438, :worker_monitor=>1.2499141693115234, :worker_dequeue=>0.012761831283569336, :total_time=>1.2656567096710205} [----] I, [2016-09-13T09:14:29.536903 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78911], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.388696872] seconds [----] I, [2016-09-13T09:14:29.537105 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78911], Delivering... [----] I, [2016-09-13T09:14:29.543903 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035834312438964844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036067962646484375, :pending_vm_jobs=>0.0007977485656738281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063898563385009766} [----] I, [2016-09-13T09:14:29.544292 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78911], State: [ok], Delivered in [0.007177528] seconds [----] I, [2016-09-13T09:14:30.336907 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78910], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.208352185] seconds [----] I, [2016-09-13T09:14:30.337183 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78910], Delivering... [----] I, [2016-09-13T09:14:30.344255 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78910], State: [ok], Delivered in [0.007062699] seconds [----] I, [2016-09-13T09:14:34.458766 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T09:14:41.164078 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:14:41.181177 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78912], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:14:45.789061 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:14:45.793965 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035152435302734375, :worker_monitor=>1.295407772064209, :worker_dequeue=>0.008522748947143555, :total_time=>1.3076913356781006} [----] I, [2016-09-13T09:14:46.627057 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78912], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.45702516] seconds [----] I, [2016-09-13T09:14:46.627169 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78912], Delivering... [----] I, [2016-09-13T09:14:46.630841 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0019845962524414062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0019974708557128906, :pending_vm_jobs=>0.0004673004150390625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0034596920013427734} [----] I, [2016-09-13T09:14:46.631047 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78912], State: [ok], Delivered in [0.003866497] seconds [----] I, [2016-09-13T09:14:50.794550 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:14:50 UTC]... [----] I, [2016-09-13T09:14:50.815681 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:14:50 UTC]...Complete [----] I, [2016-09-13T09:14:56.194622 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:14:56.209991 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78913], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:14:56.227571 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78914], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:14:56.250200 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78915], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:14:56.272935 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78916], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:15:02.293954 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:15:02.301213 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003942012786865234, :worker_monitor=>1.4159870147705078, :worker_dequeue=>0.013226985931396484, :total_time=>1.4334795475006104} [----] I, [2016-09-13T09:15:02.804560 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78913], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.604958137] seconds [----] I, [2016-09-13T09:15:02.804725 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78913], Delivering... [----] I, [2016-09-13T09:15:02.815943 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78916], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.557048098] seconds [----] I, [2016-09-13T09:15:02.816099 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78916], Delivering... [----] I, [2016-09-13T09:15:02.823028 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037567615509033203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037767887115478516, :pending_vm_jobs=>0.000843048095703125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006588459014892578} [----] I, [2016-09-13T09:15:02.823747 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78916], State: [ok], Delivered in [0.007618242] seconds [----] I, [2016-09-13T09:15:02.861537 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78913], State: [ok], Delivered in [0.056778363] seconds [----] I, [2016-09-13T09:15:03.439723 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78914], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.224323345] seconds [----] I, [2016-09-13T09:15:03.439866 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78914], Delivering... [----] I, [2016-09-13T09:15:03.442021 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78914], State: [ok], Delivered in [0.002139225] seconds [----] I, [2016-09-13T09:15:03.461248 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78915], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.221082916] seconds [----] I, [2016-09-13T09:15:03.461378 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78915], Delivering... [----] I, [2016-09-13T09:15:03.464690 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78915], State: [ok], Delivered in [0.003309767] seconds [----] I, [2016-09-13T09:15:11.288359 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:15:11.307970 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78917], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:15:12.422928 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:15:12.501670 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78917], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.208056089] seconds [----] I, [2016-09-13T09:15:12.501792 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78917], Delivering... [----] I, [2016-09-13T09:15:12.505713 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002073526382446289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020890235900878906, :pending_vm_jobs=>0.0004837512969970703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003671407699584961} [----] I, [2016-09-13T09:15:12.505924 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78917], State: [ok], Delivered in [0.004126262] seconds [----] I, [2016-09-13T09:15:19.053800 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003998994827270508, :worker_monitor=>1.6110575199127197, :worker_dequeue=>0.011458396911621094, :total_time=>1.6267828941345215} [----] I, [2016-09-13T09:15:24.054265 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:15:24 UTC]... [----] I, [2016-09-13T09:15:24.078968 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:15:24 UTC]...Complete [----] I, [2016-09-13T09:15:26.319806 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:15:26.365029 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78918], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:15:26.398463 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78919], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:15:29.097527 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:15:30.047459 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78919], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.673426865] seconds [----] I, [2016-09-13T09:15:30.047626 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78919], Delivering... [----] I, [2016-09-13T09:15:30.052366 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002504587173461914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025205612182617188, :pending_vm_jobs=>0.0006639957427978516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004476785659790039} [----] I, [2016-09-13T09:15:30.052688 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78919], State: [ok], Delivered in [0.005052789] seconds [----] I, [2016-09-13T09:15:30.559613 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78918], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.226962809] seconds [----] I, [2016-09-13T09:15:30.559810 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78918], Delivering... [----] I, [2016-09-13T09:15:30.564710 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78918], State: [ok], Delivered in [0.004891463] seconds [----] I, [2016-09-13T09:15:35.793973 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00357818603515625, :worker_monitor=>1.677612543106079, :worker_dequeue=>0.00938725471496582, :total_time=>1.6907994747161865} [----] I, [2016-09-13T09:15:41.415977 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:15:41.439179 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78920], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:15:45.811090 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:15:46.188211 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78920], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.765053712] seconds [----] I, [2016-09-13T09:15:46.188530 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78920], Delivering... [----] I, [2016-09-13T09:15:46.198112 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004908084869384766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0049457550048828125, :pending_vm_jobs=>0.0011916160583496094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009035825729370117} [----] I, [2016-09-13T09:15:46.198560 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78920], State: [ok], Delivered in [0.010027546] seconds [----] I, [2016-09-13T09:15:52.408958 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038700103759765625, :worker_monitor=>1.5224530696868896, :worker_dequeue=>0.007561206817626953, :total_time=>1.5342164039611816} [----] I, [2016-09-13T09:15:56.791512 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:15:56.827666 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78921], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:15:56.858998 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78922], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:15:56.884928 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78923], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:15:56.907656 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78924], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:15:57.409376 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:15:57 UTC]... [----] I, [2016-09-13T09:15:57.427616 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:15:57 UTC]...Complete [----] I, [2016-09-13T09:15:57.435650 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:15:57.701943 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78921], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.886571887] seconds [----] I, [2016-09-13T09:15:57.702075 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78921], Delivering... [----] I, [2016-09-13T09:15:57.747850 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78924], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.857522636] seconds [----] I, [2016-09-13T09:15:57.748060 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78924], Delivering... [----] I, [2016-09-13T09:15:57.754185 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036640167236328125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003682851791381836, :pending_vm_jobs=>0.0007221698760986328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005777835845947266} [----] I, [2016-09-13T09:15:57.754505 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78924], State: [ok], Delivered in [0.006464356] seconds [----] I, [2016-09-13T09:15:57.770624 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78921], State: [ok], Delivered in [0.068486456] seconds [----] I, [2016-09-13T09:15:57.776070 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78922], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.942010263] seconds [----] I, [2016-09-13T09:15:57.776181 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78922], Delivering... [----] I, [2016-09-13T09:15:57.777997 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78922], State: [ok], Delivered in [0.001812682] seconds [----] I, [2016-09-13T09:15:57.850926 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78923], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.986594913] seconds [----] I, [2016-09-13T09:15:57.851098 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78923], Delivering... [----] I, [2016-09-13T09:15:57.855461 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78923], State: [ok], Delivered in [0.00433611] seconds [----] I, [2016-09-13T09:16:09.043102 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003208160400390625, :server_monitor=>0.08212828636169434, :worker_monitor=>1.4934947490692139, :worker_dequeue=>0.007441520690917969, :total_time=>1.5866694450378418} [----] I, [2016-09-13T09:16:11.917763 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:16:11.942054 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78925], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:16:14.055439 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:16:14.377012 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78925], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.451910514] seconds [----] I, [2016-09-13T09:16:14.377138 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78925], Delivering... [----] I, [2016-09-13T09:16:14.380847 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002030611038208008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002040863037109375, :pending_vm_jobs=>0.0005040168762207031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0034737586975097656} [----] I, [2016-09-13T09:16:14.381041 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78925], State: [ok], Delivered in [0.00390354] seconds [----] I, [2016-09-13T09:16:25.580006 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004099130630493164, :worker_monitor=>1.4776582717895508, :worker_dequeue=>0.01115274429321289, :total_time=>1.4931864738464355} [----] I, [2016-09-13T09:16:26.952000 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:16:26.989715 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78926], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:16:27.028406 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78927], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:16:30.581036 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:16:30 UTC]... [----] I, [2016-09-13T09:16:30.668242 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:16:30 UTC]...Complete [----] I, [2016-09-13T09:16:30.679801 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:16:30.919780 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78927], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.92414254] seconds [----] I, [2016-09-13T09:16:30.919921 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78927], Delivering... [----] I, [2016-09-13T09:16:30.924666 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002565145492553711, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025777816772460938, :pending_vm_jobs=>0.0005755424499511719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004469394683837891} [----] I, [2016-09-13T09:16:30.924918 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78927], State: [ok], Delivered in [0.004995222] seconds [----] I, [2016-09-13T09:16:30.948148 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78926], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.991698272] seconds [----] I, [2016-09-13T09:16:30.948282 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78926], Delivering... [----] I, [2016-09-13T09:16:30.952055 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78926], State: [ok], Delivered in [0.003766319] seconds [----] I, [2016-09-13T09:16:41.983331 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004629850387573242, :worker_monitor=>1.2554471492767334, :worker_dequeue=>0.009572744369506836, :total_time=>1.2699589729309082} [----] I, [2016-09-13T09:16:42.038823 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:16:42.051204 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78928], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:16:46.993028 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:16:47.618690 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78928], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.576158801] seconds [----] I, [2016-09-13T09:16:47.618869 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78928], Delivering... [----] I, [2016-09-13T09:16:47.625369 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033931732177734375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003427267074584961, :pending_vm_jobs=>0.0009279251098632812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006173849105834961} [----] I, [2016-09-13T09:16:47.625788 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78928], State: [ok], Delivered in [0.006908787] seconds [----] I, [2016-09-13T09:16:57.063073 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:16:57.074140 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78929], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:16:57.085498 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78930], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:16:57.102739 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78931], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:16:57.120238 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78932], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:16:58.399920 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:16:58.406347 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003981351852416992, :worker_monitor=>1.3749611377716064, :worker_dequeue=>0.01148366928100586, :total_time=>1.3907158374786377} [----] I, [2016-09-13T09:16:58.748737 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78929], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.680500323] seconds [----] I, [2016-09-13T09:16:58.748924 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78929], Delivering... [----] I, [2016-09-13T09:16:58.760215 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78932], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.651766581] seconds [----] I, [2016-09-13T09:16:58.760398 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78932], Delivering... [----] I, [2016-09-13T09:16:58.766526 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031995773315429688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032167434692382812, :pending_vm_jobs=>0.0007469654083251953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005674839019775391} [----] I, [2016-09-13T09:16:58.766940 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78932], State: [ok], Delivered in [0.006543898] seconds [----] I, [2016-09-13T09:16:58.805948 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78929], State: [ok], Delivered in [0.05700523] seconds [----] I, [2016-09-13T09:17:01.051452 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78930], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.97214287] seconds [----] I, [2016-09-13T09:17:01.051629 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78930], Delivering... [----] I, [2016-09-13T09:17:01.055921 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78930], State: [ok], Delivered in [0.004290937] seconds [----] I, [2016-09-13T09:17:01.074475 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78931], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.981219961] seconds [----] I, [2016-09-13T09:17:01.074673 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78931], Delivering... [----] I, [2016-09-13T09:17:01.079241 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78931], State: [ok], Delivered in [0.004565206] seconds [----] I, [2016-09-13T09:17:03.406843 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:17:03 UTC]... [----] I, [2016-09-13T09:17:03.457289 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:17:03 UTC]...Complete [----] I, [2016-09-13T09:17:12.133651 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:17:12.161948 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78933], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:17:14.952383 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:17:14.962219 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006374835968017578, :worker_monitor=>1.3228347301483154, :worker_dequeue=>0.014707803726196289, :total_time=>1.344223976135254} [----] I, [2016-09-13T09:17:15.885947 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78933], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.746250804] seconds [----] I, [2016-09-13T09:17:15.886116 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78933], Delivering... [----] I, [2016-09-13T09:17:15.892142 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003130674362182617, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031478404998779297, :pending_vm_jobs=>0.0007638931274414062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005706071853637695} [----] I, [2016-09-13T09:17:15.892478 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78933], State: [ok], Delivered in [0.006326304] seconds [----] I, [2016-09-13T09:17:27.173649 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:17:27.194723 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78934], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:17:27.205727 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78935], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:17:31.227628 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:17:31.230827 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0029006004333496094, :worker_monitor=>1.2277710437774658, :worker_dequeue=>0.005953073501586914, :total_time=>1.2368147373199463} [----] I, [2016-09-13T09:17:32.006193 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78935], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.805741902] seconds [----] I, [2016-09-13T09:17:32.006372 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78935], Delivering... [----] I, [2016-09-13T09:17:32.012605 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032460689544677734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003264188766479492, :pending_vm_jobs=>0.0008058547973632812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005835771560668945} [----] I, [2016-09-13T09:17:32.012968 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78935], State: [ok], Delivered in [0.006599477] seconds [----] I, [2016-09-13T09:17:34.149139 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78934], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.971028859] seconds [----] I, [2016-09-13T09:17:34.149316 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78934], Delivering... [----] I, [2016-09-13T09:17:34.153839 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78934], State: [ok], Delivered in [0.004507275] seconds [----] I, [2016-09-13T09:17:36.231270 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:17:36 UTC]... [----] I, [2016-09-13T09:17:36.280170 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:17:36 UTC]...Complete [----] I, [2016-09-13T09:17:42.217271 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:17:42.234500 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78936], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:17:47.802807 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:17:47.809640 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038604736328125, :worker_monitor=>1.48193359375, :worker_dequeue=>0.011760711669921875, :total_time=>1.497967004776001} [----] I, [2016-09-13T09:17:48.132200 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78936], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.909021798] seconds [----] I, [2016-09-13T09:17:48.132453 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78936], Delivering... [----] I, [2016-09-13T09:17:48.138863 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003437519073486328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034570693969726562, :pending_vm_jobs=>0.0007529258728027344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059757232666015625} [----] I, [2016-09-13T09:17:48.139183 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78936], State: [ok], Delivered in [0.006780589] seconds [----] I, [2016-09-13T09:17:57.246220 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:17:57.263562 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78937], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:17:57.274819 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78938], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:17:57.292124 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78939], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:17:57.303274 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78940], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:17:57.838943 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:17:58.201096 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78937], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.950014041] seconds [----] I, [2016-09-13T09:17:58.201315 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78937], Delivering... [----] I, [2016-09-13T09:17:58.249183 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78940], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.950921984] seconds [----] I, [2016-09-13T09:17:58.249332 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78940], Delivering... [----] I, [2016-09-13T09:17:58.254138 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022630691528320312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027756690979003906, :pending_vm_jobs=>0.0005540847778320312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004511117935180664} [----] I, [2016-09-13T09:17:58.254366 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78940], State: [ok], Delivered in [0.005034527] seconds [----] I, [2016-09-13T09:17:58.275578 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78938], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.006192247] seconds [----] I, [2016-09-13T09:17:58.275866 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78938], Delivering... [----] I, [2016-09-13T09:17:58.280728 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78939], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.997700603] seconds [----] I, [2016-09-13T09:17:58.280742 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78937], State: [ok], Delivered in [0.079409164] seconds [----] I, [2016-09-13T09:17:58.280841 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78939], Delivering... [----] I, [2016-09-13T09:17:58.283677 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78939], State: [ok], Delivered in [0.002832075] seconds [----] I, [2016-09-13T09:17:58.286646 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78938], State: [ok], Delivered in [0.01076843] seconds [----] I, [2016-09-13T09:18:03.969388 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004242897033691406, :worker_monitor=>1.1144866943359375, :worker_dequeue=>0.006436347961425781, :total_time=>1.1254260540008545} [----] I, [2016-09-13T09:18:08.969820 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:18:08 UTC]... [----] I, [2016-09-13T09:18:08.983465 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:18:08 UTC]...Complete [----] I, [2016-09-13T09:18:12.315915 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T09:18:12.338242 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78941], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [3600] [----] I, [2016-09-13T09:18:12.355136 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78942], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:18:14.115813 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:18:14.389688 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78942], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.044159407] seconds [----] I, [2016-09-13T09:18:14.389877 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78942], Delivering... [----] I, [2016-09-13T09:18:14.396063 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032737255096435547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003292560577392578, :pending_vm_jobs=>0.0007903575897216797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058591365814208984} [----] I, [2016-09-13T09:18:14.396401 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78942], State: [ok], Delivered in [0.006515098] seconds [----] I, [2016-09-13T09:18:16.413180 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78941], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [3600], Dequeued in: [4.091158765] seconds [----] I, [2016-09-13T09:18:16.413348 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78941], Delivering... [----] I, [2016-09-13T09:18:16.426567 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78941], State: [ok], Delivered in [0.013181185] seconds [----] I, [2016-09-13T09:18:20.869935 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00673222541809082, :worker_monitor=>1.7160074710845947, :worker_dequeue=>0.023576021194458008, :total_time=>1.746708869934082} [----] I, [2016-09-13T09:18:27.368902 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:18:27.396614 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78943], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:18:27.430128 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78944], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:18:30.897674 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:18:31.442523 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78944], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.037133914] seconds [----] I, [2016-09-13T09:18:31.442748 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78944], Delivering... [----] I, [2016-09-13T09:18:31.449324 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033981800079345703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003443002700805664, :pending_vm_jobs=>0.0007882118225097656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006201028823852539} [----] I, [2016-09-13T09:18:31.449752 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78944], State: [ok], Delivered in [0.007000818] seconds [----] I, [2016-09-13T09:18:31.481178 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78943], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.105148761] seconds [----] I, [2016-09-13T09:18:31.481358 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78943], Delivering... [----] I, [2016-09-13T09:18:31.486165 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78943], State: [ok], Delivered in [0.004791107] seconds [----] I, [2016-09-13T09:18:37.069622 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00412440299987793, :worker_monitor=>1.1453399658203125, :worker_dequeue=>0.016904830932617188, :total_time=>1.1667242050170898} [----] I, [2016-09-13T09:18:42.070153 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:18:42 UTC]... [----] I, [2016-09-13T09:18:42.093158 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:18:42 UTC]...Complete [----] I, [2016-09-13T09:18:42.447802 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:18:42.469521 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78945], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:18:42.486650 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78946], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:18:42.509327 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78947], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:18:47.128607 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:18:47.664007 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78945], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.210097507] seconds [----] I, [2016-09-13T09:18:47.664181 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78945], Delivering... [----] I, [2016-09-13T09:18:47.665051 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T09:18:47.665234 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5358440448 [----] I, [2016-09-13T09:18:47.665321 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5129359360 [----] I, [2016-09-13T09:18:47.665394 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 229081088 [----] I, [2016-09-13T09:18:47.665525 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1323302912 [----] I, [2016-09-13T09:18:47.665620 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5075304448 [----] I, [2016-09-13T09:18:47.665691 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T09:18:47.665755 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T09:18:47.665817 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 550961152 [----] I, [2016-09-13T09:18:47.665882 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T09:18:47.665945 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7878545408 [----] I, [2016-09-13T09:18:47.666010 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T09:18:47.666076 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T09:18:47.666138 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T09:18:47.666200 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T09:18:47.666267 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T09:18:47.666330 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T09:18:47.666394 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T09:18:47.666497 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T09:18:47.666600 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T09:18:47.666674 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T09:18:47.666736 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 274046976 [----] I, [2016-09-13T09:18:47.666798 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57229312 [----] I, [2016-09-13T09:18:47.666864 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216817664 [----] I, [2016-09-13T09:18:47.666927 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T09:18:47.666993 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141934592 [----] I, [2016-09-13T09:18:47.667055 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2591674368 [----] I, [2016-09-13T09:18:47.667116 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2267607040 [----] I, [2016-09-13T09:18:47.667180 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T09:18:47.667244 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T09:18:47.667317 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T09:18:47.667387 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37306368 [----] I, [2016-09-13T09:18:47.667491 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T09:18:47.667586 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53153792 [----] I, [2016-09-13T09:18:47.667658 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111284224 [----] I, [2016-09-13T09:18:47.667721 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155451392 [----] I, [2016-09-13T09:18:47.667780 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T09:18:47.667848 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T09:18:47.667910 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T09:18:47.667969 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T09:18:47.668028 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T09:18:47.668089 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T09:18:47.668151 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T09:18:47.668207 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T09:18:47.668274 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T09:18:47.671148 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78946], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.19605391] seconds [----] I, [2016-09-13T09:18:47.671388 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78946], Delivering... [----] I, [2016-09-13T09:18:47.677815 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:18:26 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212541000], Memory % [3.5], CPU Time [49152.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T09:18:47.678292 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:18:34 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169070000], Memory % [3.14], CPU Time [52015.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:18:47.678752 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:18:27 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205295000], Memory % [3.5], CPU Time [242220.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T09:18:47.679155 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:18:34 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162422000], Memory % [3.1], CPU Time [38307.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T09:18:47.679491 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:18:30 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [104789.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T09:18:47.679902 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:18:34 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [205089.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:18:47.680279 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:18:36 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [151956.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:18:47.680625 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:18:36 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152868.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:18:47.682895 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:18:28 UTC], Process Info: Memory Usage [597573632], Memory Size [926470144], Proportional Set Size: [430477000], Memory % [7.28], CPU Time [1746.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:18:47.684411 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:18:30 UTC], Process Info: Memory Usage [597368832], Memory Size [925552640], Proportional Set Size: [429939000], Memory % [7.28], CPU Time [718.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:18:47.686002 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:18:34 UTC], Process Info: Memory Usage [558166016], Memory Size [911491072], Proportional Set Size: [405872000], Memory % [6.8], CPU Time [6062.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T09:18:47.687501 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:18:36 UTC], Process Info: Memory Usage [580173824], Memory Size [922337280], Proportional Set Size: [419805000], Memory % [7.07], CPU Time [2639.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T09:18:47.687924 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:18:34 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [212352.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T09:18:47.688285 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:18:35 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177794000], Memory % [3.2], CPU Time [52010.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:18:47.688643 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:18:33 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165808000], Memory % [3.16], CPU Time [39202.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T09:18:47.688914 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78946], State: [ok], Delivered in [0.017529101] seconds [----] I, [2016-09-13T09:18:47.708485 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T09:18:47.708692 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T09:18:47.712841 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T09:18:47.716969 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T09:18:47.720862 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T09:18:47.723879 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T09:18:47.726708 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78947], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.232505849] seconds [----] I, [2016-09-13T09:18:47.726843 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78947], Delivering... [----] I, [2016-09-13T09:18:47.726855 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T09:18:47.729728 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 851 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T09:18:47.731937 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027167797088623047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027365684509277344, :pending_vm_jobs=>0.00060272216796875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004830121994018555} [----] I, [2016-09-13T09:18:47.732208 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78947], State: [ok], Delivered in [0.005360376] seconds [----] I, [2016-09-13T09:18:47.732573 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T09:18:47.735584 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T09:18:47.738446 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T09:18:47.741211 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T09:18:47.744045 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T09:18:47.746804 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T09:18:47.749304 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:18:47.749474 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:18:47.749608 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T09:18:47.753902 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202018000], Memory % [3.38], CPU Time [151948.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:18:47.754211 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78945], State: [ok], Delivered in [0.090016883] seconds [----] I, [2016-09-13T09:18:53.462324 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0047566890716552734, :worker_monitor=>1.3132922649383545, :worker_dequeue=>0.008339643478393555, :total_time=>1.3267149925231934} [----] I, [2016-09-13T09:18:57.524020 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:18:57.543686 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78948], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:18:57.554871 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78949], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:18:57.572059 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78950], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:18:57.583540 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78951], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:18:58.471925 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:18:58.635279 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78948], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.106689358] seconds [----] I, [2016-09-13T09:18:58.635563 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78948], Delivering... [----] I, [2016-09-13T09:18:58.652751 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78951], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.075264177] seconds [----] I, [2016-09-13T09:18:58.652953 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78951], Delivering... [----] I, [2016-09-13T09:18:58.659644 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035829544067382812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003609180450439453, :pending_vm_jobs=>0.0008225440979003906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006312847137451172} [----] I, [2016-09-13T09:18:58.660027 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78951], State: [ok], Delivered in [0.007068912] seconds [----] I, [2016-09-13T09:18:58.692218 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78948], State: [ok], Delivered in [0.056676556] seconds [----] I, [2016-09-13T09:18:58.697932 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78949], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.149164095] seconds [----] I, [2016-09-13T09:18:58.698102 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78949], Delivering... [----] I, [2016-09-13T09:18:58.700860 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78949], State: [ok], Delivered in [0.002749482] seconds [----] I, [2016-09-13T09:18:58.749576 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78950], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.187051641] seconds [----] I, [2016-09-13T09:18:58.749754 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78950], Delivering... [----] I, [2016-09-13T09:18:58.754863 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78950], State: [ok], Delivered in [0.005074131] seconds [----] I, [2016-09-13T09:19:12.595197 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T09:19:12.646731 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78952], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:19:12.663622 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78953], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:19:14.239240 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:19:14 UTC]... [----] I, [2016-09-13T09:19:14.257897 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:19:14 UTC]...Complete [----] I, [2016-09-13T09:19:14.367219 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:19:14.923071 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78953], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.267403013] seconds [----] I, [2016-09-13T09:19:14.923367 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78953], Delivering... [----] I, [2016-09-13T09:19:14.933264 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005439281463623047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0055332183837890625, :pending_vm_jobs=>0.0014595985412597656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009279012680053711} [----] I, [2016-09-13T09:19:14.933677 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78953], State: [ok], Delivered in [0.010341229] seconds [----] I, [2016-09-13T09:19:16.790003 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78952], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.178140337] seconds [----] I, [2016-09-13T09:19:16.790180 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78952], Delivering... [----] I, [2016-09-13T09:19:16.824379 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78954], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]] [----] I, [2016-09-13T09:19:16.847212 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78955], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]] [----] I, [2016-09-13T09:19:16.847628 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78952], State: [ok], Delivered in [0.057427315] seconds [----] I, [2016-09-13T09:19:19.398140 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_15, wcount=2, priority=200 [----] I, [2016-09-13T09:19:19.401864 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T09:19:20.973402 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [78954], MiqWorker id: [101], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_15], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 15]]], Dequeued in: [4.165349076] seconds [----] I, [2016-09-13T09:19:20.973723 #12930:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78954], Delivering... [----] I, [2016-09-13T09:19:20.977674 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T09:19:20.977849 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS... [----] I, [2016-09-13T09:19:20.977980 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15] [----] I, [2016-09-13T09:19:20.978148 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]... [----] I, [2016-09-13T09:19:20.978302 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:21.265379 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:21.465221 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:21.465405 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:21.792966 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:21.887342 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:21.977675 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:22.281243 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:22.383998 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:22.476175 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:22.567824 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:22.659296 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:22.750810 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:22.844715 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:22.938779 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:23.052873 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:23.144983 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:23.238805 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:23.331753 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:23.425000 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:23.518589 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:23.612162 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:23.704399 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:23.796084 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [TT] [----] I, [2016-09-13T09:19:24.055050 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [TT], id: [15] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [TT] id [15]...Complete [----] I, [2016-09-13T09:19:24.055290 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [TT], id: [15] Refreshing targets for EMS...Complete - Timings {:server_dequeue=>0.004851818084716797, :collect_inventory_for_targets=>4.172325134277344e-05, :parse_legacy_inventory=>18.05898427963257, :parse_targeted_inventory=>18.05913758277893, :save_inventory=>1.0430428981781006, :ems_refresh=>19.105055809020996} [----] I, [2016-09-13T09:19:24.075388 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] I, [2016-09-13T09:19:24.075882 #12930:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78954], State: [ok], Delivered in [3.10217958] seconds [----] I, [2016-09-13T09:19:25.615967 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_16, wcount=2, priority=200 [----] I, [2016-09-13T09:19:25.616099 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037746429443359375, :worker_monitor=>1.2025830745697021, :worker_dequeue=>0.0071010589599609375, :total_time=>1.213737964630127} [----] I, [2016-09-13T09:19:27.675299 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T09:19:27.738939 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78956], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:19:27.756101 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78957], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:19:27.778731 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78958], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:19:28.339609 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [78955], MiqWorker id: [100], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_16], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 16]]], Dequeued in: [11.508056884] seconds [----] I, [2016-09-13T09:19:28.339824 #10859:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78955], Delivering... [----] I, [2016-09-13T09:19:28.343787 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T09:19:28.343995 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refreshing targets for EMS... [----] I, [2016-09-13T09:19:28.344149 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T09:19:28.344335 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [16] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16]... [----] I, [2016-09-13T09:19:28.344564 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:28.790118 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:29.092526 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:29.092715 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:29.595561 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:29.911366 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:29.911658 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:30.414988 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:30.625725 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:19:30.711082 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:30.711273 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:31.064916 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78958], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.303341159] seconds [----] I, [2016-09-13T09:19:31.065110 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78958], Delivering... [----] I, [2016-09-13T09:19:31.071401 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003421306610107422, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034389495849609375, :pending_vm_jobs=>0.0007588863372802734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005921840667724609} [----] I, [2016-09-13T09:19:31.071815 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78958], State: [ok], Delivered in [0.006690801] seconds [----] I, [2016-09-13T09:19:31.178469 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:31.477522 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:31.477711 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:31.859090 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78956], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.179112011] seconds [----] I, [2016-09-13T09:19:31.859241 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78956], Delivering... [----] I, [2016-09-13T09:19:31.904698 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78957], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.16278192] seconds [----] I, [2016-09-13T09:19:31.904864 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78957], Delivering... [----] I, [2016-09-13T09:19:31.910366 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78957], State: [ok], Delivered in [0.005461247] seconds [----] I, [2016-09-13T09:19:31.940147 #2937:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 13:19:30 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_16' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 13:19:30.630250') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2927,,2016-09-13 13:19:31 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2936,,2016-09-13 13:19:28 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2946,2016-09-13 13:19:31 UTC,2016-09-13 13:19:31 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 13:19:31 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 13:19:31 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 13:19:29 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2986,,2016-09-13 13:19:29 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2997,,2016-09-13 13:19:27 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 13:19:12.669717')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,4, 3011,,2016-09-13 12:55:20 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1451, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,514926, 3030,,2016-09-13 12:55:16 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1455, 3054,,2016-09-13 12:25:11 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3260, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,514925, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,514924, 3160,,2016-09-13 12:25:14 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3256, 10867,,2016-09-13 13:19:28 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3, 703,,2016-09-13 12:55:23 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1448, 27056,,2016-09-13 12:55:24 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1447, 28888,,2016-09-13 11:55:01 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5070, 12938,,2016-09-13 13:19:24 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,7, 20394,,2016-09-13 12:55:25 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1446, ACTIVITY_STATS_CSV [----] I, [2016-09-13T09:19:31.940517 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78956], State: [ok], Delivered in [0.081230854] seconds [----] I, [2016-09-13T09:19:31.972722 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:32.293618 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:32.293803 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:32.760771 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:33.068288 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:33.068482 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:33.594790 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:33.920404 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:33.920636 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:34.375852 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:34.665879 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:34.666059 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:35.126866 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:35.406905 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:35.407066 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:35.647189 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T09:19:41.876245 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:42.104242 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041391849517822266, :worker_monitor=>1.4346327781677246, :worker_dequeue=>0.00654292106628418, :total_time=>1.445594072341919} [----] I, [2016-09-13T09:19:42.187343 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:42.187531 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:42.703667 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:42.788358 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:19:42.836356 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78959], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:19:43.010196 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:43.010487 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:43.536165 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:43.847589 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:43.847717 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:44.320258 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:44.627658 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:44.627795 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:45.094780 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:45.257273 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:45.396710 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:45.534095 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:45.673024 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:45.814248 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:45.949973 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:46.084805 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:46.220345 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:46.354861 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:46.493308 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:46.623662 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:46.757170 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:46.897522 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:47.034582 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:47.104643 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:19:47 UTC]... [----] I, [2016-09-13T09:19:47.115410 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:19:47 UTC]...Complete [----] I, [2016-09-13T09:19:47.130593 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:19:47.172961 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78959], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.378268015] seconds [----] I, [2016-09-13T09:19:47.173171 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78959], Delivering... [----] I, [2016-09-13T09:19:47.180396 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003871917724609375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038955211639404297, :pending_vm_jobs=>0.0009047985076904297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006807565689086914} [----] I, [2016-09-13T09:19:47.180829 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78959], State: [ok], Delivered in [0.007647652] seconds [----] I, [2016-09-13T09:19:47.410487 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:47.563718 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:47.720452 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:47.858110 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:48.002114 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:48.144031 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:48.293636 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:48.427863 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:48.576404 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:48.735138 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:48.873620 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:49.017689 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:49.185015 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:49.330114 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:49.465012 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:49.620991 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:49.759929 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:50.226720 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:50.377130 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:50.520690 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:50.655811 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:50.791647 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:50.933016 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:51.078530 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:51.218807 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:51.362327 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:51.510776 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:51.650206 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:51.794779 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:51.932835 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:52.069052 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:52.213718 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:52.357097 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:52.490986 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:52.886986 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:57.849444 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:19:57.875598 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78960], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:19:57.886930 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78961], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:19:57.910220 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78962], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:19:57.921143 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78963], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:19:58.300366 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:19:58.304559 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030832290649414062, :worker_monitor=>1.1359608173370361, :worker_dequeue=>0.007798433303833008, :total_time=>1.1471049785614014} [----] I, [2016-09-13T09:19:59.048499 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78960], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.193574111] seconds [----] I, [2016-09-13T09:19:59.048724 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78960], Delivering... [----] I, [2016-09-13T09:19:59.058996 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78963], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.143006978] seconds [----] I, [2016-09-13T09:19:59.059245 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78963], Delivering... [----] I, [2016-09-13T09:19:59.064623 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:59.068600 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004900217056274414, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0049250125885009766, :pending_vm_jobs=>0.0011060237884521484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008762359619140625} [----] I, [2016-09-13T09:19:59.069044 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78963], State: [ok], Delivered in [0.009801205] seconds [----] I, [2016-09-13T09:19:59.092939 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78961], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.211750787] seconds [----] I, [2016-09-13T09:19:59.093153 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78961], Delivering... [----] I, [2016-09-13T09:19:59.097135 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78961], State: [ok], Delivered in [0.003868159] seconds [----] I, [2016-09-13T09:19:59.109968 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78960], State: [ok], Delivered in [0.061221999] seconds [----] I, [2016-09-13T09:19:59.121462 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78962], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.226463829] seconds [----] I, [2016-09-13T09:19:59.121690 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78962], Delivering... [----] I, [2016-09-13T09:19:59.126399 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78962], State: [ok], Delivered in [0.00468649] seconds [----] I, [2016-09-13T09:19:59.201718 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:59.347709 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:59.484998 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:59.660030 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:59.802044 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:19:59.948410 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:00.090148 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:00.226564 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:00.366843 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:00.502333 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:00.642048 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:00.787264 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:00.921622 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:01.067339 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:01.205210 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:01.542229 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:01.693466 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:01.835705 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:01.973252 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:02.110828 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:02.247820 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:02.390230 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:02.536645 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:02.678397 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:02.821741 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:02.971198 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:03.106623 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:03.248604 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:03.386398 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:03.529298 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:03.669475 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:03.812494 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:04.244382 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:04.397659 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:04.543815 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:04.686549 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:04.824170 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:04.959453 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:05.095485 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:05.237609 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:05.382943 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:05.521050 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:05.664335 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:05.807438 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:05.941947 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:06.088712 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:06.237030 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:06.377692 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:06.510647 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:07.031782 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:07.182398 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:07.324842 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:07.465265 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:07.608400 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:07.749362 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:07.895746 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:08.033807 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:08.173367 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:08.319197 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:08.466310 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:08.603827 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:08.777975 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:08.919297 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:09.058873 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:09.213148 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:09.354639 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:09.840924 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:12.933876 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T09:20:12.950108 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78964], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:20:12.968344 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78965], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:20:12.984560 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78966], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:20:13.001553 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78967], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:20:14.894359 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:20:14.901306 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004153251647949219, :worker_monitor=>1.530994176864624, :worker_dequeue=>0.012433052062988281, :total_time=>1.547942876815796} [----] I, [2016-09-13T09:20:15.419353 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78967], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.425928043] seconds [----] I, [2016-09-13T09:20:15.419709 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78967], Delivering... [----] I, [2016-09-13T09:20:15.429896 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005369424819946289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005418539047241211, :pending_vm_jobs=>0.00128173828125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009630441665649414} [----] I, [2016-09-13T09:20:15.430364 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78967], State: [ok], Delivered in [0.01066189] seconds [----] I, [2016-09-13T09:20:16.029166 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:16.169051 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:16.305606 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:16.448656 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:16.586622 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:16.728204 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:16.870055 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:17.013579 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:17.155970 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:17.185105 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78964], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.245543823] seconds [----] I, [2016-09-13T09:20:17.185356 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78964], Delivering... [----] I, [2016-09-13T09:20:17.188714 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78964], State: [ok], Delivered in [0.003334331] seconds [----] I, [2016-09-13T09:20:17.202410 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78965], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.243637571] seconds [----] I, [2016-09-13T09:20:17.202756 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78965], Delivering... [----] I, [2016-09-13T09:20:17.219603 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78965], State: [ok], Delivered in [0.016786593] seconds [----] I, [2016-09-13T09:20:17.270652 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78966], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.293643023] seconds [----] I, [2016-09-13T09:20:17.270850 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78966], Delivering... [----] I, [2016-09-13T09:20:17.276858 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78966], State: [ok], Delivered in [0.005970541] seconds [----] I, [2016-09-13T09:20:17.300299 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:17.447151 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:17.591619 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:17.726717 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:17.868021 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:18.009182 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:18.148718 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:18.527766 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:18.722046 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:18.874654 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:19.015496 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:19.163812 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:19.304106 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:19.443860 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:19.588545 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:19.735894 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:19.881555 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:19.901818 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:20:19 UTC]... [----] I, [2016-09-13T09:20:19.921604 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:20:19 UTC]...Complete [----] I, [2016-09-13T09:20:20.037730 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:20.170917 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:20.312705 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:20.454301 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:20.590331 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:20.724761 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:20.866256 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:21.188779 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:21.342189 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:21.475309 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:21.613021 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:21.755989 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:21.900257 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:22.041637 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:22.181564 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:22.320875 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:22.467828 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:22.612972 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:22.785665 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:22.921708 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:23.061751 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:23.204227 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:23.345023 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:23.487998 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:23.845247 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:24.004804 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:24.144687 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:24.287145 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:24.425691 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:24.565573 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:24.702907 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:24.905035 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:25.046102 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:25.190196 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:25.330252 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:25.469597 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:25.611792 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:25.794979 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:25.945474 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:26.087364 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:26.229628 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:26.598836 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:26.776634 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:28.013916 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:20:28.036026 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78968], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:20:28.058927 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78969], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:20:31.632114 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:20:31.638523 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003991127014160156, :worker_monitor=>1.5596296787261963, :worker_dequeue=>0.011325597763061523, :total_time=>1.5752317905426025} [----] I, [2016-09-13T09:20:32.310276 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78969], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.266805885] seconds [----] I, [2016-09-13T09:20:32.310405 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78969], Delivering... [----] I, [2016-09-13T09:20:32.314585 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002320528030395508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002337217330932617, :pending_vm_jobs=>0.0004553794860839844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003914356231689453} [----] I, [2016-09-13T09:20:32.314812 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78969], State: [ok], Delivered in [0.004407563] seconds [----] I, [2016-09-13T09:20:32.338785 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78968], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.316760423] seconds [----] I, [2016-09-13T09:20:32.338912 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78968], Delivering... [----] I, [2016-09-13T09:20:32.342213 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78968], State: [ok], Delivered in [0.003293068] seconds [----] I, [2016-09-13T09:20:32.944684 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:33.085523 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:33.223019 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:33.369630 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:33.508523 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:33.652564 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:33.794492 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:33.930689 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:34.064150 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:34.209513 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:34.351495 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:34.490635 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:34.629321 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:34.780324 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:34.915550 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:35.315860 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:35.473329 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:35.617305 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:35.751972 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:35.894068 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:36.035487 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:36.175627 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:36.315304 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:36.449031 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:36.594319 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:36.731722 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:36.869477 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:37.015187 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:37.154959 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:37.294438 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:37.427720 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:37.569050 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:37.926548 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:38.076409 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:38.216287 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:38.368984 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:38.516446 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:38.669165 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:38.812786 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:38.950464 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:39.092065 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:39.237822 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:39.375136 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:39.515112 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:39.652638 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:39.798745 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:39.936981 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:40.073567 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:20:40.211365 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T09:20:40.406536 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Refresh failed [----] E, [2016-09-13T09:20:40.406879 #10859:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T09:20:40.407177 #10859:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T09:20:40.407282 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [16] Unable to perform refresh for the following targets: [----] E, [2016-09-13T09:20:40.407400 #10859:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [16] [----] I, [2016-09-13T09:20:40.430165 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T09:20:40.430577 #10859:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [78955], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T09:20:40.430817 #10859:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T09:20:40.431045 #10859:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T09:20:40.431221 #10859:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78955], State: [error], Delivered in [72.091410219] seconds [----] I, [2016-09-13T09:20:43.073638 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:20:43.093098 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78970], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:20:48.227461 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:20:48.233383 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003984689712524414, :worker_monitor=>1.5489084720611572, :worker_dequeue=>0.010543107986450195, :total_time=>1.5637075901031494} [----] I, [2016-09-13T09:20:48.614586 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78970], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.534784883] seconds [----] I, [2016-09-13T09:20:48.614866 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78970], Delivering... [----] I, [2016-09-13T09:20:48.623669 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004622936248779297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00464630126953125, :pending_vm_jobs=>0.001062631607055664, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008299589157104492} [----] I, [2016-09-13T09:20:48.624115 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78970], State: [ok], Delivered in [0.009254738] seconds [----] I, [2016-09-13T09:20:53.233891 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:20:53 UTC]... [----] I, [2016-09-13T09:20:53.247387 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:20:53 UTC]...Complete [----] I, [2016-09-13T09:20:58.104869 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:20:58.128021 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78971], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:20:58.167877 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78972], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:20:58.184986 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78973], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:20:58.213602 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78974], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:20:58.266755 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:20:58.733494 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78971], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.62420088] seconds [----] I, [2016-09-13T09:20:58.733661 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78971], Delivering... [----] I, [2016-09-13T09:20:58.768340 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78974], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.579981548] seconds [----] I, [2016-09-13T09:20:58.768586 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78974], Delivering... [----] I, [2016-09-13T09:20:58.773151 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78971], State: [ok], Delivered in [0.039475241] seconds [----] I, [2016-09-13T09:20:58.774798 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031137466430664062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003133535385131836, :pending_vm_jobs=>0.000827789306640625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005836963653564453} [----] I, [2016-09-13T09:20:58.775101 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78974], State: [ok], Delivered in [0.006514408] seconds [----] I, [2016-09-13T09:20:59.483614 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78972], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.349948253] seconds [----] I, [2016-09-13T09:20:59.483816 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78972], Delivering... [----] I, [2016-09-13T09:20:59.487195 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78972], State: [ok], Delivered in [0.003374815] seconds [----] I, [2016-09-13T09:20:59.494971 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78973], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.322308994] seconds [----] I, [2016-09-13T09:20:59.495227 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78973], Delivering... [----] I, [2016-09-13T09:20:59.500816 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78973], State: [ok], Delivered in [0.005590428] seconds [----] I, [2016-09-13T09:21:04.575647 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036106109619140625, :worker_monitor=>1.2913975715637207, :worker_dequeue=>0.009878396987915039, :total_time=>1.305206060409546} [----] I, [2016-09-13T09:21:13.222612 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:21:13.237219 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78975], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:21:14.598858 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:21:14.871882 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78975], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.643554763] seconds [----] I, [2016-09-13T09:21:14.872076 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78975], Delivering... [----] I, [2016-09-13T09:21:14.878530 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032663345336914062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032858848571777344, :pending_vm_jobs=>0.0007767677307128906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00604701042175293} [----] I, [2016-09-13T09:21:14.878909 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78975], State: [ok], Delivered in [0.00683302] seconds [----] I, [2016-09-13T09:21:21.213226 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038847923278808594, :worker_monitor=>1.5959482192993164, :worker_dequeue=>0.0070230960845947266, :total_time=>1.6071183681488037} [----] I, [2016-09-13T09:21:26.213733 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:21:26 UTC]... [----] I, [2016-09-13T09:21:26.231487 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:21:26 UTC]...Complete [----] I, [2016-09-13T09:21:28.248452 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:21:28.261465 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78976], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:21:28.277302 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78977], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:21:31.349408 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:21:31.997465 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78977], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.729637675] seconds [----] I, [2016-09-13T09:21:31.997597 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78977], Delivering... [----] I, [2016-09-13T09:21:32.001255 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.001997709274291992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020110607147216797, :pending_vm_jobs=>0.00043392181396484375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0034241676330566406} [----] I, [2016-09-13T09:21:32.001542 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78977], State: [ok], Delivered in [0.003914107] seconds [----] I, [2016-09-13T09:21:32.591714 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78976], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.338298331] seconds [----] I, [2016-09-13T09:21:32.591842 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78976], Delivering... [----] I, [2016-09-13T09:21:32.595680 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78976], State: [ok], Delivered in [0.003815327] seconds [----] I, [2016-09-13T09:21:37.811820 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003838062286376953, :worker_monitor=>1.4406938552856445, :worker_dequeue=>0.011404752731323242, :total_time=>1.4562511444091797} [----] I, [2016-09-13T09:21:43.290648 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:21:43.313576 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78978], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:21:47.833221 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:21:48.100650 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78978], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.803798546] seconds [----] I, [2016-09-13T09:21:48.100802 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78978], Delivering... [----] I, [2016-09-13T09:21:48.105887 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027179718017578125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002732515335083008, :pending_vm_jobs=>0.0006117820739746094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004807710647583008} [----] I, [2016-09-13T09:21:48.106160 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78978], State: [ok], Delivered in [0.005355912] seconds [----] I, [2016-09-13T09:21:54.718182 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040149688720703125, :worker_monitor=>1.8643088340759277, :worker_dequeue=>0.012656688690185547, :total_time=>1.881272315979004} [----] I, [2016-09-13T09:21:58.328298 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:21:58.350959 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78979], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:21:58.370877 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78980], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:21:58.386490 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78981], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:21:58.403586 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78982], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:21:59.718794 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:21:59 UTC]... [----] I, [2016-09-13T09:21:59.770835 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:21:59 UTC]...Complete [----] I, [2016-09-13T09:21:59.781481 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:22:00.232612 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78979], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.901410293] seconds [----] I, [2016-09-13T09:22:00.232818 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78979], Delivering... [----] I, [2016-09-13T09:22:00.255796 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78982], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.86323016] seconds [----] I, [2016-09-13T09:22:00.256082 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78982], Delivering... [----] I, [2016-09-13T09:22:00.264721 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00494384765625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004968404769897461, :pending_vm_jobs=>0.0009157657623291016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008083105087280273} [----] I, [2016-09-13T09:22:00.265193 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78982], State: [ok], Delivered in [0.009104631] seconds [----] I, [2016-09-13T09:22:00.336492 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78979], State: [ok], Delivered in [0.103617973] seconds [----] I, [2016-09-13T09:22:02.758122 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78980], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.401598399] seconds [----] I, [2016-09-13T09:22:02.758325 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78980], Delivering... [----] I, [2016-09-13T09:22:02.765863 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78980], State: [ok], Delivered in [0.007529829] seconds [----] I, [2016-09-13T09:22:02.832535 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78981], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.456169363] seconds [----] I, [2016-09-13T09:22:02.832738 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78981], Delivering... [----] I, [2016-09-13T09:22:02.841347 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78981], State: [ok], Delivered in [0.008579353] seconds [----] I, [2016-09-13T09:22:11.206599 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003868579864501953, :worker_monitor=>1.3665947914123535, :worker_dequeue=>0.021318435668945312, :total_time=>1.3921053409576416} [----] I, [2016-09-13T09:22:13.414047 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:22:13.442947 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78983], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:22:16.217821 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:22:16.403021 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78983], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.985322545] seconds [----] I, [2016-09-13T09:22:16.403198 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78983], Delivering... [----] I, [2016-09-13T09:22:16.409458 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003231048583984375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032525062561035156, :pending_vm_jobs=>0.0007877349853515625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005889892578125} [----] I, [2016-09-13T09:22:16.409918 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78983], State: [ok], Delivered in [0.006706664] seconds [----] I, [2016-09-13T09:22:27.587154 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025572776794433594, :server_monitor=>0.12436485290527344, :worker_monitor=>1.2132353782653809, :worker_dequeue=>0.005862712860107422, :total_time=>1.3462879657745361} [----] I, [2016-09-13T09:22:28.451699 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:22:28.471639 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78984], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:22:28.494249 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78985], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:22:32.589572 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:22:32 UTC]... [----] I, [2016-09-13T09:22:32.615370 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:22:32 UTC]...Complete [----] I, [2016-09-13T09:22:32.627710 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:22:32.934393 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78985], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.456804414] seconds [----] I, [2016-09-13T09:22:32.934681 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78985], Delivering... [----] I, [2016-09-13T09:22:32.941727 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037522315979003906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003772258758544922, :pending_vm_jobs=>0.0008378028869628906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006670236587524414} [----] I, [2016-09-13T09:22:32.942202 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78985], State: [ok], Delivered in [0.007503592] seconds [----] I, [2016-09-13T09:22:33.215987 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78984], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.75985936] seconds [----] I, [2016-09-13T09:22:33.216970 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78984], Delivering... [----] I, [2016-09-13T09:22:33.222982 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78984], State: [ok], Delivered in [0.00599787] seconds [----] I, [2016-09-13T09:22:43.506718 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:22:43.528603 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78986], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:22:43.775266 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:22:43.781190 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004048824310302734, :worker_monitor=>1.1163089275360107, :worker_dequeue=>0.010478019714355469, :total_time=>1.1311180591583252} [----] I, [2016-09-13T09:22:44.037390 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78986], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.524742583] seconds [----] I, [2016-09-13T09:22:44.037651 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78986], Delivering... [----] I, [2016-09-13T09:22:44.043784 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031719207763671875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032393932342529297, :pending_vm_jobs=>0.0007643699645996094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005764007568359375} [----] I, [2016-09-13T09:22:44.044138 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78986], State: [ok], Delivered in [0.006483626] seconds [----] I, [2016-09-13T09:22:58.538912 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:22:58.567382 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78987], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:22:58.590395 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78988], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:22:58.641977 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78989], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:22:58.676935 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78990], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:23:00.180737 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:23:00.186233 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002546072006225586, :worker_monitor=>1.3664019107818604, :worker_dequeue=>0.009112358093261719, :total_time=>1.378309726715088} [----] I, [2016-09-13T09:23:00.342819 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78987], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.800629654] seconds [----] I, [2016-09-13T09:23:00.343156 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78987], Delivering... [----] I, [2016-09-13T09:23:00.381443 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78990], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.734436119] seconds [----] I, [2016-09-13T09:23:00.381723 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78990], Delivering... [----] I, [2016-09-13T09:23:00.389734 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004137277603149414, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004162311553955078, :pending_vm_jobs=>0.0010294914245605469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007512807846069336} [----] I, [2016-09-13T09:23:00.390149 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78990], State: [ok], Delivered in [0.008428623] seconds [----] I, [2016-09-13T09:23:00.438449 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78987], State: [ok], Delivered in [0.09526537] seconds [----] I, [2016-09-13T09:23:00.467231 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78988], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.896386682] seconds [----] I, [2016-09-13T09:23:00.467471 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78988], Delivering... [----] I, [2016-09-13T09:23:00.471126 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78988], State: [ok], Delivered in [0.003688448] seconds [----] I, [2016-09-13T09:23:00.541473 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78989], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.94643885] seconds [----] I, [2016-09-13T09:23:00.541725 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78989], Delivering... [----] I, [2016-09-13T09:23:00.547642 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78989], State: [ok], Delivered in [0.005888444] seconds [----] I, [2016-09-13T09:23:05.186767 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:23:05 UTC]... [----] I, [2016-09-13T09:23:05.213853 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:23:05 UTC]...Complete [----] I, [2016-09-13T09:23:13.687744 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:23:13.705831 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78991], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:23:13.717260 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78992], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:23:16.597686 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:23:16.602200 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005859851837158203, :worker_monitor=>1.3356528282165527, :worker_dequeue=>0.00816965103149414, :total_time=>1.3499870300292969} [----] I, [2016-09-13T09:23:17.272532 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78992], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.560584854] seconds [----] I, [2016-09-13T09:23:17.272855 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78992], Delivering... [----] I, [2016-09-13T09:23:17.284634 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.006073474884033203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.006136417388916016, :pending_vm_jobs=>0.001477956771850586, :vm_jobs_to_dispatch_count=>0, :total_time=>0.011075496673583984} [----] I, [2016-09-13T09:23:17.285160 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78992], State: [ok], Delivered in [0.012315611] seconds [----] I, [2016-09-13T09:23:18.568842 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78991], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.875658854] seconds [----] I, [2016-09-13T09:23:18.568990 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78991], Delivering... [----] I, [2016-09-13T09:23:18.569207 #2928:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Starting [----] I, [2016-09-13T09:23:18.573448 #2928:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Complete [----] I, [2016-09-13T09:23:18.573706 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78991], State: [ok], Delivered in [0.004705425] seconds [----] I, [2016-09-13T09:23:28.727315 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T09:23:28.757580 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78993], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:23:28.768708 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78994], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:23:28.780113 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78995], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:23:28.791524 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78996], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:23:33.145353 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:23:33.152091 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006278038024902344, :worker_monitor=>1.3985939025878906, :worker_dequeue=>0.012091875076293945, :total_time=>1.4172914028167725} [----] I, [2016-09-13T09:23:33.410175 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78994], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.648483731] seconds [----] I, [2016-09-13T09:23:33.410327 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78994], Delivering... [----] I, [2016-09-13T09:23:33.414988 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78995], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.643118332] seconds [----] I, [2016-09-13T09:23:33.415177 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78995], Delivering... [----] I, [2016-09-13T09:23:33.416706 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T09:23:33.416927 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5371523072 [----] I, [2016-09-13T09:23:33.416939 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003157377243041992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003176450729370117, :pending_vm_jobs=>0.0007157325744628906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006242990493774414} [----] I, [2016-09-13T09:23:33.417025 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5142151168 [----] I, [2016-09-13T09:23:33.417131 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 229371904 [----] I, [2016-09-13T09:23:33.417224 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1323302912 [----] I, [2016-09-13T09:23:33.417244 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78994], State: [ok], Delivered in [0.006905849] seconds [----] I, [2016-09-13T09:23:33.417302 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5088083968 [----] I, [2016-09-13T09:23:33.417384 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T09:23:33.417519 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T09:23:33.417621 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 551247872 [----] I, [2016-09-13T09:23:33.417701 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T09:23:33.417776 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 8064864256 [----] I, [2016-09-13T09:23:33.417853 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T09:23:33.417935 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T09:23:33.418017 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T09:23:33.418100 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T09:23:33.418181 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T09:23:33.418259 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T09:23:33.418337 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T09:23:33.418432 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T09:23:33.418550 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T09:23:33.418640 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T09:23:33.418718 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 274030592 [----] I, [2016-09-13T09:23:33.418804 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57217024 [----] I, [2016-09-13T09:23:33.418885 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216813568 [----] I, [2016-09-13T09:23:33.418968 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T09:23:33.419047 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141934592 [----] I, [2016-09-13T09:23:33.419129 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2579103744 [----] I, [2016-09-13T09:23:33.419254 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2254749696 [----] I, [2016-09-13T09:23:33.419346 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T09:23:33.419445 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T09:23:33.419557 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T09:23:33.419647 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37568512 [----] I, [2016-09-13T09:23:33.419728 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T09:23:33.419808 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53248000 [----] I, [2016-09-13T09:23:33.419881 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111284224 [----] I, [2016-09-13T09:23:33.419959 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155545600 [----] I, [2016-09-13T09:23:33.420037 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T09:23:33.420114 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T09:23:33.420196 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T09:23:33.420277 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T09:23:33.420355 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T09:23:33.420459 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T09:23:33.420578 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T09:23:33.420665 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T09:23:33.420744 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T09:23:33.457659 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T09:23:33.457877 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T09:23:33.461895 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T09:23:33.464900 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T09:23:33.468531 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T09:23:33.472543 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T09:23:33.476097 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T09:23:33.479838 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 851 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T09:23:33.483630 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T09:23:33.487116 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T09:23:33.490715 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T09:23:33.493954 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T09:23:33.497272 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T09:23:33.500733 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T09:23:33.503667 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:23:33.503814 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:23:33.503918 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T09:23:33.508453 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [205165.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:23:33.508812 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78995], State: [ok], Delivered in [0.093627718] seconds [----] I, [2016-09-13T09:23:33.637872 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78993], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.907193776] seconds [----] I, [2016-09-13T09:23:33.638079 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78993], Delivering... [----] I, [2016-09-13T09:23:33.643351 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78993], State: [ok], Delivered in [0.005270832] seconds [----] I, [2016-09-13T09:23:38.152692 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:23:38 UTC]... [----] I, [2016-09-13T09:23:38.175006 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:23:38 UTC]...Complete [----] I, [2016-09-13T09:23:38.190807 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:23:38.508347 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78996], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [9.725007285] seconds [----] I, [2016-09-13T09:23:38.508602 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [78996], Delivering... [----] I, [2016-09-13T09:23:38.517612 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:23:32 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [152053.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:23:38.518210 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:23:32 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169071000], Memory % [3.14], CPU Time [52029.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:23:38.518729 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:23:30 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347148000], Memory % [5.04], CPU Time [104806.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T09:23:38.519271 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:23:28 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205296000], Memory % [3.5], CPU Time [242340.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T09:23:38.519845 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:23:26 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212541000], Memory % [3.5], CPU Time [49161.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T09:23:38.520437 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:23:32 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162422000], Memory % [3.1], CPU Time [38316.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T09:23:38.521021 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:23:30 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [205175.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:23:38.521595 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:23:32 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [152962.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:23:38.522081 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:23:30 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [212436.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T09:23:38.522619 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:23:32 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177794000], Memory % [3.2], CPU Time [52025.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:23:38.523086 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:23:21 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165808000], Memory % [3.16], CPU Time [39211.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T09:23:38.526587 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:23:30 UTC], Process Info: Memory Usage [608571392], Memory Size [1064759296], Proportional Set Size: [441234000], Memory % [7.42], CPU Time [1886.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:23:38.528939 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:23:24 UTC], Process Info: Memory Usage [597676032], Memory Size [940904448], Proportional Set Size: [430240000], Memory % [7.29], CPU Time [755.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:23:38.531271 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:23:24 UTC], Process Info: Memory Usage [558706688], Memory Size [929497088], Proportional Set Size: [406460000], Memory % [6.81], CPU Time [6073.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T09:23:38.533631 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:23:26 UTC], Process Info: Memory Usage [580411392], Memory Size [937541632], Proportional Set Size: [420037000], Memory % [7.08], CPU Time [2651.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T09:23:38.534006 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [78996], State: [ok], Delivered in [0.025405316] seconds [----] I, [2016-09-13T09:23:43.801723 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:23:43.820685 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78997], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:23:49.680571 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:23:49.686070 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0053119659423828125, :worker_monitor=>1.4567956924438477, :worker_dequeue=>0.009879112243652344, :total_time=>1.4723243713378906} [----] I, [2016-09-13T09:23:50.649594 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78997], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.841599473] seconds [----] I, [2016-09-13T09:23:50.649816 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [78997], Delivering... [----] I, [2016-09-13T09:23:50.657332 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003920078277587891, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0039823055267333984, :pending_vm_jobs=>0.0009706020355224609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007076740264892578} [----] I, [2016-09-13T09:23:50.657834 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [78997], State: [ok], Delivered in [0.008021138] seconds [----] I, [2016-09-13T09:23:58.832328 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:23:58.849175 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78998], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:23:58.860583 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [78999], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:23:58.878033 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79000], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:23:58.890176 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79001], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:23:59.724610 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:23:59.775399 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [78998], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.938539359] seconds [----] I, [2016-09-13T09:23:59.775603 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78998], Delivering... [----] I, [2016-09-13T09:23:59.826311 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78998], State: [ok], Delivered in [0.050688168] seconds [----] I, [2016-09-13T09:23:59.849304 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79001], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.965833104] seconds [----] I, [2016-09-13T09:23:59.849516 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79001], Delivering... [----] I, [2016-09-13T09:23:59.855704 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031723976135253906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003193378448486328, :pending_vm_jobs=>0.0007908344268798828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005829334259033203} [----] I, [2016-09-13T09:23:59.856065 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79001], State: [ok], Delivered in [0.006560668] seconds [----] I, [2016-09-13T09:24:00.746670 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [78999], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.892252235] seconds [----] I, [2016-09-13T09:24:00.746864 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [78999], Delivering... [----] I, [2016-09-13T09:24:00.750300 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [78999], State: [ok], Delivered in [0.003436346] seconds [----] I, [2016-09-13T09:24:00.752287 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79000], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.882951756] seconds [----] I, [2016-09-13T09:24:00.752529 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79000], Delivering... [----] I, [2016-09-13T09:24:00.757903 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79000], State: [ok], Delivered in [0.005397449] seconds [----] I, [2016-09-13T09:24:05.970873 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004102468490600586, :worker_monitor=>1.2291631698608398, :worker_dequeue=>0.005715370178222656, :total_time=>1.2392618656158447} [----] I, [2016-09-13T09:24:10.971332 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:24:10 UTC]... [----] I, [2016-09-13T09:24:10.993691 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:24:10 UTC]...Complete [----] I, [2016-09-13T09:24:13.902005 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:24:13.917986 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79002], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:24:16.019950 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:24:16.804207 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79002], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.896341914] seconds [----] I, [2016-09-13T09:24:16.804460 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79002], Delivering... [----] I, [2016-09-13T09:24:16.811983 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003961086273193359, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003987550735473633, :pending_vm_jobs=>0.0009279251098632812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0070416927337646484} [----] I, [2016-09-13T09:24:16.812369 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79002], State: [ok], Delivered in [0.007941852] seconds [----] I, [2016-09-13T09:24:22.634455 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003887176513671875, :worker_monitor=>1.590681791305542, :worker_dequeue=>0.010984182357788086, :total_time=>1.60593581199646} [----] I, [2016-09-13T09:24:28.930141 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:24:28.940772 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79003], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:24:28.957213 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79004], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:24:32.763442 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:24:32.941614 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79004], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.996357105] seconds [----] I, [2016-09-13T09:24:32.941800 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79004], Delivering... [----] I, [2016-09-13T09:24:32.948376 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034737586975097656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034940242767333984, :pending_vm_jobs=>0.0007829666137695312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006206989288330078} [----] I, [2016-09-13T09:24:32.948771 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79004], State: [ok], Delivered in [0.006972157] seconds [----] I, [2016-09-13T09:24:33.849183 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79003], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.915296591] seconds [----] I, [2016-09-13T09:24:33.849370 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79003], Delivering... [----] I, [2016-09-13T09:24:33.854877 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79003], State: [ok], Delivered in [0.005494745] seconds [----] I, [2016-09-13T09:24:37.784200 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T09:24:39.158733 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003924846649169922, :log_active_servers=>0.010307550430297852, :worker_monitor=>1.359910249710083, :worker_dequeue=>0.014261007308959961, :total_time=>1.3887948989868164} [----] I, [2016-09-13T09:24:43.965802 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:24:43.981202 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79005], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:24:44.160289 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:24:44 UTC]... [----] I, [2016-09-13T09:24:44.180856 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:24:44 UTC]...Complete [----] I, [2016-09-13T09:24:44.187128 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:24:45.055879 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79005], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.086304243] seconds [----] I, [2016-09-13T09:24:45.056131 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79005], Delivering... [----] I, [2016-09-13T09:24:45.066040 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004975795745849609, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005017995834350586, :pending_vm_jobs=>0.001256704330444336, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009300470352172852} [----] I, [2016-09-13T09:24:45.066581 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79005], State: [ok], Delivered in [0.01044275] seconds [----] I, [2016-09-13T09:24:55.634174 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0048716068267822266, :worker_monitor=>1.4173963069915771, :worker_dequeue=>0.0058786869049072266, :total_time=>1.4284107685089111} [----] I, [2016-09-13T09:24:58.990001 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:24:59.009954 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79006], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:24:59.027338 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79007], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:24:59.051864 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79008], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:24:59.067023 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79009], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:25:00.642771 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:25:00.952881 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79006], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.958275303] seconds [----] I, [2016-09-13T09:25:00.953027 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79006], Delivering... [----] I, [2016-09-13T09:25:00.958679 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79009], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.901077364] seconds [----] I, [2016-09-13T09:25:00.958876 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79009], Delivering... [----] I, [2016-09-13T09:25:00.966292 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038318634033203125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038650035858154297, :pending_vm_jobs=>0.0009136199951171875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006930351257324219} [----] I, [2016-09-13T09:25:00.966705 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79009], State: [ok], Delivered in [0.00782746] seconds [----] I, [2016-09-13T09:25:00.993000 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79007], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.977631705] seconds [----] I, [2016-09-13T09:25:00.993184 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79007], Delivering... [----] I, [2016-09-13T09:25:00.996438 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79007], State: [ok], Delivered in [0.003220322] seconds [----] I, [2016-09-13T09:25:01.004234 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79006], State: [ok], Delivered in [0.051172505] seconds [----] I, [2016-09-13T09:25:01.028355 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79008], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.993015158] seconds [----] I, [2016-09-13T09:25:01.028585 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79008], Delivering... [----] I, [2016-09-13T09:25:01.033814 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79008], State: [ok], Delivered in [0.005220117] seconds [----] I, [2016-09-13T09:25:11.921376 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003627777099609375, :worker_monitor=>1.2444970607757568, :worker_dequeue=>0.011018991470336914, :total_time=>1.2594177722930908} [----] I, [2016-09-13T09:25:14.078161 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:25:14.096517 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79010], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:25:16.921992 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:25:16 UTC]... [----] I, [2016-09-13T09:25:16.935649 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:25:16 UTC]...Complete [----] I, [2016-09-13T09:25:16.946443 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:25:17.404579 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79010], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.321254332] seconds [----] I, [2016-09-13T09:25:17.404718 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79010], Delivering... [----] I, [2016-09-13T09:25:17.408889 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022521018981933594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00226593017578125, :pending_vm_jobs=>0.0005030632019042969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003896951675415039} [----] I, [2016-09-13T09:25:17.409137 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79010], State: [ok], Delivered in [0.00442201] seconds [----] I, [2016-09-13T09:25:28.096266 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [101], PID: [12930], GUID: [4846d89a-79ab-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:25:28.096525 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [101], PID: [12930], GUID: [4846d89a-79ab-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:25:28.119273 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [100], PID: [10859], GUID: [5b4aad44-79a7-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:25:28.119498 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [100], PID: [10859], GUID: [5b4aad44-79a7-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:25:28.142092 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:25:28.142304 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:25:28.164837 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:25:28.165025 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:25:28.193785 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:25:28.193972 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:25:28.228024 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:25:28.228230 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:25:28.257119 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:25:28.257499 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:25:28.284959 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:25:28.285175 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:25:28.307849 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:25:28.308035 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:25:28.330648 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:25:28.330843 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:25:28.353615 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:25:28.353807 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:25:28.376633 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:25:28.376827 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:25:28.415710 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:25:28.415915 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:25:28.445441 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:25:28.445610 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:25:28.456146 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:25:28.456295 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:25:28.467295 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003952741622924805, :worker_monitor=>1.4858334064483643, :worker_dequeue=>0.008752822875976562, :total_time=>1.4988987445831299} [----] I, [2016-09-13T09:25:29.106574 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:25:29.106711 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:25:29.106764 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:25:29.212932 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:25:29.213947 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T09:25:29.214006 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:25:29.214038 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:25:29.214064 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:25:29.214088 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T09:25:29.214124 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T09:25:29.214152 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:25:29.214176 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T09:25:29.214200 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:25:29.214223 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:25:29.214247 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:25:29.214270 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:25:29.214291 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T09:25:29.214314 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T09:25:29.214336 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T09:25:29.214358 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T09:25:29.214380 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T09:25:29.214402 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T09:25:29.214461 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T09:25:29.214513 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T09:25:29.214541 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T09:25:29.214564 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T09:25:29.214587 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T09:25:29.214609 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T09:25:29.214646 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T09:25:29.214694 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T09:25:29.214723 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T09:25:29.214748 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T09:25:29.214771 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T09:25:29.214793 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T09:25:29.214816 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T09:25:29.214839 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T09:25:29.214861 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T09:25:29.214883 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T09:25:29.214906 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T09:25:29.214929 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T09:25:29.214951 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T09:25:29.214974 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T09:25:29.214995 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T09:25:29.215191 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:25:29.215297 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:25:29.215356 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:25:29.233671 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79011], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:25:29.250295 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79012], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:25:30.277015 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:25:30.277197 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:25:30.277328 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:25:30.399696 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:25:30.400303 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T09:25:30.400351 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:25:30.400379 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:25:30.400402 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:25:30.400457 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T09:25:30.400499 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T09:25:30.400531 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:25:30.400557 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T09:25:30.400581 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:25:30.400606 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:25:30.400630 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:25:30.400652 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:25:30.400674 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T09:25:30.400700 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:25:30.400721 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T09:25:30.400744 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T09:25:30.400948 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:25:30.401062 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:25:30.754306 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:25:30.754445 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:25:30.754545 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:25:30.857773 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:25:30.858343 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T09:25:30.858403 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:25:30.858471 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:25:30.858523 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:25:30.858555 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T09:25:30.858582 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T09:25:30.858610 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:25:30.858642 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T09:25:30.858669 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:25:30.858695 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:25:30.858721 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:25:30.858746 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:25:30.858772 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T09:25:30.858796 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T09:25:30.859007 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:25:30.859207 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:25:30.932875 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T09:25:30.933006 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T09:25:30.933073 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T09:25:31.063074 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:25:31.063788 #10859:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T09:25:31.063862 #10859:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:25:31.063899 #10859:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:25:31.063930 #10859:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:25:31.063959 #10859:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T09:25:31.063990 #10859:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T09:25:31.064018 #10859:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:25:31.064047 #10859:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T09:25:31.064076 #10859:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:25:31.064102 #10859:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:25:31.064129 #10859:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T09:25:31.064156 #10859:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:25:31.064191 #10859:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T09:25:31.064223 #10859:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:25:31.064264 #10859:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T09:25:31.064293 #10859:34713c] INFO -- : --- [----] I, [2016-09-13T09:25:31.064659 #10859:34713c] INFO -- : :guid: 5b4aad44-79a7-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:25:31.064726 #10859:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T09:25:31.064854 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T09:25:31.455850 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:25:31.456001 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:25:31.456091 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:25:31.619775 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:25:31.620761 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T09:25:31.620845 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:25:31.620903 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:25:31.620974 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:25:31.621040 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T09:25:31.621104 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T09:25:31.621175 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:25:31.621238 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T09:25:31.621306 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:25:31.621371 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:25:31.621482 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:25:31.621589 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:25:31.621672 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T09:25:31.621749 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:25:31.621826 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T09:25:31.621898 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T09:25:31.622380 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:25:31.622693 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:25:32.251245 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:25:32.251354 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:25:32.251404 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:25:32.352828 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:25:32.353582 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T09:25:32.353649 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:25:32.353684 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:25:32.353713 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:25:32.353741 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T09:25:32.353767 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T09:25:32.353794 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:25:32.353819 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T09:25:32.353846 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:25:32.353871 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:25:32.353896 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:25:32.353920 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:25:32.353945 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T09:25:32.353969 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:25:32.353993 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T09:25:32.354017 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T09:25:32.354234 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:25:32.354353 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:25:33.581329 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:25:33.657271 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79012], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.419284104] seconds [----] I, [2016-09-13T09:25:33.657505 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79012], Delivering... [----] I, [2016-09-13T09:25:33.663702 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003228425979614258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032460689544677734, :pending_vm_jobs=>0.0007812976837158203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005810260772705078} [----] I, [2016-09-13T09:25:33.664018 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79012], State: [ok], Delivered in [0.006550486] seconds [----] I, [2016-09-13T09:25:33.909269 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:25:33.909410 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:25:33.909540 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:25:34.054326 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:25:34.055060 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T09:25:34.055143 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:25:34.055191 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:25:34.055228 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:25:34.055264 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T09:25:34.055298 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T09:25:34.055332 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:25:34.055364 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T09:25:34.055396 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:25:34.055468 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:25:34.055535 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:25:34.055574 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:25:34.055606 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T09:25:34.055637 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T09:25:34.055901 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:25:34.056151 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:25:34.107605 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79011], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.888808224] seconds [----] I, [2016-09-13T09:25:34.107855 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79011], Delivering... [----] I, [2016-09-13T09:25:34.112910 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79011], State: [ok], Delivered in [0.005057466] seconds [----] I, [2016-09-13T09:25:34.575101 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T09:25:34.575267 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T09:25:34.575361 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T09:25:34.742274 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:25:34.743142 #12930:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T09:25:34.743223 #12930:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:25:34.743271 #12930:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:25:34.743310 #12930:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:25:34.743365 #12930:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T09:25:34.743406 #12930:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T09:25:34.743498 #12930:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:25:34.743545 #12930:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T09:25:34.743582 #12930:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:25:34.743615 #12930:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:25:34.743649 #12930:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T09:25:34.743684 #12930:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:25:34.743719 #12930:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T09:25:34.743752 #12930:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:25:34.743785 #12930:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T09:25:34.743817 #12930:34713c] INFO -- : --- [----] I, [2016-09-13T09:25:34.744206 #12930:34713c] INFO -- : :guid: 4846d89a-79ab-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:25:34.744270 #12930:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T09:25:34.744479 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T09:25:35.188672 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T09:25:35.188811 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [10.16.23.206] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T09:25:35.188882 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T09:25:35.325857 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:25:35.326744 #684:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T09:25:35.326827 #684:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:25:35.326872 #684:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:25:35.326908 #684:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:25:35.326944 #684:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T09:25:35.326978 #684:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T09:25:35.327012 #684:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:25:35.327045 #684:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T09:25:35.327078 #684:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:25:35.327110 #684:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:25:35.327143 #684:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:25:35.327174 #684:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:25:35.327207 #684:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T09:25:35.327240 #684:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T09:25:35.327273 #684:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T09:25:35.327304 #684:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T09:25:35.327351 #684:34713c] INFO -- : --- [----] I, [2016-09-13T09:25:35.327733 #684:34713c] INFO -- : :guid: c253e5f6-7924-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:25:35.327806 #684:34713c] INFO -- : :ems_id: 15 [----] I, [2016-09-13T09:25:35.327934 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [10.16.23.206] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T09:25:35.520748 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:25:35.520918 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:25:35.521008 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:25:35.689405 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:25:35.690215 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T09:25:35.690285 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:25:35.690323 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:25:35.690357 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:25:35.690390 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T09:25:35.690451 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T09:25:35.690519 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:25:35.690565 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T09:25:35.690600 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:25:35.690632 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:25:35.690666 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:25:35.690696 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:25:35.690725 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T09:25:35.690754 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:25:35.690786 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T09:25:35.690814 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T09:25:35.691093 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:25:35.691230 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:25:36.528156 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:25:36.528386 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:25:36.528594 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:25:36.647783 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:25:36.648269 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T09:25:36.648311 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:25:36.648336 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:25:36.648359 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:25:36.648379 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T09:25:36.648398 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T09:25:36.648434 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:25:36.648464 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T09:25:36.648497 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:25:36.648522 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:25:36.648541 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:25:36.648561 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:25:36.648580 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T09:25:36.648597 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:25:36.648617 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T09:25:36.648635 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T09:25:36.648805 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:25:36.648898 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:25:37.055848 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T09:25:37.056003 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T09:25:37.056079 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T09:25:37.202099 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:25:37.203626 #20386:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T09:25:37.203760 #20386:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:25:37.203851 #20386:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:25:37.203936 #20386:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:25:37.204016 #20386:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T09:25:37.204093 #20386:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T09:25:37.204173 #20386:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:25:37.204253 #20386:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T09:25:37.204331 #20386:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:25:37.204406 #20386:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:25:37.204566 #20386:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:25:37.204687 #20386:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:25:37.204778 #20386:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T09:25:37.204862 #20386:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T09:25:37.204949 #20386:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T09:25:37.205029 #20386:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T09:25:37.205103 #20386:34713c] INFO -- : --- [----] I, [2016-09-13T09:25:37.205759 #20386:34713c] INFO -- : :guid: e5930efc-7974-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:25:37.205890 #20386:34713c] INFO -- : :ems_id: 16 [----] I, [2016-09-13T09:25:37.206109 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T09:25:38.248763 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:25:38.248903 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:25:38.248975 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:25:38.395003 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:25:38.395705 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T09:25:38.395784 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:25:38.395828 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:25:38.395864 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:25:38.395899 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T09:25:38.395932 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T09:25:38.395967 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:25:38.396006 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T09:25:38.396040 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:25:38.396072 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:25:38.396104 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:25:38.396136 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:25:38.396168 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T09:25:38.396202 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T09:25:38.396506 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:25:38.396751 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:25:40.107750 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:25:40.107926 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:25:40.108016 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:25:40.130845 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:25:40.130947 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:25:40.131005 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:25:40.231204 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:25:40.231753 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T09:25:40.231804 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:25:40.231839 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:25:40.231863 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:25:40.231886 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T09:25:40.231910 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T09:25:40.231931 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:25:40.231953 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T09:25:40.231976 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:25:40.231999 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:25:40.232019 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:25:40.232039 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:25:40.232063 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T09:25:40.232087 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:25:40.232108 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T09:25:40.232128 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T09:25:40.232315 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:25:40.232455 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:25:40.266317 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:25:40.267151 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T09:25:40.267230 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:25:40.267273 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:25:40.267308 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:25:40.267344 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T09:25:40.267376 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T09:25:40.267408 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:25:40.267496 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T09:25:40.267545 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:25:40.267579 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:25:40.267627 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:25:40.267668 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:25:40.267702 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T09:25:40.267731 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:25:40.267762 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T09:25:40.267791 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T09:25:40.268070 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:25:40.268244 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:25:44.258223 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:25:44.285153 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79013], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:25:45.377654 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:25:45.382164 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004849910736083984, :worker_monitor=>1.764817476272583, :worker_dequeue=>0.008746623992919922, :total_time=>1.778883934020996} [----] I, [2016-09-13T09:25:45.770973 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79013], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.508226198] seconds [----] I, [2016-09-13T09:25:45.771151 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79013], Delivering... [----] I, [2016-09-13T09:25:45.775371 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002421140670776367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002433300018310547, :pending_vm_jobs=>0.0004591941833496094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0039882659912109375} [----] I, [2016-09-13T09:25:45.775645 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79013], State: [ok], Delivered in [0.004502871] seconds [----] I, [2016-09-13T09:25:50.382689 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:25:50 UTC]... [----] I, [2016-09-13T09:25:50.433482 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:25:50 UTC]...Complete [----] I, [2016-09-13T09:25:59.301920 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:25:59.336542 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79014], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:25:59.347604 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79015], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:25:59.370838 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79016], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:25:59.383323 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79017], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:26:02.127741 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:26:02.134320 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0058977603912353516, :worker_monitor=>1.6562340259552002, :worker_dequeue=>0.011873245239257812, :total_time=>1.6743583679199219} [----] I, [2016-09-13T09:26:02.914286 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79014], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.607975701] seconds [----] I, [2016-09-13T09:26:02.914621 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79014], Delivering... [----] I, [2016-09-13T09:26:02.935707 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79017], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.55917956] seconds [----] I, [2016-09-13T09:26:02.935955 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79017], Delivering... [----] I, [2016-09-13T09:26:02.942789 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003597736358642578, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036504268646240234, :pending_vm_jobs=>0.0008606910705566406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006405830383300781} [----] I, [2016-09-13T09:26:02.943258 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79017], State: [ok], Delivered in [0.007294246] seconds [----] I, [2016-09-13T09:26:03.005371 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79014], State: [ok], Delivered in [0.090705821] seconds [----] I, [2016-09-13T09:26:04.428184 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79015], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.086332304] seconds [----] I, [2016-09-13T09:26:04.428324 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79015], Delivering... [----] I, [2016-09-13T09:26:04.430393 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79015], State: [ok], Delivered in [0.002061075] seconds [----] I, [2016-09-13T09:26:04.449748 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79016], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.094891877] seconds [----] I, [2016-09-13T09:26:04.449899 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79016], Delivering... [----] I, [2016-09-13T09:26:04.452868 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79016], State: [ok], Delivered in [0.002983154] seconds [----] I, [2016-09-13T09:26:14.395157 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:26:14.409523 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79018], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:26:18.418343 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:26:18.422657 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0027129650115966797, :worker_monitor=>1.2405047416687012, :worker_dequeue=>0.00782918930053711, :total_time=>1.2512943744659424} [----] I, [2016-09-13T09:26:19.080258 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79018], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.679903785] seconds [----] I, [2016-09-13T09:26:19.080538 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79018], Delivering... [----] I, [2016-09-13T09:26:19.089252 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004530191421508789, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004581928253173828, :pending_vm_jobs=>0.0010790824890136719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008243322372436523} [----] I, [2016-09-13T09:26:19.089693 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79018], State: [ok], Delivered in [0.009163977] seconds [----] I, [2016-09-13T09:26:23.423133 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:26:23 UTC]... [----] I, [2016-09-13T09:26:23.445358 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:26:23 UTC]...Complete [----] I, [2016-09-13T09:26:29.418944 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:26:29.438619 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79019], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:26:29.467327 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79020], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:26:35.053879 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:26:35.060212 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004338264465332031, :server_monitor=>0.15676546096801758, :worker_monitor=>1.4100615978240967, :worker_dequeue=>0.011308670043945312, :total_time=>1.582904577255249} [----] I, [2016-09-13T09:26:35.235911 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79020], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.790501108] seconds [----] I, [2016-09-13T09:26:35.236094 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79020], Delivering... [----] I, [2016-09-13T09:26:35.241621 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00289154052734375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002909421920776367, :pending_vm_jobs=>0.0006754398345947266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005145072937011719} [----] I, [2016-09-13T09:26:35.241906 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79020], State: [ok], Delivered in [0.005808198] seconds [----] I, [2016-09-13T09:26:37.548702 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79019], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.125928407] seconds [----] I, [2016-09-13T09:26:37.548879 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79019], Delivering... [----] I, [2016-09-13T09:26:37.553324 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79019], State: [ok], Delivered in [0.00443339] seconds [----] I, [2016-09-13T09:26:44.481763 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:26:44.497067 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79021], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:26:45.084803 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:26:45.280616 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79021], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.792010421] seconds [----] I, [2016-09-13T09:26:45.280866 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79021], Delivering... [----] I, [2016-09-13T09:26:45.290626 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005079030990600586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005107402801513672, :pending_vm_jobs=>0.0013172626495361328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009267330169677734} [----] I, [2016-09-13T09:26:45.291088 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79021], State: [ok], Delivered in [0.010218881] seconds [----] I, [2016-09-13T09:26:51.255682 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003779172897338867, :worker_monitor=>1.152613878250122, :worker_dequeue=>0.007274150848388672, :total_time=>1.1639866828918457} [----] I, [2016-09-13T09:26:56.256257 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:26:56 UTC]... [----] I, [2016-09-13T09:26:56.280241 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:26:56 UTC]...Complete [----] I, [2016-09-13T09:26:59.511698 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:26:59.532157 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79022], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:26:59.548890 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79023], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:26:59.571586 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79024], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:26:59.600378 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79025], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:27:01.310061 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:27:01.440732 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79022], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.922292454] seconds [----] I, [2016-09-13T09:27:01.440912 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79022], Delivering... [----] I, [2016-09-13T09:27:01.457191 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79025], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.876931345] seconds [----] I, [2016-09-13T09:27:01.457328 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79025], Delivering... [----] I, [2016-09-13T09:27:01.461177 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021538734436035156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002166748046875, :pending_vm_jobs=>0.00044083595275878906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0035631656646728516} [----] I, [2016-09-13T09:27:01.461405 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79025], State: [ok], Delivered in [0.004062175] seconds [----] I, [2016-09-13T09:27:01.503150 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79022], State: [ok], Delivered in [0.062199871] seconds [----] I, [2016-09-13T09:27:01.668940 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79023], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.13066199] seconds [----] I, [2016-09-13T09:27:01.669151 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79023], Delivering... [----] I, [2016-09-13T09:27:01.672310 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79023], State: [ok], Delivered in [0.003151548] seconds [----] I, [2016-09-13T09:27:01.686622 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79024], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.125059608] seconds [----] I, [2016-09-13T09:27:01.686874 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79024], Delivering... [----] I, [2016-09-13T09:27:01.693199 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79024], State: [ok], Delivered in [0.00629025] seconds [----] I, [2016-09-13T09:27:07.974151 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005423545837402344, :worker_monitor=>1.6395187377929688, :worker_dequeue=>0.010956525802612305, :total_time=>1.6563220024108887} [----] I, [2016-09-13T09:27:14.612622 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:27:14.634339 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79026], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:27:17.994987 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:27:18.589258 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79026], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.972984372] seconds [----] I, [2016-09-13T09:27:18.589522 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79026], Delivering... [----] I, [2016-09-13T09:27:18.597849 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004137516021728516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004163503646850586, :pending_vm_jobs=>0.001154184341430664, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007892847061157227} [----] I, [2016-09-13T09:27:18.598244 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79026], State: [ok], Delivered in [0.008732484] seconds [----] I, [2016-09-13T09:27:24.489631 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004293918609619141, :worker_monitor=>1.4741325378417969, :worker_dequeue=>0.01166224479675293, :total_time=>1.4904232025146484} [----] I, [2016-09-13T09:27:29.490239 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:27:29 UTC]... [----] I, [2016-09-13T09:27:29.509712 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:27:29 UTC]...Complete [----] I, [2016-09-13T09:27:29.642762 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:27:29.657565 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79027], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:27:29.680563 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79028], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:27:34.603368 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:27:34.743045 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79028], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.07999931] seconds [----] I, [2016-09-13T09:27:34.743159 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79028], Delivering... [----] I, [2016-09-13T09:27:34.746930 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020339488983154297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020494461059570312, :pending_vm_jobs=>0.0004715919494628906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0035555362701416016} [----] I, [2016-09-13T09:27:34.747176 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79028], State: [ok], Delivered in [0.004010465] seconds [----] I, [2016-09-13T09:27:34.795162 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79027], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.147959937] seconds [----] I, [2016-09-13T09:27:34.795408 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79027], Delivering... [----] I, [2016-09-13T09:27:34.801790 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79027], State: [ok], Delivered in [0.00638665] seconds [----] I, [2016-09-13T09:27:41.165505 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007365703582763672, :worker_monitor=>1.5418760776519775, :worker_dequeue=>0.008553743362426758, :total_time=>1.5581228733062744} [----] I, [2016-09-13T09:27:44.693004 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:27:44.715261 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79029], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:27:46.175226 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:27:46.848125 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79029], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.14818255] seconds [----] I, [2016-09-13T09:27:46.848467 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79029], Delivering... [----] I, [2016-09-13T09:27:46.855336 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004487514495849609, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004527568817138672, :pending_vm_jobs=>0.0006406307220458984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006360530853271484} [----] I, [2016-09-13T09:27:46.855599 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79029], State: [ok], Delivered in [0.007203608] seconds [----] I, [2016-09-13T09:27:57.654126 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004458427429199219, :worker_monitor=>1.439620018005371, :worker_dequeue=>0.012982606887817383, :total_time=>1.4574036598205566} [----] I, [2016-09-13T09:27:59.727957 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:27:59.750529 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79030], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:27:59.773453 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79031], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:27:59.819223 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79032], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:27:59.848122 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79033], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:28:02.654784 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:28:02 UTC]... [----] I, [2016-09-13T09:28:02.691715 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:28:02 UTC]...Complete [----] I, [2016-09-13T09:28:02.710800 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:28:02.954803 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79030], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.223327204] seconds [----] I, [2016-09-13T09:28:02.954965 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79030], Delivering... [----] I, [2016-09-13T09:28:03.001464 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79030], State: [ok], Delivered in [0.046430684] seconds [----] I, [2016-09-13T09:28:03.017693 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79033], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.193586516] seconds [----] I, [2016-09-13T09:28:03.017915 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79033], Delivering... [----] I, [2016-09-13T09:28:03.024236 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033309459686279297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034189224243164062, :pending_vm_jobs=>0.000698089599609375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005944490432739258} [----] I, [2016-09-13T09:28:03.024599 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79033], State: [ok], Delivered in [0.006698054] seconds [----] I, [2016-09-13T09:28:04.903352 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79031], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.146747849] seconds [----] I, [2016-09-13T09:28:04.903608 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79031], Delivering... [----] I, [2016-09-13T09:28:04.906971 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79031], State: [ok], Delivered in [0.003359377] seconds [----] I, [2016-09-13T09:28:04.937911 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79032], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.157699014] seconds [----] I, [2016-09-13T09:28:04.938192 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79032], Delivering... [----] I, [2016-09-13T09:28:04.943623 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79032], State: [ok], Delivered in [0.005459967] seconds [----] I, [2016-09-13T09:28:14.466141 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039348602294921875, :worker_monitor=>1.7130327224731445, :worker_dequeue=>0.011281728744506836, :total_time=>1.7285289764404297} [----] I, [2016-09-13T09:28:14.864715 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:28:14.886201 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79034], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:28:19.475658 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:28:19.989003 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79034], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.118430745] seconds [----] I, [2016-09-13T09:28:19.989179 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79034], Delivering... [----] I, [2016-09-13T09:28:19.995379 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003298044204711914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033159255981445312, :pending_vm_jobs=>0.0007648468017578125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058214664459228516} [----] I, [2016-09-13T09:28:19.995771 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79034], State: [ok], Delivered in [0.006578078] seconds [----] I, [2016-09-13T09:28:29.898307 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T09:28:29.908987 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79035], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:28:29.937328 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79036], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:28:29.971590 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79037], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:28:29.982943 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79038], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:28:30.657443 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:28:30.660703 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002431154251098633, :worker_monitor=>1.1586523056030273, :worker_dequeue=>0.005998373031616211, :total_time=>1.1673271656036377} [----] I, [2016-09-13T09:28:31.298158 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79036], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.384147041] seconds [----] I, [2016-09-13T09:28:31.298473 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79036], Delivering... [----] I, [2016-09-13T09:28:31.308991 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005360603332519531, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005393028259277344, :pending_vm_jobs=>0.0013370513916015625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009923219680786133} [----] I, [2016-09-13T09:28:31.309578 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79036], State: [ok], Delivered in [0.011127949] seconds [----] I, [2016-09-13T09:28:31.315352 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79037], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.375025349] seconds [----] I, [2016-09-13T09:28:31.315663 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79037], Delivering... [----] I, [2016-09-13T09:28:31.317108 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T09:28:31.317507 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 5371731968 [----] I, [2016-09-13T09:28:31.317688 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 5142126592 [----] I, [2016-09-13T09:28:31.317834 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 229605376 [----] I, [2016-09-13T09:28:31.317986 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 1323302912 [----] I, [2016-09-13T09:28:31.318129 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 5088059392 [----] I, [2016-09-13T09:28:31.318267 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T09:28:31.318407 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T09:28:31.318617 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 551477248 [----] I, [2016-09-13T09:28:31.318762 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T09:28:31.318904 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7987138560 [----] I, [2016-09-13T09:28:31.319042 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T09:28:31.319186 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T09:28:31.319321 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T09:28:31.319495 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 12288 [----] I, [2016-09-13T09:28:31.319659 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T09:28:31.319797 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T09:28:31.319933 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T09:28:31.320069 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T09:28:31.320203 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T09:28:31.320343 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T09:28:31.320547 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 274026496 [----] I, [2016-09-13T09:28:31.320693 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57217024 [----] I, [2016-09-13T09:28:31.320840 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216809472 [----] I, [2016-09-13T09:28:31.320969 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T09:28:31.321098 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141934592 [----] I, [2016-09-13T09:28:31.321243 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 2579206144 [----] I, [2016-09-13T09:28:31.321381 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2254622720 [----] I, [2016-09-13T09:28:31.321590 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T09:28:31.321727 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T09:28:31.321865 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T09:28:31.321997 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37527552 [----] I, [2016-09-13T09:28:31.322143 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T09:28:31.322282 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53141504 [----] I, [2016-09-13T09:28:31.322453 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111284224 [----] I, [2016-09-13T09:28:31.322637 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155439104 [----] I, [2016-09-13T09:28:31.322780 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T09:28:31.322930 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T09:28:31.323070 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T09:28:31.323216 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T09:28:31.323350 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T09:28:31.323574 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T09:28:31.323712 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T09:28:31.323849 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 8192 [----] I, [2016-09-13T09:28:31.323984 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T09:28:31.367004 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T09:28:31.367290 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T09:28:31.373111 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T09:28:31.377715 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T09:28:31.383221 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T09:28:31.388905 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T09:28:31.394503 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T09:28:31.400077 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 849 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T09:28:31.405688 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T09:28:31.411244 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T09:28:31.416859 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T09:28:31.422596 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T09:28:31.428296 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T09:28:31.433779 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T09:28:31.437943 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:28:31.438188 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:28:31.438372 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T09:28:31.445465 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [152126.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:28:31.445974 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79037], State: [ok], Delivered in [0.130284751] seconds [----] I, [2016-09-13T09:28:32.057466 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79035], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.155772014] seconds [----] I, [2016-09-13T09:28:32.057662 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79035], Delivering... [----] I, [2016-09-13T09:28:32.062309 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79035], State: [ok], Delivered in [0.004639255] seconds [----] I, [2016-09-13T09:28:35.661171 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:28:35 UTC]... [----] I, [2016-09-13T09:28:35.674447 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:28:35 UTC]...Complete [----] I, [2016-09-13T09:28:35.788730 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:28:36.417845 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79038], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.442518526] seconds [----] I, [2016-09-13T09:28:36.418022 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79038], Delivering... [----] I, [2016-09-13T09:28:36.425722 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:28:27 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169071000], Memory % [3.14], CPU Time [52084.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:28:36.426169 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:28:26 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [212541000], Memory % [3.5], CPU Time [49210.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T09:28:36.426728 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:28:29 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [205296000], Memory % [3.5], CPU Time [242467.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T09:28:36.427150 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:28:19 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347149000], Memory % [5.04], CPU Time [104871.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T09:28:36.427682 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:28:30 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [162422000], Memory % [3.1], CPU Time [38356.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T09:28:36.428162 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:28:29 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [358683000], Memory % [5.28], CPU Time [205219.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:28:36.428727 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:28:30 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [200501000], Memory % [3.36], CPU Time [153047.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:28:36.429153 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:28:30 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202019000], Memory % [3.38], CPU Time [152133.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:28:36.432105 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: TT] Worker ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:28:25 UTC], Process Info: Memory Usage [598245376], Memory Size [927567872], Proportional Set Size: [430799000], Memory % [7.29], CPU Time [832.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:28:36.434070 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:28:21 UTC], Process Info: Memory Usage [609239040], Memory Size [1064759296], Proportional Set Size: [441886000], Memory % [7.43], CPU Time [1908.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:28:36.436084 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:28:27 UTC], Process Info: Memory Usage [580104192], Memory Size [908623872], Proportional Set Size: [419742000], Memory % [7.07], CPU Time [2707.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T09:28:36.438054 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: TT] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:28:25 UTC], Process Info: Memory Usage [557883392], Memory Size [894074880], Proportional Set Size: [405575000], Memory % [6.8], CPU Time [6141.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T09:28:36.438606 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:28:29 UTC], Process Info: Memory Usage [432046080], Memory Size [729399296], Proportional Set Size: [357917000], Memory % [5.27], CPU Time [212479.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T09:28:36.439073 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:28:28 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [177794000], Memory % [3.2], CPU Time [52079.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:28:36.439555 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:28:22 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [165809000], Memory % [3.16], CPU Time [39259.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T09:28:36.439890 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79038], State: [ok], Delivered in [0.021863658] seconds [----] I, [2016-09-13T09:28:44.991546 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:28:45.011871 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79039], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:28:47.436989 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:28:47.443764 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004113674163818359, :worker_monitor=>1.605891466140747, :worker_dequeue=>0.011905908584594727, :total_time=>1.622222661972046} [----] I, [2016-09-13T09:28:47.555044 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79039], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.559700004] seconds [----] I, [2016-09-13T09:28:47.555211 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79039], Delivering... [----] I, [2016-09-13T09:28:47.561325 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031671524047851562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003186941146850586, :pending_vm_jobs=>0.0007762908935546875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005717277526855469} [----] I, [2016-09-13T09:28:47.561714 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79039], State: [ok], Delivered in [0.006490697] seconds [----] I, [2016-09-13T09:28:54.711446 #3046:a89738] INFO -- : MIQ(Authenticator.authenticate) userid: [admin] - User admin successfully validated by EVM [----] I, [2016-09-13T09:28:54.728689 #3046:a89738] INFO -- : MIQ(Authenticator.authenticate) userid: [admin] - Authentication successful for user admin [----] I, [2016-09-13T09:28:55.063868 #3022:985d64] INFO -- : MIQ(Authenticator.authenticate) userid: [admin] - User admin successfully validated by EVM [----] I, [2016-09-13T09:28:55.086790 #3022:985d64] INFO -- : MIQ(Authenticator.authenticate) userid: [admin] - Authentication successful for user admin [----] I, [2016-09-13T09:28:55.389856 #3022:985d64] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-04 00:00:00 UTC [----] I, [2016-09-13T09:28:55.390871 #3022:985d64] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-14 00:00:00 UTC [----] I, [2016-09-13T09:28:55.441127 #3022:985d64] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T09:28:55.441580 #3022:985d64] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 14:00:00 UTC [----] I, [2016-09-13T09:28:55.482494 #3022:985d64] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-04 00:00:00 UTC [----] I, [2016-09-13T09:28:55.482999 #3022:985d64] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-14 00:00:00 UTC [----] I, [2016-09-13T09:28:55.524709 #3022:985d64] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-04 00:00:00 UTC [----] I, [2016-09-13T09:28:55.525214 #3022:985d64] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-14 00:00:00 UTC [----] I, [2016-09-13T09:28:55.566234 #3022:985d64] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-04 00:00:00 UTC [----] I, [2016-09-13T09:28:55.566765 #3022:985d64] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-14 00:00:00 UTC [----] I, [2016-09-13T09:28:55.597196 #3022:985d64] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-04 00:00:00 UTC [----] I, [2016-09-13T09:28:55.597557 #3022:985d64] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-14 00:00:00 UTC [----] I, [2016-09-13T09:28:55.619158 #3022:985d64] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T09:28:55.619563 #3022:985d64] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 14:00:00 UTC [----] I, [2016-09-13T09:28:55.651907 #3022:985d64] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-04 00:00:00 UTC [----] I, [2016-09-13T09:28:55.652384 #3022:985d64] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-14 00:00:00 UTC [----] I, [2016-09-13T09:28:59.646936 #3022:985580] INFO -- : MIQ(EmsCommon.block in process_emss) userid: [admin] - [Hawkular-Provider] Record delete initiated [----] I, [2016-09-13T09:28:59.663929 #3022:985580] INFO -- : MIQ(EmsCommon.block in process_emss) userid: [admin] - [TT] Record delete initiated [----] I, [2016-09-13T09:28:59.664058 #3022:985580] INFO -- : MIQ(ManageIQ::Providers::MiddlewareManager.destroy_queue) Queuing destroy of ManageIQ::Providers::MiddlewareManager with the following ids: [16, 15] [----] I, [2016-09-13T09:28:59.698540 #3022:985580] INFO -- : MIQ(MiqQueue.put) Message id: [79040], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [16], Task id: [], Command: [ManageIQ::Providers::MiddlewareManager.destroy], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:28:59.715462 #3022:985580] INFO -- : MIQ(MiqQueue.put) Message id: [79041], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [15], Task id: [], Command: [ManageIQ::Providers::MiddlewareManager.destroy], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:29:00.020942 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:29:00.035449 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79042], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:29:00.046621 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79043], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:29:00.063866 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79044], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:29:00.081718 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79045], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:29:03.964510 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:29:03.974731 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0029048919677734375, :worker_monitor=>1.4695987701416016, :worker_dequeue=>0.017657995223999023, :total_time=>1.4904894828796387} [----] I, [2016-09-13T09:29:04.681085 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79042], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.655809386] seconds [----] I, [2016-09-13T09:29:04.681210 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79042], Delivering... [----] I, [2016-09-13T09:29:04.698895 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79045], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.62897295] seconds [----] I, [2016-09-13T09:29:04.699180 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79045], Delivering... [----] I, [2016-09-13T09:29:04.709053 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0050241947174072266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0050506591796875, :pending_vm_jobs=>0.001279592514038086, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009279251098632812} [----] I, [2016-09-13T09:29:04.709663 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79045], State: [ok], Delivered in [0.010474557] seconds [----] I, [2016-09-13T09:29:04.726668 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79042], State: [ok], Delivered in [0.045438803] seconds [----] I, [2016-09-13T09:29:05.155589 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79043], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.114537404] seconds [----] I, [2016-09-13T09:29:05.155795 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79043], Delivering... [----] I, [2016-09-13T09:29:05.159670 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79043], State: [ok], Delivered in [0.003872411] seconds [----] I, [2016-09-13T09:29:05.195866 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79044], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.141454391] seconds [----] I, [2016-09-13T09:29:05.196091 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79044], Delivering... [----] I, [2016-09-13T09:29:05.201739 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79044], State: [ok], Delivered in [0.005650115] seconds [----] I, [2016-09-13T09:29:05.224148 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79040], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [16], Task id: [], Command: [ManageIQ::Providers::MiddlewareManager.destroy], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.555791702] seconds [----] I, [2016-09-13T09:29:05.224308 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79040], Delivering... [----] I, [2016-09-13T09:29:05.277003 #2928:34713c] INFO -- : MIQ(ExtManagementSystem.after_destroy) Removed EMS [Hawkular-Provider] id [16] [----] I, [2016-09-13T09:29:05.281460 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79041], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [15], Task id: [], Command: [ManageIQ::Providers::MiddlewareManager.destroy], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.581067354] seconds [----] I, [2016-09-13T09:29:05.281607 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79041], Delivering... [----] I, [2016-09-13T09:29:05.299009 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79040], State: [ok], Delivered in [0.074664062] seconds [----] I, [2016-09-13T09:29:05.406584 #2937:34713c] INFO -- : MIQ(ExtManagementSystem.after_destroy) Removed EMS [TT] id [15] [----] I, [2016-09-13T09:29:05.433385 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79041], State: [ok], Delivered in [0.151737659] seconds [----] I, [2016-09-13T09:29:08.975330 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:29:08 UTC]... [----] I, [2016-09-13T09:29:09.007336 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:29:08 UTC]...Complete [----] I, [2016-09-13T09:29:15.011082 #3022:9825b0] INFO -- : MIQ(AuthUseridPassword#after_authentication_changed) [ExtManagementSystem] [17], previously valid on: [] [----] I, [2016-09-13T09:29:15.019496 #3022:9825b0] INFO -- : MIQ(MiqQueue.put) Message id: [79046], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 17], "ems_auth_changed", {}] [----] I, [2016-09-13T09:29:15.029515 #3022:9825b0] INFO -- : MIQ(MiqQueue.put) Message id: [79047], id: [], Zone: [default], Role: [ems_operations], Server: [], Ident: [generic], Target id: [], Instance id: [17], Task id: [], Command: [ExtManagementSystem.authentication_check_types], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[:default], {}] [----] I, [2016-09-13T09:29:15.064980 #3022:9825b0] INFO -- : MIQ(EmsCommon.create) userid: [admin] - [Hawkular-Provider] Record created (name:[Hawkular-Provider], provider_region:[], hostname:[livingontheedge.hawkular.org], emstype:[hawkular], port:[80], api_version:[], provider_id:[], default_security_protocol:[kerberos], zone:[default], default_userid:[jdoe], default_password:[*], metrics_userid:[], metrics_password:[*], amqp_userid:[], amqp_password:[*], ssh_keypair_userid:[], ssh_keypair_password:[*], bearer_token:[*], ipaddress:[]) [----] I, [2016-09-13T09:29:15.098600 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:29:15.121892 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79048], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:29:19.193796 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker.sync_workers) Workers are being synchronized: Current: ["ems_15", "ems_16"], Desired: [] [----] I, [2016-09-13T09:29:19.224930 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79049], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [miq_server], Target id: [], Instance id: [1], Task id: [], Command: [MiqServer.stop_worker], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [101, :waiting_for_stop, nil] [----] I, [2016-09-13T09:29:19.253412 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79050], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [miq_server], Target id: [], Instance id: [1], Task id: [], Command: [MiqServer.stop_worker], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [100, :waiting_for_stop, nil] [----] I, [2016-09-13T09:29:19.357956 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher.sync_workers) Workers are being synchronized: Current: ["ems_15", "ems_16"], Desired: [] [----] I, [2016-09-13T09:29:19.385840 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79051], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [miq_server], Target id: [], Instance id: [1], Task id: [], Command: [MiqServer.stop_worker], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [88, :waiting_for_stop, nil] [----] I, [2016-09-13T09:29:19.419351 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79052], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [miq_server], Target id: [], Instance id: [1], Task id: [], Command: [MiqServer.stop_worker], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [94, :waiting_for_stop, nil] [----] I, [2016-09-13T09:29:20.960575 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:29:20.964086 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003862142562866211, :worker_monitor=>1.8847911357879639, :worker_dequeue=>0.006295919418334961, :total_time=>1.8951854705810547} [----] I, [2016-09-13T09:29:21.847863 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79048], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.73995364] seconds [----] I, [2016-09-13T09:29:21.848040 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79048], Delivering... [----] I, [2016-09-13T09:29:21.853860 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003078460693359375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030977725982666016, :pending_vm_jobs=>0.0007426738739013672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005478382110595703} [----] I, [2016-09-13T09:29:21.859898 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79048], State: [ok], Delivered in [0.011783263] seconds [----] I, [2016-09-13T09:29:23.380893 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79046], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 17], "ems_auth_changed", {}], Dequeued in: [8.365554883] seconds [----] I, [2016-09-13T09:29:23.381109 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79046], Delivering... [----] I, [2016-09-13T09:29:23.408025 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"ems_auth_changed"> inputs=<{"MiqEvent::miq_event"=>1090, :miq_event_id=>1090, "EventStream::event_stream"=>1090, :event_stream_id=>1090}> [----] I, [2016-09-13T09:29:23.443250 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79053], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>17, :attrs=>{:event_type=>"ems_auth_changed", "MiqEvent::miq_event"=>1090, :miq_event_id=>1090, "EventStream::event_stream"=>1090, :event_stream_id=>1090}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T09:29:23.443671 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79046], State: [ok], Delivered in [0.06256535] seconds [----] I, [2016-09-13T09:29:23.477034 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79047], MiqWorker id: [13], Zone: [default], Role: [ems_operations], Server: [], Ident: [generic], Target id: [], Instance id: [17], Task id: [], Command: [ExtManagementSystem.authentication_check_types], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[:default], {}], Dequeued in: [8.451183897] seconds [----] I, [2016-09-13T09:29:23.477234 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79047], Delivering... [----] I, [2016-09-13T09:29:23.973680 #2928:34713c] INFO -- : MIQ(AuthUseridPassword#validation_successful) [ExtManagementSystem] [17], previously valid/invalid on: []/[], previous status: [] [----] I, [2016-09-13T09:29:24.002862 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79054], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 17], "ems_auth_valid", {}] [----] I, [2016-09-13T09:29:24.003366 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79047], State: [ok], Delivered in [0.526109459] seconds [----] I, [2016-09-13T09:29:25.985654 #2763:34713c] INFO -- : MIQ(MiqQueue.get) Message id: [79049], MiqServer id: [1], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [miq_server], Target id: [], Instance id: [1], Task id: [], Command: [MiqServer.stop_worker], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [101, :waiting_for_stop, nil], Dequeued in: [6.777356012] seconds [----] I, [2016-09-13T09:29:25.985894 #2763:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79049], Delivering... [----] I, [2016-09-13T09:29:25.989375 #2763:34713c] INFO -- : MIQ(MiqServer#stop_worker) Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [101], PID: [12930], GUID: [4846d89a-79ab-11e6-87c1-fa163e7d01a3], status [started]... [----] I, [2016-09-13T09:29:26.008758 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79055], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [101], PID: [12930], GUID: [4846d89a-79ab-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T09:29:26.067403 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [101], PID: [12930], GUID: [4846d89a-79ab-11e6-87c1-fa163e7d01a3] is being requested to exit [----] I, [2016-09-13T09:29:26.067988 #2763:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79049], State: [ok], Delivered in [0.082089358] seconds [----] I, [2016-09-13T09:29:26.106485 #2763:34713c] INFO -- : MIQ(MiqQueue.get) Message id: [79050], MiqServer id: [1], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [miq_server], Target id: [], Instance id: [1], Task id: [], Command: [MiqServer.stop_worker], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [100, :waiting_for_stop, nil], Dequeued in: [6.867667039] seconds [----] I, [2016-09-13T09:29:26.106626 #2763:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79050], Delivering... [----] I, [2016-09-13T09:29:26.109373 #2763:34713c] INFO -- : MIQ(MiqServer#stop_worker) Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [100], PID: [10859], GUID: [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], status [started]... [----] I, [2016-09-13T09:29:26.129202 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79056], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [100], PID: [10859], GUID: [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T09:29:26.151272 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [100], PID: [10859], GUID: [5b4aad44-79a7-11e6-87c1-fa163e7d01a3] is being requested to exit [----] I, [2016-09-13T09:29:26.151797 #2763:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79050], State: [ok], Delivered in [0.045150467] seconds [----] I, [2016-09-13T09:29:26.209803 #2763:34713c] INFO -- : MIQ(MiqQueue.get) Message id: [79051], MiqServer id: [1], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [miq_server], Target id: [], Instance id: [1], Task id: [], Command: [MiqServer.stop_worker], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [88, :waiting_for_stop, nil], Dequeued in: [6.843462129] seconds [----] I, [2016-09-13T09:29:26.210032 #2763:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79051], Delivering... [----] I, [2016-09-13T09:29:26.215087 #2763:34713c] INFO -- : MIQ(MiqServer#stop_worker) Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3], status [started]... [----] I, [2016-09-13T09:29:26.238342 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79057], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher"}] [----] I, [2016-09-13T09:29:26.254395 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3] is being requested to exit [----] I, [2016-09-13T09:29:26.255064 #2763:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79051], State: [ok], Delivered in [0.045020893] seconds [----] I, [2016-09-13T09:29:26.318226 #2763:34713c] INFO -- : MIQ(MiqQueue.get) Message id: [79052], MiqServer id: [1], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [miq_server], Target id: [], Instance id: [1], Task id: [], Command: [MiqServer.stop_worker], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [94, :waiting_for_stop, nil], Dequeued in: [6.91913007] seconds [----] I, [2016-09-13T09:29:26.318545 #2763:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79052], Delivering... [----] I, [2016-09-13T09:29:26.323647 #2763:34713c] INFO -- : MIQ(MiqServer#stop_worker) Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3], status [started]... [----] I, [2016-09-13T09:29:26.346299 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79058], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher"}] [----] I, [2016-09-13T09:29:26.363253 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3] is being requested to exit [----] I, [2016-09-13T09:29:26.363981 #2763:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79052], State: [ok], Delivered in [0.045439821] seconds [----] I, [2016-09-13T09:29:26.400393 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:29:26.524569 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79053], MiqWorker id: [14], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>17, :attrs=>{:event_type=>"ems_auth_changed", "MiqEvent::miq_event"=>1090, :miq_event_id=>1090, "EventStream::event_stream"=>1090, :event_stream_id=>1090}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [3.096890551] seconds [----] I, [2016-09-13T09:29:26.524798 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79053], Delivering... [----] I, [2016-09-13T09:29:26.527106 #2937:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"ems_auth_changed", "MiqEvent::miq_event"=>1090, :miq_event_id=>1090, "EventStream::event_stream"=>1090, :event_stream_id=>1090} for object [ManageIQ::Providers::Hawkular::MiddlewareManager.17] with state [] to Automate [----] I, [2016-09-13T09:29:26.533286 #2937:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1090&ExtManagementSystem%3A%3Aext_management_system=17&MiqEvent%3A%3Amiq_event=1090&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1090&event_type=ems_auth_changed&miq_event_id=1090&object_name=Event&vmdb_object_type=ext_management_system] [----] I, [2016-09-13T09:29:26.558575 #2937:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1090&ExtManagementSystem%3A%3Aext_management_system=17&MiqEvent%3A%3Amiq_event=1090&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1090&event_type=ems_auth_changed&miq_event_id=1090&object_name=Event&vmdb_object_type=ext_management_system ManageIQ/System] [----] I, [2016-09-13T09:29:26.620858 #2937:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_changed#create] [----] I, [2016-09-13T09:29:26.635719 #2937:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_changed#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T09:29:26.650248 #2937:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/ems_auth_changed] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T09:29:26.664246 #2937:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:26.668489 #2937:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T09:29:26.681521 #2937:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T09:29:26.687646 #2937:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T09:29:26.690633 #2937:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#] [----] I, [2016-09-13T09:29:26.690863 #2937:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [ems_auth_changed] [----] I, [2016-09-13T09:29:26.728536 #2937:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [ems_auth_changed] [----] I, [2016-09-13T09:29:26.728813 #2937:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [ems_auth_changed] Target: ManageIQ::Providers::Hawkular::MiddlewareManager Name: [Hawkular-Provider], Id: [17] [----] I, [2016-09-13T09:29:26.735460 #2937:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:26.735913 #2937:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_changed#create] [----] I, [2016-09-13T09:29:26.736502 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79053], State: [ok], Delivered in [0.211715104] seconds [----] I, [2016-09-13T09:29:26.781055 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79054], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 17], "ems_auth_valid", {}], Dequeued in: [2.785862324] seconds [----] I, [2016-09-13T09:29:26.781273 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79054], Delivering... [----] I, [2016-09-13T09:29:26.808849 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"ems_auth_valid"> inputs=<{"MiqEvent::miq_event"=>1091, :miq_event_id=>1091, "EventStream::event_stream"=>1091, :event_stream_id=>1091}> [----] I, [2016-09-13T09:29:26.843739 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79059], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>17, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1091, :miq_event_id=>1091, "EventStream::event_stream"=>1091, :event_stream_id=>1091}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T09:29:26.844110 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79054], State: [ok], Delivered in [0.062837748] seconds [----] I, [2016-09-13T09:29:26.906359 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79055], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [101], PID: [12930], GUID: [4846d89a-79ab-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [0.915359067] seconds [----] I, [2016-09-13T09:29:26.906543 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79055], Delivering... [----] I, [2016-09-13T09:29:26.934379 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_stop"> inputs=<{:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [101], PID: [12930], GUID: [4846d89a-79ab-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1092, :miq_event_id=>1092, "EventStream::event_stream"=>1092, :event_stream_id=>1092}> [----] I, [2016-09-13T09:29:26.964347 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79060], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [101], PID: [12930], GUID: [4846d89a-79ab-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1092, :miq_event_id=>1092, "EventStream::event_stream"=>1092, :event_stream_id=>1092}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T09:29:26.964807 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79055], State: [ok], Delivered in [0.058252561] seconds [----] I, [2016-09-13T09:29:27.009069 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79056], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [100], PID: [10859], GUID: [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [0.898268234] seconds [----] I, [2016-09-13T09:29:27.009201 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79056], Delivering... [----] I, [2016-09-13T09:29:27.031495 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_stop"> inputs=<{:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [100], PID: [10859], GUID: [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1093, :miq_event_id=>1093, "EventStream::event_stream"=>1093, :event_stream_id=>1093}> [----] I, [2016-09-13T09:29:27.061195 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79057], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher"}], Dequeued in: [0.843533569] seconds [----] I, [2016-09-13T09:29:27.061455 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79057], Delivering... [----] I, [2016-09-13T09:29:27.078458 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79061], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [100], PID: [10859], GUID: [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1093, :miq_event_id=>1093, "EventStream::event_stream"=>1093, :event_stream_id=>1093}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T09:29:27.078747 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79056], State: [ok], Delivered in [0.069547202] seconds [----] I, [2016-09-13T09:29:27.101845 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_stop"> inputs=<{:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher", "MiqEvent::miq_event"=>1094, :miq_event_id=>1094, "EventStream::event_stream"=>1094, :event_stream_id=>1094}> [----] I, [2016-09-13T09:29:27.137112 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79062], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher", "MiqEvent::miq_event"=>1094, :miq_event_id=>1094, "EventStream::event_stream"=>1094, :event_stream_id=>1094}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T09:29:27.137370 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79057], State: [ok], Delivered in [0.07597236] seconds [----] I, [2016-09-13T09:29:27.148253 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79058], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher"}], Dequeued in: [0.822072669] seconds [----] I, [2016-09-13T09:29:27.148404 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79058], Delivering... [----] I, [2016-09-13T09:29:27.233489 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_stop"> inputs=<{:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher", "MiqEvent::miq_event"=>1095, :miq_event_id=>1095, "EventStream::event_stream"=>1095, :event_stream_id=>1095}> [----] I, [2016-09-13T09:29:27.285654 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79063], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher", "MiqEvent::miq_event"=>1095, :miq_event_id=>1095, "EventStream::event_stream"=>1095, :event_stream_id=>1095}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T09:29:27.285914 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79058], State: [ok], Delivered in [0.137512145] seconds [----] I, [2016-09-13T09:29:27.645565 #20386:34713c] INFO -- : EMS [livingontheedge.hawkular.org] as [jdoe] ID [94] PID [20386] GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3] Exit request received. Stopping Event Monitor Thread. [----] I, [2016-09-13T09:29:27.645746 #20386:34713c] INFO -- : EMS [livingontheedge.hawkular.org] as [jdoe] ID [94] PID [20386] GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3] Exit request received. Waiting for Event Monitor Thread to Stop. [----] I, [2016-09-13T09:29:30.135075 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:29:30.153658 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79064], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:29:30.168618 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79065], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:29:31.427590 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 7 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:29:31.433972 #10859:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Ems 16] Worker ID [100], PID [10859], GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:29:11 UTC], Process Info: Memory Usage [609239040], Memory Size [1064759296], Proportional Set Size: [441910000], Memory % [7.43], CPU Time [1910.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:29:31.434323 #10859:34713c] INFO -- : EMS [livingontheedge.hawkular.org] as [jdoe] ID [100] PID [10859] GUID [5b4aad44-79a7-11e6-87c1-fa163e7d01a3] Exit request received. Worker exiting. [----] I, [2016-09-13T09:29:31.923885 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79059], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>17, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1091, :miq_event_id=>1091, "EventStream::event_stream"=>1091, :event_stream_id=>1091}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [5.10380435] seconds [----] I, [2016-09-13T09:29:31.924026 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79059], Delivering... [----] I, [2016-09-13T09:29:31.925330 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1091, :miq_event_id=>1091, "EventStream::event_stream"=>1091, :event_stream_id=>1091} for object [ManageIQ::Providers::Hawkular::MiddlewareManager.17] with state [] to Automate [----] I, [2016-09-13T09:29:31.928860 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1091&ExtManagementSystem%3A%3Aext_management_system=17&MiqEvent%3A%3Amiq_event=1091&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1091&event_type=ems_auth_valid&miq_event_id=1091&object_name=Event&vmdb_object_type=ext_management_system] [----] I, [2016-09-13T09:29:31.946517 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1091&ExtManagementSystem%3A%3Aext_management_system=17&MiqEvent%3A%3Amiq_event=1091&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1091&event_type=ems_auth_valid&miq_event_id=1091&object_name=Event&vmdb_object_type=ext_management_system ManageIQ/System] [----] I, [2016-09-13T09:29:31.948363 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79060], MiqWorker id: [16], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [101], PID: [12930], GUID: [4846d89a-79ab-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1092, :miq_event_id=>1092, "EventStream::event_stream"=>1092, :event_stream_id=>1092}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [5.005459873] seconds [----] I, [2016-09-13T09:29:31.948565 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79060], Delivering... [----] I, [2016-09-13T09:29:31.950543 #2957:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [101], PID: [12930], GUID: [4846d89a-79ab-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1092, :miq_event_id=>1092, "EventStream::event_stream"=>1092, :event_stream_id=>1092} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T09:29:31.954595 #2957:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1092&MiqEvent%3A%3Amiq_event=1092&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B101%5D%2C%20PID%3A%20%5B12930%5D%2C%20GUID%3A%20%5B4846d89a-79ab-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1092&event_type=evm_worker_stop&miq_event_id=1092&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T09:29:31.980614 #2957:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1092&MiqEvent%3A%3Amiq_event=1092&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B101%5D%2C%20PID%3A%20%5B12930%5D%2C%20GUID%3A%20%5B4846d89a-79ab-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1092&event_type=evm_worker_stop&miq_event_id=1092&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T09:29:31.997202 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T09:29:32.009610 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T09:29:32.021853 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/ems_auth_valid] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T09:29:32.033846 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:32.037331 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T09:29:32.047729 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T09:29:32.052676 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T09:29:32.055090 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#] [----] I, [2016-09-13T09:29:32.055259 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [ems_auth_valid] [----] I, [2016-09-13T09:29:32.058719 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T09:29:32.071240 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [ems_auth_valid] [----] I, [2016-09-13T09:29:32.071442 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [ems_auth_valid] Target: ManageIQ::Providers::Hawkular::MiddlewareManager Name: [Hawkular-Provider], Id: [17] [----] I, [2016-09-13T09:29:32.076917 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:32.077293 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T09:29:32.077869 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79059], State: [ok], Delivered in [0.15382918] seconds [----] I, [2016-09-13T09:29:32.079461 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T09:29:32.095453 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79061], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [100], PID: [10859], GUID: [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1093, :miq_event_id=>1093, "EventStream::event_stream"=>1093, :event_stream_id=>1093}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [5.058869449] seconds [----] I, [2016-09-13T09:29:32.095653 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79061], Delivering... [----] I, [2016-09-13T09:29:32.096202 #2957:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_stop] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T09:29:32.097235 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [100], PID: [10859], GUID: [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1093, :miq_event_id=>1093, "EventStream::event_stream"=>1093, :event_stream_id=>1093} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T09:29:32.100201 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1093&MiqEvent%3A%3Amiq_event=1093&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B100%5D%2C%20PID%3A%20%5B10859%5D%2C%20GUID%3A%20%5B5b4aad44-79a7-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1093&event_type=evm_worker_stop&miq_event_id=1093&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T09:29:32.109277 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:32.113062 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T09:29:32.117012 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1093&MiqEvent%3A%3Amiq_event=1093&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B100%5D%2C%20PID%3A%20%5B10859%5D%2C%20GUID%3A%20%5B5b4aad44-79a7-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1093&event_type=evm_worker_stop&miq_event_id=1093&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T09:29:32.124409 #2957:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T09:29:32.130074 #2957:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T09:29:32.133374 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 13:29:08", os_priority: 21, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 275689472, memory_size: 574287872, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 200501000, has_active_websocket: true>] [----] I, [2016-09-13T09:29:32.133593 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_stop] [----] I, [2016-09-13T09:29:32.157191 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_stop] [----] I, [2016-09-13T09:29:32.157408 #2957:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_stop] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T09:29:32.163410 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:32.163453 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T09:29:32.163854 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T09:29:32.164443 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79060], State: [ok], Delivered in [0.215844524] seconds [----] I, [2016-09-13T09:29:32.175498 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T09:29:32.187660 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_stop] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T09:29:32.198961 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:32.202331 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T09:29:32.204302 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79062], MiqWorker id: [16], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher", "MiqEvent::miq_event"=>1094, :miq_event_id=>1094, "EventStream::event_stream"=>1094, :event_stream_id=>1094}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [5.094638441] seconds [----] I, [2016-09-13T09:29:32.204502 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79062], Delivering... [----] I, [2016-09-13T09:29:32.206521 #2957:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher", "MiqEvent::miq_event"=>1094, :miq_event_id=>1094, "EventStream::event_stream"=>1094, :event_stream_id=>1094} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T09:29:32.211922 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T09:29:32.211998 #2957:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1094&MiqEvent%3A%3Amiq_event=1094&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3AEventCatcher%5D%20with%20ID%3A%20%5B88%5D%2C%20PID%3A%20%5B684%5D%2C%20GUID%3A%20%5Bc253e5f6-7924-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1094&event_type=evm_worker_stop&miq_event_id=1094&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3AEventCatcher&vmdb_object_type=miq_server] [----] I, [2016-09-13T09:29:32.216728 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T09:29:32.219470 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 13:29:08", os_priority: 21, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 275689472, memory_size: 574287872, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 200501000, has_active_websocket: true>] [----] I, [2016-09-13T09:29:32.219646 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_stop] [----] I, [2016-09-13T09:29:32.235012 #2957:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1094&MiqEvent%3A%3Amiq_event=1094&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3AEventCatcher%5D%20with%20ID%3A%20%5B88%5D%2C%20PID%3A%20%5B684%5D%2C%20GUID%3A%20%5Bc253e5f6-7924-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1094&event_type=evm_worker_stop&miq_event_id=1094&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3AEventCatcher&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T09:29:32.237100 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_stop] [----] I, [2016-09-13T09:29:32.237289 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_stop] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T09:29:32.240088 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:32.240441 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T09:29:32.241013 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79061], State: [ok], Delivered in [0.145364587] seconds [----] I, [2016-09-13T09:29:32.292989 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T09:29:32.307361 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T09:29:32.312205 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79063], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher", "MiqEvent::miq_event"=>1095, :miq_event_id=>1095, "EventStream::event_stream"=>1095, :event_stream_id=>1095}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [5.070943286] seconds [----] I, [2016-09-13T09:29:32.312314 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79063], Delivering... [----] I, [2016-09-13T09:29:32.313529 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher", "MiqEvent::miq_event"=>1095, :miq_event_id=>1095, "EventStream::event_stream"=>1095, :event_stream_id=>1095} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T09:29:32.316376 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1095&MiqEvent%3A%3Amiq_event=1095&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3AEventCatcher%5D%20with%20ID%3A%20%5B94%5D%2C%20PID%3A%20%5B20386%5D%2C%20GUID%3A%20%5Be5930efc-7974-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1095&event_type=evm_worker_stop&miq_event_id=1095&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3AEventCatcher&vmdb_object_type=miq_server] [----] I, [2016-09-13T09:29:32.321145 #2957:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_stop] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T09:29:32.333556 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:32.334321 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1095&MiqEvent%3A%3Amiq_event=1095&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3AEventCatcher%5D%20with%20ID%3A%20%5B94%5D%2C%20PID%3A%20%5B20386%5D%2C%20GUID%3A%20%5Be5930efc-7974-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1095&event_type=evm_worker_stop&miq_event_id=1095&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3AEventCatcher&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T09:29:32.337175 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T09:29:32.348449 #2957:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T09:29:32.353916 #2957:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T09:29:32.357182 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 13:29:08", os_priority: 21, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 275689472, memory_size: 574287872, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 200501000, has_active_websocket: true>] [----] I, [2016-09-13T09:29:32.357337 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_stop] [----] I, [2016-09-13T09:29:32.374351 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_stop] [----] I, [2016-09-13T09:29:32.374569 #2957:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_stop] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T09:29:32.374912 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:32.375217 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T09:29:32.375745 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79062], State: [ok], Delivered in [0.171253634] seconds [----] I, [2016-09-13T09:29:32.387563 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T09:29:32.403567 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T09:29:32.419859 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_stop] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T09:29:32.426238 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79065], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.268424118] seconds [----] I, [2016-09-13T09:29:32.426409 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79065], Delivering... [----] I, [2016-09-13T09:29:32.433003 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003821134567260742, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003840208053588867, :pending_vm_jobs=>0.0007631778717041016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006230831146240234} [----] I, [2016-09-13T09:29:32.433314 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79065], State: [ok], Delivered in [0.006903455] seconds [----] I, [2016-09-13T09:29:32.434327 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:32.438745 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T09:29:32.456782 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T09:29:32.463075 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T09:29:32.466591 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 13:29:08", os_priority: 21, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 275689472, memory_size: 574287872, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 200501000, has_active_websocket: true>] [----] I, [2016-09-13T09:29:32.466778 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_stop] [----] I, [2016-09-13T09:29:32.488821 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_stop] [----] I, [2016-09-13T09:29:32.489048 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_stop] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T09:29:32.489491 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:32.489911 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T09:29:32.490549 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79063], State: [ok], Delivered in [0.178215667] seconds [----] I, [2016-09-13T09:29:33.225904 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79064], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.087637349] seconds [----] I, [2016-09-13T09:29:33.226036 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79064], Delivering... [----] I, [2016-09-13T09:29:33.228995 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79064], State: [ok], Delivered in [0.002963245] seconds [----] I, [2016-09-13T09:29:35.015176 #3022:9858a0] INFO -- : MIQ(MiqQueue.put) Message id: [79066], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T09:29:35.037651 #3022:9858a0] INFO -- : MIQ(EmsCommon.process_emss) userid: [admin] - 'refresh_ems' successfully initiated for 1 Middleware Providers [----] I, [2016-09-13T09:29:35.436704 #684:34713c] INFO -- : EMS [10.16.23.206] as [jdoe] ID [88] PID [684] GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3] Exit request received. Stopping Event Monitor Thread. [----] I, [2016-09-13T09:29:35.436930 #684:34713c] INFO -- : EMS [10.16.23.206] as [jdoe] ID [88] PID [684] GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3] Exit request received. Waiting for Event Monitor Thread to Stop. [----] I, [2016-09-13T09:29:35.735126 #12930:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Ems 15] Worker ID [101], PID [12930], GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:29:15 UTC], Process Info: Memory Usage [598245376], Memory Size [927567872], Proportional Set Size: [437949000], Memory % [7.29], CPU Time [835.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:29:35.736009 #12930:34713c] INFO -- : EMS [10.16.23.206] as [jdoe] ID [101] PID [12930] GUID [4846d89a-79ab-11e6-87c1-fa163e7d01a3] Exit request received. Worker exiting. [----] I, [2016-09-13T09:29:36.622219 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker.sync_workers) Workers are being synchronized: Current: [], Desired: ["ems_17"] [----] I, [2016-09-13T09:29:36.701857 #2763:34713c] INFO -- : :kill_algorithm: [----] I, [2016-09-13T09:29:36.701962 #2763:34713c] INFO -- : :name: :used_swap_percent_gt_value [----] I, [2016-09-13T09:29:36.702001 #2763:34713c] INFO -- : :value: 80 [----] I, [2016-09-13T09:29:36.702031 #2763:34713c] INFO -- : :miq_server_time_threshold: 120 [----] I, [2016-09-13T09:29:36.702058 #2763:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T09:29:36.702084 #2763:34713c] INFO -- : :poll: 2 [----] I, [2016-09-13T09:29:36.702110 #2763:34713c] INFO -- : :start_algorithm: [----] I, [2016-09-13T09:29:36.702137 #2763:34713c] INFO -- : :name: :used_swap_percent_lt_value [----] I, [2016-09-13T09:29:36.702168 #2763:34713c] INFO -- : :value: 60 [----] I, [2016-09-13T09:29:36.702193 #2763:34713c] INFO -- : :sync_interval: 1800 [----] I, [2016-09-13T09:29:36.702219 #2763:34713c] INFO -- : :wait_for_started_timeout: 600 [----] I, [2016-09-13T09:29:36.906604 #684:34713c] INFO -- : EMS [10.16.23.206] as [jdoe] ID [88] PID [684] GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3] Exit request received. Draining Event Queue. [----] I, [2016-09-13T09:29:37.024446 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker.close_pg_sockets_inherited_from_parent) Closing socket: 21 [----] I, [2016-09-13T09:29:37.058090 #684:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Ems 15] Worker ID [88], PID [684], GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:29:15 UTC], Process Info: Memory Usage [558022656], Memory Size [897220608], Proportional Set Size: [417690000], Memory % [6.8], CPU Time [6144.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T09:29:37.058585 #684:34713c] INFO -- : EMS [10.16.23.206] as [jdoe] ID [88] PID [684] GUID [c253e5f6-7924-11e6-87c1-fa163e7d01a3] Exit request received. Worker exiting. [----] I, [2016-09-13T09:29:37.175320 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79067], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T09:29:37.175536 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#start) Worker started: ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] [----] I, [2016-09-13T09:29:37.295188 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher.sync_workers) Workers are being synchronized: Current: [], Desired: ["ems_17"] [----] I, [2016-09-13T09:29:37.326977 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher.close_pg_sockets_inherited_from_parent) Closing socket: 21 [----] I, [2016-09-13T09:29:37.393760 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79068], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher"}] [----] I, [2016-09-13T09:29:37.394019 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#start) Worker started: ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3] [----] I, [2016-09-13T09:29:37.454301 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:29:37.455543 #17546:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T09:29:37.455621 #17546:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:29:37.455687 #17546:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:29:37.455739 #17546:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:29:37.455798 #17546:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T09:29:37.455846 #17546:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T09:29:37.455906 #17546:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:29:37.455951 #17546:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T09:29:37.456009 #17546:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:29:37.456060 #17546:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:29:37.456115 #17546:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T09:29:37.456165 #17546:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:29:37.456223 #17546:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T09:29:37.456279 #17546:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:29:37.456327 #17546:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T09:29:37.456378 #17546:34713c] INFO -- : --- [----] I, [2016-09-13T09:29:37.456899 #17546:34713c] INFO -- : :guid: 1d7be00a-79b6-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:29:37.456966 #17546:34713c] INFO -- : :ems_id: 17 [----] I, [2016-09-13T09:29:37.646051 #20386:34713c] INFO -- : EMS [livingontheedge.hawkular.org] as [jdoe] ID [94] PID [20386] GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3] Exit request received. Draining Event Queue. [----] I, [2016-09-13T09:29:37.738346 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:29:37.739522 #17555:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T09:29:37.739593 #17555:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:29:37.739648 #17555:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:29:37.739698 #17555:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:29:37.739744 #17555:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T09:29:37.739793 #17555:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T09:29:37.739839 #17555:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:29:37.739899 #17555:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T09:29:37.739948 #17555:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:29:37.739988 #17555:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:29:37.740039 #17555:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:29:37.740084 #17555:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:29:37.740136 #17555:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T09:29:37.740195 #17555:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T09:29:37.740244 #17555:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T09:29:37.740299 #17555:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T09:29:37.740346 #17555:34713c] INFO -- : --- [----] I, [2016-09-13T09:29:37.740848 #17555:34713c] INFO -- : :guid: 1dd6952c-79b6-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:29:37.740920 #17555:34713c] INFO -- : :ems_id: 17 [----] I, [2016-09-13T09:29:37.774185 #20386:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Ems 16] Worker ID [94], PID [20386], GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:29:17 UTC], Process Info: Memory Usage [580153344], Memory Size [911769600], Proportional Set Size: [424410000], Memory % [7.07], CPU Time [2710.0], CPU % [0.01], Priority [21] [----] I, [2016-09-13T09:29:37.774908 #20386:34713c] INFO -- : EMS [livingontheedge.hawkular.org] as [jdoe] ID [94] PID [20386] GUID [e5930efc-7974-11e6-87c1-fa163e7d01a3] Exit request received. Worker exiting. [----] I, [2016-09-13T09:29:38.050041 #17546:34713c] INFO -- : MIQ(AuthUseridPassword#validation_successful) [ExtManagementSystem] [17], previously valid/invalid on: [2016-09-13 13:29:23 UTC]/[], previous status: [Valid] [----] I, [2016-09-13T09:29:38.106983 #17546:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79069], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 17], "ems_auth_valid", {}] [----] I, [2016-09-13T09:29:38.252432 #17555:34713c] INFO -- : MIQ(AuthUseridPassword#validation_successful) [ExtManagementSystem] [17], previously valid/invalid on: [2016-09-13 13:29:23 UTC]/[], previous status: [Valid] [----] I, [2016-09-13T09:29:38.380905 #17555:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79070], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 17], "ems_auth_valid", {}] [----] I, [2016-09-13T09:29:38.385685 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#after_initialize) EMS [livingontheedge.hawkular.org] as [jdoe] Event Catcher skipping the following events: [----] I, [2016-09-13T09:29:38.529999 #17546:34713c] INFO -- : ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner started. ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Zone [default], Role [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket] [----] I, [2016-09-13T09:29:38.530435 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_wait_for_worker_monitor) EMS [livingontheedge.hawkular.org] as [jdoe] Checking that worker monitor has started before doing work [----] I, [2016-09-13T09:29:38.535083 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_wait_for_worker_monitor) EMS [livingontheedge.hawkular.org] as [jdoe] Starting work since worker monitor has started [----] I, [2016-09-13T09:29:38.535227 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_before_work_loop) EMS [livingontheedge.hawkular.org] as [jdoe] Queueing initial refresh for EMS. [----] I, [2016-09-13T09:29:38.554394 #17546:34713c] INFO -- : MIQ(MiqQueue.put_or_update) Message id: [79066] updated with following: {:queue_name=>"ems_17", :state=>"ready", :zone=>"default", :class_name=>"EmsRefresh", :method_name=>"refresh", :role=>"ems_inventory", :args=>[[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], :msg_timeout=>7200, :task_id=>nil} [----] I, [2016-09-13T09:29:38.554820 #17546:34713c] INFO -- : MIQ(MiqQueue.put_or_update) Message id: [79066], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Requeued [----] I, [2016-09-13T09:29:38.557087 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#worker_monitor_drb) EMS [livingontheedge.hawkular.org] as [jdoe] Initializing DRb Connection to MiqServer with ID=[1], NAME=[EVM], PID=[2763], GUID=[36647afc-71a3-11e6-838a-fa163e68952f] DRb URI=[druby://127.0.0.1:41718] [----] I, [2016-09-13T09:29:38.570662 #2763:34713c] INFO -- : MIQ(MiqServer#clean_worker_records) SQL Record for Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [100], PID: [10859], GUID: [5b4aad44-79a7-11e6-87c1-fa163e7d01a3], Status: [stopped] is being deleted [----] I, [2016-09-13T09:29:38.597623 #2763:34713c] INFO -- : MIQ(MiqServer#clean_worker_records) SQL Record for Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [101], PID: [12930], GUID: [4846d89a-79ab-11e6-87c1-fa163e7d01a3], Status: [stopped] is being deleted [----] I, [2016-09-13T09:29:38.676793 #2763:34713c] INFO -- : MIQ(MiqServer#clean_worker_records) SQL Record for Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [94], PID: [20386], GUID: [e5930efc-7974-11e6-87c1-fa163e7d01a3], Status: [stopped] is being deleted [----] I, [2016-09-13T09:29:38.695282 #2763:34713c] INFO -- : MIQ(MiqServer#clean_worker_records) SQL Record for Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [88], PID: [684], GUID: [c253e5f6-7924-11e6-87c1-fa163e7d01a3], Status: [stopped] is being deleted [----] I, [2016-09-13T09:29:38.883737 #17555:34713c] INFO -- : ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner started. ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Zone [default], Role [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket] [----] I, [2016-09-13T09:29:38.883875 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#do_wait_for_worker_monitor) EMS [livingontheedge.hawkular.org] as [jdoe] Checking that worker monitor has started before doing work [----] I, [2016-09-13T09:29:38.890438 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#do_wait_for_worker_monitor) EMS [livingontheedge.hawkular.org] as [jdoe] Starting work since worker monitor has started [----] I, [2016-09-13T09:29:38.890891 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#start_event_monitor) EMS [livingontheedge.hawkular.org] as [jdoe] Validating Connection/Credentials [----] I, [2016-09-13T09:29:39.101342 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:29:39.104756 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=1, priority=200 [----] I, [2016-09-13T09:29:39.104948 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0034151077270507812, :server_monitor=>0.0906219482421875, :worker_monitor=>2.562847375869751, :worker_dequeue=>0.0076503753662109375, :total_time=>2.664846658706665} [----] I, [2016-09-13T09:29:39.267042 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79067], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [2.12917254] seconds [----] I, [2016-09-13T09:29:39.267203 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79067], Delivering... [----] I, [2016-09-13T09:29:39.282961 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_start"> inputs=<{:event_details=>"Worker started: ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1096, :miq_event_id=>1096, "EventStream::event_stream"=>1096, :event_stream_id=>1096}> [----] I, [2016-09-13T09:29:39.312906 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79071], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1096, :miq_event_id=>1096, "EventStream::event_stream"=>1096, :event_stream_id=>1096}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T09:29:39.313217 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79067], State: [ok], Delivered in [0.046013476] seconds [----] I, [2016-09-13T09:29:39.346934 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79068], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher"}], Dequeued in: [1.982588029] seconds [----] I, [2016-09-13T09:29:39.347061 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79068], Delivering... [----] I, [2016-09-13T09:29:39.352396 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79069], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 17], "ems_auth_valid", {}], Dequeued in: [1.278974101] seconds [----] I, [2016-09-13T09:29:39.352533 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79069], Delivering... [----] I, [2016-09-13T09:29:39.357745 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_start"> inputs=<{:event_details=>"Worker started: ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher", "MiqEvent::miq_event"=>1097, :miq_event_id=>1097, "EventStream::event_stream"=>1097, :event_stream_id=>1097}> [----] I, [2016-09-13T09:29:39.363540 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"ems_auth_valid"> inputs=<{"MiqEvent::miq_event"=>1098, :miq_event_id=>1098, "EventStream::event_stream"=>1098, :event_stream_id=>1098}> [----] I, [2016-09-13T09:29:39.381682 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79072], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher", "MiqEvent::miq_event"=>1097, :miq_event_id=>1097, "EventStream::event_stream"=>1097, :event_stream_id=>1097}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T09:29:39.382043 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79068], State: [ok], Delivered in [0.03496106] seconds [----] I, [2016-09-13T09:29:39.387507 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79073], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>17, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1098, :miq_event_id=>1098, "EventStream::event_stream"=>1098, :event_stream_id=>1098}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T09:29:39.387871 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79069], State: [ok], Delivered in [0.035317956] seconds [----] I, [2016-09-13T09:29:39.426544 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79070], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 17], "ems_auth_valid", {}], Dequeued in: [1.13297769] seconds [----] I, [2016-09-13T09:29:39.426687 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79070], Delivering... [----] I, [2016-09-13T09:29:39.437779 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"ems_auth_valid"> inputs=<{"MiqEvent::miq_event"=>1099, :miq_event_id=>1099, "EventStream::event_stream"=>1099, :event_stream_id=>1099}> [----] I, [2016-09-13T09:29:39.463402 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79074], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>17, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1099, :miq_event_id=>1099, "EventStream::event_stream"=>1099, :event_stream_id=>1099}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T09:29:39.463895 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79070], State: [ok], Delivered in [0.037177933] seconds [----] I, [2016-09-13T09:29:44.105390 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:29:44 UTC]... [----] I, [2016-09-13T09:29:44.125452 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:29:44 UTC]...Complete [----] I, [2016-09-13T09:29:44.141291 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T09:29:44.148269 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:29:44.156277 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=1, priority=200 [----] I, [2016-09-13T09:29:44.583507 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79071], MiqWorker id: [16], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1096, :miq_event_id=>1096, "EventStream::event_stream"=>1096, :event_stream_id=>1096}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [5.295598176] seconds [----] I, [2016-09-13T09:29:44.583675 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79071], Delivering... [----] I, [2016-09-13T09:29:44.585408 #2957:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1096, :miq_event_id=>1096, "EventStream::event_stream"=>1096, :event_stream_id=>1096} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T09:29:44.589969 #2957:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1096&MiqEvent%3A%3Amiq_event=1096&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B102%5D%2C%20PID%20%5B17546%5D%2C%20GUID%20%5B1d7be00a-79b6-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1096&event_type=evm_worker_start&miq_event_id=1096&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T09:29:44.594931 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79072], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher", "MiqEvent::miq_event"=>1097, :miq_event_id=>1097, "EventStream::event_stream"=>1097, :event_stream_id=>1097}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [5.227582727] seconds [----] I, [2016-09-13T09:29:44.595073 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79072], Delivering... [----] I, [2016-09-13T09:29:44.596585 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher", "MiqEvent::miq_event"=>1097, :miq_event_id=>1097, "EventStream::event_stream"=>1097, :event_stream_id=>1097} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T09:29:44.600319 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1097&MiqEvent%3A%3Amiq_event=1097&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B103%5D%2C%20PID%20%5B17555%5D%2C%20GUID%20%5B1dd6952c-79b6-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1097&event_type=evm_worker_start&miq_event_id=1097&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3AEventCatcher&vmdb_object_type=miq_server] [----] I, [2016-09-13T09:29:44.615595 #2957:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1096&MiqEvent%3A%3Amiq_event=1096&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B102%5D%2C%20PID%20%5B17546%5D%2C%20GUID%20%5B1d7be00a-79b6-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1096&event_type=evm_worker_start&miq_event_id=1096&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T09:29:44.622143 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1097&MiqEvent%3A%3Amiq_event=1097&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B103%5D%2C%20PID%20%5B17555%5D%2C%20GUID%20%5B1dd6952c-79b6-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1097&event_type=evm_worker_start&miq_event_id=1097&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3AEventCatcher&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T09:29:44.686736 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T09:29:44.704973 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T09:29:44.715782 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T09:29:44.723254 #2957:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_start] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T09:29:44.731823 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T09:29:44.740133 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:44.745129 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T09:29:44.748585 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_start] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T09:29:44.759829 #2957:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T09:29:44.763897 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:44.767265 #2957:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T09:29:44.768355 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T09:29:44.771336 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 13:29:44", os_priority: 21, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 275689472, memory_size: 574287872, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 200501000, has_active_websocket: true>] [----] I, [2016-09-13T09:29:44.771595 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_start] [----] I, [2016-09-13T09:29:44.781377 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T09:29:44.787909 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T09:29:44.787945 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_start] [----] I, [2016-09-13T09:29:44.788150 #2957:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_start] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T09:29:44.791462 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 13:29:44", os_priority: 21, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 275689472, memory_size: 574287872, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 200501000, has_active_websocket: true>] [----] I, [2016-09-13T09:29:44.791656 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_start] [----] I, [2016-09-13T09:29:44.792163 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:44.792662 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T09:29:44.793335 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79071], State: [ok], Delivered in [0.209651855] seconds [----] I, [2016-09-13T09:29:44.816484 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_start] [----] I, [2016-09-13T09:29:44.816670 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_start] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T09:29:44.820177 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:44.820614 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T09:29:44.821203 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79072], State: [ok], Delivered in [0.226115509] seconds [----] I, [2016-09-13T09:29:44.835534 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79073], MiqWorker id: [16], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>17, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1098, :miq_event_id=>1098, "EventStream::event_stream"=>1098, :event_stream_id=>1098}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [5.461686306] seconds [----] I, [2016-09-13T09:29:44.835679 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79073], Delivering... [----] I, [2016-09-13T09:29:44.837260 #2957:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1098, :miq_event_id=>1098, "EventStream::event_stream"=>1098, :event_stream_id=>1098} for object [ManageIQ::Providers::Hawkular::MiddlewareManager.17] with state [] to Automate [----] I, [2016-09-13T09:29:44.841748 #2957:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1098&ExtManagementSystem%3A%3Aext_management_system=17&MiqEvent%3A%3Amiq_event=1098&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1098&event_type=ems_auth_valid&miq_event_id=1098&object_name=Event&vmdb_object_type=ext_management_system] [----] I, [2016-09-13T09:29:44.866508 #2957:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1098&ExtManagementSystem%3A%3Aext_management_system=17&MiqEvent%3A%3Amiq_event=1098&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1098&event_type=ems_auth_valid&miq_event_id=1098&object_name=Event&vmdb_object_type=ext_management_system ManageIQ/System] [----] I, [2016-09-13T09:29:44.874882 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79074], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>17, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1099, :miq_event_id=>1099, "EventStream::event_stream"=>1099, :event_stream_id=>1099}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [5.428808778] seconds [----] I, [2016-09-13T09:29:44.875022 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79074], Delivering... [----] I, [2016-09-13T09:29:44.876853 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1099, :miq_event_id=>1099, "EventStream::event_stream"=>1099, :event_stream_id=>1099} for object [ManageIQ::Providers::Hawkular::MiddlewareManager.17] with state [] to Automate [----] I, [2016-09-13T09:29:44.882021 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1099&ExtManagementSystem%3A%3Aext_management_system=17&MiqEvent%3A%3Amiq_event=1099&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1099&event_type=ems_auth_valid&miq_event_id=1099&object_name=Event&vmdb_object_type=ext_management_system] [----] I, [2016-09-13T09:29:44.906595 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1099&ExtManagementSystem%3A%3Aext_management_system=17&MiqEvent%3A%3Amiq_event=1099&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1099&event_type=ems_auth_valid&miq_event_id=1099&object_name=Event&vmdb_object_type=ext_management_system ManageIQ/System] [----] I, [2016-09-13T09:29:44.935858 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T09:29:44.952973 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T09:29:44.969865 #2957:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/ems_auth_valid] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T09:29:44.970806 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T09:29:44.987125 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:44.987122 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T09:29:44.991854 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T09:29:45.002853 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/ems_auth_valid] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T09:29:45.005442 #2957:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T09:29:45.012172 #2957:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T09:29:45.015588 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#] [----] I, [2016-09-13T09:29:45.015841 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [ems_auth_valid] [----] I, [2016-09-13T09:29:45.017610 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:45.022001 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T09:29:45.033855 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [ems_auth_valid] [----] I, [2016-09-13T09:29:45.034090 #2957:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [ems_auth_valid] Target: ManageIQ::Providers::Hawkular::MiddlewareManager Name: [Hawkular-Provider], Id: [17] [----] I, [2016-09-13T09:29:45.034789 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T09:29:45.038181 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:45.038656 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T09:29:45.039294 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79073], State: [ok], Delivered in [0.20359948] seconds [----] I, [2016-09-13T09:29:45.041173 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T09:29:45.044288 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#] [----] I, [2016-09-13T09:29:45.044555 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [ems_auth_valid] [----] I, [2016-09-13T09:29:45.068233 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [ems_auth_valid] [----] I, [2016-09-13T09:29:45.068523 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [ems_auth_valid] Target: ManageIQ::Providers::Hawkular::MiddlewareManager Name: [Hawkular-Provider], Id: [17] [----] I, [2016-09-13T09:29:45.068986 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T09:29:45.069398 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T09:29:45.070031 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79074], State: [ok], Delivered in [0.194988713] seconds [----] I, [2016-09-13T09:29:45.175166 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:29:45.176573 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#start_event_monitor) EMS [livingontheedge.hawkular.org] as [jdoe] Starting Event Monitor Thread [----] I, [2016-09-13T09:29:45.178296 #17555:89cde4] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:45.188210 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79075], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:29:45.332329 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#start_event_monitor) EMS [livingontheedge.hawkular.org] as [jdoe] Started Event Monitor Thread [----] I, [2016-09-13T09:29:45.336297 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#worker_monitor_drb) EMS [livingontheedge.hawkular.org] as [jdoe] Initializing DRb Connection to MiqServer with ID=[1], NAME=[EVM], PID=[2763], GUID=[36647afc-71a3-11e6-838a-fa163e68952f] DRb URI=[druby://127.0.0.1:41718] [----] I, [2016-09-13T09:29:49.031691 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [79066], MiqWorker id: [102], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [14.039681595] seconds [----] I, [2016-09-13T09:29:49.032115 #17546:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79066], Delivering... [----] I, [2016-09-13T09:29:49.053385 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T09:29:49.053765 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T09:29:49.054013 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T09:29:49.054306 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T09:29:49.062554 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:49.164245 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:29:49.500625 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:49.865228 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:49.865538 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:50.108755 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79075], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.928962185] seconds [----] I, [2016-09-13T09:29:50.108962 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79075], Delivering... [----] I, [2016-09-13T09:29:50.115437 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034732818603515625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034940242767333984, :pending_vm_jobs=>0.0007846355438232422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006067752838134766} [----] I, [2016-09-13T09:29:50.115805 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79075], State: [ok], Delivered in [0.006835306] seconds [----] I, [2016-09-13T09:29:50.702462 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:51.019240 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:51.019500 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:51.552942 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:51.859160 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:51.859276 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:52.349006 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:52.666176 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:52.666292 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:53.165399 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:53.476881 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:53.477113 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:54.032747 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:54.364278 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:54.364462 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:55.179675 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:55.663003 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:55.663170 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:29:55.672643 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005453824996948242, :worker_monitor=>1.4836101531982422, :worker_dequeue=>0.009554147720336914, :total_time=>1.4989616870880127} [----] I, [2016-09-13T09:30:00.197644 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:30:00.205273 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79076], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:30:00.222870 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79077], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:30:00.302757 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79078], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:30:00.319833 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79079], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:30:00.681137 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:30:01.188781 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79076], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.988352463] seconds [----] I, [2016-09-13T09:30:01.189002 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79076], Delivering... [----] I, [2016-09-13T09:30:01.250774 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79076], State: [ok], Delivered in [0.061727004] seconds [----] I, [2016-09-13T09:30:01.265005 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79079], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.957606568] seconds [----] I, [2016-09-13T09:30:01.265224 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79079], Delivering... [----] I, [2016-09-13T09:30:01.272132 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038585662841796875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00390625, :pending_vm_jobs=>0.0007848739624023438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006488323211669922} [----] I, [2016-09-13T09:30:01.272547 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79079], State: [ok], Delivered in [0.007317987] seconds [----] I, [2016-09-13T09:30:02.304940 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:02.623135 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:02.623395 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:03.180122 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:03.509018 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79077], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.300748403] seconds [----] I, [2016-09-13T09:30:03.509238 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79077], Delivering... [----] I, [2016-09-13T09:30:03.512573 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79077], State: [ok], Delivered in [0.003337448] seconds [----] I, [2016-09-13T09:30:03.533564 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79078], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.302709364] seconds [----] I, [2016-09-13T09:30:03.533746 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79078], Delivering... [----] I, [2016-09-13T09:30:03.538512 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79078], State: [ok], Delivered in [0.004747089] seconds [----] I, [2016-09-13T09:30:03.554250 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:03.554410 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:04.110583 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:04.637125 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:04.637298 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:05.365310 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:05.706564 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:05.706773 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:06.253267 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:06.578792 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:06.578897 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:07.262493 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:07.663363 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:07.663644 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:08.309862 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:08.470063 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:08.652019 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:08.813736 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:08.962044 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:09.109595 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:09.256763 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:09.395409 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:09.544616 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:09.694403 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:09.831622 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:09.993995 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:10.166036 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:10.321147 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:10.476841 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:10.879745 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:11.118117 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:11.266228 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:11.443979 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:11.617606 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:11.757622 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0029790401458740234, :worker_monitor=>1.044233798980713, :worker_dequeue=>0.00473475456237793, :total_time=>1.052215814590454} [----] I, [2016-09-13T09:30:11.806969 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:11.941537 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:12.117279 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:12.250078 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:12.397395 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:12.615739 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:12.758032 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:15.333577 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T09:30:15.354701 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79080], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:30:15.365399 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79081], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:30:15.377273 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79082], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:30:15.394348 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79083], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:30:16.758090 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:30:16 UTC]... [----] I, [2016-09-13T09:30:16.777202 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:30:16 UTC]...Complete [----] I, [2016-09-13T09:30:16.788355 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:30:17.371877 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79083], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.991303188] seconds [----] I, [2016-09-13T09:30:17.372047 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79083], Delivering... [----] I, [2016-09-13T09:30:17.378219 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003397226333618164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034160614013671875, :pending_vm_jobs=>0.0006775856018066406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005835533142089844} [----] I, [2016-09-13T09:30:17.378557 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79083], State: [ok], Delivered in [0.006502905] seconds [----] I, [2016-09-13T09:30:18.589069 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79080], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.249916053] seconds [----] I, [2016-09-13T09:30:18.589240 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79080], Delivering... [----] I, [2016-09-13T09:30:18.591392 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79080], State: [ok], Delivered in [0.002135691] seconds [----] I, [2016-09-13T09:30:18.594639 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79081], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.234037318] seconds [----] I, [2016-09-13T09:30:18.594834 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79081], Delivering... [----] I, [2016-09-13T09:30:18.604259 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79081], State: [ok], Delivered in [0.009409611] seconds [----] I, [2016-09-13T09:30:18.624409 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79082], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.255994996] seconds [----] I, [2016-09-13T09:30:18.624635 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79082], Delivering... [----] I, [2016-09-13T09:30:18.630038 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79082], State: [ok], Delivered in [0.005392833] seconds [----] I, [2016-09-13T09:30:18.908530 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:19.043525 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:19.193040 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:19.351211 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:19.539995 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:20.776543 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:20.974277 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:21.120369 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:21.269598 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:21.419047 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:21.564683 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:21.798557 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:21.947932 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:22.097673 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:22.259516 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:22.394843 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:22.542879 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:22.765847 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:22.977110 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:23.129693 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:23.303828 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:23.459965 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:24.247017 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:24.420336 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:24.558726 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:24.830016 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:25.059145 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:25.204891 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:25.360248 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:25.510166 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:25.678072 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:25.827732 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:25.972879 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:26.125956 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:26.274126 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:26.468614 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:26.610319 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:26.748597 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:26.889860 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:27.421236 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:27.578746 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:27.723243 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:27.872797 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:28.012323 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:28.153197 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:28.231563 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005574226379394531, :worker_monitor=>1.4109776020050049, :worker_dequeue=>0.004884243011474609, :total_time=>1.421729326248169} [----] I, [2016-09-13T09:30:28.322513 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:28.504525 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:28.642020 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:28.793863 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:28.947085 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:29.091831 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:29.230564 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:29.374008 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:29.524047 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:29.678699 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:29.935121 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:30.405075 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:30:30.422990 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79084], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:30:30.434244 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79085], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:30:33.251776 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:30:33.469222 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79085], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.041170492] seconds [----] I, [2016-09-13T09:30:33.469398 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79085], Delivering... [----] I, [2016-09-13T09:30:33.475755 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033423900604248047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003359556198120117, :pending_vm_jobs=>0.0007717609405517578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005965232849121094} [----] I, [2016-09-13T09:30:33.476091 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79085], State: [ok], Delivered in [0.006687946] seconds [----] I, [2016-09-13T09:30:33.657448 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79084], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.244536096] seconds [----] I, [2016-09-13T09:30:33.657599 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79084], Delivering... [----] I, [2016-09-13T09:30:33.660587 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79084], State: [ok], Delivered in [0.002996121] seconds [----] I, [2016-09-13T09:30:36.490410 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:36.655458 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:36.800493 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:36.943715 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:37.088220 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:37.227296 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:37.386939 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:37.560755 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:37.710754 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:37.861392 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:38.035884 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:38.174378 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:38.340340 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:38.492683 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:38.629494 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:38.777046 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:38.922906 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:39.552725 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:39.734728 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:39.886282 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:40.111360 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:40.246243 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:40.385621 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:40.527432 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:40.672021 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:40.813919 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:40.958161 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:41.105864 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:41.245083 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:41.381577 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:41.533248 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:41.685442 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:41.833160 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:41.992583 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:42.754557 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:42.916374 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:43.071105 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:43.218834 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:43.410703 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:43.596517 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:43.746883 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:43.891839 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:44.043222 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:44.196760 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:44.357137 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:44.538778 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:44.738091 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:44.926263 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:45.083518 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:45.211539 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006040811538696289, :worker_monitor=>1.823897361755371, :worker_dequeue=>0.007449150085449219, :total_time=>1.8376986980438232} [----] I, [2016-09-13T09:30:45.228393 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:45.364077 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:45.445809 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:30:45.484318 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79086], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:30:45.883908 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:46.043313 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:46.179604 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:46.321265 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:46.480826 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:46.622536 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:46.842839 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:50.212062 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:30:50 UTC]... [----] I, [2016-09-13T09:30:50.232745 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:30:50 UTC]...Complete [----] I, [2016-09-13T09:30:50.244121 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:30:50.604662 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79086], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.152799067] seconds [----] I, [2016-09-13T09:30:50.604865 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79086], Delivering... [----] I, [2016-09-13T09:30:50.610976 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003286600112915039, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033059120178222656, :pending_vm_jobs=>0.0007088184356689453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005732059478759766} [----] I, [2016-09-13T09:30:50.611316 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79086], State: [ok], Delivered in [0.006452543] seconds [----] I, [2016-09-13T09:30:53.004188 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:53.176091 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:53.318980 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:53.466390 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:53.622496 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:53.762941 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:53.933208 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:54.075311 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:54.213236 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:54.349708 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:54.942028 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:55.108077 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:55.247169 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:55.386286 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:55.548391 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:55.713399 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:55.879245 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:56.144395 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:56.322681 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:56.472518 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:56.617495 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:56.761515 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:56.904339 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:57.055927 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:57.211198 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:57.348049 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:57.498483 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:58.388833 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:58.566123 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:58.769121 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:58.921226 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:59.056513 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:59.196623 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:59.330537 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:59.500616 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:59.636647 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:59.780013 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:30:59.923987 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:00.079479 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:00.227942 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:00.373674 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:00.513288 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:00.650729 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:00.805583 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:00.855282 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:31:00.881042 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79087], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:31:00.897600 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79088], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:31:00.915120 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79089], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:31:00.943369 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79090], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:31:01.433527 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:01.508927 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:31:01.511283 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004498958587646484, :worker_monitor=>1.2381598949432373, :worker_dequeue=>0.005131959915161133, :total_time=>1.248091459274292} [----] I, [2016-09-13T09:31:01.612997 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:01.704182 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79087], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.835851674] seconds [----] I, [2016-09-13T09:31:01.704660 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79087], Delivering... [----] I, [2016-09-13T09:31:01.747885 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:01.755103 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79087], State: [ok], Delivered in [0.050465103] seconds [----] I, [2016-09-13T09:31:01.766455 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79090], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.845086409] seconds [----] I, [2016-09-13T09:31:01.766656 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79090], Delivering... [----] I, [2016-09-13T09:31:01.772385 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030243396759033203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030417442321777344, :pending_vm_jobs=>0.0007016658782958984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005396127700805664} [----] I, [2016-09-13T09:31:01.772756 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79090], State: [ok], Delivered in [0.00610453] seconds [----] I, [2016-09-13T09:31:01.887347 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:02.043886 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:02.204277 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:02.341505 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:02.497725 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:02.640309 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:02.777627 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:02.914053 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:03.247244 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:03.438562 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:03.584257 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:03.730663 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:03.783757 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79088], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.895077528] seconds [----] I, [2016-09-13T09:31:03.783935 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79088], Delivering... [----] I, [2016-09-13T09:31:03.789343 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79089], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.883496561] seconds [----] I, [2016-09-13T09:31:03.789563 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79089], Delivering... [----] I, [2016-09-13T09:31:03.793679 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79088], State: [ok], Delivered in [0.00971361] seconds [----] I, [2016-09-13T09:31:03.793833 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79089], State: [ok], Delivered in [0.004272316] seconds [----] I, [2016-09-13T09:31:09.897271 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:10.033261 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:10.615251 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:10.785522 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:10.945720 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:11.088313 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:11.231152 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:11.369503 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:11.516919 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:11.651320 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:11.800270 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:11.942195 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:12.084264 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:12.236804 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:12.380694 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:12.529172 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:12.680660 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:12.820314 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:12.960149 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:13.624412 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:13.784250 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:13.932601 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:14.071764 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:14.218050 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:14.355562 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:14.487911 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:14.628981 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:14.771595 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:14.916824 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:15.077505 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:15.218368 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:15.358715 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:15.494202 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:15.635907 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:15.826526 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:15.954985 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:31:15.968342 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:31:16.000950 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79091], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] E, [2016-09-13T09:31:16.168206 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T09:31:16.168695 #17546:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T09:31:16.169030 #17546:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T09:31:16.169142 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T09:31:16.169284 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T09:31:16.195901 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T09:31:16.196385 #17546:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [79066], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T09:31:16.196742 #17546:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T09:31:16.196999 #17546:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T09:31:16.197249 #17546:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79066], State: [error], Delivered in [87.165198674] seconds [----] I, [2016-09-13T09:31:17.683505 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:31:17.687868 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0042574405670166016, :worker_monitor=>1.132153034210205, :worker_dequeue=>0.009560823440551758, :total_time=>1.1463143825531006} [----] I, [2016-09-13T09:31:17.852226 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79091], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.89149355] seconds [----] I, [2016-09-13T09:31:17.852403 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79091], Delivering... [----] I, [2016-09-13T09:31:17.858368 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031206607818603516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003139495849609375, :pending_vm_jobs=>0.0007290840148925781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005558013916015625} [----] I, [2016-09-13T09:31:17.858763 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79091], State: [ok], Delivered in [0.006350027] seconds [----] I, [2016-09-13T09:31:22.688483 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:31:22 UTC]... [----] I, [2016-09-13T09:31:22.709091 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:31:22 UTC]...Complete [----] I, [2016-09-13T09:31:31.013319 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:31:31.029365 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79092], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:31:31.040830 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79093], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:31:33.919596 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:31:33.921916 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004308462142944336, :worker_monitor=>1.1753931045532227, :worker_dequeue=>0.005053043365478516, :total_time=>1.1850738525390625} [----] I, [2016-09-13T09:31:33.972521 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79093], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.9374162] seconds [----] I, [2016-09-13T09:31:33.972627 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79093], Delivering... [----] I, [2016-09-13T09:31:33.976212 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020551681518554688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002065420150756836, :pending_vm_jobs=>0.000431060791015625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003385782241821289} [----] I, [2016-09-13T09:31:33.976457 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79093], State: [ok], Delivered in [0.003800912] seconds [----] I, [2016-09-13T09:31:36.898856 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79092], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.880650819] seconds [----] I, [2016-09-13T09:31:36.899085 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79092], Delivering... [----] I, [2016-09-13T09:31:36.904524 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79092], State: [ok], Delivered in [0.005417772] seconds [----] I, [2016-09-13T09:31:46.051082 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:31:46.063750 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79094], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:31:50.306548 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:31:50.312106 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007916450500488281, :worker_monitor=>1.245138168334961, :worker_dequeue=>0.010869741439819336, :total_time=>1.2643065452575684} [----] I, [2016-09-13T09:31:51.110086 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79094], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.054734253] seconds [----] I, [2016-09-13T09:31:51.110278 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79094], Delivering... [----] I, [2016-09-13T09:31:51.116247 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003198862075805664, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003215312957763672, :pending_vm_jobs=>0.0007238388061523438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005579233169555664} [----] I, [2016-09-13T09:31:51.116595 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79094], State: [ok], Delivered in [0.006323853] seconds [----] I, [2016-09-13T09:31:55.312695 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:31:55 UTC]... [----] I, [2016-09-13T09:31:55.349819 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:31:55 UTC]...Complete [----] I, [2016-09-13T09:32:01.073087 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:32:01.115718 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79095], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:32:01.128152 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79096], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:32:01.182086 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79097], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:32:01.210759 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79098], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:32:06.734986 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:32:06.739695 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005182981491088867, :worker_monitor=>1.3461956977844238, :worker_dequeue=>0.009873151779174805, :total_time=>1.3616375923156738} [----] I, [2016-09-13T09:32:06.979282 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79095], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.901655858] seconds [----] I, [2016-09-13T09:32:06.979548 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79095], Delivering... [----] I, [2016-09-13T09:32:07.013143 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79098], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.825228023] seconds [----] I, [2016-09-13T09:32:07.013359 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79098], Delivering... [----] I, [2016-09-13T09:32:07.020174 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003568410873413086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003590106964111328, :pending_vm_jobs=>0.0008471012115478516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006331443786621094} [----] I, [2016-09-13T09:32:07.020596 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79098], State: [ok], Delivered in [0.007237588] seconds [----] I, [2016-09-13T09:32:07.047506 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79095], State: [ok], Delivered in [0.067887388] seconds [----] I, [2016-09-13T09:32:07.052733 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79096], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.93152612] seconds [----] I, [2016-09-13T09:32:07.052874 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79096], Delivering... [----] I, [2016-09-13T09:32:07.057134 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79096], State: [ok], Delivered in [0.004226248] seconds [----] I, [2016-09-13T09:32:07.087550 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79097], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.951155078] seconds [----] I, [2016-09-13T09:32:07.087734 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79097], Delivering... [----] I, [2016-09-13T09:32:07.092199 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79097], State: [ok], Delivered in [0.00444596] seconds [----] I, [2016-09-13T09:32:16.222679 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:32:16.235646 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79099], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:32:16.769167 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:32:17.275762 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79099], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.047135418] seconds [----] I, [2016-09-13T09:32:17.275942 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79099], Delivering... [----] I, [2016-09-13T09:32:17.282085 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003325223922729492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003343820571899414, :pending_vm_jobs=>0.0006656646728515625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057985782623291016} [----] I, [2016-09-13T09:32:17.282457 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79099], State: [ok], Delivered in [0.006491201] seconds [----] I, [2016-09-13T09:32:23.127830 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004857540130615234, :worker_monitor=>1.3401083946228027, :worker_dequeue=>0.0088043212890625, :total_time=>1.3541181087493896} [----] I, [2016-09-13T09:32:28.128359 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:32:28 UTC]... [----] I, [2016-09-13T09:32:28.144079 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:32:28 UTC]...Complete [----] I, [2016-09-13T09:32:31.247486 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:32:31.270003 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79100], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:32:31.281544 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79101], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:32:33.167839 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:32:33.396363 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79101], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.120888386] seconds [----] I, [2016-09-13T09:32:33.396598 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79101], Delivering... [----] I, [2016-09-13T09:32:33.403005 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033600330352783203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033795833587646484, :pending_vm_jobs=>0.0008745193481445312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006060123443603516} [----] I, [2016-09-13T09:32:33.403384 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79101], State: [ok], Delivered in [0.006779481] seconds [----] I, [2016-09-13T09:32:34.133316 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79100], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.880896907] seconds [----] I, [2016-09-13T09:32:34.133544 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79100], Delivering... [----] I, [2016-09-13T09:32:34.138197 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79100], State: [ok], Delivered in [0.004649623] seconds [----] I, [2016-09-13T09:32:39.502344 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038056373596191406, :worker_monitor=>1.320124864578247, :worker_dequeue=>0.0073337554931640625, :total_time=>1.3315322399139404} [----] I, [2016-09-13T09:32:46.295046 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:32:46.316240 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79102], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:32:49.624801 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:32:50.505958 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79102], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.201513807] seconds [----] I, [2016-09-13T09:32:50.506250 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79102], Delivering... [----] I, [2016-09-13T09:32:50.514001 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004280805587768555, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004302024841308594, :pending_vm_jobs=>0.000978231430053711, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007104396820068359} [----] I, [2016-09-13T09:32:50.514314 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79102], State: [ok], Delivered in [0.008088095] seconds [----] I, [2016-09-13T09:32:55.794379 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038847923278808594, :worker_monitor=>1.1529326438903809, :worker_dequeue=>0.007733583450317383, :total_time=>1.1649000644683838} [----] I, [2016-09-13T09:33:00.794908 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:33:00 UTC]... [----] I, [2016-09-13T09:33:00.813208 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:33:00 UTC]...Complete [----] I, [2016-09-13T09:33:01.335214 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:33:01.357744 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79103], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:33:01.376979 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79104], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:33:01.405717 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79105], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:33:01.422589 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79106], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:33:05.839607 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:33:06.637039 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79103], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.295647267] seconds [----] I, [2016-09-13T09:33:06.637225 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79103], Delivering... [----] I, [2016-09-13T09:33:06.642581 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79106], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.228812314] seconds [----] I, [2016-09-13T09:33:06.642750 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79106], Delivering... [----] I, [2016-09-13T09:33:06.648597 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002888202667236328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030660629272460938, :pending_vm_jobs=>0.0007765293121337891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005509376525878906} [----] I, [2016-09-13T09:33:06.648885 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79106], State: [ok], Delivered in [0.006132049] seconds [----] I, [2016-09-13T09:33:06.685976 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79103], State: [ok], Delivered in [0.048716696] seconds [----] I, [2016-09-13T09:33:07.280568 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79104], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.914615532] seconds [----] I, [2016-09-13T09:33:07.280784 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79104], Delivering... [----] I, [2016-09-13T09:33:07.284248 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79104], State: [ok], Delivered in [0.003466144] seconds [----] I, [2016-09-13T09:33:07.286040 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79105], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.897828141] seconds [----] I, [2016-09-13T09:33:07.286224 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79105], Delivering... [----] I, [2016-09-13T09:33:07.291108 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79105], State: [ok], Delivered in [0.004879235] seconds [----] I, [2016-09-13T09:33:11.866270 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038919448852539062, :worker_monitor=>1.0099706649780273, :worker_dequeue=>0.007081031799316406, :total_time=>1.0212054252624512} [----] I, [2016-09-13T09:33:16.437545 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:33:16.457285 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79107], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:33:16.875586 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:33:17.731362 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79107], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.287679074] seconds [----] I, [2016-09-13T09:33:17.731535 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79107], Delivering... [----] I, [2016-09-13T09:33:17.735950 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023572444915771484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023698806762695312, :pending_vm_jobs=>0.0006241798400878906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0041751861572265625} [----] I, [2016-09-13T09:33:17.736228 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79107], State: [ok], Delivered in [0.004678264] seconds [----] I, [2016-09-13T09:33:31.470866 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T09:33:31.514724 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79108], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:33:31.525848 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79109], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:33:31.537361 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79110], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:33:31.560531 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79111], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:33:32.745116 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:33:32 UTC]... [----] I, [2016-09-13T09:33:32.788746 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:33:32 UTC]...Complete [----] I, [2016-09-13T09:33:32.800598 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:33:32.845934 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79109], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.325121688] seconds [----] I, [2016-09-13T09:33:32.846087 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79109], Delivering... [----] I, [2016-09-13T09:33:32.851675 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79110], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.3215297] seconds [----] I, [2016-09-13T09:33:32.851831 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79110], Delivering... [----] I, [2016-09-13T09:33:32.851949 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002802610397338867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002820253372192383, :pending_vm_jobs=>0.0008306503295898438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005362749099731445} [----] I, [2016-09-13T09:33:32.852306 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79109], State: [ok], Delivered in [0.006205878] seconds [----] I, [2016-09-13T09:33:32.852808 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T09:33:32.852986 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4548976640 [----] I, [2016-09-13T09:33:32.853068 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4318642176 [----] I, [2016-09-13T09:33:32.853137 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 230334464 [----] I, [2016-09-13T09:33:32.853201 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T09:33:32.853265 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4264546304 [----] I, [2016-09-13T09:33:32.853326 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T09:33:32.853384 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T09:33:32.853494 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 552218624 [----] I, [2016-09-13T09:33:32.853631 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T09:33:32.853693 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6756528128 [----] I, [2016-09-13T09:33:32.853749 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T09:33:32.853824 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T09:33:32.853889 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T09:33:32.853947 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 28672 [----] I, [2016-09-13T09:33:32.854005 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T09:33:32.854061 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T09:33:32.854117 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T09:33:32.854172 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T09:33:32.854227 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T09:33:32.854287 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T09:33:32.854344 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 274001920 [----] I, [2016-09-13T09:33:32.854400 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57196544 [----] I, [2016-09-13T09:33:32.854518 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216805376 [----] I, [2016-09-13T09:33:32.854635 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6111232 [----] I, [2016-09-13T09:33:32.854713 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142249984 [----] I, [2016-09-13T09:33:32.854776 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3402280960 [----] I, [2016-09-13T09:33:32.854838 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3076972544 [----] I, [2016-09-13T09:33:32.854899 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T09:33:32.854958 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T09:33:32.855014 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T09:33:32.855072 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36753408 [----] I, [2016-09-13T09:33:32.855130 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T09:33:32.855186 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53837824 [----] I, [2016-09-13T09:33:32.855241 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111300608 [----] I, [2016-09-13T09:33:32.855305 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 156135424 [----] I, [2016-09-13T09:33:32.855362 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T09:33:32.855447 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T09:33:32.855557 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T09:33:32.855676 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T09:33:32.855735 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T09:33:32.855793 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T09:33:32.855851 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T09:33:32.855909 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T09:33:32.855966 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T09:33:32.896437 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T09:33:32.896650 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T09:33:32.899807 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T09:33:32.902026 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T09:33:32.904846 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T09:33:32.907495 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T09:33:32.910184 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T09:33:32.912833 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 851 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T09:33:32.915527 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T09:33:32.918135 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T09:33:32.920879 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.8 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T09:33:32.923566 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T09:33:32.926300 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T09:33:32.928966 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T09:33:32.931673 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:33:32.931800 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:33:32.931887 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T09:33:32.936033 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [202684000], Memory % [5.28], CPU Time [152264.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:33:32.936361 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79110], State: [ok], Delivered in [0.084514507] seconds [----] I, [2016-09-13T09:33:34.377731 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79108], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.902011155] seconds [----] I, [2016-09-13T09:33:34.377900 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79108], Delivering... [----] I, [2016-09-13T09:33:34.382506 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79108], State: [ok], Delivered in [0.004555257] seconds [----] I, [2016-09-13T09:33:37.814838 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:33:37.914589 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79111], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.372858934] seconds [----] I, [2016-09-13T09:33:37.914852 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79111], Delivering... [----] I, [2016-09-13T09:33:37.921639 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:33:26 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201167000], Memory % [3.36], CPU Time [153190.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:33:37.922090 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:33:19 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347776000], Memory % [5.04], CPU Time [105407.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T09:33:37.922616 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:33:25 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169743000], Memory % [3.14], CPU Time [52098.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:33:37.923094 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:33:27 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163147000], Memory % [3.1], CPU Time [38366.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T09:33:37.923528 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:33:26 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [213403000], Memory % [3.5], CPU Time [49242.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T09:33:37.924077 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:33:16 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [206034000], Memory % [3.5], CPU Time [242624.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T09:33:37.924554 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:33:25 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359293000], Memory % [5.28], CPU Time [205294.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:33:37.924985 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:33:26 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202684000], Memory % [3.38], CPU Time [152271.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:33:37.927621 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:33:26 UTC], Process Info: Memory Usage [610451456], Memory Size [1036869632], Proportional Set Size: [442493000], Memory % [7.44], CPU Time [279.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:33:37.929539 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:33:25 UTC], Process Info: Memory Usage [601366528], Memory Size [944701440], Proportional Set Size: [433080000], Memory % [7.33], CPU Time [138.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T09:33:37.929995 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:33:25 UTC], Process Info: Memory Usage [432603136], Memory Size [733093888], Proportional Set Size: [358615000], Memory % [5.27], CPU Time [212533.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T09:33:37.930454 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:33:25 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178469000], Memory % [3.2], CPU Time [52094.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:33:37.930966 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:33:22 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166756000], Memory % [3.16], CPU Time [39269.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T09:33:37.931282 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79111], State: [ok], Delivered in [0.016530373] seconds [----] I, [2016-09-13T09:33:44.294672 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006079673767089844, :worker_monitor=>1.4578447341918945, :worker_dequeue=>0.010671615600585938, :total_time=>1.4749796390533447} [----] I, [2016-09-13T09:33:46.572334 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:33:46.617338 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79112], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:33:49.422688 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:33:50.054207 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79112], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.47590252] seconds [----] I, [2016-09-13T09:33:50.054438 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79112], Delivering... [----] I, [2016-09-13T09:33:50.060847 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034494400024414062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00347137451171875, :pending_vm_jobs=>0.0007264614105224609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059986114501953125} [----] I, [2016-09-13T09:33:50.061222 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79112], State: [ok], Delivered in [0.006808054] seconds [----] I, [2016-09-13T09:34:00.833301 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00404810905456543, :worker_monitor=>1.3767330646514893, :worker_dequeue=>0.007660865783691406, :total_time=>1.3887016773223877} [----] I, [2016-09-13T09:34:01.629082 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:34:01.646136 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79113], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:34:01.657683 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79114], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:34:01.674588 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79115], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:34:01.686003 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79116], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:34:05.833951 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:34:05 UTC]... [----] I, [2016-09-13T09:34:05.880780 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:34:05 UTC]...Complete [----] I, [2016-09-13T09:34:05.892178 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:34:06.160676 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79113], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.526879434] seconds [----] I, [2016-09-13T09:34:06.160850 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79113], Delivering... [----] I, [2016-09-13T09:34:06.167593 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79116], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.487389691] seconds [----] I, [2016-09-13T09:34:06.167774 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79116], Delivering... [----] I, [2016-09-13T09:34:06.174007 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034210681915283203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034637451171875, :pending_vm_jobs=>0.0007495880126953125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005911350250244141} [----] I, [2016-09-13T09:34:06.174285 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79116], State: [ok], Delivered in [0.006508951] seconds [----] I, [2016-09-13T09:34:06.206023 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79113], State: [ok], Delivered in [0.045151384] seconds [----] I, [2016-09-13T09:34:07.480600 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79114], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.828686872] seconds [----] I, [2016-09-13T09:34:07.480773 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79114], Delivering... [----] I, [2016-09-13T09:34:07.486013 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79114], State: [ok], Delivered in [0.00521722] seconds [----] I, [2016-09-13T09:34:07.487550 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79115], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.821937345] seconds [----] I, [2016-09-13T09:34:07.487751 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79115], Delivering... [----] I, [2016-09-13T09:34:07.492329 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79115], State: [ok], Delivered in [0.00458629] seconds [----] I, [2016-09-13T09:34:16.737446 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T09:34:16.772144 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79117], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:34:16.788986 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79118], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:34:17.125528 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:34:17.129627 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036063194274902344, :worker_monitor=>1.2002644538879395, :worker_dequeue=>0.009444952011108398, :total_time=>1.2135818004608154} [----] I, [2016-09-13T09:34:17.271904 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79118], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.490380831] seconds [----] I, [2016-09-13T09:34:17.272122 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79118], Delivering... [----] I, [2016-09-13T09:34:17.282193 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005529642105102539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005554914474487305, :pending_vm_jobs=>0.0011701583862304688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00948333740234375} [----] I, [2016-09-13T09:34:17.282629 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79118], State: [ok], Delivered in [0.010490318] seconds [----] I, [2016-09-13T09:34:19.540708 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79117], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.785288982] seconds [----] I, [2016-09-13T09:34:19.540870 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79117], Delivering... [----] I, [2016-09-13T09:34:19.563558 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79119], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T09:34:19.563956 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79117], State: [ok], Delivered in [0.023073044] seconds [----] I, [2016-09-13T09:34:22.142559 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T09:34:26.548185 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [79119], MiqWorker id: [102], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [6.993339621] seconds [----] I, [2016-09-13T09:34:26.548454 #17546:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79119], Delivering... [----] I, [2016-09-13T09:34:26.552268 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T09:34:26.552472 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T09:34:26.552625 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T09:34:26.552809 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T09:34:26.552953 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:26.983482 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:27.347113 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:27.347289 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:27.838885 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:28.141660 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:28.141830 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:28.646879 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:28.981356 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:28.981683 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:29.473131 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:29.781314 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:29.781596 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:30.310304 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:30.640235 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:30.640389 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:31.164259 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:31.504242 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:31.504407 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:31.801624 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:34:31.820684 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79120], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:34:31.838245 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79121], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:34:32.047403 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:32.356865 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:32.357017 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:32.829691 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:33.111785 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:33.111932 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:33.282299 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:34:33.288873 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003253459930419922, :worker_monitor=>1.1152825355529785, :worker_dequeue=>0.014044523239135742, :total_time=>1.132873773574829} [----] I, [2016-09-13T09:34:33.403398 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79121], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.577114526] seconds [----] I, [2016-09-13T09:34:33.403613 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79121], Delivering... [----] I, [2016-09-13T09:34:33.409742 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031197071075439453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031375885009765625, :pending_vm_jobs=>0.0007777214050292969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005796670913696289} [----] I, [2016-09-13T09:34:33.410104 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79121], State: [ok], Delivered in [0.006490597] seconds [----] I, [2016-09-13T09:34:33.581478 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:33.897894 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:33.898111 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:34.411731 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:34.575082 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79120], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.768929352] seconds [----] I, [2016-09-13T09:34:34.575291 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79120], Delivering... [----] I, [2016-09-13T09:34:34.581338 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79120], State: [ok], Delivered in [0.006033507] seconds [----] I, [2016-09-13T09:34:34.742411 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:34.742625 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:35.309187 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:35.673277 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:35.673469 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:38.289444 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:34:38 UTC]... [----] I, [2016-09-13T09:34:38.307302 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:34:38 UTC]...Complete [----] I, [2016-09-13T09:34:42.306713 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:42.633441 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:42.633633 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:43.121453 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:43.446703 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:43.446866 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:43.981708 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:44.156647 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:44.301500 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:46.851914 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:34:46.878019 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79122], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:34:48.058655 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:48.197265 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:48.329014 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:48.347570 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T09:34:48.485016 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:48.632674 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:48.772477 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:48.912208 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:49.048282 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:49.185756 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:49.324374 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:49.503667 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:49.634822 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:49.823070 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:34:49.827305 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004245758056640625, :log_active_servers=>0.00971221923828125, :worker_monitor=>1.4681951999664307, :worker_dequeue=>0.0111846923828125, :total_time=>1.4936962127685547} [----] I, [2016-09-13T09:34:50.335723 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:50.493208 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:50.518047 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79122], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.656609716] seconds [----] I, [2016-09-13T09:34:50.518336 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79122], Delivering... [----] I, [2016-09-13T09:34:50.528589 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00522303581237793, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005254507064819336, :pending_vm_jobs=>0.0012252330780029297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00956869125366211} [----] I, [2016-09-13T09:34:50.529038 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79122], State: [ok], Delivered in [0.010704196] seconds [----] I, [2016-09-13T09:34:50.643999 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:50.835493 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:50.981617 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:51.141140 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:51.283834 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:51.418774 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:51.551710 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:51.689408 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:51.836279 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:51.972956 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:52.119829 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:52.261553 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:52.414865 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:52.549998 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:52.699715 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:53.086219 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:59.276498 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:59.416796 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:59.561929 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:59.724592 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:59.861818 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:34:59.996388 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:00.138752 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:00.297387 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:00.452755 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:00.592011 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:00.735491 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:00.879476 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:01.020700 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:01.164959 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:01.317707 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:01.483161 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:01.842588 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:01.891625 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:35:01.906621 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79123], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:35:01.929638 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79124], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:35:01.952956 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79125], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:35:01.975227 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79126], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:35:02.006883 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:02.157355 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:02.300722 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:02.452785 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:02.614923 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:02.781479 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:02.934552 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:03.079302 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:03.212566 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:03.351829 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:03.490481 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:03.637778 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:03.785147 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:03.929691 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:04.079034 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:04.215617 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:05.634336 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:05.800082 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:05.955512 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:06.103166 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:06.237814 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:06.238500 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:35:06.240803 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005476236343383789, :worker_monitor=>1.2410285472869873, :worker_dequeue=>0.005129337310791016, :total_time=>1.252084493637085} [----] I, [2016-09-13T09:35:06.372017 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:06.520569 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:06.615562 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79123], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.720066474] seconds [----] I, [2016-09-13T09:35:06.615792 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79123], Delivering... [----] I, [2016-09-13T09:35:06.638270 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79126], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.67937804] seconds [----] I, [2016-09-13T09:35:06.638479 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79126], Delivering... [----] I, [2016-09-13T09:35:06.644483 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003031015396118164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030508041381835938, :pending_vm_jobs=>0.0007929801940917969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005646705627441406} [----] I, [2016-09-13T09:35:06.644810 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79126], State: [ok], Delivered in [0.006368888] seconds [----] I, [2016-09-13T09:35:06.673953 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:06.683899 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79123], State: [ok], Delivered in [0.068108069] seconds [----] I, [2016-09-13T09:35:06.817748 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:06.963569 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:07.113058 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:07.258048 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:07.405232 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:07.546340 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:07.683537 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79124], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.771402733] seconds [----] I, [2016-09-13T09:35:07.683674 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79124], Delivering... [----] I, [2016-09-13T09:35:07.685523 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79124], State: [ok], Delivered in [0.001850733] seconds [----] I, [2016-09-13T09:35:07.695061 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:07.698189 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79125], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.75743949] seconds [----] I, [2016-09-13T09:35:07.698398 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79125], Delivering... [----] I, [2016-09-13T09:35:07.703844 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79125], State: [ok], Delivered in [0.00543828] seconds [----] I, [2016-09-13T09:35:07.842167 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:07.982589 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:08.404163 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:08.573726 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:08.716750 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:08.855020 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:09.023006 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:09.165300 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:09.327184 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:09.471342 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:09.610025 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:09.757112 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:11.241317 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:35:11 UTC]... [----] I, [2016-09-13T09:35:11.266616 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:35:11 UTC]...Complete [----] I, [2016-09-13T09:35:11.288028 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:11.429380 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:11.588561 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:11.821404 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:11.998749 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:12.150809 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:12.294378 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:12.888714 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:13.077726 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:13.218086 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:13.359712 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:13.518689 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:13.673640 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:13.820741 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:14.062524 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:14.233876 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:14.376061 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:14.523311 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:14.674952 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:14.842121 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:14.994014 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:15.148987 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:15.294009 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:15.446086 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:16.216964 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:16.398302 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:16.548822 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:16.695232 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:16.850383 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:16.985298 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:35:16.998095 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79127], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:35:16.998400 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:17.157129 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:17.317724 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:17.459251 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:17.597322 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:17.735793 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:17.887065 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:18.033621 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:18.173322 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:18.320243 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:18.471372 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:18.609070 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:19.366742 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:19.535434 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:19.674549 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:19.824000 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:20.000977 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:20.186292 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:20.340513 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:20.496075 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:20.647757 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:20.823658 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:20.995928 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:21.137123 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:21.301303 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:21.442183 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:21.576547 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:21.753571 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:22.518948 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:35:22.521396 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030858516693115234, :worker_monitor=>1.2114322185516357, :worker_dequeue=>0.005452394485473633, :total_time=>1.220177173614502} [----] I, [2016-09-13T09:35:22.730888 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79127], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.74036118] seconds [----] I, [2016-09-13T09:35:22.731072 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79127], Delivering... [----] I, [2016-09-13T09:35:22.737270 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003291606903076172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033125877380371094, :pending_vm_jobs=>0.0007565021514892578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00585174560546875} [----] I, [2016-09-13T09:35:22.737574 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79127], State: [ok], Delivered in [0.006496033] seconds [----] I, [2016-09-13T09:35:23.039952 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:23.424802 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:23.590742 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:23.730103 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:23.873827 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:24.047384 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:24.199292 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:24.355879 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:24.510780 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:24.671304 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:24.934768 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:25.127101 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:25.298667 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:25.446602 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:25.597337 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:25.836292 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:26.092500 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:26.275903 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:27.195631 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:27.382308 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:27.528502 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:27.678544 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:27.860873 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:27.999740 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:28.140581 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:28.302756 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:28.455875 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:28.602233 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:28.775155 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:28.924584 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:29.078294 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:29.219438 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:29.367625 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:29.505107 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:29.645964 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:30.210577 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:30.432175 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:30.602890 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:30.755440 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:30.901664 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:31.041216 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:31.215309 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:31.355972 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:31.507096 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:31.655862 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:31.802923 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:31.946580 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:32.007592 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:35:32.020871 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79128], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:35:32.032174 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79129], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:35:32.092879 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:32.238402 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:32.382352 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:32.526605 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:32.548440 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:35:32.662829 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:32.826637 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79129], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.802402293] seconds [----] I, [2016-09-13T09:35:32.826749 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79129], Delivering... [----] I, [2016-09-13T09:35:32.830111 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0018343925476074219, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0018451213836669922, :pending_vm_jobs=>0.0004115104675292969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0031473636627197266} [----] I, [2016-09-13T09:35:32.830335 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79129], State: [ok], Delivered in [0.003580007] seconds [----] I, [2016-09-13T09:35:33.491801 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:33.667448 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:33.809599 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:34.787255 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79128], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.774794713] seconds [----] I, [2016-09-13T09:35:34.787529 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79128], Delivering... [----] I, [2016-09-13T09:35:34.792802 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79128], State: [ok], Delivered in [0.00525953] seconds [----] I, [2016-09-13T09:35:39.006465 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003298521041870117, :worker_monitor=>1.4441754817962646, :worker_dequeue=>0.006039619445800781, :total_time=>1.4537632465362549} [----] I, [2016-09-13T09:35:39.970770 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:40.113372 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:40.253727 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:40.394076 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:40.544577 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:40.703657 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:40.842054 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:40.988652 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:41.127053 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:41.274049 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:41.420522 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:41.564801 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:41.707805 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:41.850509 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:42.228781 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:42.398177 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:42.538316 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:42.694051 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:42.855995 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:43.002051 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:43.140389 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:43.284006 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:43.427476 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:43.563140 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:43.724755 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:43.865282 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:44.007012 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:35:44 UTC]... [----] I, [2016-09-13T09:35:44.019496 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:44.025013 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:35:44 UTC]...Complete [----] I, [2016-09-13T09:35:44.189536 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:44.339845 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:44.498693 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:35:44.638407 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T09:35:44.846002 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T09:35:44.846553 #17546:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T09:35:44.846968 #17546:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T09:35:44.847095 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T09:35:44.847229 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T09:35:44.872511 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T09:35:44.872869 #17546:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [79119], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T09:35:44.873104 #17546:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T09:35:44.873339 #17546:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T09:35:44.873563 #17546:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79119], State: [error], Delivered in [78.325140764] seconds [----] I, [2016-09-13T09:35:47.038714 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:35:47.067190 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79130], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:35:49.045195 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:35:49.855552 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79130], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.813051311] seconds [----] I, [2016-09-13T09:35:49.855699 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79130], Delivering... [----] I, [2016-09-13T09:35:49.860328 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025048255920410156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025207996368408203, :pending_vm_jobs=>0.0005319118499755859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0043222904205322266} [----] I, [2016-09-13T09:35:49.860658 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79130], State: [ok], Delivered in [0.004957926] seconds [----] I, [2016-09-13T09:35:55.124677 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002783060073852539, :worker_monitor=>1.0689666271209717, :worker_dequeue=>0.004808902740478516, :total_time=>1.0767717361450195} [----] I, [2016-09-13T09:36:02.076610 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:36:02.090125 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79131], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:36:02.107492 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79132], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:36:02.125329 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79133], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:36:02.141502 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79134], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:36:05.252289 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:36:06.051203 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79131], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.970790229] seconds [----] I, [2016-09-13T09:36:06.051382 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79131], Delivering... [----] I, [2016-09-13T09:36:06.073077 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79134], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.941830433] seconds [----] I, [2016-09-13T09:36:06.073248 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79134], Delivering... [----] I, [2016-09-13T09:36:06.079319 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003203153610229492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003222942352294922, :pending_vm_jobs=>0.0007884502410888672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0056514739990234375} [----] I, [2016-09-13T09:36:06.079662 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79134], State: [ok], Delivered in [0.006410387] seconds [----] I, [2016-09-13T09:36:06.113179 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79131], State: [ok], Delivered in [0.061767831] seconds [----] I, [2016-09-13T09:36:07.919327 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79132], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.822960616] seconds [----] I, [2016-09-13T09:36:07.919685 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79132], Delivering... [----] I, [2016-09-13T09:36:07.931365 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79133], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.815295885] seconds [----] I, [2016-09-13T09:36:07.931564 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79133], Delivering... [----] I, [2016-09-13T09:36:07.931724 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79132], State: [ok], Delivered in [0.012014142] seconds [----] I, [2016-09-13T09:36:07.946605 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79133], State: [ok], Delivered in [0.015007376] seconds [----] I, [2016-09-13T09:36:11.576288 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004038810729980469, :worker_monitor=>1.3070223331451416, :worker_dequeue=>0.009052276611328125, :total_time=>1.3203859329223633} [----] I, [2016-09-13T09:36:16.576839 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:36:16 UTC]... [----] I, [2016-09-13T09:36:16.593222 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:36:16 UTC]...Complete [----] I, [2016-09-13T09:36:17.152816 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:36:17.170559 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79135], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:36:21.612238 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:36:22.245069 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79135], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.087661014] seconds [----] I, [2016-09-13T09:36:22.245233 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79135], Delivering... [----] I, [2016-09-13T09:36:22.251029 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003069639205932617, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030889511108398438, :pending_vm_jobs=>0.0006530284881591797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005451679229736328} [----] I, [2016-09-13T09:36:22.251354 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79135], State: [ok], Delivered in [0.006111561] seconds [----] I, [2016-09-13T09:36:27.736274 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030357837677001953, :worker_monitor=>1.1078360080718994, :worker_dequeue=>0.008382797241210938, :total_time=>1.1194913387298584} [----] I, [2016-09-13T09:36:32.178665 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:36:32.228038 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79136], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:36:32.259556 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79137], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:36:32.751067 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:36:33.322045 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79137], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.087172117] seconds [----] I, [2016-09-13T09:36:33.322163 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79137], Delivering... [----] I, [2016-09-13T09:36:33.325565 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0019011497497558594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0019123554229736328, :pending_vm_jobs=>0.0003948211669921875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0031702518463134766} [----] I, [2016-09-13T09:36:33.325791 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79137], State: [ok], Delivered in [0.003631387] seconds [----] I, [2016-09-13T09:36:35.026067 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79136], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.841747723] seconds [----] I, [2016-09-13T09:36:35.026185 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79136], Delivering... [----] I, [2016-09-13T09:36:35.028902 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79136], State: [ok], Delivered in [0.002713092] seconds [----] I, [2016-09-13T09:36:44.081008 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003347635269165039, :worker_monitor=>1.3024075031280518, :worker_dequeue=>0.0053806304931640625, :total_time=>1.3114147186279297} [----] I, [2016-09-13T09:36:47.274245 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:36:47.302752 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79138], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:36:49.081594 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:36:49 UTC]... [----] I, [2016-09-13T09:36:49.102049 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:36:49 UTC]...Complete [----] I, [2016-09-13T09:36:49.113004 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:36:49.479667 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79138], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.196300298] seconds [----] I, [2016-09-13T09:36:49.479854 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79138], Delivering... [----] I, [2016-09-13T09:36:49.485747 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003116130828857422, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031325817108154297, :pending_vm_jobs=>0.0007319450378417969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005587100982666016} [----] I, [2016-09-13T09:36:49.486059 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79138], State: [ok], Delivered in [0.006200134] seconds [----] I, [2016-09-13T09:37:00.570866 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004086732864379883, :worker_monitor=>1.4203355312347412, :worker_dequeue=>0.01241445541381836, :total_time=>1.4372847080230713} [----] I, [2016-09-13T09:37:02.319762 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:37:02.342748 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79139], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:37:02.365544 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79140], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:37:02.400435 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79141], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:37:02.416617 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79142], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:37:05.697029 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:37:06.588382 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79139], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.263463741] seconds [----] I, [2016-09-13T09:37:06.588535 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79139], Delivering... [----] I, [2016-09-13T09:37:06.622530 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79139], State: [ok], Delivered in [0.033962322] seconds [----] I, [2016-09-13T09:37:06.680053 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79142], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.273408798] seconds [----] I, [2016-09-13T09:37:06.680252 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79142], Delivering... [----] I, [2016-09-13T09:37:06.684017 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020427703857421875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020575523376464844, :pending_vm_jobs=>0.00039386749267578125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0033948421478271484} [----] I, [2016-09-13T09:37:06.684239 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79142], State: [ok], Delivered in [0.004004054] seconds [----] I, [2016-09-13T09:37:08.154061 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79140], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.805001142] seconds [----] I, [2016-09-13T09:37:08.154232 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79140], Delivering... [----] I, [2016-09-13T09:37:08.160235 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79140], State: [ok], Delivered in [0.005996271] seconds [----] I, [2016-09-13T09:37:08.193834 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79141], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.818119396] seconds [----] I, [2016-09-13T09:37:08.193973 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79141], Delivering... [----] I, [2016-09-13T09:37:08.197737 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79141], State: [ok], Delivered in [0.003755555] seconds [----] I, [2016-09-13T09:37:17.198752 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00409388542175293, :worker_monitor=>1.475264072418213, :worker_dequeue=>0.0066432952880859375, :total_time=>1.4864132404327393} [----] I, [2016-09-13T09:37:17.427152 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:37:17.445597 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79143], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:37:22.199144 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:37:22 UTC]... [----] I, [2016-09-13T09:37:22.239602 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:37:22 UTC]...Complete [----] I, [2016-09-13T09:37:22.245532 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:37:23.154287 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79143], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.720499288] seconds [----] I, [2016-09-13T09:37:23.154499 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79143], Delivering... [----] I, [2016-09-13T09:37:23.162845 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002944469451904297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002961874008178711, :pending_vm_jobs=>0.0007905960083007812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005457162857055664} [----] I, [2016-09-13T09:37:23.163144 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79143], State: [ok], Delivered in [0.008687391] seconds [----] I, [2016-09-13T09:37:32.462246 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:37:32.486901 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79144], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:37:32.514575 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79145], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:37:33.830391 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:37:33.834352 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004015445709228516, :worker_monitor=>1.5645616054534912, :worker_dequeue=>0.008579730987548828, :total_time=>1.5775961875915527} [----] I, [2016-09-13T09:37:34.257253 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79145], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.761866056] seconds [----] I, [2016-09-13T09:37:34.257403 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79145], Delivering... [----] I, [2016-09-13T09:37:34.262136 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025708675384521484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002588510513305664, :pending_vm_jobs=>0.0005404949188232422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004360675811767578} [----] I, [2016-09-13T09:37:34.262405 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79145], State: [ok], Delivered in [0.005008852] seconds [----] I, [2016-09-13T09:37:35.554327 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79144], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.085934804] seconds [----] I, [2016-09-13T09:37:35.554574 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79144], Delivering... [----] I, [2016-09-13T09:37:35.558839 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79144], State: [ok], Delivered in [0.004267335] seconds [----] I, [2016-09-13T09:37:47.531264 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:37:47.554637 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79146], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:37:50.216823 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:37:50.224007 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037920475006103516, :worker_monitor=>1.3503947257995605, :worker_dequeue=>0.013453006744384766, :total_time=>1.3684756755828857} [----] I, [2016-09-13T09:37:50.447716 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79146], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.910492745] seconds [----] I, [2016-09-13T09:37:50.447952 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79146], Delivering... [----] I, [2016-09-13T09:37:50.455353 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003911256790161133, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003937482833862305, :pending_vm_jobs=>0.0009407997131347656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006944894790649414} [----] I, [2016-09-13T09:37:50.455772 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79146], State: [ok], Delivered in [0.007818423] seconds [----] I, [2016-09-13T09:37:55.224609 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:37:55 UTC]... [----] I, [2016-09-13T09:37:55.240381 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:37:55 UTC]...Complete [----] I, [2016-09-13T09:38:02.567068 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:38:02.595267 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79147], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:38:02.626055 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79148], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:38:02.648403 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79149], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:38:02.671231 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79150], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:38:06.650221 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:38:06.654281 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002727508544921875, :worker_monitor=>1.3737692832946777, :worker_dequeue=>0.00864553451538086, :total_time=>1.385361909866333} [----] I, [2016-09-13T09:38:07.536662 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79147], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.964079872] seconds [----] I, [2016-09-13T09:38:07.537028 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79147], Delivering... [----] I, [2016-09-13T09:38:07.580013 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79150], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.926008328] seconds [----] I, [2016-09-13T09:38:07.580194 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79150], Delivering... [----] I, [2016-09-13T09:38:07.587141 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034689903259277344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034971237182617188, :pending_vm_jobs=>0.0009965896606445312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006505727767944336} [----] I, [2016-09-13T09:38:07.587523 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79150], State: [ok], Delivered in [0.007262714] seconds [----] I, [2016-09-13T09:38:07.614305 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79147], State: [ok], Delivered in [0.077300883] seconds [----] I, [2016-09-13T09:38:08.689048 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79148], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.087550897] seconds [----] I, [2016-09-13T09:38:08.689311 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79148], Delivering... [----] I, [2016-09-13T09:38:08.693644 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79148], State: [ok], Delivered in [0.004340485] seconds [----] I, [2016-09-13T09:38:08.740515 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79149], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.105409239] seconds [----] I, [2016-09-13T09:38:08.740763 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79149], Delivering... [----] I, [2016-09-13T09:38:08.747135 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79149], State: [ok], Delivered in [0.00634925] seconds [----] I, [2016-09-13T09:38:17.683232 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:38:17.699987 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79151], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:38:23.330502 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:38:23.334535 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004411935806274414, :worker_monitor=>1.5321524143218994, :worker_dequeue=>0.008685588836669922, :total_time=>1.5456175804138184} [----] I, [2016-09-13T09:38:23.711868 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79151], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.023349786] seconds [----] I, [2016-09-13T09:38:23.712060 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79151], Delivering... [----] I, [2016-09-13T09:38:23.719020 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037114620208740234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037338733673095703, :pending_vm_jobs=>0.0008471012115478516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065860748291015625} [----] I, [2016-09-13T09:38:23.719457 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79151], State: [ok], Delivered in [0.007343064] seconds [----] I, [2016-09-13T09:38:28.334954 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:38:28 UTC]... [----] I, [2016-09-13T09:38:28.351086 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:38:28 UTC]...Complete [----] I, [2016-09-13T09:38:32.711827 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T09:38:32.741676 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79152], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:38:32.791736 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79153], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:38:32.883471 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79154], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:38:32.911906 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79155], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:38:33.367974 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:38:33.838817 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79153], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.092808249] seconds [----] I, [2016-09-13T09:38:33.839005 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79153], Delivering... [----] I, [2016-09-13T09:38:33.843117 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79154], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.046665254] seconds [----] I, [2016-09-13T09:38:33.843306 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79154], Delivering... [----] I, [2016-09-13T09:38:33.844622 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T09:38:33.844830 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4572856320 [----] I, [2016-09-13T09:38:33.844923 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4342206464 [----] I, [2016-09-13T09:38:33.845004 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 230649856 [----] I, [2016-09-13T09:38:33.845076 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T09:38:33.845147 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4288081920 [----] I, [2016-09-13T09:38:33.845217 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T09:38:33.845292 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T09:38:33.845364 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 552579072 [----] I, [2016-09-13T09:38:33.845477 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T09:38:33.845592 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6882349056 [----] I, [2016-09-13T09:38:33.845674 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T09:38:33.845750 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T09:38:33.845816 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T09:38:33.845888 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T09:38:33.845958 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T09:38:33.846030 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T09:38:33.846097 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T09:38:33.846164 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T09:38:33.846234 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T09:38:33.846303 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T09:38:33.846380 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 274026496 [----] I, [2016-09-13T09:38:33.846500 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57208832 [----] I, [2016-09-13T09:38:33.846599 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216817664 [----] I, [2016-09-13T09:38:33.846670 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6127616 [----] I, [2016-09-13T09:38:33.846737 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142262272 [----] I, [2016-09-13T09:38:33.846805 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3377934336 [----] I, [2016-09-13T09:38:33.846879 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3052298240 [----] I, [2016-09-13T09:38:33.846945 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T09:38:33.847013 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T09:38:33.847082 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T09:38:33.847146 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37257216 [----] I, [2016-09-13T09:38:33.847213 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T09:38:33.847275 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53956608 [----] I, [2016-09-13T09:38:33.847342 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111333376 [----] I, [2016-09-13T09:38:33.847411 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 156254208 [----] I, [2016-09-13T09:38:33.847533 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T09:38:33.847611 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T09:38:33.847685 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T09:38:33.847753 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T09:38:33.847821 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T09:38:33.847900 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T09:38:33.848025 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T09:38:33.848157 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T09:38:33.848252 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T09:38:33.851006 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0060575008392333984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.006094455718994141, :pending_vm_jobs=>0.0016007423400878906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.011538982391357422} [----] I, [2016-09-13T09:38:33.851623 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79153], State: [ok], Delivered in [0.01258987] seconds [----] I, [2016-09-13T09:38:33.903893 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T09:38:33.904106 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T09:38:33.908271 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T09:38:33.911465 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T09:38:33.915156 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T09:38:33.918785 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T09:38:33.922298 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T09:38:33.925899 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 852 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T09:38:33.929346 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T09:38:33.932982 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T09:38:33.936468 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T09:38:33.939973 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T09:38:33.943356 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T09:38:33.946805 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T09:38:33.951513 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:38:33.951687 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:38:33.951793 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T09:38:33.956391 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201168000], Memory % [3.36], CPU Time [153288.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:38:33.956807 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79154], State: [ok], Delivered in [0.113479755] seconds [----] I, [2016-09-13T09:38:35.838192 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79152], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.121011784] seconds [----] I, [2016-09-13T09:38:35.838400 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79152], Delivering... [----] I, [2016-09-13T09:38:35.843283 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79152], State: [ok], Delivered in [0.004860823] seconds [----] I, [2016-09-13T09:38:39.649033 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:38:39.655260 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0026712417602539062, :worker_monitor=>1.266756296157837, :worker_dequeue=>0.013460397720336914, :total_time=>1.2831320762634277} [----] I, [2016-09-13T09:38:39.957706 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79155], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.069141493] seconds [----] I, [2016-09-13T09:38:39.957871 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79155], Delivering... [----] I, [2016-09-13T09:38:39.964477 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:38:32 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [206034000], Memory % [3.5], CPU Time [242748.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T09:38:39.964934 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:38:31 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347776000], Memory % [5.04], CPU Time [105509.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T09:38:39.965399 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:38:37 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163147000], Memory % [3.1], CPU Time [38376.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T09:38:39.965923 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:38:38 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202684000], Memory % [3.38], CPU Time [152372.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:38:39.966371 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:38:38 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359291000], Memory % [5.28], CPU Time [205356.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:38:39.966828 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:38:38 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201168000], Memory % [3.36], CPU Time [153306.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:38:39.967247 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:38:38 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169743000], Memory % [3.14], CPU Time [52114.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:38:39.967661 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:38:39 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [213403000], Memory % [3.5], CPU Time [49250.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T09:38:39.970138 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:38:35 UTC], Process Info: Memory Usage [622891008], Memory Size [1145794560], Proportional Set Size: [458999000], Memory % [7.59], CPU Time [426.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:38:39.971995 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:38:36 UTC], Process Info: Memory Usage [601612288], Memory Size [959381504], Proportional Set Size: [437736000], Memory % [7.33], CPU Time [150.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T09:38:39.972498 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:38:38 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358589000], Memory % [5.27], CPU Time [212599.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T09:38:39.973024 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:38:38 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178470000], Memory % [3.2], CPU Time [52108.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:38:39.973489 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:38:34 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166755000], Memory % [3.16], CPU Time [39280.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T09:38:39.973808 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79155], State: [ok], Delivered in [0.015932946] seconds [----] I, [2016-09-13T09:38:47.923311 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:38:47.940306 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79156], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:38:49.683325 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:38:50.186405 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79156], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.25769302] seconds [----] I, [2016-09-13T09:38:50.186670 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79156], Delivering... [----] I, [2016-09-13T09:38:50.195630 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037240982055664062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038089752197265625, :pending_vm_jobs=>0.0014095306396484375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00852203369140625} [----] I, [2016-09-13T09:38:50.196004 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79156], State: [ok], Delivered in [0.009336613] seconds [----] I, [2016-09-13T09:38:55.708165 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0027265548706054688, :worker_monitor=>1.0117096900939941, :worker_dequeue=>0.005510091781616211, :total_time=>1.0201473236083984} [----] I, [2016-09-13T09:39:00.708697 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:39:00 UTC]... [----] I, [2016-09-13T09:39:00.728728 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:39:00 UTC]...Complete [----] I, [2016-09-13T09:39:02.949773 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:39:02.968860 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79157], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:39:02.980490 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79158], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:39:03.025959 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79159], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:39:03.071797 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79160], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:39:05.747509 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:39:05.923065 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79157], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.970310687] seconds [----] I, [2016-09-13T09:39:05.923188 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79157], Delivering... [----] I, [2016-09-13T09:39:05.957743 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79160], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.928145274] seconds [----] I, [2016-09-13T09:39:05.957956 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79160], Delivering... [----] I, [2016-09-13T09:39:05.963018 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79157], State: [ok], Delivered in [0.039817804] seconds [----] I, [2016-09-13T09:39:05.965359 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0040094852447509766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0040340423583984375, :pending_vm_jobs=>0.0008869171142578125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0069653987884521484} [----] I, [2016-09-13T09:39:05.965759 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79160], State: [ok], Delivered in [0.007799835] seconds [----] I, [2016-09-13T09:39:05.987283 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79158], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.014819361] seconds [----] I, [2016-09-13T09:39:05.987411 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79158], Delivering... [----] I, [2016-09-13T09:39:05.989491 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79158], State: [ok], Delivered in [0.002081859] seconds [----] I, [2016-09-13T09:39:05.992220 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79159], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.006803147] seconds [----] I, [2016-09-13T09:39:05.992489 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79159], Delivering... [----] I, [2016-09-13T09:39:05.997657 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79159], State: [ok], Delivered in [0.005206792] seconds [----] I, [2016-09-13T09:39:12.206835 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004179239273071289, :worker_monitor=>1.44667649269104, :worker_dequeue=>0.004945278167724609, :total_time=>1.4560928344726562} [----] I, [2016-09-13T09:39:18.082032 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:39:18.123574 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79161], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:39:22.371494 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:39:22.449191 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79161], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.361314106] seconds [----] I, [2016-09-13T09:39:22.449378 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79161], Delivering... [----] I, [2016-09-13T09:39:22.455720 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003339529037475586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003362417221069336, :pending_vm_jobs=>0.0007932186126708984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059506893157958984} [----] I, [2016-09-13T09:39:22.456143 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79161], State: [ok], Delivered in [0.006775886] seconds [----] I, [2016-09-13T09:39:28.876154 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003772258758544922, :worker_monitor=>1.4773223400115967, :worker_dequeue=>0.014101505279541016, :total_time=>1.4954960346221924} [----] I, [2016-09-13T09:39:33.138107 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:39:33.161324 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79162], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:39:33.189971 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79163], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:39:33.876714 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:39:33 UTC]... [----] I, [2016-09-13T09:39:33.919582 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:39:33 UTC]...Complete [----] I, [2016-09-13T09:39:33.927867 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:39:34.395976 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79163], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.228917949] seconds [----] I, [2016-09-13T09:39:34.396182 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79163], Delivering... [----] I, [2016-09-13T09:39:34.403299 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037147998809814453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037381649017333984, :pending_vm_jobs=>0.0008420944213867188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00663304328918457} [----] I, [2016-09-13T09:39:34.403734 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79163], State: [ok], Delivered in [0.007551888] seconds [----] I, [2016-09-13T09:39:36.104402 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79162], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.961894473] seconds [----] I, [2016-09-13T09:39:36.104618 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79162], Delivering... [----] I, [2016-09-13T09:39:36.108381 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79162], State: [ok], Delivered in [0.003763769] seconds [----] I, [2016-09-13T09:39:45.377570 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002743244171142578, :worker_monitor=>1.4176914691925049, :worker_dequeue=>0.007838249206542969, :total_time=>1.4285087585449219} [----] I, [2016-09-13T09:39:48.201888 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:39:48.224335 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79164], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:39:50.392322 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T09:39:50.399938 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:39:50.562000 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79164], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.351119605] seconds [----] I, [2016-09-13T09:39:50.562224 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79164], Delivering... [----] I, [2016-09-13T09:39:50.569619 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003561258316040039, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003654956817626953, :pending_vm_jobs=>0.0007941722869873047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006916522979736328} [----] I, [2016-09-13T09:39:50.569989 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79164], State: [ok], Delivered in [0.007766288] seconds [----] I, [2016-09-13T09:40:01.812843 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035772323608398438, :worker_monitor=>1.3843295574188232, :worker_dequeue=>0.009071111679077148, :total_time=>1.3972387313842773} [----] I, [2016-09-13T09:40:03.234955 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 8. [----] I, [2016-09-13T09:40:03.247117 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79165], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:40:03.281508 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79166], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:40:03.315834 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79167], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:40:03.390578 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79168], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:40:03.401454 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79169], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:40:03.435776 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79170], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:40:03.453080 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79171], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:40:06.813477 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:40:06 UTC]... [----] I, [2016-09-13T09:40:06.864504 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:40:06 UTC]...Complete [----] I, [2016-09-13T09:40:06.876776 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 7 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:40:07.722276 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79165], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.484374466] seconds [----] I, [2016-09-13T09:40:07.722594 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79165], Delivering... [----] I, [2016-09-13T09:40:07.773492 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79168], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.454000301] seconds [----] I, [2016-09-13T09:40:07.773748 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79168], Delivering... [----] I, [2016-09-13T09:40:07.780651 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034825801849365234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035817623138427734, :pending_vm_jobs=>0.0008351802825927734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006478071212768555} [----] I, [2016-09-13T09:40:07.781029 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79168], State: [ok], Delivered in [0.007283314] seconds [----] I, [2016-09-13T09:40:07.830497 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79165], State: [ok], Delivered in [0.10781381] seconds [----] I, [2016-09-13T09:40:09.173321 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79166], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.922841515] seconds [----] I, [2016-09-13T09:40:09.173559 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79166], Delivering... [----] I, [2016-09-13T09:40:09.176802 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79166], State: [ok], Delivered in [0.003241714] seconds [----] I, [2016-09-13T09:40:09.207348 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79167], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.921139332] seconds [----] I, [2016-09-13T09:40:09.207533 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79167], Delivering... [----] I, [2016-09-13T09:40:09.211402 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79167], State: [ok], Delivered in [0.003863752] seconds [----] I, [2016-09-13T09:40:09.310381 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79169], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.916488377] seconds [----] I, [2016-09-13T09:40:09.310566 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79169], Delivering... [----] I, [2016-09-13T09:40:09.312367 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79169], State: [ok], Delivered in [0.001805656] seconds [----] I, [2016-09-13T09:40:09.344965 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79170], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.94022307] seconds [----] I, [2016-09-13T09:40:09.345189 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79170], Delivering... [----] I, [2016-09-13T09:40:09.359577 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79170], State: [ok], Delivered in [0.014361833] seconds [----] I, [2016-09-13T09:40:09.367369 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79171], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.927577207] seconds [----] I, [2016-09-13T09:40:09.367556 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79171], Delivering... [----] I, [2016-09-13T09:40:09.372000 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79171], State: [ok], Delivered in [0.004435697] seconds [----] I, [2016-09-13T09:40:18.325248 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038530826568603516, :worker_monitor=>1.4132609367370605, :worker_dequeue=>0.011245250701904297, :total_time=>1.428656816482544} [----] I, [2016-09-13T09:40:18.461635 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:40:18.510887 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79172], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:40:23.490525 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:40:23.939245 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79172], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.471629815] seconds [----] I, [2016-09-13T09:40:23.939496 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79172], Delivering... [----] I, [2016-09-13T09:40:23.948812 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004356861114501953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004387617111206055, :pending_vm_jobs=>0.0013680458068847656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008841991424560547} [----] I, [2016-09-13T09:40:23.949322 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79172], State: [ok], Delivered in [0.009838984] seconds [----] I, [2016-09-13T09:40:33.528497 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:40:33.579656 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79173], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:40:33.608069 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79174], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:40:35.378958 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:40:35.386110 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039038658142089844, :worker_monitor=>1.8498022556304932, :worker_dequeue=>0.014820337295532227, :total_time=>1.868798017501831} [----] I, [2016-09-13T09:40:36.043025 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79174], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.454724324] seconds [----] I, [2016-09-13T09:40:36.043234 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79174], Delivering... [----] I, [2016-09-13T09:40:36.048708 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031676292419433594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031855106353759766, :pending_vm_jobs=>0.0007128715515136719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005143404006958008} [----] I, [2016-09-13T09:40:36.048963 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79174], State: [ok], Delivered in [0.005754352] seconds [----] I, [2016-09-13T09:40:36.465082 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79173], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.928565828] seconds [----] I, [2016-09-13T09:40:36.465264 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79173], Delivering... [----] I, [2016-09-13T09:40:36.470622 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79173], State: [ok], Delivered in [0.005354689] seconds [----] I, [2016-09-13T09:40:40.386761 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:40:40 UTC]... [----] I, [2016-09-13T09:40:40.407867 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:40:40 UTC]...Complete [----] I, [2016-09-13T09:40:48.625633 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:40:48.641808 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79175], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:40:52.220689 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:40:52.227634 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006330728530883789, :worker_monitor=>1.75563383102417, :worker_dequeue=>0.014762639999389648, :total_time=>1.7772448062896729} [----] I, [2016-09-13T09:40:53.210616 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79175], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.579198654] seconds [----] I, [2016-09-13T09:40:53.210956 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79175], Delivering... [----] I, [2016-09-13T09:40:53.221529 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005335807800292969, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00536799430847168, :pending_vm_jobs=>0.0012483596801757812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00977635383605957} [----] I, [2016-09-13T09:40:53.222020 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79175], State: [ok], Delivered in [0.011067412] seconds [----] I, [2016-09-13T09:41:03.649818 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:41:03.710605 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79176], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:41:03.790617 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79177], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:41:03.807623 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79178], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:41:03.819100 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79179], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:41:09.141593 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:41:09.144409 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004221439361572266, :worker_monitor=>1.8726484775543213, :worker_dequeue=>0.006430864334106445, :total_time=>1.8836758136749268} [----] I, [2016-09-13T09:41:09.347613 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79176], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.694540057] seconds [----] I, [2016-09-13T09:41:09.347919 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79176], Delivering... [----] I, [2016-09-13T09:41:09.438979 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79179], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.627885008] seconds [----] I, [2016-09-13T09:41:09.439243 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79179], Delivering... [----] I, [2016-09-13T09:41:09.450756 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005900144577026367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005937099456787109, :pending_vm_jobs=>0.0015094280242919922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010889530181884766} [----] I, [2016-09-13T09:41:09.451265 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79179], State: [ok], Delivered in [0.012003413] seconds [----] I, [2016-09-13T09:41:09.455341 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79176], State: [ok], Delivered in [0.107437585] seconds [----] I, [2016-09-13T09:41:09.609698 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79177], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.895509161] seconds [----] I, [2016-09-13T09:41:09.609863 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79177], Delivering... [----] I, [2016-09-13T09:41:09.616963 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79177], State: [ok], Delivered in [0.007067619] seconds [----] I, [2016-09-13T09:41:09.649540 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79178], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.853758173] seconds [----] I, [2016-09-13T09:41:09.649669 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79178], Delivering... [----] I, [2016-09-13T09:41:09.653018 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79178], State: [ok], Delivered in [0.003345724] seconds [----] I, [2016-09-13T09:41:12.598136 #3046:a8ad40] INFO -- : MIQ(Authenticator.authenticate) userid: [admin] - User admin successfully validated by EVM [----] I, [2016-09-13T09:41:12.638272 #3046:a8ad40] INFO -- : MIQ(Authenticator.authenticate) userid: [admin] - Authentication successful for user admin [----] I, [2016-09-13T09:41:13.061153 #3022:9821a0] INFO -- : MIQ(Authenticator.authenticate) userid: [admin] - User admin successfully validated by EVM [----] I, [2016-09-13T09:41:13.072615 #3022:9821a0] INFO -- : MIQ(Authenticator.authenticate) userid: [admin] - Authentication successful for user admin [----] I, [2016-09-13T09:41:13.408313 #3022:985580] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-04 00:00:00 UTC [----] I, [2016-09-13T09:41:13.410115 #3022:985580] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-14 00:00:00 UTC [----] I, [2016-09-13T09:41:13.546583 #3022:985580] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T09:41:13.546840 #3022:985580] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 14:00:00 UTC [----] I, [2016-09-13T09:41:13.573923 #3022:985580] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-04 00:00:00 UTC [----] I, [2016-09-13T09:41:13.574241 #3022:985580] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-14 00:00:00 UTC [----] I, [2016-09-13T09:41:13.599443 #3022:985580] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-04 00:00:00 UTC [----] I, [2016-09-13T09:41:13.599997 #3022:985580] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-14 00:00:00 UTC [----] I, [2016-09-13T09:41:13.640799 #3022:985580] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-04 00:00:00 UTC [----] I, [2016-09-13T09:41:13.641246 #3022:985580] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-14 00:00:00 UTC [----] I, [2016-09-13T09:41:13.681331 #3022:985580] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-04 00:00:00 UTC [----] I, [2016-09-13T09:41:13.681990 #3022:985580] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-14 00:00:00 UTC [----] I, [2016-09-13T09:41:13.709349 #3022:985580] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T09:41:13.709628 #3022:985580] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 14:00:00 UTC [----] I, [2016-09-13T09:41:13.735460 #3022:985580] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-04 00:00:00 UTC [----] I, [2016-09-13T09:41:13.735819 #3022:985580] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-14 00:00:00 UTC [----] I, [2016-09-13T09:41:14.144848 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:41:14 UTC]... [----] I, [2016-09-13T09:41:14.186881 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:41:14 UTC]...Complete [----] I, [2016-09-13T09:41:18.826560 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:41:18.906781 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79180], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:41:19.207847 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:41:19.598767 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79180], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.768719348] seconds [----] I, [2016-09-13T09:41:19.598955 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79180], Delivering... [----] I, [2016-09-13T09:41:19.605792 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003505229949951172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003523111343383789, :pending_vm_jobs=>0.0007953643798828125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006389617919921875} [----] I, [2016-09-13T09:41:19.606095 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79180], State: [ok], Delivered in [0.007130891] seconds [----] I, [2016-09-13T09:41:25.710526 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035500526428222656, :server_monitor=>0.07547616958618164, :worker_monitor=>1.4140312671661377, :worker_dequeue=>0.006421566009521484, :total_time=>1.5000362396240234} [----] I, [2016-09-13T09:41:33.915265 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:41:34.032811 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79181], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:41:34.049844 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79182], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:41:35.733463 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:41:35.752957 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79182], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.714231814] seconds [----] I, [2016-09-13T09:41:35.753139 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79182], Delivering... [----] I, [2016-09-13T09:41:35.759099 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029802322387695312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002998828887939453, :pending_vm_jobs=>0.0008246898651123047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005635976791381836} [----] I, [2016-09-13T09:41:35.759513 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79182], State: [ok], Delivered in [0.006306027] seconds [----] I, [2016-09-13T09:41:36.719039 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79181], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.799290434] seconds [----] I, [2016-09-13T09:41:36.719287 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79181], Delivering... [----] I, [2016-09-13T09:41:36.724904 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79181], State: [ok], Delivered in [0.005621347] seconds [----] I, [2016-09-13T09:41:42.881712 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00416254997253418, :worker_monitor=>2.1347382068634033, :worker_dequeue=>0.0064640045166015625, :total_time=>2.145669937133789} [----] I, [2016-09-13T09:41:47.883484 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:41:47 UTC]... [----] I, [2016-09-13T09:41:47.907765 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:41:47 UTC]...Complete [----] I, [2016-09-13T09:41:49.062976 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:41:49.114636 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79183], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:41:52.933955 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:41:53.838815 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79183], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.766587783] seconds [----] I, [2016-09-13T09:41:53.838961 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79183], Delivering... [----] I, [2016-09-13T09:41:53.843271 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024094581604003906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024611949920654297, :pending_vm_jobs=>0.0004930496215820312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004039764404296875} [----] I, [2016-09-13T09:41:53.843528 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79183], State: [ok], Delivered in [0.004554582] seconds [----] I, [2016-09-13T09:41:59.935451 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003834962844848633, :worker_monitor=>1.975944995880127, :worker_dequeue=>0.013232946395874023, :total_time=>1.9932959079742432} [----] I, [2016-09-13T09:42:04.127146 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:42:04.162914 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79184], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:42:04.202816 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79185], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:42:04.232982 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79186], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:42:04.312816 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79187], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:42:04.951086 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:42:04.976314 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79184], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.846139072] seconds [----] I, [2016-09-13T09:42:04.976566 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79184], Delivering... [----] I, [2016-09-13T09:42:05.032885 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79184], State: [ok], Delivered in [0.056302656] seconds [----] I, [2016-09-13T09:42:05.055855 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79187], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.81804607] seconds [----] I, [2016-09-13T09:42:05.056025 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79187], Delivering... [----] I, [2016-09-13T09:42:05.064553 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003840208053588867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038652420043945312, :pending_vm_jobs=>0.00135040283203125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008072137832641602} [----] I, [2016-09-13T09:42:05.065034 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79187], State: [ok], Delivered in [0.008959323] seconds [----] I, [2016-09-13T09:42:06.879516 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79185], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.712382219] seconds [----] I, [2016-09-13T09:42:06.879817 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79185], Delivering... [----] I, [2016-09-13T09:42:06.884962 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79185], State: [ok], Delivered in [0.005144459] seconds [----] I, [2016-09-13T09:42:06.907708 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79186], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.700158521] seconds [----] I, [2016-09-13T09:42:06.907929 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79186], Delivering... [----] I, [2016-09-13T09:42:06.913622 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79186], State: [ok], Delivered in [0.00566079] seconds [----] I, [2016-09-13T09:42:16.699198 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006150722503662109, :worker_monitor=>1.7115540504455566, :worker_dequeue=>0.010215282440185547, :total_time=>1.728288173675537} [----] I, [2016-09-13T09:42:19.323208 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:42:19.341502 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79188], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:42:21.699745 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:42:21 UTC]... [----] I, [2016-09-13T09:42:21.724554 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:42:21 UTC]...Complete [----] I, [2016-09-13T09:42:21.741327 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:42:21.965407 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79188], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.63823364] seconds [----] I, [2016-09-13T09:42:21.965750 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79188], Delivering... [----] I, [2016-09-13T09:42:21.977505 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005839824676513672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0058765411376953125, :pending_vm_jobs=>0.00165557861328125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010967254638671875} [----] I, [2016-09-13T09:42:21.978013 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79188], State: [ok], Delivered in [0.012241478] seconds [----] I, [2016-09-13T09:42:33.361582 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006460428237915039, :worker_monitor=>1.454228401184082, :worker_dequeue=>0.005895376205444336, :total_time=>1.466953992843628} [----] I, [2016-09-13T09:42:34.350628 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:42:34.432865 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79189], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:42:34.461959 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79190], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:42:38.369643 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:42:39.159696 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79190], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.72049655] seconds [----] I, [2016-09-13T09:42:39.159925 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79190], Delivering... [----] I, [2016-09-13T09:42:39.168405 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004442691802978516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004475116729736328, :pending_vm_jobs=>0.0010728836059570312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008030414581298828} [----] I, [2016-09-13T09:42:39.168935 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79190], State: [ok], Delivered in [0.008994013] seconds [----] I, [2016-09-13T09:42:40.010524 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79189], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.655780593] seconds [----] I, [2016-09-13T09:42:40.010686 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79189], Delivering... [----] I, [2016-09-13T09:42:40.014960 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79189], State: [ok], Delivered in [0.004260121] seconds [----] I, [2016-09-13T09:42:49.508395 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:42:49.567838 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79191], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:42:50.250354 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:42:50.255317 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00427699089050293, :worker_monitor=>1.851893424987793, :worker_dequeue=>0.011810302734375, :total_time=>1.8683068752288818} [----] I, [2016-09-13T09:42:50.290936 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79191], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.778580843] seconds [----] I, [2016-09-13T09:42:50.291157 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79191], Delivering... [----] I, [2016-09-13T09:42:50.298087 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036427974700927734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036649703979492188, :pending_vm_jobs=>0.0008111000061035156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0064847469329833984} [----] I, [2016-09-13T09:42:50.298511 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79191], State: [ok], Delivered in [0.007362912] seconds [----] I, [2016-09-13T09:42:55.255980 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:42:55 UTC]... [----] I, [2016-09-13T09:42:55.289566 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:42:55 UTC]...Complete [----] I, [2016-09-13T09:43:04.576924 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:43:04.649627 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79192], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:43:04.683585 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79193], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:43:04.702087 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79194], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:43:04.726274 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79195], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:43:07.990778 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:43:07.995152 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00548553466796875, :worker_monitor=>2.6501715183258057, :worker_dequeue=>0.009682655334472656, :total_time=>2.6657326221466064} [----] I, [2016-09-13T09:43:08.502631 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79192], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.921813961] seconds [----] I, [2016-09-13T09:43:08.502798 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79192], Delivering... [----] I, [2016-09-13T09:43:08.525532 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79195], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.818067904] seconds [----] I, [2016-09-13T09:43:08.525739 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79195], Delivering... [----] I, [2016-09-13T09:43:08.534227 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038084983825683594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003834962844848633, :pending_vm_jobs=>0.0012578964233398438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008051633834838867} [----] I, [2016-09-13T09:43:08.534724 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79195], State: [ok], Delivered in [0.008962127] seconds [----] I, [2016-09-13T09:43:08.668040 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79192], State: [ok], Delivered in [0.165194083] seconds [----] I, [2016-09-13T09:43:10.262241 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79193], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.606938418] seconds [----] I, [2016-09-13T09:43:10.262379 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79193], Delivering... [----] I, [2016-09-13T09:43:10.264704 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79193], State: [ok], Delivered in [0.002320982] seconds [----] I, [2016-09-13T09:43:10.365090 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79194], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.673574415] seconds [----] I, [2016-09-13T09:43:10.365228 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79194], Delivering... [----] I, [2016-09-13T09:43:10.368629 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79194], State: [ok], Delivered in [0.003402572] seconds [----] I, [2016-09-13T09:43:19.734195 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:43:19.770825 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79196], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:43:24.021191 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:43:24.771180 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79196], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.027953762] seconds [----] I, [2016-09-13T09:43:24.771369 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79196], Delivering... [----] I, [2016-09-13T09:43:24.778520 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003385782241821289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034110546112060547, :pending_vm_jobs=>0.0008840560913085938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006653785705566406} [----] I, [2016-09-13T09:43:24.778892 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79196], State: [ok], Delivered in [0.007513996] seconds [----] I, [2016-09-13T09:43:29.023870 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:43:29 UTC]... [----] I, [2016-09-13T09:43:29.045088 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:43:29 UTC]...Complete [----] I, [2016-09-13T09:43:34.779909 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T09:43:34.793386 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79197], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:43:34.822119 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79198], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:43:34.839223 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79199], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:43:34.867871 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79200], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:43:40.540875 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:43:40.542921 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0045964717864990234, :worker_monitor=>1.3191075325012207, :worker_dequeue=>0.004951953887939453, :total_time=>1.328967571258545} [----] I, [2016-09-13T09:43:40.919841 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79198], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.122824738] seconds [----] I, [2016-09-13T09:43:40.920013 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79198], Delivering... [----] I, [2016-09-13T09:43:40.926276 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033125877380371094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003330230712890625, :pending_vm_jobs=>0.0007414817810058594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005912065505981445} [----] I, [2016-09-13T09:43:40.926598 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79198], State: [ok], Delivered in [0.006580268] seconds [----] I, [2016-09-13T09:43:40.936626 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79199], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.111832408] seconds [----] I, [2016-09-13T09:43:40.936723 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79199], Delivering... [----] I, [2016-09-13T09:43:40.937248 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T09:43:40.937345 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4573519872 [----] I, [2016-09-13T09:43:40.937393 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4342648832 [----] I, [2016-09-13T09:43:40.937477 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 230871040 [----] I, [2016-09-13T09:43:40.937550 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T09:43:40.937594 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4288569344 [----] I, [2016-09-13T09:43:40.937631 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T09:43:40.937670 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T09:43:40.937706 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 552771584 [----] I, [2016-09-13T09:43:40.937763 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T09:43:40.937802 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6895071232 [----] I, [2016-09-13T09:43:40.937839 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T09:43:40.937878 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T09:43:40.937913 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T09:43:40.937951 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 24576 [----] I, [2016-09-13T09:43:40.937987 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T09:43:40.938023 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T09:43:40.938060 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T09:43:40.938096 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T09:43:40.938131 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T09:43:40.938167 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T09:43:40.938203 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 274018304 [----] I, [2016-09-13T09:43:40.938239 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57196544 [----] I, [2016-09-13T09:43:40.938276 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216821760 [----] I, [2016-09-13T09:43:40.938310 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6127616 [----] I, [2016-09-13T09:43:40.938348 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142262272 [----] I, [2016-09-13T09:43:40.938384 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3377123328 [----] I, [2016-09-13T09:43:40.938441 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3051261952 [----] I, [2016-09-13T09:43:40.938508 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T09:43:40.938553 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T09:43:40.938587 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T09:43:40.938623 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37015552 [----] I, [2016-09-13T09:43:40.938659 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T09:43:40.938698 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53821440 [----] I, [2016-09-13T09:43:40.938734 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111300608 [----] I, [2016-09-13T09:43:40.938772 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 156119040 [----] I, [2016-09-13T09:43:40.938808 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T09:43:40.938845 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T09:43:40.938880 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T09:43:40.938915 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T09:43:40.938951 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T09:43:40.938986 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T09:43:40.939024 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T09:43:40.939060 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T09:43:40.939097 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T09:43:40.970658 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T09:43:40.970786 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T09:43:40.972850 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T09:43:40.974303 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T09:43:40.976071 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T09:43:40.977789 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T09:43:40.979325 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T09:43:40.980886 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 852 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T09:43:40.982627 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T09:43:40.984299 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T09:43:40.986012 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T09:43:40.987688 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T09:43:40.989357 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T09:43:40.991015 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T09:43:40.992561 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:43:40.992637 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:43:40.992693 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T09:43:40.994960 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202684000], Memory % [3.38], CPU Time [153357.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:43:40.995203 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79199], State: [ok], Delivered in [0.058466332] seconds [----] I, [2016-09-13T09:43:43.502517 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79197], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.719508209] seconds [----] I, [2016-09-13T09:43:43.502694 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79197], Delivering... [----] I, [2016-09-13T09:43:43.506277 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79197], State: [ok], Delivered in [0.003570725] seconds [----] I, [2016-09-13T09:43:45.552383 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:43:45.999879 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79200], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [11.157926387] seconds [----] I, [2016-09-13T09:43:46.000060 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79200], Delivering... [----] I, [2016-09-13T09:43:46.006925 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:43:32 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347777000], Memory % [5.04], CPU Time [105663.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T09:43:46.007527 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:43:39 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202684000], Memory % [3.38], CPU Time [152448.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:43:46.008017 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:43:39 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169744000], Memory % [3.14], CPU Time [52156.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:43:46.008484 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:43:39 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [213404000], Memory % [3.5], CPU Time [49324.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T09:43:46.009017 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:43:34 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [206035000], Memory % [3.5], CPU Time [242860.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T09:43:46.009546 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:43:38 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163148000], Memory % [3.1], CPU Time [38413.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T09:43:46.010022 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:43:37 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359293000], Memory % [5.28], CPU Time [205389.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:43:46.010515 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:43:39 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201168000], Memory % [3.36], CPU Time [153364.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:43:46.013295 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:43:35 UTC], Process Info: Memory Usage [622911488], Memory Size [1145794560], Proportional Set Size: [459128000], Memory % [7.59], CPU Time [438.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:43:46.015647 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:43:36 UTC], Process Info: Memory Usage [602071040], Memory Size [975331328], Proportional Set Size: [438414000], Memory % [7.34], CPU Time [161.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T09:43:46.016158 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:43:37 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358591000], Memory % [5.27], CPU Time [212631.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T09:43:46.016671 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:43:39 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178470000], Memory % [3.2], CPU Time [52153.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:43:46.017102 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:43:34 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166757000], Memory % [3.16], CPU Time [39318.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T09:43:46.017412 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79200], State: [ok], Delivered in [0.017350623] seconds [----] I, [2016-09-13T09:43:49.875647 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:43:49.890959 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79201], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:43:50.564453 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:43:51.108677 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79201], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.229018677] seconds [----] I, [2016-09-13T09:43:51.108818 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79201], Delivering... [----] I, [2016-09-13T09:43:51.112990 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022537708282470703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002269268035888672, :pending_vm_jobs=>0.0005035400390625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038979053497314453} [----] I, [2016-09-13T09:43:51.113245 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79201], State: [ok], Delivered in [0.004423032] seconds [----] I, [2016-09-13T09:43:56.936227 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.008476972579956055, :worker_monitor=>1.3470032215118408, :worker_dequeue=>0.011913776397705078, :total_time=>1.3678736686706543} [----] I, [2016-09-13T09:44:01.936954 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:44:01 UTC]... [----] I, [2016-09-13T09:44:01.953826 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:44:01 UTC]...Complete [----] I, [2016-09-13T09:44:04.901094 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:44:04.914944 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79202], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:44:04.925260 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79203], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:44:04.942488 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79204], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:44:04.959685 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79205], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:44:06.975950 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:44:07.240164 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79202], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.335272079] seconds [----] I, [2016-09-13T09:44:07.240365 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79202], Delivering... [----] I, [2016-09-13T09:44:07.280126 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79205], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.332287827] seconds [----] I, [2016-09-13T09:44:07.280297 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79205], Delivering... [----] I, [2016-09-13T09:44:07.285319 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028357505798339844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028519630432128906, :pending_vm_jobs=>0.0005733966827392578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004689693450927734} [----] I, [2016-09-13T09:44:07.285656 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79205], State: [ok], Delivered in [0.00535398] seconds [----] I, [2016-09-13T09:44:07.382440 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79202], State: [ok], Delivered in [0.14203915] seconds [----] I, [2016-09-13T09:44:07.594624 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79203], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.675004862] seconds [----] I, [2016-09-13T09:44:07.594925 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79203], Delivering... [----] I, [2016-09-13T09:44:07.613500 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79203], State: [ok], Delivered in [0.01855876] seconds [----] I, [2016-09-13T09:44:07.651847 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79204], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.720024364] seconds [----] I, [2016-09-13T09:44:07.652142 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79204], Delivering... [----] I, [2016-09-13T09:44:07.658024 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79204], State: [ok], Delivered in [0.005913333] seconds [----] I, [2016-09-13T09:44:13.479820 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0056934356689453125, :worker_monitor=>1.4856343269348145, :worker_dequeue=>0.009076595306396484, :total_time=>1.5008277893066406} [----] I, [2016-09-13T09:44:19.969956 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:44:19.987185 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79206], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:44:23.499115 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:44:24.479132 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79206], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.504732018] seconds [----] I, [2016-09-13T09:44:24.479300 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79206], Delivering... [----] I, [2016-09-13T09:44:24.484411 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002611398696899414, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026264190673828125, :pending_vm_jobs=>0.0007200241088867188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0047533512115478516} [----] I, [2016-09-13T09:44:24.484760 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79206], State: [ok], Delivered in [0.005469819] seconds [----] I, [2016-09-13T09:44:29.856309 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006016731262207031, :worker_monitor=>1.339651346206665, :worker_dequeue=>0.006975889205932617, :total_time=>1.3530569076538086} [----] I, [2016-09-13T09:44:34.856803 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:44:34 UTC]... [----] I, [2016-09-13T09:44:34.875982 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:44:34 UTC]...Complete [----] I, [2016-09-13T09:44:34.997289 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:44:35.011204 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79207], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:44:35.036987 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79208], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:44:40.017279 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:44:40.618196 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79208], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.601253215] seconds [----] I, [2016-09-13T09:44:40.618525 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79208], Delivering... [----] I, [2016-09-13T09:44:40.629155 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005246639251708984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005280017852783203, :pending_vm_jobs=>0.0015037059783935547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010042190551757812} [----] I, [2016-09-13T09:44:40.629663 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79208], State: [ok], Delivered in [0.011183848] seconds [----] I, [2016-09-13T09:44:40.709027 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79207], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.708909157] seconds [----] I, [2016-09-13T09:44:40.709255 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79207], Delivering... [----] I, [2016-09-13T09:44:40.714592 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79207], State: [ok], Delivered in [0.005314374] seconds [----] I, [2016-09-13T09:44:46.546315 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038819313049316406, :worker_monitor=>1.5132417678833008, :worker_dequeue=>0.006879568099975586, :total_time=>1.524256706237793} [----] I, [2016-09-13T09:44:50.052643 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:44:50.068649 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79209], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:44:51.558978 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T09:44:51.562465 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:44:51.680402 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79209], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.622053783] seconds [----] I, [2016-09-13T09:44:51.680656 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79209], Delivering... [----] I, [2016-09-13T09:44:51.687527 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036673545837402344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036873817443847656, :pending_vm_jobs=>0.0008618831634521484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006453514099121094} [----] I, [2016-09-13T09:44:51.687854 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79209], State: [ok], Delivered in [0.007196127] seconds [----] I, [2016-09-13T09:45:02.882240 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039751529693603516, :worker_monitor=>1.2896382808685303, :worker_dequeue=>0.008458614349365234, :total_time=>1.3024375438690186} [----] I, [2016-09-13T09:45:05.080095 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:45:05.091349 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79210], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:45:05.108936 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79211], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:45:05.161336 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79212], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:45:05.183141 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79213], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:45:07.882741 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:45:07 UTC]... [----] I, [2016-09-13T09:45:07.908780 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:45:07 UTC]...Complete [----] I, [2016-09-13T09:45:07.919873 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:45:08.835029 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79210], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.750538083] seconds [----] I, [2016-09-13T09:45:08.835231 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79210], Delivering... [----] I, [2016-09-13T09:45:08.851960 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79213], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.686248762] seconds [----] I, [2016-09-13T09:45:08.852125 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79213], Delivering... [----] I, [2016-09-13T09:45:08.857476 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028998851776123047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002916574478149414, :pending_vm_jobs=>0.0006923675537109375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0050237178802490234} [----] I, [2016-09-13T09:45:08.857744 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79213], State: [ok], Delivered in [0.005614659] seconds [----] I, [2016-09-13T09:45:08.934824 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79210], State: [ok], Delivered in [0.099552472] seconds [----] I, [2016-09-13T09:45:10.851222 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79211], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.754493496] seconds [----] I, [2016-09-13T09:45:10.851490 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79211], Delivering... [----] I, [2016-09-13T09:45:10.855756 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79211], State: [ok], Delivered in [0.004280653] seconds [----] I, [2016-09-13T09:45:10.869086 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79212], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.750411983] seconds [----] I, [2016-09-13T09:45:10.869270 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79212], Delivering... [----] I, [2016-09-13T09:45:10.873715 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79212], State: [ok], Delivered in [0.004448695] seconds [----] I, [2016-09-13T09:45:20.195262 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:45:20.320362 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79214], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:45:23.886183 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:45:24.001033 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79214], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.794826229] seconds [----] I, [2016-09-13T09:45:24.001283 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79214], Delivering... [----] I, [2016-09-13T09:45:24.008792 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004384279251098633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004456043243408203, :pending_vm_jobs=>0.0008273124694824219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007053852081298828} [----] I, [2016-09-13T09:45:24.009136 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79214], State: [ok], Delivered in [0.007867236] seconds [----] I, [2016-09-13T09:45:35.019010 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003930330276489258, :worker_monitor=>1.091925859451294, :worker_dequeue=>0.005634307861328125, :total_time=>1.101750135421753} [----] I, [2016-09-13T09:45:35.335197 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:45:35.360917 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79215], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:45:35.383265 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79216], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:45:40.019572 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:45:40 UTC]... [----] I, [2016-09-13T09:45:40.041348 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:45:40 UTC]...Complete [----] I, [2016-09-13T09:45:40.194845 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:45:40.966312 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79216], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.599292971] seconds [----] I, [2016-09-13T09:45:40.966526 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79216], Delivering... [----] I, [2016-09-13T09:45:40.973758 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003913402557373047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003934144973754883, :pending_vm_jobs=>0.0008893013000488281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006836414337158203} [----] I, [2016-09-13T09:45:40.974083 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79216], State: [ok], Delivered in [0.007553123] seconds [----] I, [2016-09-13T09:45:40.983592 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79215], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.634945711] seconds [----] I, [2016-09-13T09:45:40.983772 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79215], Delivering... [----] I, [2016-09-13T09:45:40.989277 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79215], State: [ok], Delivered in [0.005494357] seconds [----] I, [2016-09-13T09:45:50.398047 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:45:50.417652 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79217], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:45:51.721492 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:45:51.724524 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003400087356567383, :worker_monitor=>1.5000755786895752, :worker_dequeue=>0.007109880447387695, :total_time=>1.510866641998291} [----] I, [2016-09-13T09:45:52.291977 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79217], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.887480344] seconds [----] I, [2016-09-13T09:45:52.292108 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79217], Delivering... [----] I, [2016-09-13T09:45:52.296020 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021915435791015625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022034645080566406, :pending_vm_jobs=>0.00044155120849609375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0036554336547851562} [----] I, [2016-09-13T09:45:52.296228 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79217], State: [ok], Delivered in [0.0041174] seconds [----] I, [2016-09-13T09:46:05.760298 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:46:05.812179 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79218], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:46:05.824205 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79219], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:46:05.846327 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79220], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:46:05.863591 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79221], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:46:08.067968 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:46:08.070644 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004027605056762695, :worker_monitor=>1.3046069145202637, :worker_dequeue=>0.005884647369384766, :total_time=>1.3148736953735352} [----] I, [2016-09-13T09:46:08.108332 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79218], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.31439134] seconds [----] I, [2016-09-13T09:46:08.108547 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79218], Delivering... [----] I, [2016-09-13T09:46:08.131469 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79221], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.278423477] seconds [----] I, [2016-09-13T09:46:08.131684 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79221], Delivering... [----] I, [2016-09-13T09:46:08.138677 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035855770111083984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003690004348754883, :pending_vm_jobs=>0.0009615421295166016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006585836410522461} [----] I, [2016-09-13T09:46:08.139049 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79221], State: [ok], Delivered in [0.007362137] seconds [----] I, [2016-09-13T09:46:08.165573 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79218], State: [ok], Delivered in [0.057007323] seconds [----] I, [2016-09-13T09:46:08.182843 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79219], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.365009906] seconds [----] I, [2016-09-13T09:46:08.182964 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79219], Delivering... [----] I, [2016-09-13T09:46:08.185237 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79219], State: [ok], Delivered in [0.002261071] seconds [----] I, [2016-09-13T09:46:08.246038 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79220], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.412132652] seconds [----] I, [2016-09-13T09:46:08.246274 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79220], Delivering... [----] I, [2016-09-13T09:46:08.250580 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79220], State: [ok], Delivered in [0.004311977] seconds [----] I, [2016-09-13T09:46:13.071084 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:46:13 UTC]... [----] I, [2016-09-13T09:46:13.086879 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:46:13 UTC]...Complete [----] I, [2016-09-13T09:46:20.877546 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:46:20.898093 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79222], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:46:24.376528 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:46:24.380267 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037136077880859375, :worker_monitor=>1.2551205158233643, :worker_dequeue=>0.006258726119995117, :total_time=>1.2653236389160156} [----] I, [2016-09-13T09:46:24.400599 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79222], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.516352771] seconds [----] I, [2016-09-13T09:46:24.400802 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79222], Delivering... [----] I, [2016-09-13T09:46:24.407504 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033354759216308594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003386974334716797, :pending_vm_jobs=>0.0008745193481445312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062601566314697266} [----] I, [2016-09-13T09:46:24.407940 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79222], State: [ok], Delivered in [0.007136628] seconds [----] I, [2016-09-13T09:46:35.909752 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:46:35.920546 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79223], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:46:35.937809 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79224], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:46:40.777793 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:46:40.780270 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004393339157104492, :worker_monitor=>1.3617525100708008, :worker_dequeue=>0.005522966384887695, :total_time=>1.3719725608825684} [----] I, [2016-09-13T09:46:41.318847 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79224], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.392183566] seconds [----] I, [2016-09-13T09:46:41.319166 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79224], Delivering... [----] I, [2016-09-13T09:46:41.330365 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005864858627319336, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005899667739868164, :pending_vm_jobs=>0.0014598369598388672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010608673095703125} [----] I, [2016-09-13T09:46:41.330939 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79224], State: [ok], Delivered in [0.011762036] seconds [----] I, [2016-09-13T09:46:41.355961 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79223], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.442498401] seconds [----] I, [2016-09-13T09:46:41.356146 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79223], Delivering... [----] I, [2016-09-13T09:46:41.360900 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79223], State: [ok], Delivered in [0.004715926] seconds [----] I, [2016-09-13T09:46:45.780650 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:46:45 UTC]... [----] I, [2016-09-13T09:46:45.795280 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:46:45 UTC]...Complete [----] I, [2016-09-13T09:46:50.950392 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:46:50.966884 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79225], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:46:56.933346 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:46:56.938074 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0026760101318359375, :worker_monitor=>1.0368025302886963, :worker_dequeue=>0.008675575256347656, :total_time=>1.0483829975128174} [----] I, [2016-09-13T09:46:57.624991 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79225], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.668557704] seconds [----] I, [2016-09-13T09:46:57.625161 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79225], Delivering... [----] I, [2016-09-13T09:46:57.629811 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024929046630859375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025081634521484375, :pending_vm_jobs=>0.0005660057067871094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004371166229248047} [----] I, [2016-09-13T09:46:57.630076 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79225], State: [ok], Delivered in [0.004907866] seconds [----] I, [2016-09-13T09:47:05.978321 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:47:06.002606 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79226], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:47:06.024248 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79227], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:47:06.075617 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79228], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:47:06.098653 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79229], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:47:06.962278 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:47:07.733056 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79226], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.750841549] seconds [----] I, [2016-09-13T09:47:07.733217 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79226], Delivering... [----] I, [2016-09-13T09:47:07.750522 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79229], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.669536885] seconds [----] I, [2016-09-13T09:47:07.750797 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79229], Delivering... [----] I, [2016-09-13T09:47:07.761170 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005179882049560547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005217313766479492, :pending_vm_jobs=>0.0014078617095947266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009861469268798828} [----] I, [2016-09-13T09:47:07.761718 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79229], State: [ok], Delivered in [0.010915601] seconds [----] I, [2016-09-13T09:47:07.790048 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79226], State: [ok], Delivered in [0.056790949] seconds [----] I, [2016-09-13T09:47:08.449335 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79227], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.441754156] seconds [----] I, [2016-09-13T09:47:08.449751 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79227], Delivering... [----] I, [2016-09-13T09:47:08.455489 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79227], State: [ok], Delivered in [0.005679662] seconds [----] I, [2016-09-13T09:47:08.470034 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79228], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.439016772] seconds [----] I, [2016-09-13T09:47:08.470210 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79228], Delivering... [----] I, [2016-09-13T09:47:08.474334 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79228], State: [ok], Delivered in [0.004108231] seconds [----] I, [2016-09-13T09:47:13.116562 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005662441253662109, :worker_monitor=>1.1392123699188232, :worker_dequeue=>0.004921913146972656, :total_time=>1.1501877307891846} [----] I, [2016-09-13T09:47:18.117037 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:47:18 UTC]... [----] I, [2016-09-13T09:47:18.150309 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:47:18 UTC]...Complete [----] I, [2016-09-13T09:47:21.107944 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:47:21.133758 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79230], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:47:23.183987 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:47:23.515932 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79230], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.404142861] seconds [----] I, [2016-09-13T09:47:23.516090 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79230], Delivering... [----] I, [2016-09-13T09:47:23.521931 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029802322387695312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030007362365722656, :pending_vm_jobs=>0.0007815361022949219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005530595779418945} [----] I, [2016-09-13T09:47:23.522232 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79230], State: [ok], Delivered in [0.006137653] seconds [----] I, [2016-09-13T09:47:29.789519 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004337310791015625, :worker_monitor=>1.586841344833374, :worker_dequeue=>0.010903120040893555, :total_time=>1.6025314331054688} [----] I, [2016-09-13T09:47:36.144919 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:47:36.155692 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79231], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:47:36.167017 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79232], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:47:39.812896 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:47:40.018791 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79232], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.857343244] seconds [----] I, [2016-09-13T09:47:40.018923 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79232], Delivering... [----] I, [2016-09-13T09:47:40.022578 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0019567012786865234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0019681453704833984, :pending_vm_jobs=>0.00047779083251953125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0034487247467041016} [----] I, [2016-09-13T09:47:40.022822 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79232], State: [ok], Delivered in [0.003891884] seconds [----] I, [2016-09-13T09:47:41.573387 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79231], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.423822058] seconds [----] I, [2016-09-13T09:47:41.573636 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79231], Delivering... [----] I, [2016-09-13T09:47:41.577940 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79231], State: [ok], Delivered in [0.00429588] seconds [----] I, [2016-09-13T09:47:46.102075 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038759708404541016, :worker_monitor=>1.26481294631958, :worker_dequeue=>0.014758110046386719, :total_time=>1.2839064598083496} [----] I, [2016-09-13T09:47:51.102745 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:47:51 UTC]... [----] I, [2016-09-13T09:47:51.127349 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:47:51 UTC]...Complete [----] I, [2016-09-13T09:47:51.180909 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:47:51.208045 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79233], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:47:51.254465 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:47:52.128303 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79233], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.938253022] seconds [----] I, [2016-09-13T09:47:52.128541 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79233], Delivering... [----] I, [2016-09-13T09:47:52.134650 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031578540802001953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031883716583251953, :pending_vm_jobs=>0.0007913112640380859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005727052688598633} [----] I, [2016-09-13T09:47:52.134989 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79233], State: [ok], Delivered in [0.006456464] seconds [----] I, [2016-09-13T09:48:02.760828 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0026273727416992188, :worker_monitor=>1.4626951217651367, :worker_dequeue=>0.007288455963134766, :total_time=>1.4728436470031738} [----] I, [2016-09-13T09:48:06.226546 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:48:06.247611 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79234], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:48:06.272038 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79235], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:48:06.299161 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79236], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:48:06.327546 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79237], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:48:07.773772 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:48:08.290599 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79237], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.984954453] seconds [----] I, [2016-09-13T09:48:08.290816 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79237], Delivering... [----] I, [2016-09-13T09:48:08.295364 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79234], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.063449567] seconds [----] I, [2016-09-13T09:48:08.295709 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79234], Delivering... [----] I, [2016-09-13T09:48:08.312447 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004074811935424805, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004103422164916992, :pending_vm_jobs=>0.0010182857513427734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.02117156982421875} [----] I, [2016-09-13T09:48:08.313029 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79237], State: [ok], Delivered in [0.022201069] seconds [----] I, [2016-09-13T09:48:08.401916 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79234], State: [ok], Delivered in [0.106190989] seconds [----] I, [2016-09-13T09:48:08.674183 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79235], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.418489234] seconds [----] I, [2016-09-13T09:48:08.674385 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79235], Delivering... [----] I, [2016-09-13T09:48:08.676856 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79235], State: [ok], Delivered in [0.002465311] seconds [----] I, [2016-09-13T09:48:08.687304 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79236], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.406146769] seconds [----] I, [2016-09-13T09:48:08.687527 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79236], Delivering... [----] I, [2016-09-13T09:48:08.691260 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79236], State: [ok], Delivered in [0.00371809] seconds [----] I, [2016-09-13T09:48:19.180245 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0047724246978759766, :worker_monitor=>1.3787589073181152, :worker_dequeue=>0.005096912384033203, :total_time=>1.3889482021331787} [----] I, [2016-09-13T09:48:21.340481 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:48:21.356083 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79238], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:48:24.180725 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:48:24 UTC]... [----] I, [2016-09-13T09:48:24.201522 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:48:24 UTC]...Complete [----] I, [2016-09-13T09:48:24.207817 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:48:24.470536 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79238], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.124754741] seconds [----] I, [2016-09-13T09:48:24.470722 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79238], Delivering... [----] I, [2016-09-13T09:48:24.477083 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003223419189453125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032465457916259766, :pending_vm_jobs=>0.0008351802825927734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006008625030517578} [----] I, [2016-09-13T09:48:24.477485 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79238], State: [ok], Delivered in [0.006720826] seconds [----] I, [2016-09-13T09:48:36.370290 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T09:48:36.385021 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79239], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:48:36.402257 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79240], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:48:36.442532 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79241], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:48:36.482607 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79242], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:48:40.221666 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:48:40.648682 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79240], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.259594235] seconds [----] I, [2016-09-13T09:48:40.648849 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79240], Delivering... [----] I, [2016-09-13T09:48:40.655902 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003345966339111328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003368377685546875, :pending_vm_jobs=>0.0007054805755615234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006647348403930664} [----] I, [2016-09-13T09:48:40.656324 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79240], State: [ok], Delivered in [0.007444447] seconds [----] I, [2016-09-13T09:48:40.700184 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79241], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.293862052] seconds [----] I, [2016-09-13T09:48:40.700349 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79241], Delivering... [----] I, [2016-09-13T09:48:40.701462 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T09:48:40.701730 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4552392704 [----] I, [2016-09-13T09:48:40.701876 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4321329152 [----] I, [2016-09-13T09:48:40.702028 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 231063552 [----] I, [2016-09-13T09:48:40.702130 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T09:48:40.702199 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4267225088 [----] I, [2016-09-13T09:48:40.702269 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T09:48:40.702330 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T09:48:40.702400 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 552964096 [----] I, [2016-09-13T09:48:40.702521 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T09:48:40.702590 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6652039168 [----] I, [2016-09-13T09:48:40.702651 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T09:48:40.702714 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T09:48:40.702776 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T09:48:40.702840 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 24576 [----] I, [2016-09-13T09:48:40.702927 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T09:48:40.702996 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T09:48:40.703060 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T09:48:40.703126 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T09:48:40.703185 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T09:48:40.703268 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T09:48:40.703338 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 274018304 [----] I, [2016-09-13T09:48:40.703402 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57196544 [----] I, [2016-09-13T09:48:40.703552 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216821760 [----] I, [2016-09-13T09:48:40.703637 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6094848 [----] I, [2016-09-13T09:48:40.703709 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142262272 [----] I, [2016-09-13T09:48:40.703773 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3400957952 [----] I, [2016-09-13T09:48:40.703833 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3074904064 [----] I, [2016-09-13T09:48:40.703910 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T09:48:40.703976 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T09:48:40.704046 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T09:48:40.704108 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36626432 [----] I, [2016-09-13T09:48:40.704171 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T09:48:40.704235 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53571584 [----] I, [2016-09-13T09:48:40.704296 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111300608 [----] I, [2016-09-13T09:48:40.704356 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155869184 [----] I, [2016-09-13T09:48:40.704451 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T09:48:40.704538 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T09:48:40.704603 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T09:48:40.704664 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T09:48:40.704728 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T09:48:40.704798 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T09:48:40.704861 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T09:48:40.704920 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T09:48:40.704983 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T09:48:40.741452 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T09:48:40.741662 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T09:48:40.745040 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T09:48:40.747649 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T09:48:40.750633 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T09:48:40.753527 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T09:48:40.756353 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T09:48:40.759232 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 852 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T09:48:40.762030 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T09:48:40.765077 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T09:48:40.767913 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T09:48:40.770654 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T09:48:40.773502 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T09:48:40.776326 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T09:48:40.779105 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:48:40.779288 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:48:40.779395 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T09:48:40.783616 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359293000], Memory % [5.28], CPU Time [152501.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:48:40.784002 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79241], State: [ok], Delivered in [0.083609944] seconds [----] I, [2016-09-13T09:48:41.763223 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79239], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.389191637] seconds [----] I, [2016-09-13T09:48:41.763556 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79239], Delivering... [----] I, [2016-09-13T09:48:41.771951 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79239], State: [ok], Delivered in [0.008379893] seconds [----] I, [2016-09-13T09:48:45.231984 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:48:45.825767 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79242], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [9.378900712] seconds [----] I, [2016-09-13T09:48:45.825947 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79242], Delivering... [----] I, [2016-09-13T09:48:45.833589 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:48:34 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169744000], Memory % [3.14], CPU Time [52170.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:48:45.834163 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:48:21 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [206035000], Memory % [3.5], CPU Time [243011.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T09:48:45.834681 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:48:27 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [213404000], Memory % [3.5], CPU Time [49351.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T09:48:45.835106 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:48:32 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347777000], Memory % [5.04], CPU Time [105680.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T09:48:45.835625 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:48:32 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359293000], Memory % [5.28], CPU Time [205423.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:48:45.836125 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:48:32 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163148000], Memory % [3.1], CPU Time [38422.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T09:48:45.836644 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:48:34 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202684000], Memory % [3.38], CPU Time [152513.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:48:45.837089 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:48:34 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201168000], Memory % [3.36], CPU Time [153423.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:48:45.840064 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:48:26 UTC], Process Info: Memory Usage [601366528], Memory Size [932499456], Proportional Set Size: [438406000], Memory % [7.33], CPU Time [544.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:48:45.842279 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:48:26 UTC], Process Info: Memory Usage [601554944], Memory Size [945594368], Proportional Set Size: [438212000], Memory % [7.33], CPU Time [211.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T09:48:45.842829 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:48:32 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358591000], Memory % [5.27], CPU Time [212665.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T09:48:45.843338 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:48:34 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178470000], Memory % [3.2], CPU Time [52167.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:48:45.843845 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:48:34 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166757000], Memory % [3.16], CPU Time [39327.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T09:48:45.844174 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79242], State: [ok], Delivered in [0.01822103] seconds [----] I, [2016-09-13T09:48:51.242334 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0024857521057128906, :worker_monitor=>0.9960567951202393, :worker_dequeue=>0.008727312088012695, :total_time=>1.0075247287750244} [----] I, [2016-09-13T09:48:51.494868 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:48:51.510762 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79243], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:48:56.242796 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:48:56 UTC]... [----] I, [2016-09-13T09:48:56.281876 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:48:56 UTC]...Complete [----] I, [2016-09-13T09:48:56.376780 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:48:56.831223 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79243], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.33048133] seconds [----] I, [2016-09-13T09:48:56.831468 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79243], Delivering... [----] I, [2016-09-13T09:48:56.838076 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034017562866210938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003446340560913086, :pending_vm_jobs=>0.0008461475372314453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006169795989990234} [----] I, [2016-09-13T09:48:56.838558 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79243], State: [ok], Delivered in [0.007118126] seconds [----] I, [2016-09-13T09:49:06.523064 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 14. [----] I, [2016-09-13T09:49:06.539520 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79244], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:49:06.556761 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79245], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:49:06.579732 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79246], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:49:06.610149 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79247], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:49:06.653906 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79248], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:49:08.130646 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:49:08.135167 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004323482513427734, :worker_monitor=>1.716423511505127, :worker_dequeue=>0.009737730026245117, :total_time=>1.7307813167572021} [----] I, [2016-09-13T09:49:08.882935 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79244], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.353068427] seconds [----] I, [2016-09-13T09:49:08.883177 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79244], Delivering... [----] I, [2016-09-13T09:49:08.910938 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79247], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.323392649] seconds [----] I, [2016-09-13T09:49:08.911128 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79247], Delivering... [----] I, [2016-09-13T09:49:08.918460 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004016399383544922, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004037618637084961, :pending_vm_jobs=>0.0008072853088378906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068454742431640625} [----] I, [2016-09-13T09:49:08.918859 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79247], State: [ok], Delivered in [0.007721294] seconds [----] I, [2016-09-13T09:49:08.956949 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79245], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.411863333] seconds [----] I, [2016-09-13T09:49:08.957137 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79245], Delivering... [----] I, [2016-09-13T09:49:08.960442 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79245], State: [ok], Delivered in [0.003256625] seconds [----] I, [2016-09-13T09:49:08.962399 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79244], State: [ok], Delivered in [0.07919649] seconds [----] I, [2016-09-13T09:49:09.008590 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79246], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.443513045] seconds [----] I, [2016-09-13T09:49:09.008782 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79246], Delivering... [----] I, [2016-09-13T09:49:09.013878 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79246], State: [ok], Delivered in [0.005081776] seconds [----] I, [2016-09-13T09:49:09.025735 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79248], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.39156561] seconds [----] I, [2016-09-13T09:49:09.025918 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79248], Delivering... [----] I, [2016-09-13T09:49:09.060051 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79249], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T09:49:09.060515 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79248], State: [ok], Delivered in [0.034531809] seconds [----] I, [2016-09-13T09:49:13.152368 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T09:49:17.078144 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [79249], MiqWorker id: [102], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [8.036183441] seconds [----] I, [2016-09-13T09:49:17.078514 #17546:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79249], Delivering... [----] I, [2016-09-13T09:49:17.084198 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T09:49:17.084525 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T09:49:17.084786 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T09:49:17.085087 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T09:49:17.085347 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:17.560342 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:17.888376 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:17.888658 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:18.386270 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:18.759675 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:18.759801 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:19.256238 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:19.565402 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:19.565635 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:20.111102 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:20.419163 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:20.419356 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:20.914663 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:21.215212 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:21.215386 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:21.668872 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:49:21.694949 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:21.722546 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79250], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:49:21.773960 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79251], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:49:24.528833 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:49:24.536164 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00390625, :worker_monitor=>1.3407645225524902, :worker_dequeue=>0.016168832778930664, :total_time=>1.3611838817596436} [----] I, [2016-09-13T09:49:25.088335 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79250], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.413575813] seconds [----] I, [2016-09-13T09:49:25.088486 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79250], Delivering... [----] I, [2016-09-13T09:49:25.092290 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022134780883789062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022246837615966797, :pending_vm_jobs=>0.00040721893310546875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0035614967346191406} [----] I, [2016-09-13T09:49:25.092540 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79250], State: [ok], Delivered in [0.004056439] seconds [----] I, [2016-09-13T09:49:27.128520 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79251], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.400965053] seconds [----] I, [2016-09-13T09:49:27.128690 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79251], Delivering... [----] I, [2016-09-13T09:49:27.206441 #2937:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 13:49:24 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_17' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 13:49:24.532818') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2927,,2016-09-13 13:49:26 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2936,,2016-09-13 13:49:27 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2946,2016-09-13 13:49:27 UTC,2016-09-13 13:49:27 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 13:49:26 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2966,,2016-09-13 13:49:27 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 13:49:25 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2986,,2016-09-13 13:49:25 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2997,,2016-09-13 13:49:21 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 13:49:06.663645')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5, 3011,,2016-09-13 13:25:34 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1433, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,516722, 3030,,2016-09-13 13:41:26 UTC,SELECT 1,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,480, 3054,,2016-09-13 13:49:25 UTC,"SELECT ""miq_groups"".""description"" FROM ""miq_groups"" INNER JOIN ""miq_groups_users"" ON ""miq_groups"".""id"" = ""miq_groups_users"".""miq_group_id"" WHERE ""miq_groups_users"".""user_id"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,516720, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,516719, 3160,,2016-09-13 13:41:22 UTC,SELECT 1,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,484, 17554,,2016-09-13 13:49:17 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,10, 17563,,2016-09-13 13:29:45 UTC,"SELECT ""miq_servers"".* FROM ""miq_servers"" WHERE ""miq_servers"".""id"" = $1 LIMIT $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1181, 27056,,2016-09-13 13:48:25 UTC,"SELECT ""miq_groups"".""description"" FROM ""miq_groups"" INNER JOIN ""miq_groups_users"" ON ""miq_groups"".""id"" = ""miq_groups_users"".""miq_group_id"" WHERE ""miq_groups_users"".""user_id"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,61, 28888,,2016-09-13 13:41:23 UTC,"SELECT ""ext_management_systems"".""id"" FROM ""ext_management_systems"" WHERE ""ext_management_systems"".""type"" IN ('ManageIQ::Providers::Openstack::InfraManager')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,484, ACTIVITY_STATS_CSV [----] I, [2016-09-13T09:49:27.206860 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79251], State: [ok], Delivered in [0.078126684] seconds [----] I, [2016-09-13T09:49:28.041986 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:28.042159 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:28.559727 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:28.867747 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:28.868067 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:29.365087 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:29.536695 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:49:29 UTC]... [----] I, [2016-09-13T09:49:29.552500 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:49:29 UTC]...Complete [----] I, [2016-09-13T09:49:29.680697 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:29.680854 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:30.144719 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:30.525134 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:30.525308 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:31.066585 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:31.384014 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:31.384187 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:31.882632 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:32.195100 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:32.195294 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:32.684978 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:32.996646 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:32.996831 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:33.485316 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:33.811856 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:33.812039 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:34.345000 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:34.511173 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:34.671186 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:34.827975 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:34.967264 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:35.111347 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:35.254511 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:35.394459 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:35.546599 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:35.708347 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:35.862000 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:36.003522 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:36.142819 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:36.279143 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:36.418599 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:36.785642 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:49:36.825498 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79252], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:49:36.842566 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79253], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:49:36.905318 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:37.076776 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:37.235025 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:37.391926 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:37.543175 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:37.705721 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:37.858864 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:38.024086 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:38.180111 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:38.334549 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:38.494752 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:38.646284 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:38.792949 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:41.016728 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:49:41.020014 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004076719284057617, :worker_monitor=>1.4308838844299316, :worker_dequeue=>0.007119178771972656, :total_time=>1.442366600036621} [----] I, [2016-09-13T09:49:41.238553 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79253], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.409578042] seconds [----] I, [2016-09-13T09:49:41.238697 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79253], Delivering... [----] I, [2016-09-13T09:49:41.243595 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00266265869140625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002677440643310547, :pending_vm_jobs=>0.0005557537078857422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004618644714355469} [----] I, [2016-09-13T09:49:41.243890 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79253], State: [ok], Delivered in [0.005168187] seconds [----] I, [2016-09-13T09:49:42.163699 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79252], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.373840822] seconds [----] I, [2016-09-13T09:49:42.163977 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79252], Delivering... [----] I, [2016-09-13T09:49:42.170371 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79252], State: [ok], Delivered in [0.00638903] seconds [----] I, [2016-09-13T09:49:45.237202 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:45.411951 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:45.554663 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:45.705009 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:46.083313 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:46.230805 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:46.383281 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:46.520181 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:46.666320 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:46.816144 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:46.957212 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:47.361614 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:47.505720 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:47.648397 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:47.788496 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:47.930096 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:48.072891 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:48.208629 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:48.344497 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:48.484997 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:48.625287 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:49.194404 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:49.366191 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:49.523955 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:49.661468 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:49.807630 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:49.977229 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:50.220837 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:50.363228 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:50.501369 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:50.640338 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:50.805829 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:50.943668 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:51.086215 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:51.228740 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:51.376042 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:51.519853 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:51.656010 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:51.852509 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:49:51.900502 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79254], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:49:52.191027 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:52.347808 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:52.486765 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:52.627535 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:52.778714 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:52.927519 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:53.069024 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:53.203175 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:53.367323 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:53.501745 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:53.640870 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:53.779702 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:53.919916 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:54.072454 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:54.217589 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:54.362243 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:54.516693 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:54.930895 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:55.091073 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:55.228006 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:55.367140 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:55.511877 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:55.652679 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:55.798013 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:49:56.066374 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T09:49:57.233601 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:49:57.235986 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0032958984375, :log_active_servers=>0.009203433990478516, :worker_monitor=>1.163902997970581, :worker_dequeue=>0.005419015884399414, :total_time=>1.1821863651275635} [----] I, [2016-09-13T09:49:57.277602 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79254], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.415868383] seconds [----] I, [2016-09-13T09:49:57.277828 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79254], Delivering... [----] I, [2016-09-13T09:49:57.284237 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003493785858154297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003513336181640625, :pending_vm_jobs=>0.0007364749908447266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005991458892822266} [----] I, [2016-09-13T09:49:57.284629 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79254], State: [ok], Delivered in [0.006790056] seconds [----] I, [2016-09-13T09:50:01.959246 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:02.092931 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:02.236518 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:50:02 UTC]... [----] I, [2016-09-13T09:50:02.236518 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:02.260328 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:50:02 UTC]...Complete [----] I, [2016-09-13T09:50:02.375558 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:02.519034 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:02.674892 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:02.823741 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:02.964679 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:03.120949 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:03.272330 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:03.681316 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:03.834431 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:03.969447 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:04.106513 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:04.252479 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:04.393628 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:04.529076 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:04.663849 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:04.801767 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:04.936020 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:05.083622 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:05.221969 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:05.361801 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:05.500358 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:05.643969 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:05.814457 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:05.992157 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:06.449873 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:06.592749 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:06.741080 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:06.889449 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:06.917309 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 9. [----] I, [2016-09-13T09:50:06.934584 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79255], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:50:06.960258 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79256], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:50:06.985948 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79257], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:50:07.003113 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79258], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:50:07.020260 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79259], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:50:07.037677 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79260], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:50:07.043568 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:07.065936 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79261], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:50:07.106393 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79262], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:50:07.128903 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79263], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:50:07.199284 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:07.345182 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:07.384968 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 9 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:50:07.447865 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79255], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.526092602] seconds [----] I, [2016-09-13T09:50:07.448147 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79255], Delivering... [----] I, [2016-09-13T09:50:07.489331 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79258], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.49766068] seconds [----] I, [2016-09-13T09:50:07.489501 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79258], Delivering... [----] I, [2016-09-13T09:50:07.490739 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:07.494516 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79255], State: [ok], Delivered in [0.046291523] seconds [----] I, [2016-09-13T09:50:07.495588 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031805038452148438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003198385238647461, :pending_vm_jobs=>0.0007815361022949219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057525634765625} [----] I, [2016-09-13T09:50:07.495933 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79258], State: [ok], Delivered in [0.006417227] seconds [----] I, [2016-09-13T09:50:07.645154 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:08.070553 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:08.211003 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:08.352884 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:08.496982 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:08.637187 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:08.792814 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:08.943732 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:09.086677 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:09.346230 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79256], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.404195795] seconds [----] I, [2016-09-13T09:50:09.346445 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79256], Delivering... [----] I, [2016-09-13T09:50:09.349110 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79256], State: [ok], Delivered in [0.002687172] seconds [----] I, [2016-09-13T09:50:09.386162 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79257], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.416578411] seconds [----] I, [2016-09-13T09:50:09.386376 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79257], Delivering... [----] I, [2016-09-13T09:50:09.390958 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79257], State: [ok], Delivered in [0.004568128] seconds [----] I, [2016-09-13T09:50:09.391628 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79259], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.384104564] seconds [----] I, [2016-09-13T09:50:09.391767 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79259], Delivering... [----] I, [2016-09-13T09:50:09.409710 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79264], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 13:50:09 UTC] [----] I, [2016-09-13T09:50:09.414380 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79260], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.389853751] seconds [----] I, [2016-09-13T09:50:09.414593 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79260], Delivering... [----] I, [2016-09-13T09:50:09.432307 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79265], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 13:50:09 UTC] [----] I, [2016-09-13T09:50:09.432775 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79259], State: [ok], Delivered in [0.040970398] seconds [----] I, [2016-09-13T09:50:09.443999 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79266], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 13:50:09 UTC] [----] I, [2016-09-13T09:50:09.483364 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79267], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 13:50:09 UTC] [----] I, [2016-09-13T09:50:09.483700 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79260], State: [ok], Delivered in [0.069106431] seconds [----] I, [2016-09-13T09:50:09.495063 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79261], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.450167856] seconds [----] I, [2016-09-13T09:50:09.495298 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79261], Delivering... [----] I, [2016-09-13T09:50:09.498211 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79261], State: [ok], Delivered in [0.002911469] seconds [----] I, [2016-09-13T09:50:09.577049 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79262], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.505306974] seconds [----] I, [2016-09-13T09:50:09.577320 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79262], Delivering... [----] I, [2016-09-13T09:50:09.580591 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79263], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.464616231] seconds [----] I, [2016-09-13T09:50:09.580808 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79263], Delivering... [----] I, [2016-09-13T09:50:09.589352 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79263], State: [ok], Delivered in [0.008520081] seconds [----] I, [2016-09-13T09:50:09.590474 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79262], State: [ok], Delivered in [0.013122587] seconds [----] I, [2016-09-13T09:50:09.620317 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:09.780545 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:09.926789 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:10.073684 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:10.214853 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:10.357510 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:10.504089 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:10.637895 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:10.775508 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:10.926395 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:11.077253 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:11.212739 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:11.356373 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:11.493819 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:11.643292 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:11.803913 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:11.944675 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:12.293569 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:12.452097 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:12.594462 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:12.746314 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:13.555929 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:50:13.563524 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0026009082794189453, :worker_monitor=>1.1517512798309326, :worker_dequeue=>0.020516633987426758, :total_time=>1.1751384735107422} [----] I, [2016-09-13T09:50:15.649544 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79264], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 13:50:09 UTC], Dequeued in: [6.252061076] seconds [----] I, [2016-09-13T09:50:15.649672 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79264], Delivering... [----] I, [2016-09-13T09:50:15.649905 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 13:50:09 UTC]... [----] I, [2016-09-13T09:50:15.651616 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T09:50:15.653012 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 13:50:09 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T09:50:15.653202 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79264], State: [ok], Delivered in [0.003524883] seconds [----] I, [2016-09-13T09:50:15.661290 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79265], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 13:50:09 UTC], Dequeued in: [6.24253481] seconds [----] I, [2016-09-13T09:50:15.661586 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79265], Delivering... [----] I, [2016-09-13T09:50:15.662074 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 13:50:09 UTC]... [----] I, [2016-09-13T09:50:15.666262 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T09:50:15.669495 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 13:50:09 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T09:50:15.669904 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79265], State: [ok], Delivered in [0.008320577] seconds [----] I, [2016-09-13T09:50:15.717350 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79266], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 13:50:09 UTC], Dequeued in: [6.294227007] seconds [----] I, [2016-09-13T09:50:15.717478 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79266], Delivering... [----] I, [2016-09-13T09:50:15.717673 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 13:50:09 UTC]... [----] I, [2016-09-13T09:50:15.719241 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T09:50:15.729981 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79267], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 13:50:09 UTC], Dequeued in: [6.277368033] seconds [----] I, [2016-09-13T09:50:15.730242 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79267], Delivering... [----] I, [2016-09-13T09:50:15.730687 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 13:50:09 UTC]... [----] I, [2016-09-13T09:50:15.734447 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T09:50:15.763321 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 13:50:09 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T09:50:15.763608 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79266], State: [ok], Delivered in [0.046120078] seconds [----] I, [2016-09-13T09:50:15.809962 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 13:50:09 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T09:50:15.810324 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79267], State: [ok], Delivered in [0.080096919] seconds [----] I, [2016-09-13T09:50:18.900865 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:19.046013 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:19.192680 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:19.334283 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:19.474651 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:19.619354 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:19.764292 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:19.913937 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:20.077118 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:20.225209 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:20.374653 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:20.515654 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:20.658577 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:21.014177 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:21.187303 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:21.325555 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:21.477055 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:21.615990 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:21.762275 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:21.923205 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:22.129763 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:22.143305 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:50:22.164710 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79268], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:50:22.282372 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:22.422566 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:22.567154 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:22.744092 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:22.883571 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:23.035592 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:23.181169 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:23.328669 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:23.495566 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:23.586886 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:50:23.638878 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79268], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.4883724] seconds [----] I, [2016-09-13T09:50:23.638999 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79268], Delivering... [----] I, [2016-09-13T09:50:23.642647 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020182132720947266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020294189453125, :pending_vm_jobs=>0.00045418739318847656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003439188003540039} [----] I, [2016-09-13T09:50:23.642882 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79268], State: [ok], Delivered in [0.003878669] seconds [----] I, [2016-09-13T09:50:23.991107 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:24.156980 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:24.308202 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:24.466086 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:24.606790 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:24.743987 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:24.898657 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:25.047383 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:25.193108 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:25.330203 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:25.478599 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:25.619402 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:25.772387 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:25.910109 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:26.069764 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:26.220686 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:26.366569 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:26.960264 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:27.148526 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:27.316490 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:27.463659 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:27.660469 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:27.851303 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:28.015213 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:28.194012 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:28.348603 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:28.500572 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:28.655226 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:28.825505 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:28.972853 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:29.119209 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:29.302656 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:29.484954 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:29.626342 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:29.890469 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0058269500732421875, :worker_monitor=>1.2823302745819092, :worker_dequeue=>0.01024317741394043, :total_time=>1.2988042831420898} [----] I, [2016-09-13T09:50:30.066046 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:34.891004 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:50:34 UTC]... [----] I, [2016-09-13T09:50:34.907563 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:50:34 UTC]...Complete [----] I, [2016-09-13T09:50:36.245099 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:36.391230 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:36.554547 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:36.718625 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:36.861157 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:37.023042 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:37.168131 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:37.178635 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:50:37.207193 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79269], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:50:37.250603 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79270], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:50:37.334393 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:37.480226 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:37.658778 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:37.852882 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:37.996131 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:38.159331 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:38.331574 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:38.490253 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T09:50:38.674934 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T09:50:38.888012 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T09:50:38.888354 #17546:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T09:50:38.888680 #17546:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T09:50:38.888801 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T09:50:38.888908 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T09:50:38.913323 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T09:50:38.913708 #17546:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [79249], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T09:50:38.913897 #17546:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T09:50:38.914117 #17546:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T09:50:38.914374 #17546:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79249], State: [error], Delivered in [81.835929665] seconds [----] I, [2016-09-13T09:50:39.936608 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:50:40.737563 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79270], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.522003039] seconds [----] I, [2016-09-13T09:50:40.737732 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79270], Delivering... [----] I, [2016-09-13T09:50:40.743312 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002849102020263672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028748512268066406, :pending_vm_jobs=>0.0008976459503173828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005269050598144531} [----] I, [2016-09-13T09:50:40.743619 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79270], State: [ok], Delivered in [0.005894182] seconds [----] I, [2016-09-13T09:50:42.948003 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79269], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.760542846] seconds [----] I, [2016-09-13T09:50:42.948195 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79269], Delivering... [----] I, [2016-09-13T09:50:42.952644 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79269], State: [ok], Delivered in [0.004443438] seconds [----] I, [2016-09-13T09:50:46.501085 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039691925048828125, :worker_monitor=>1.541572093963623, :worker_dequeue=>0.011942863464355469, :total_time=>1.5578100681304932} [----] I, [2016-09-13T09:50:52.263315 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:50:52.281048 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79271], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:50:56.532104 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:50:56.902480 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79271], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.63133497] seconds [----] I, [2016-09-13T09:50:56.902671 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79271], Delivering... [----] I, [2016-09-13T09:50:56.910561 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004922628402709961, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004942893981933594, :pending_vm_jobs=>0.0006778240203857422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068738460540771484} [----] I, [2016-09-13T09:50:56.912088 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79271], State: [ok], Delivered in [0.009388099] seconds [----] I, [2016-09-13T09:51:02.843060 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003856182098388672, :worker_monitor=>1.2946431636810303, :worker_dequeue=>0.007363557815551758, :total_time=>1.3061351776123047} [----] I, [2016-09-13T09:51:07.296396 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:51:07.324739 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79272], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:51:07.347667 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79273], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:51:07.376195 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79274], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:51:07.399164 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79275], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:51:07.843563 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:51:07 UTC]... [----] I, [2016-09-13T09:51:07.862831 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:51:07 UTC]...Complete [----] I, [2016-09-13T09:51:07.981625 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:51:08.016947 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79272], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.716663506] seconds [----] I, [2016-09-13T09:51:08.017183 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79272], Delivering... [----] I, [2016-09-13T09:51:08.073487 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79272], State: [ok], Delivered in [0.056233058] seconds [----] I, [2016-09-13T09:51:08.126648 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79275], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.746100495] seconds [----] I, [2016-09-13T09:51:08.126892 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79275], Delivering... [----] I, [2016-09-13T09:51:08.134642 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004673004150390625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004752635955810547, :pending_vm_jobs=>0.0008196830749511719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007283210754394531} [----] I, [2016-09-13T09:51:08.134992 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79275], State: [ok], Delivered in [0.00810425] seconds [----] I, [2016-09-13T09:51:10.016470 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79273], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.687261479] seconds [----] I, [2016-09-13T09:51:10.016617 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79273], Delivering... [----] I, [2016-09-13T09:51:10.019217 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79273], State: [ok], Delivered in [0.002595027] seconds [----] I, [2016-09-13T09:51:10.050595 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79274], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.697272498] seconds [----] I, [2016-09-13T09:51:10.050717 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79274], Delivering... [----] I, [2016-09-13T09:51:10.054189 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79274], State: [ok], Delivered in [0.003464569] seconds [----] I, [2016-09-13T09:51:19.257263 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004014015197753906, :worker_monitor=>1.2358601093292236, :worker_dequeue=>0.00955820083618164, :total_time=>1.2497563362121582} [----] I, [2016-09-13T09:51:22.410122 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:51:22.429917 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79276], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:51:24.264357 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:51:25.041803 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79276], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.625930978] seconds [----] I, [2016-09-13T09:51:25.042089 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79276], Delivering... [----] I, [2016-09-13T09:51:25.052529 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0052378177642822266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005278825759887695, :pending_vm_jobs=>0.0013773441314697266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00971841812133789} [----] I, [2016-09-13T09:51:25.053022 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79276], State: [ok], Delivered in [0.010921494] seconds [----] I, [2016-09-13T09:51:35.572141 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0058825016021728516, :worker_monitor=>1.2812342643737793, :worker_dequeue=>0.009047985076904297, :total_time=>1.2965431213378906} [----] I, [2016-09-13T09:51:37.443222 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:51:37.485886 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79277], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:51:37.519152 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79278], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:51:40.572605 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:51:40 UTC]... [----] I, [2016-09-13T09:51:40.587888 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:51:40 UTC]...Complete [----] I, [2016-09-13T09:51:40.599986 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:51:41.188513 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79278], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.69882332] seconds [----] I, [2016-09-13T09:51:41.188793 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79278], Delivering... [----] I, [2016-09-13T09:51:41.198039 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004815340042114258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0048410892486572266, :pending_vm_jobs=>0.001127004623413086, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008789777755737305} [----] I, [2016-09-13T09:51:41.198553 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79278], State: [ok], Delivered in [0.009769197] seconds [----] I, [2016-09-13T09:51:43.165692 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79277], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.717868737] seconds [----] I, [2016-09-13T09:51:43.165927 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79277], Delivering... [----] I, [2016-09-13T09:51:43.172053 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79277], State: [ok], Delivered in [0.006113667] seconds [----] I, [2016-09-13T09:51:51.785959 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0028443336486816406, :worker_monitor=>1.148822546005249, :worker_dequeue=>0.010463237762451172, :total_time=>1.1623899936676025} [----] I, [2016-09-13T09:51:52.528973 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:51:52.555378 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79279], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:51:56.793984 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:51:57.407156 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79279], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.871974886] seconds [----] I, [2016-09-13T09:51:57.407493 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79279], Delivering... [----] I, [2016-09-13T09:51:57.416124 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004220008850097656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004249095916748047, :pending_vm_jobs=>0.0016562938690185547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008140325546264648} [----] I, [2016-09-13T09:51:57.416525 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79279], State: [ok], Delivered in [0.009098868] seconds [----] I, [2016-09-13T09:52:07.567605 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:52:07.576691 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79280], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:52:07.587886 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79281], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:52:07.599617 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79282], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:52:07.610719 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79283], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:52:07.733691 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:52:08.520110 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79280], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.948298248] seconds [----] I, [2016-09-13T09:52:08.520301 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79280], Delivering... [----] I, [2016-09-13T09:52:08.555014 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79283], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.949966944] seconds [----] I, [2016-09-13T09:52:08.555159 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79283], Delivering... [----] I, [2016-09-13T09:52:08.559148 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022513866424560547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022640228271484375, :pending_vm_jobs=>0.00045990943908691406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003712177276611328} [----] I, [2016-09-13T09:52:08.559429 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79283], State: [ok], Delivered in [0.004232734] seconds [----] I, [2016-09-13T09:52:08.577125 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79280], State: [ok], Delivered in [0.056790154] seconds [----] I, [2016-09-13T09:52:10.297167 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79281], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.714730379] seconds [----] I, [2016-09-13T09:52:10.297469 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79281], Delivering... [----] I, [2016-09-13T09:52:10.301234 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79281], State: [ok], Delivered in [0.003832155] seconds [----] I, [2016-09-13T09:52:10.371611 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79282], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.777589807] seconds [----] I, [2016-09-13T09:52:10.371849 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79282], Delivering... [----] I, [2016-09-13T09:52:10.377750 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79282], State: [ok], Delivered in [0.005882546] seconds [----] I, [2016-09-13T09:52:12.738111 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:52:12 UTC]... [----] I, [2016-09-13T09:52:12.753673 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:52:12 UTC]...Complete [----] I, [2016-09-13T09:52:22.621614 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:52:22.639831 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79284], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:52:24.211771 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:52:24.214069 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005483388900756836, :worker_monitor=>1.3463451862335205, :worker_dequeue=>0.005828857421875, :total_time=>1.3580338954925537} [----] I, [2016-09-13T09:52:25.092391 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79284], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.464765652] seconds [----] I, [2016-09-13T09:52:25.092607 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79284], Delivering... [----] I, [2016-09-13T09:52:25.098622 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030715465545654297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003090381622314453, :pending_vm_jobs=>0.0007448196411132812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005686759948730469} [----] I, [2016-09-13T09:52:25.098954 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79284], State: [ok], Delivered in [0.006339665] seconds [----] I, [2016-09-13T09:52:37.651946 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:52:37.668382 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79285], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:52:37.691298 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79286], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:52:40.459610 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:52:40.462516 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004388093948364258, :worker_monitor=>1.2071154117584229, :worker_dequeue=>0.007287502288818359, :total_time=>1.2191758155822754} [----] I, [2016-09-13T09:52:40.622799 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79286], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.948848914] seconds [----] I, [2016-09-13T09:52:40.622945 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79286], Delivering... [----] I, [2016-09-13T09:52:40.627233 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00238037109375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023946762084960938, :pending_vm_jobs=>0.0004916191101074219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0040242671966552734} [----] I, [2016-09-13T09:52:40.627472 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79286], State: [ok], Delivered in [0.004524029] seconds [----] I, [2016-09-13T09:52:40.662776 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79285], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.006461825] seconds [----] I, [2016-09-13T09:52:40.662907 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79285], Delivering... [----] I, [2016-09-13T09:52:40.668019 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79285], State: [ok], Delivered in [0.00507907] seconds [----] I, [2016-09-13T09:52:45.462975 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:52:45 UTC]... [----] I, [2016-09-13T09:52:45.475102 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:52:45 UTC]...Complete [----] I, [2016-09-13T09:52:52.705211 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:52:52.732063 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79287], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:52:57.180944 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:52:57.185310 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040569305419921875, :worker_monitor=>1.6741828918457031, :worker_dequeue=>0.009279489517211914, :total_time=>1.6878623962402344} [----] I, [2016-09-13T09:52:57.355670 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79287], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.641920437] seconds [----] I, [2016-09-13T09:52:57.355896 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79287], Delivering... [----] I, [2016-09-13T09:52:57.363490 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00385284423828125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003880739212036133, :pending_vm_jobs=>0.0010077953338623047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007124423980712891} [----] I, [2016-09-13T09:52:57.364012 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79287], State: [ok], Delivered in [0.008098087] seconds [----] I, [2016-09-13T09:53:07.744236 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:53:07.778838 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79288], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:53:07.801484 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79289], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:53:07.818258 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79290], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:53:07.841238 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79291], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:53:13.487057 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:53:13.491497 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004160404205322266, :worker_monitor=>1.253067970275879, :worker_dequeue=>0.012397289276123047, :total_time=>1.2700483798980713} [----] I, [2016-09-13T09:53:13.532769 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79288], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.784739297] seconds [----] I, [2016-09-13T09:53:13.532972 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79288], Delivering... [----] I, [2016-09-13T09:53:13.606949 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79288], State: [ok], Delivered in [0.073953624] seconds [----] I, [2016-09-13T09:53:13.652723 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79291], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.827589828] seconds [----] I, [2016-09-13T09:53:13.652901 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79291], Delivering... [----] I, [2016-09-13T09:53:13.659610 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034732818603515625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003584623336791992, :pending_vm_jobs=>0.0008099079132080078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063533782958984375} [----] I, [2016-09-13T09:53:13.659963 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79291], State: [ok], Delivered in [0.007051099] seconds [----] I, [2016-09-13T09:53:13.789707 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79289], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.004201382] seconds [----] I, [2016-09-13T09:53:13.789866 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79289], Delivering... [----] I, [2016-09-13T09:53:13.792614 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79289], State: [ok], Delivered in [0.00274979] seconds [----] I, [2016-09-13T09:53:13.852794 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79290], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.044673742] seconds [----] I, [2016-09-13T09:53:13.852981 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79290], Delivering... [----] I, [2016-09-13T09:53:13.858269 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79290], State: [ok], Delivered in [0.005276145] seconds [----] I, [2016-09-13T09:53:18.492174 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:53:18 UTC]... [----] I, [2016-09-13T09:53:18.527077 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:53:18 UTC]...Complete [----] I, [2016-09-13T09:53:22.850909 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:53:22.869647 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79292], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:53:23.748752 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:53:24.510373 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79292], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.652088979] seconds [----] I, [2016-09-13T09:53:24.510646 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79292], Delivering... [----] I, [2016-09-13T09:53:24.518969 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004439592361450195, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004473209381103516, :pending_vm_jobs=>0.0010826587677001953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007826805114746094} [----] I, [2016-09-13T09:53:24.519459 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79292], State: [ok], Delivered in [0.008780517] seconds [----] I, [2016-09-13T09:53:29.962618 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005052089691162109, :worker_monitor=>1.197838544845581, :worker_dequeue=>0.005654096603393555, :total_time=>1.2089011669158936} [----] I, [2016-09-13T09:53:37.883280 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T09:53:37.909953 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79293], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:53:37.928149 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79294], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:53:37.955582 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79295], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:53:38.001364 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79296], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:53:39.989303 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:53:40.635721 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79294], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.721434539] seconds [----] I, [2016-09-13T09:53:40.635910 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79294], Delivering... [----] I, [2016-09-13T09:53:40.637587 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T09:53:40.637933 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4567003136 [----] I, [2016-09-13T09:53:40.638107 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4335652864 [----] I, [2016-09-13T09:53:40.638262 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 231350272 [----] I, [2016-09-13T09:53:40.638463 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T09:53:40.638637 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4281556992 [----] I, [2016-09-13T09:53:40.638792 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T09:53:40.638956 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T09:53:40.639104 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 553254912 [----] I, [2016-09-13T09:53:40.639258 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T09:53:40.639464 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6806196224 [----] I, [2016-09-13T09:53:40.639649 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T09:53:40.639820 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T09:53:40.639969 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T09:53:40.640113 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 28672 [----] I, [2016-09-13T09:53:40.640262 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T09:53:40.640465 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T09:53:40.640644 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T09:53:40.640795 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T09:53:40.640947 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T09:53:40.641110 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T09:53:40.641263 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 274022400 [----] I, [2016-09-13T09:53:40.641452 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57196544 [----] I, [2016-09-13T09:53:40.641615 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216825856 [----] I, [2016-09-13T09:53:40.641766 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6078464 [----] I, [2016-09-13T09:53:40.641908 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142262272 [----] I, [2016-09-13T09:53:40.642036 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3384549376 [----] I, [2016-09-13T09:53:40.642124 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3058204672 [----] I, [2016-09-13T09:53:40.642212 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T09:53:40.642291 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T09:53:40.642369 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T09:53:40.642506 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36864000 [----] I, [2016-09-13T09:53:40.642598 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T09:53:40.642674 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53858304 [----] I, [2016-09-13T09:53:40.642753 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111300608 [----] I, [2016-09-13T09:53:40.642831 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 156155904 [----] I, [2016-09-13T09:53:40.642916 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T09:53:40.643005 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T09:53:40.643085 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T09:53:40.643164 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T09:53:40.643238 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T09:53:40.643314 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T09:53:40.643411 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T09:53:40.643530 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T09:53:40.643619 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T09:53:40.693624 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T09:53:40.693864 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T09:53:40.698040 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T09:53:40.701121 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T09:53:40.704793 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T09:53:40.708476 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T09:53:40.712280 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T09:53:40.715743 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 852 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T09:53:40.719325 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T09:53:40.722931 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T09:53:40.726449 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T09:53:40.729744 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T09:53:40.732954 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T09:53:40.736149 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T09:53:40.739291 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:53:40.739486 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:53:40.739617 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T09:53:40.744237 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202684000], Memory % [3.38], CPU Time [153516.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:53:40.744640 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79294], State: [ok], Delivered in [0.108706346] seconds [----] I, [2016-09-13T09:53:40.835982 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79296], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.874766282] seconds [----] I, [2016-09-13T09:53:40.836206 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79296], Delivering... [----] I, [2016-09-13T09:53:40.845205 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00461888313293457, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004646778106689453, :pending_vm_jobs=>0.0011141300201416016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008492469787597656} [----] I, [2016-09-13T09:53:40.845641 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79296], State: [ok], Delivered in [0.009425375] seconds [----] I, [2016-09-13T09:53:40.853016 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79295], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.920813871] seconds [----] I, [2016-09-13T09:53:40.853215 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79295], Delivering... [----] I, [2016-09-13T09:53:40.860773 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:53:27 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [213405000], Memory % [3.5], CPU Time [49384.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T09:53:40.861379 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:53:28 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169744000], Memory % [3.14], CPU Time [52186.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:53:40.861995 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:53:27 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163148000], Memory % [3.1], CPU Time [38431.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T09:53:40.862579 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:53:22 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [206035000], Memory % [3.5], CPU Time [243141.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T09:53:40.863134 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:53:28 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359293000], Memory % [5.28], CPU Time [205502.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:53:40.863760 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:53:20 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347778000], Memory % [5.04], CPU Time [105698.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T09:53:40.864321 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:53:29 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202684000], Memory % [3.38], CPU Time [152609.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:53:40.864863 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:53:29 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201168000], Memory % [3.36], CPU Time [153525.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:53:40.867772 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:53:29 UTC], Process Info: Memory Usage [612474880], Memory Size [1071321088], Proportional Set Size: [450650000], Memory % [7.47], CPU Time [688.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:53:40.870050 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:53:26 UTC], Process Info: Memory Usage [601784320], Memory Size [960274432], Proportional Set Size: [439809000], Memory % [7.34], CPU Time [223.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T09:53:40.870663 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:53:28 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358592000], Memory % [5.27], CPU Time [212742.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T09:53:40.871189 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:53:29 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178470000], Memory % [3.2], CPU Time [52182.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:53:40.871691 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:53:23 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166757000], Memory % [3.16], CPU Time [39337.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T09:53:40.872023 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79295], State: [ok], Delivered in [0.018818108] seconds [----] I, [2016-09-13T09:53:40.949914 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79293], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.062087154] seconds [----] I, [2016-09-13T09:53:40.950132 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79293], Delivering... [----] I, [2016-09-13T09:53:40.954721 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79293], State: [ok], Delivered in [0.004569237] seconds [----] I, [2016-09-13T09:53:46.220284 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005796194076538086, :worker_monitor=>1.2131004333496094, :worker_dequeue=>0.0049250125885009766, :total_time=>1.2241616249084473} [----] I, [2016-09-13T09:53:51.220813 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:53:51 UTC]... [----] I, [2016-09-13T09:53:51.241235 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:53:51 UTC]...Complete [----] I, [2016-09-13T09:53:53.013473 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:53:53.035511 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79297], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:53:56.266983 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:53:57.013583 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79297], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.992229315] seconds [----] I, [2016-09-13T09:53:57.013983 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79297], Delivering... [----] I, [2016-09-13T09:53:57.023838 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005356550216674805, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0053942203521728516, :pending_vm_jobs=>0.0011143684387207031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009228229522705078} [----] I, [2016-09-13T09:53:57.024280 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79297], State: [ok], Delivered in [0.01031018] seconds [----] I, [2016-09-13T09:54:02.494924 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002534627914428711, :worker_monitor=>1.209911823272705, :worker_dequeue=>0.010006189346313477, :total_time=>1.222679853439331} [----] I, [2016-09-13T09:54:08.048359 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:54:08.064130 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79298], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:54:08.075349 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79299], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:54:08.099052 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79300], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:54:08.110756 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79301], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:54:12.516158 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:54:13.104472 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79298], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.051625488] seconds [----] I, [2016-09-13T09:54:13.104702 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79298], Delivering... [----] I, [2016-09-13T09:54:13.167493 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79301], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.062886062] seconds [----] I, [2016-09-13T09:54:13.167679 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79301], Delivering... [----] I, [2016-09-13T09:54:13.172803 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79298], State: [ok], Delivered in [0.068084833] seconds [----] I, [2016-09-13T09:54:13.174441 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003531217575073242, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035550594329833984, :pending_vm_jobs=>0.0007841587066650391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006330966949462891} [----] I, [2016-09-13T09:54:13.174796 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79301], State: [ok], Delivered in [0.00711283] seconds [----] I, [2016-09-13T09:54:14.065721 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79299], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.996184757] seconds [----] I, [2016-09-13T09:54:14.065939 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79299], Delivering... [----] I, [2016-09-13T09:54:14.074638 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79299], State: [ok], Delivered in [0.008703187] seconds [----] I, [2016-09-13T09:54:14.104436 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79300], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.021308607] seconds [----] I, [2016-09-13T09:54:14.104643 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79300], Delivering... [----] I, [2016-09-13T09:54:14.110133 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79300], State: [ok], Delivered in [0.005479554] seconds [----] I, [2016-09-13T09:54:18.630760 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038607120513916016, :worker_monitor=>1.097754955291748, :worker_dequeue=>0.008886098861694336, :total_time=>1.110853910446167} [----] I, [2016-09-13T09:54:23.124175 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:54:23.172900 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79302], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:54:23.631251 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:54:23 UTC]... [----] I, [2016-09-13T09:54:23.659187 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:54:23 UTC]...Complete [----] I, [2016-09-13T09:54:23.767100 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:54:24.293224 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79302], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.160673635] seconds [----] I, [2016-09-13T09:54:24.293462 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79302], Delivering... [----] I, [2016-09-13T09:54:24.300218 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003512144088745117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035653114318847656, :pending_vm_jobs=>0.0008373260498046875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006367921829223633} [----] I, [2016-09-13T09:54:24.300605 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79302], State: [ok], Delivered in [0.007189929] seconds [----] I, [2016-09-13T09:54:35.036556 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036690235137939453, :worker_monitor=>1.2290349006652832, :worker_dequeue=>0.009196996688842773, :total_time=>1.2422199249267578} [----] I, [2016-09-13T09:54:38.185767 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:54:38.230784 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79303], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:54:38.247826 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79304], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:54:40.045984 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:54:40.396736 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79304], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.158329462] seconds [----] I, [2016-09-13T09:54:40.396919 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79304], Delivering... [----] I, [2016-09-13T09:54:40.403440 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034563541412353516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003478527069091797, :pending_vm_jobs=>0.0008325576782226562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0061435699462890625} [----] I, [2016-09-13T09:54:40.403792 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79304], State: [ok], Delivered in [0.00686499] seconds [----] I, [2016-09-13T09:54:41.362505 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79303], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.170778713] seconds [----] I, [2016-09-13T09:54:41.362723 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79303], Delivering... [----] I, [2016-09-13T09:54:41.368144 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79303], State: [ok], Delivered in [0.005416935] seconds [----] I, [2016-09-13T09:54:53.262443 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:54:53.305146 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79305], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:54:55.986015 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:54:55 UTC]... [----] I, [2016-09-13T09:54:56.025884 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:54:55 UTC]...Complete [----] I, [2016-09-13T09:54:56.036224 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:54:56.242482 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79305], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.974213199] seconds [----] I, [2016-09-13T09:54:56.242684 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79305], Delivering... [----] I, [2016-09-13T09:54:56.249747 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003643512725830078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036687850952148438, :pending_vm_jobs=>0.0009160041809082031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006616830825805664} [----] I, [2016-09-13T09:54:56.250074 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79305], State: [ok], Delivered in [0.007391493] seconds [----] I, [2016-09-13T09:55:01.055538 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T09:55:07.180531 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003409862518310547, :worker_monitor=>1.1025989055633545, :worker_dequeue=>0.00900721549987793, :total_time=>1.1153557300567627} [----] I, [2016-09-13T09:55:08.316659 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:55:08.333870 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79306], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:55:08.345219 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79307], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:55:08.362180 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79308], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:55:08.373654 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79309], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:55:12.190305 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:55:12.654005 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79306], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.332613392] seconds [----] I, [2016-09-13T09:55:12.654215 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79306], Delivering... [----] I, [2016-09-13T09:55:12.666693 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79309], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.298624159] seconds [----] I, [2016-09-13T09:55:12.666955 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79309], Delivering... [----] I, [2016-09-13T09:55:12.676746 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0052089691162109375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005240917205810547, :pending_vm_jobs=>0.001165151596069336, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0092926025390625} [----] I, [2016-09-13T09:55:12.677175 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79309], State: [ok], Delivered in [0.010212777] seconds [----] I, [2016-09-13T09:55:12.716722 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79306], State: [ok], Delivered in [0.06246211] seconds [----] I, [2016-09-13T09:55:14.351501 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79307], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.011883533] seconds [----] I, [2016-09-13T09:55:14.351706 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79307], Delivering... [----] I, [2016-09-13T09:55:14.355085 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79307], State: [ok], Delivered in [0.003362808] seconds [----] I, [2016-09-13T09:55:14.414011 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79308], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.060265808] seconds [----] I, [2016-09-13T09:55:14.414197 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79308], Delivering... [----] I, [2016-09-13T09:55:14.419324 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79308], State: [ok], Delivered in [0.005113387] seconds [----] I, [2016-09-13T09:55:23.246205 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039904117584228516, :worker_monitor=>1.0319757461547852, :worker_dequeue=>0.006537437438964844, :total_time=>1.0428647994995117} [----] I, [2016-09-13T09:55:23.385995 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:55:23.402644 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79310], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:55:28.246695 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:55:28 UTC]... [----] I, [2016-09-13T09:55:28.271016 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:55:28 UTC]...Complete [----] I, [2016-09-13T09:55:28.386530 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:55:28.785282 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79310], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.393181101] seconds [----] I, [2016-09-13T09:55:28.785404 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79310], Delivering... [----] I, [2016-09-13T09:55:28.789349 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002115964889526367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021295547485351562, :pending_vm_jobs=>0.0004374980926513672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0037004947662353516} [----] I, [2016-09-13T09:55:28.789597 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79310], State: [ok], Delivered in [0.004201917] seconds [----] I, [2016-09-13T09:55:38.414671 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:55:38.436779 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79311], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:55:38.448074 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79312], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:55:39.556874 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:55:39.556993 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:55:39.568195 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [103], PID: [17555], GUID: [1dd6952c-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:55:39.568294 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [103], PID: [17555], GUID: [1dd6952c-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:55:39.579698 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:55:39.579804 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:55:39.590993 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:55:39.591106 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:55:39.602498 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:55:39.602600 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:55:39.613835 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:55:39.613992 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:55:39.625313 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:55:39.625462 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:55:39.653444 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:55:39.653568 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:55:39.689212 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:55:39.689408 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:55:39.745037 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:55:39.745214 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:55:39.785071 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:55:39.785236 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:55:39.802752 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:55:39.802907 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:55:39.818917 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T09:55:39.819071 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T09:55:39.825252 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:55:39.828653 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00452733039855957, :worker_monitor=>1.4159669876098633, :worker_dequeue=>0.00750279426574707, :total_time=>1.4283778667449951} [----] I, [2016-09-13T09:55:39.858674 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:55:39.858823 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:55:39.858902 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:55:39.934383 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79312], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.493434178] seconds [----] I, [2016-09-13T09:55:39.934625 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79312], Delivering... [----] I, [2016-09-13T09:55:39.938965 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:55:39.939092 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:55:39.939158 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:55:39.941262 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034453868865966797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003467559814453125, :pending_vm_jobs=>0.0008199214935302734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006270170211791992} [----] I, [2016-09-13T09:55:39.941626 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79312], State: [ok], Delivered in [0.006993976] seconds [----] I, [2016-09-13T09:55:40.015526 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:55:40.016302 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T09:55:40.016373 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:55:40.016467 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:55:40.016515 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:55:40.016568 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T09:55:40.016607 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T09:55:40.016640 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:55:40.016676 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T09:55:40.016706 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:55:40.016739 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:55:40.016769 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:55:40.016801 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:55:40.016833 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T09:55:40.016863 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:55:40.016893 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T09:55:40.016921 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T09:55:40.017210 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:55:40.017408 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:55:40.138599 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:55:40.139283 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T09:55:40.139352 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:55:40.139412 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:55:40.139497 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:55:40.139538 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T09:55:40.139573 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T09:55:40.139605 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:55:40.139643 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T09:55:40.139675 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:55:40.139706 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:55:40.139737 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:55:40.139769 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:55:40.139804 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T09:55:40.139834 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T09:55:40.140085 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:55:40.140329 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:55:41.540257 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79311], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.119392275] seconds [----] I, [2016-09-13T09:55:41.540509 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79311], Delivering... [----] I, [2016-09-13T09:55:41.545624 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79311], State: [ok], Delivered in [0.005112893] seconds [----] I, [2016-09-13T09:55:41.572253 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:55:41.572543 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:55:41.572713 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:55:41.751715 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:55:41.752664 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T09:55:41.752748 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:55:41.752794 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:55:41.752830 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:55:41.752867 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T09:55:41.752902 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T09:55:41.752937 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:55:41.752972 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T09:55:41.753008 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:55:41.753043 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:55:41.753080 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:55:41.753120 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:55:41.753153 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T09:55:41.753183 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:55:41.753216 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T09:55:41.753248 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T09:55:41.753590 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:55:41.753750 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:55:43.977303 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:55:43.977490 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:55:43.977594 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:55:44.124517 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:55:44.125278 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T09:55:44.125349 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:55:44.125404 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:55:44.125492 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:55:44.125549 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T09:55:44.125592 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T09:55:44.125626 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:55:44.125657 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T09:55:44.125688 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:55:44.125718 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:55:44.125755 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:55:44.125786 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:55:44.125816 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T09:55:44.125846 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:55:44.125876 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T09:55:44.125904 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T09:55:44.126189 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:55:44.126356 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:55:44.606936 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:55:44.607076 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:55:44.607143 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:55:44.744576 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:55:44.745299 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T09:55:44.745369 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:55:44.745467 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:55:44.745519 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:55:44.745556 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T09:55:44.745590 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T09:55:44.745624 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:55:44.745656 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T09:55:44.745689 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:55:44.745720 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:55:44.745758 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:55:44.745789 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:55:44.745821 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T09:55:44.745851 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T09:55:44.746130 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:55:44.746407 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:55:46.921083 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T09:55:46.921261 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T09:55:46.921373 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T09:55:47.070404 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:55:47.071286 #17555:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T09:55:47.071359 #17555:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:55:47.071452 #17555:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:55:47.071512 #17555:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:55:47.071552 #17555:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T09:55:47.071587 #17555:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T09:55:47.071646 #17555:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:55:47.071716 #17555:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T09:55:47.071763 #17555:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:55:47.071802 #17555:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:55:47.071835 #17555:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:55:47.071867 #17555:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:55:47.071900 #17555:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T09:55:47.071933 #17555:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T09:55:47.071968 #17555:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T09:55:47.072003 #17555:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T09:55:47.072035 #17555:34713c] INFO -- : --- [----] I, [2016-09-13T09:55:47.072534 #17555:34713c] INFO -- : :guid: 1dd6952c-79b6-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:55:47.072617 #17555:34713c] INFO -- : :ems_id: 17 [----] I, [2016-09-13T09:55:47.072802 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T09:55:47.422320 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:55:47.422430 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:55:47.422484 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:55:47.477372 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:55:47.477575 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:55:47.477688 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:55:47.503180 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:55:47.503580 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T09:55:47.503623 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:55:47.503648 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:55:47.503668 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:55:47.503687 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T09:55:47.503705 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T09:55:47.503723 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:55:47.503741 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T09:55:47.503759 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:55:47.503776 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:55:47.503794 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:55:47.503811 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:55:47.503828 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T09:55:47.503844 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T09:55:47.503985 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:55:47.504123 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:55:47.670265 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:55:47.670929 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T09:55:47.670992 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:55:47.671025 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:55:47.671054 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:55:47.671080 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T09:55:47.671108 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T09:55:47.671136 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:55:47.671163 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T09:55:47.671186 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:55:47.671210 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:55:47.671233 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:55:47.671259 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:55:47.671285 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T09:55:47.671310 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:55:47.671332 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T09:55:47.671356 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T09:55:47.671608 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:55:47.671731 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:55:48.707379 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:55:48.707566 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:55:48.707640 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:55:48.843870 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:55:48.844662 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T09:55:48.844739 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:55:48.844783 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:55:48.844819 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:55:48.844853 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T09:55:48.844885 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T09:55:48.844918 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:55:48.844950 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T09:55:48.844982 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:55:48.845014 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:55:48.845046 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:55:48.845078 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:55:48.845109 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T09:55:48.845140 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:55:48.845171 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T09:55:48.845200 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T09:55:48.845509 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:55:48.845661 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:55:49.390375 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T09:55:49.390615 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T09:55:49.390732 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T09:55:49.559482 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:55:49.560319 #17546:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T09:55:49.560412 #17546:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:55:49.560501 #17546:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:55:49.560546 #17546:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:55:49.560582 #17546:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T09:55:49.560613 #17546:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T09:55:49.560649 #17546:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:55:49.560685 #17546:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T09:55:49.560720 #17546:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:55:49.560753 #17546:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:55:49.560787 #17546:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T09:55:49.560821 #17546:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:55:49.560851 #17546:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T09:55:49.560883 #17546:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:55:49.560915 #17546:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T09:55:49.560943 #17546:34713c] INFO -- : --- [----] I, [2016-09-13T09:55:49.561338 #17546:34713c] INFO -- : :guid: 1d7be00a-79b6-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:55:49.561455 #17546:34713c] INFO -- : :ems_id: 17 [----] I, [2016-09-13T09:55:49.561647 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T09:55:50.583515 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:55:50.583685 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:55:50.583774 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:55:50.588023 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:55:50.588117 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:55:50.588179 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:55:50.684375 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:55:50.684856 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T09:55:50.684896 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:55:50.684919 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:55:50.684939 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:55:50.684957 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T09:55:50.684976 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T09:55:50.684994 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:55:50.685012 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T09:55:50.685041 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:55:50.685063 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:55:50.685080 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:55:50.685098 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:55:50.685115 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T09:55:50.685132 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:55:50.685149 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T09:55:50.685164 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T09:55:50.685327 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:55:50.685467 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:55:50.754653 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:55:50.755407 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T09:55:50.755515 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:55:50.755563 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:55:50.755598 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:55:50.755634 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T09:55:50.755665 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T09:55:50.755698 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:55:50.755731 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T09:55:50.755764 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:55:50.755795 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:55:50.755826 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:55:50.755859 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:55:50.755890 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T09:55:50.755920 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T09:55:50.755950 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T09:55:50.755983 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T09:55:50.756263 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:55:50.756471 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:55:53.457333 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T09:55:53.457559 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T09:55:53.457643 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T09:55:53.601621 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T09:55:53.602964 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T09:55:53.603048 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T09:55:53.603094 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T09:55:53.603131 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T09:55:53.603168 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T09:55:53.603203 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T09:55:53.603236 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T09:55:53.603269 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T09:55:53.603301 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T09:55:53.603334 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T09:55:53.603367 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T09:55:53.603445 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T09:55:53.603502 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T09:55:53.603538 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T09:55:53.603572 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T09:55:53.603604 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T09:55:53.603637 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T09:55:53.603669 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T09:55:53.603701 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T09:55:53.603735 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T09:55:53.603768 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T09:55:53.603800 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T09:55:53.603831 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T09:55:53.603862 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T09:55:53.603894 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T09:55:53.603926 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T09:55:53.603958 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T09:55:53.603990 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T09:55:53.604023 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T09:55:53.604056 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T09:55:53.604089 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T09:55:53.604121 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T09:55:53.604152 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T09:55:53.604183 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T09:55:53.604215 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T09:55:53.604247 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T09:55:53.604278 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T09:55:53.604309 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T09:55:53.604339 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T09:55:53.604644 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T09:55:53.604793 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T09:55:53.604881 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:55:53.619769 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79313], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:55:55.901943 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:55:55.906454 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.009112119674682617, :worker_monitor=>1.032895565032959, :worker_dequeue=>0.009308338165283203, :total_time=>1.0516302585601807} [----] I, [2016-09-13T09:55:56.150266 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79313], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.539902039] seconds [----] I, [2016-09-13T09:55:56.150411 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79313], Delivering... [----] I, [2016-09-13T09:55:56.154837 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023381710052490234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002354145050048828, :pending_vm_jobs=>0.0007827281951904297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004164457321166992} [----] I, [2016-09-13T09:55:56.155083 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79313], State: [ok], Delivered in [0.004693265] seconds [----] I, [2016-09-13T09:56:00.906931 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:56:00 UTC]... [----] I, [2016-09-13T09:56:00.933139 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:56:00 UTC]...Complete [----] I, [2016-09-13T09:56:08.631311 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:56:08.641993 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79314], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:56:08.652961 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79315], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:56:08.664387 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79316], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:56:08.676094 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79317], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:56:12.289693 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:56:12.296466 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004429817199707031, :worker_monitor=>1.316594123840332, :worker_dequeue=>0.011942625045776367, :total_time=>1.333233118057251} [----] I, [2016-09-13T09:56:12.339208 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79314], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.704257045] seconds [----] I, [2016-09-13T09:56:12.339498 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79314], Delivering... [----] I, [2016-09-13T09:56:12.390433 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79314], State: [ok], Delivered in [0.050966906] seconds [----] I, [2016-09-13T09:56:12.425373 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79317], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.757630311] seconds [----] I, [2016-09-13T09:56:12.425612 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79317], Delivering... [----] I, [2016-09-13T09:56:12.432903 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033440589904785156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033614635467529297, :pending_vm_jobs=>0.0008182525634765625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006867885589599609} [----] I, [2016-09-13T09:56:12.433283 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79317], State: [ok], Delivered in [0.007652228] seconds [----] I, [2016-09-13T09:56:14.814017 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79315], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.168465318] seconds [----] I, [2016-09-13T09:56:14.814240 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79315], Delivering... [----] I, [2016-09-13T09:56:14.817641 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79315], State: [ok], Delivered in [0.00340516] seconds [----] I, [2016-09-13T09:56:14.848716 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79316], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.191187113] seconds [----] I, [2016-09-13T09:56:14.848907 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79316], Delivering... [----] I, [2016-09-13T09:56:14.853028 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79316], State: [ok], Delivered in [0.004134161] seconds [----] I, [2016-09-13T09:56:23.684975 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:56:23.699652 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79318], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:56:28.580951 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:56:28.584469 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037767887115478516, :worker_monitor=>1.2317276000976562, :worker_dequeue=>0.00758671760559082, :total_time=>1.2433953285217285} [----] I, [2016-09-13T09:56:29.403028 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79318], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.711794] seconds [----] I, [2016-09-13T09:56:29.403225 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79318], Delivering... [----] I, [2016-09-13T09:56:29.409818 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003286600112915039, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033562183380126953, :pending_vm_jobs=>0.0008451938629150391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0061914920806884766} [----] I, [2016-09-13T09:56:29.410226 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79318], State: [ok], Delivered in [0.006976559] seconds [----] I, [2016-09-13T09:56:33.584835 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:56:33 UTC]... [----] I, [2016-09-13T09:56:33.602232 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:56:33 UTC]...Complete [----] I, [2016-09-13T09:56:38.709951 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:56:38.753035 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79319], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:56:38.769003 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79320], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:56:44.777268 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:56:44.781716 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025038719177246094, :worker_monitor=>1.0740165710449219, :worker_dequeue=>0.009555816650390625, :total_time=>1.086301326751709} [----] I, [2016-09-13T09:56:44.969477 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79320], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.210342446] seconds [----] I, [2016-09-13T09:56:44.969754 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79320], Delivering... [----] I, [2016-09-13T09:56:44.980370 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005631208419799805, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0056650638580322266, :pending_vm_jobs=>0.001268148422241211, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010028362274169922} [----] I, [2016-09-13T09:56:44.980964 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79320], State: [ok], Delivered in [0.01118617] seconds [----] I, [2016-09-13T09:56:44.986517 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79319], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.272981767] seconds [----] I, [2016-09-13T09:56:44.986673 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79319], Delivering... [----] I, [2016-09-13T09:56:44.990072 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79319], State: [ok], Delivered in [0.003410238] seconds [----] I, [2016-09-13T09:56:53.778369 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:56:53.826457 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79321], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:56:54.799535 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:56:55.638383 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79321], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.854260195] seconds [----] I, [2016-09-13T09:56:55.638637 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79321], Delivering... [----] I, [2016-09-13T09:56:55.645085 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034303665161132812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003525972366333008, :pending_vm_jobs=>0.0007004737854003906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006036996841430664} [----] I, [2016-09-13T09:56:55.645486 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79321], State: [ok], Delivered in [0.006827113] seconds [----] I, [2016-09-13T09:57:00.996162 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041959285736083984, :worker_monitor=>1.1019527912139893, :worker_dequeue=>0.08558416366577148, :total_time=>1.1920976638793945} [----] I, [2016-09-13T09:57:05.996724 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:57:05 UTC]... [----] I, [2016-09-13T09:57:06.009220 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:57:05 UTC]...Complete [----] I, [2016-09-13T09:57:08.837324 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:57:08.856513 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79322], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:57:08.866265 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79323], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:57:08.878085 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79324], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:57:08.889155 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79325], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:57:11.042129 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:57:11.763975 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79322], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.922832897] seconds [----] I, [2016-09-13T09:57:11.764120 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79322], Delivering... [----] I, [2016-09-13T09:57:11.815510 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79322], State: [ok], Delivered in [0.051358744] seconds [----] I, [2016-09-13T09:57:11.838360 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79325], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.95603981] seconds [----] I, [2016-09-13T09:57:11.838603 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79325], Delivering... [----] I, [2016-09-13T09:57:11.845010 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033545494079589844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033719539642333984, :pending_vm_jobs=>0.0008099079132080078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006018400192260742} [----] I, [2016-09-13T09:57:11.845380 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79325], State: [ok], Delivered in [0.006775794] seconds [----] I, [2016-09-13T09:57:12.112980 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79323], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.251780135] seconds [----] I, [2016-09-13T09:57:12.113261 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79323], Delivering... [----] I, [2016-09-13T09:57:12.118099 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79323], State: [ok], Delivered in [0.00482754] seconds [----] I, [2016-09-13T09:57:12.118572 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79324], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.246011934] seconds [----] I, [2016-09-13T09:57:12.118883 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79324], Delivering... [----] I, [2016-09-13T09:57:12.126332 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79324], State: [ok], Delivered in [0.007444163] seconds [----] I, [2016-09-13T09:57:17.084592 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003890514373779297, :worker_monitor=>1.0284347534179688, :worker_dequeue=>0.005087852478027344, :total_time=>1.0377092361450195} [----] I, [2016-09-13T09:57:23.898103 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:57:23.941071 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79326], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:57:27.105780 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:57:27.175308 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79326], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.271512736] seconds [----] I, [2016-09-13T09:57:27.175523 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79326], Delivering... [----] I, [2016-09-13T09:57:27.182071 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003272533416748047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003324747085571289, :pending_vm_jobs=>0.0008552074432373047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0061647891998291016} [----] I, [2016-09-13T09:57:27.182441 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79326], State: [ok], Delivered in [0.00687173] seconds [----] I, [2016-09-13T09:57:33.306743 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005314350128173828, :worker_monitor=>1.1822068691253662, :worker_dequeue=>0.009385824203491211, :total_time=>1.1973774433135986} [----] I, [2016-09-13T09:57:38.307237 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:57:38 UTC]... [----] I, [2016-09-13T09:57:38.323912 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:57:38 UTC]...Complete [----] I, [2016-09-13T09:57:38.952587 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:57:38.968777 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79327], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:57:38.991848 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79328], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:57:43.443735 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:57:44.014876 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79328], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.040748609] seconds [----] I, [2016-09-13T09:57:44.015041 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79328], Delivering... [----] I, [2016-09-13T09:57:44.022027 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031697750091552734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031876564025878906, :pending_vm_jobs=>0.0007200241088867188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0066182613372802734} [----] I, [2016-09-13T09:57:44.022487 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79328], State: [ok], Delivered in [0.007373883] seconds [----] I, [2016-09-13T09:57:45.208981 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79327], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.251961759] seconds [----] I, [2016-09-13T09:57:45.209164 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79327], Delivering... [----] I, [2016-09-13T09:57:45.213982 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79327], State: [ok], Delivered in [0.004748878] seconds [----] I, [2016-09-13T09:57:49.574364 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003393411636352539, :worker_monitor=>1.1136322021484375, :worker_dequeue=>0.008535623550415039, :total_time=>1.1258292198181152} [----] I, [2016-09-13T09:57:54.003338 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:57:54.050166 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79329], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:57:54.581681 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:57:55.124802 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79329], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.115522647] seconds [----] I, [2016-09-13T09:57:55.125008 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79329], Delivering... [----] I, [2016-09-13T09:57:55.131485 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003438234329223633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003488302230834961, :pending_vm_jobs=>0.0008087158203125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006044864654541016} [----] I, [2016-09-13T09:57:55.131811 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79329], State: [ok], Delivered in [0.006793354] seconds [----] I, [2016-09-13T09:58:06.361868 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038645267486572266, :worker_monitor=>1.7470197677612305, :worker_dequeue=>0.012756824493408203, :total_time=>1.7639727592468262} [----] I, [2016-09-13T09:58:09.061617 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:58:09.115486 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79330], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:58:09.144193 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79331], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:58:09.172744 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79332], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:58:09.198206 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79333], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:58:11.362505 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:58:11 UTC]... [----] I, [2016-09-13T09:58:11.386656 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:58:11 UTC]...Complete [----] I, [2016-09-13T09:58:11.398246 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:58:12.278455 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79330], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.21244368] seconds [----] I, [2016-09-13T09:58:12.278632 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79330], Delivering... [----] I, [2016-09-13T09:58:12.295459 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79333], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.117312435] seconds [----] I, [2016-09-13T09:58:12.295587 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79333], Delivering... [----] I, [2016-09-13T09:58:12.299411 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002109050750732422, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021207332611083984, :pending_vm_jobs=>0.0004756450653076172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0035843849182128906} [----] I, [2016-09-13T09:58:12.299658 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79333], State: [ok], Delivered in [0.004059851] seconds [----] I, [2016-09-13T09:58:12.335402 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79331], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.214573473] seconds [----] I, [2016-09-13T09:58:12.335557 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79331], Delivering... [----] I, [2016-09-13T09:58:12.335760 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79332], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.183861282] seconds [----] I, [2016-09-13T09:58:12.335934 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79332], Delivering... [----] I, [2016-09-13T09:58:12.337561 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79331], State: [ok], Delivered in [0.002007002] seconds [----] I, [2016-09-13T09:58:12.340484 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79332], State: [ok], Delivered in [0.004492809] seconds [----] I, [2016-09-13T09:58:12.352556 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79330], State: [ok], Delivered in [0.073897539] seconds [----] I, [2016-09-13T09:58:22.683644 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0031595230102539062, :worker_monitor=>1.2571122646331787, :worker_dequeue=>0.007387638092041016, :total_time=>1.2678897380828857} [----] I, [2016-09-13T09:58:24.209612 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:58:24.226482 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79334], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:58:27.693232 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:58:28.420872 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79334], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.205366431] seconds [----] I, [2016-09-13T09:58:28.421057 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79334], Delivering... [----] I, [2016-09-13T09:58:28.427406 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003336191177368164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033550262451171875, :pending_vm_jobs=>0.0008106231689453125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005983591079711914} [----] I, [2016-09-13T09:58:28.427815 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79334], State: [ok], Delivered in [0.006756742] seconds [----] I, [2016-09-13T09:58:39.018770 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003911018371582031, :worker_monitor=>1.2977631092071533, :worker_dequeue=>0.005674123764038086, :total_time=>1.3076298236846924} [----] I, [2016-09-13T09:58:39.238200 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T09:58:39.249858 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79335], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:58:39.272665 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79336], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:58:39.283844 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79337], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:58:39.295297 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79338], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:58:44.019278 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:58:44 UTC]... [----] I, [2016-09-13T09:58:44.043999 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:58:44 UTC]...Complete [----] I, [2016-09-13T09:58:44.181150 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:58:44.575932 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79336], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.322092877] seconds [----] I, [2016-09-13T09:58:44.576114 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79336], Delivering... [----] I, [2016-09-13T09:58:44.577566 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T09:58:44.577794 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4569251840 [----] I, [2016-09-13T09:58:44.577895 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4337672192 [----] I, [2016-09-13T09:58:44.577974 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 231579648 [----] I, [2016-09-13T09:58:44.578055 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T09:58:44.578128 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4283592704 [----] I, [2016-09-13T09:58:44.578202 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T09:58:44.578286 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T09:58:44.578368 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 553504768 [----] I, [2016-09-13T09:58:44.578507 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T09:58:44.578590 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6824222720 [----] I, [2016-09-13T09:58:44.578701 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T09:58:44.578787 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T09:58:44.578861 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T09:58:44.578929 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 32768 [----] I, [2016-09-13T09:58:44.578995 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T09:58:44.579066 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T09:58:44.579136 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T09:58:44.579205 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T09:58:44.579274 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T09:58:44.579347 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T09:58:44.579466 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 274042880 [----] I, [2016-09-13T09:58:44.579561 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57196544 [----] I, [2016-09-13T09:58:44.579638 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216846336 [----] I, [2016-09-13T09:58:44.579705 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6078464 [----] I, [2016-09-13T09:58:44.579777 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142262272 [----] I, [2016-09-13T09:58:44.579849 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3383013376 [----] I, [2016-09-13T09:58:44.579921 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3056418816 [----] I, [2016-09-13T09:58:44.579991 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T09:58:44.580060 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T09:58:44.580130 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T09:58:44.580199 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36900864 [----] I, [2016-09-13T09:58:44.580276 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102297600 [----] I, [2016-09-13T09:58:44.580343 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53813248 [----] I, [2016-09-13T09:58:44.580451 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111300608 [----] I, [2016-09-13T09:58:44.580555 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 156110848 [----] I, [2016-09-13T09:58:44.580659 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T09:58:44.580737 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T09:58:44.580804 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T09:58:44.580869 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T09:58:44.580935 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T09:58:44.581004 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T09:58:44.581071 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T09:58:44.581137 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T09:58:44.581205 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T09:58:44.581327 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79337], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.30490882] seconds [----] I, [2016-09-13T09:58:44.581551 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79337], Delivering... [----] I, [2016-09-13T09:58:44.589125 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:58:38 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201169000], Memory % [3.36], CPU Time [153601.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:58:44.589881 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:58:33 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347778000], Memory % [5.04], CPU Time [105776.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T09:58:44.590439 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:58:28 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [213405000], Memory % [3.5], CPU Time [49470.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T09:58:44.591065 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:58:37 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163149000], Memory % [3.1], CPU Time [38481.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T09:58:44.591670 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:58:36 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169744000], Memory % [3.14], CPU Time [52248.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:58:44.592199 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:58:24 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [206035000], Memory % [3.5], CPU Time [243274.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T09:58:44.592757 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:58:36 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359293000], Memory % [5.28], CPU Time [205550.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T09:58:44.593240 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:58:38 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202685000], Memory % [3.38], CPU Time [152698.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:58:44.593791 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:58:36 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358592000], Memory % [5.27], CPU Time [212779.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T09:58:44.594267 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:58:36 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178471000], Memory % [3.2], CPU Time [52232.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T09:58:44.594757 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:58:35 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166757000], Memory % [3.16], CPU Time [39382.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T09:58:44.597932 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:58:29 UTC], Process Info: Memory Usage [613212160], Memory Size [1071321088], Proportional Set Size: [451400000], Memory % [7.48], CPU Time [714.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T09:58:44.600402 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 13:58:37 UTC], Process Info: Memory Usage [602763264], Memory Size [978120704], Proportional Set Size: [440866000], Memory % [7.35], CPU Time [255.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T09:58:44.600801 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79337], State: [ok], Delivered in [0.019244928] seconds [----] I, [2016-09-13T09:58:44.618001 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T09:58:44.618221 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T09:58:44.622033 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T09:58:44.624910 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T09:58:44.628041 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T09:58:44.631555 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T09:58:44.634888 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T09:58:44.638105 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 852 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T09:58:44.638451 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79338], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.349380478] seconds [----] I, [2016-09-13T09:58:44.638628 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79338], Delivering... [----] I, [2016-09-13T09:58:44.641443 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T09:58:44.644572 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T09:58:44.644671 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003068208694458008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030863285064697266, :pending_vm_jobs=>0.0008144378662109375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005707263946533203} [----] I, [2016-09-13T09:58:44.645037 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79338], State: [ok], Delivered in [0.006393821] seconds [----] I, [2016-09-13T09:58:44.647844 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T09:58:44.650982 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T09:58:44.654254 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T09:58:44.657351 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T09:58:44.660045 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:58:44.660195 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T09:58:44.660306 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T09:58:44.664645 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [201169000], Memory % [3.38], CPU Time [152690.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T09:58:44.665055 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79336], State: [ok], Delivered in [0.088914661] seconds [----] I, [2016-09-13T09:58:45.490219 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79335], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.247383707] seconds [----] I, [2016-09-13T09:58:45.490404 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79335], Delivering... [----] I, [2016-09-13T09:58:45.494544 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79335], State: [ok], Delivered in [0.004148447] seconds [----] I, [2016-09-13T09:58:54.307301 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:58:54.324182 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79339], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:58:55.955320 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:58:55.959674 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006206989288330078, :worker_monitor=>1.7403826713562012, :worker_dequeue=>0.009048700332641602, :total_time=>1.7559914588928223} [----] I, [2016-09-13T09:58:56.772152 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79339], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.458890473] seconds [----] I, [2016-09-13T09:58:56.772290 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79339], Delivering... [----] I, [2016-09-13T09:58:56.776084 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021355152130126953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021469593048095703, :pending_vm_jobs=>0.0004239082336425781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0035462379455566406} [----] I, [2016-09-13T09:58:56.776358 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79339], State: [ok], Delivered in [0.004069884] seconds [----] I, [2016-09-13T09:59:09.335501 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T09:59:09.381652 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79340], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:59:09.393912 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79341], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:59:09.410946 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79342], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:59:09.422444 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79343], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:59:12.175509 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:59:12.179961 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005929470062255859, :worker_monitor=>1.1831953525543213, :worker_dequeue=>0.009889841079711914, :total_time=>1.1993849277496338} [----] I, [2016-09-13T09:59:12.559715 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79340], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.21986453] seconds [----] I, [2016-09-13T09:59:12.559903 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79340], Delivering... [----] I, [2016-09-13T09:59:12.594147 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79343], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.178917732] seconds [----] I, [2016-09-13T09:59:12.594343 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79343], Delivering... [----] I, [2016-09-13T09:59:12.600953 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003509521484375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035572052001953125, :pending_vm_jobs=>0.0007827281951904297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00616765022277832} [----] I, [2016-09-13T09:59:12.601314 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79343], State: [ok], Delivered in [0.006964939] seconds [----] I, [2016-09-13T09:59:12.622507 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79340], State: [ok], Delivered in [0.062559847] seconds [----] I, [2016-09-13T09:59:12.628273 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79341], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.241307028] seconds [----] I, [2016-09-13T09:59:12.628500 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79341], Delivering... [----] I, [2016-09-13T09:59:12.631296 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79341], State: [ok], Delivered in [0.002784219] seconds [----] I, [2016-09-13T09:59:12.651176 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79342], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.249820373] seconds [----] I, [2016-09-13T09:59:12.651355 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79342], Delivering... [----] I, [2016-09-13T09:59:12.655793 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79342], State: [ok], Delivered in [0.004440478] seconds [----] I, [2016-09-13T09:59:17.180451 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:59:17 UTC]... [----] I, [2016-09-13T09:59:17.228405 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:59:17 UTC]...Complete [----] I, [2016-09-13T09:59:24.436412 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:59:24.457354 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79344], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:59:28.305269 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:59:28.310335 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003762960433959961, :worker_monitor=>1.0386910438537598, :worker_dequeue=>0.010463714599609375, :total_time=>1.0531773567199707} [----] I, [2016-09-13T09:59:28.960152 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79344], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.517114317] seconds [----] I, [2016-09-13T09:59:28.960364 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79344], Delivering... [----] I, [2016-09-13T09:59:28.967003 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035037994384765625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003522634506225586, :pending_vm_jobs=>0.0008137226104736328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006176948547363281} [----] I, [2016-09-13T09:59:28.967474 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79344], State: [ok], Delivered in [0.007064234] seconds [----] I, [2016-09-13T09:59:39.468732 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T09:59:39.492056 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79345], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:59:39.508645 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79346], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:59:44.444913 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:59:44.447649 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004181861877441406, :worker_monitor=>1.0878324508666992, :worker_dequeue=>0.0058901309967041016, :total_time=>1.0982248783111572} [----] I, [2016-09-13T09:59:45.051890 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79346], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.553402213] seconds [----] I, [2016-09-13T09:59:45.052071 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79346], Delivering... [----] I, [2016-09-13T09:59:45.058287 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003157377243041992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031774044036865234, :pending_vm_jobs=>0.0008146762847900391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005862712860107422} [----] I, [2016-09-13T09:59:45.058684 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79346], State: [ok], Delivered in [0.006610192] seconds [----] I, [2016-09-13T09:59:45.727502 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79345], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.253661582] seconds [----] I, [2016-09-13T09:59:45.727758 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79345], Delivering... [----] I, [2016-09-13T09:59:45.733285 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79345], State: [ok], Delivered in [0.005518592] seconds [----] I, [2016-09-13T09:59:49.448186 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:59:49 UTC]... [----] I, [2016-09-13T09:59:49.468994 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 13:59:49 UTC]...Complete [----] I, [2016-09-13T09:59:54.522456 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T09:59:54.537636 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79347], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T09:59:54.619995 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T09:59:54.817894 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79347], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.288635656] seconds [----] I, [2016-09-13T09:59:54.818103 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79347], Delivering... [----] I, [2016-09-13T09:59:54.824913 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003588438034057617, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003609180450439453, :pending_vm_jobs=>0.0008358955383300781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063550472259521484} [----] I, [2016-09-13T09:59:54.825283 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79347], State: [ok], Delivered in [0.007176888] seconds [----] I, [2016-09-13T10:00:05.475237 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T10:00:09.552363 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T10:00:09.595258 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79348], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:00:09.612189 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79349], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:00:09.627777 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79350], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:00:09.638987 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79351], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:00:09.640673 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget] [----] I, [2016-09-13T10:00:09.650657 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79352], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473778800] [----] I, [2016-09-13T10:00:09.650825 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T10:00:09.652228 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget] [----] I, [2016-09-13T10:00:09.662025 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79353], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473778800] [----] I, [2016-09-13T10:00:09.662187 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T10:00:09.673226 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79354], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:00:09.684642 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79355], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:00:09.696077 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79356], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:00:10.488880 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 9 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:00:11.298055 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79348], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.741159063] seconds [----] I, [2016-09-13T10:00:11.298256 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79348], Delivering... [----] I, [2016-09-13T10:00:11.302042 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79351], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.668621691] seconds [----] I, [2016-09-13T10:00:11.302250 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79351], Delivering... [----] I, [2016-09-13T10:00:11.308922 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034432411193847656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003463268280029297, :pending_vm_jobs=>0.0008707046508789062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006228446960449219} [----] I, [2016-09-13T10:00:11.309285 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79351], State: [ok], Delivered in [0.007058781] seconds [----] I, [2016-09-13T10:00:11.353167 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79348], State: [ok], Delivered in [0.054894263] seconds [----] I, [2016-09-13T10:00:12.856617 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79349], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.255688909] seconds [----] I, [2016-09-13T10:00:12.856802 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79349], Delivering... [----] I, [2016-09-13T10:00:12.859290 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79349], State: [ok], Delivered in [0.002479399] seconds [----] I, [2016-09-13T10:00:12.908159 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79350], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.28808997] seconds [----] I, [2016-09-13T10:00:12.908344 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79350], Delivering... [----] I, [2016-09-13T10:00:12.913368 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79350], State: [ok], Delivered in [0.004993958] seconds [----] I, [2016-09-13T10:00:12.930910 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79354], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.26338477] seconds [----] I, [2016-09-13T10:00:12.931081 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79354], Delivering... [----] I, [2016-09-13T10:00:12.933315 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79354], State: [ok], Delivered in [0.002225896] seconds [----] I, [2016-09-13T10:00:12.999604 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79355], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.320842234] seconds [----] I, [2016-09-13T10:00:12.999780 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79355], Delivering... [----] I, [2016-09-13T10:00:13.005084 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79356], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.315266919] seconds [----] I, [2016-09-13T10:00:13.005263 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79356], Delivering... [----] I, [2016-09-13T10:00:13.010080 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79355], State: [ok], Delivered in [0.010273971] seconds [----] I, [2016-09-13T10:00:13.010454 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79356], State: [ok], Delivered in [0.005140762] seconds [----] I, [2016-09-13T10:00:13.039585 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79352], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473778800], Dequeued in: [3.397408715] seconds [----] I, [2016-09-13T10:00:13.039743 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79352], Delivering... [----] I, [2016-09-13T10:00:13.045258 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79353], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473778800], Dequeued in: [3.391505099] seconds [----] I, [2016-09-13T10:00:13.045482 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79353], Delivering... [----] I, [2016-09-13T10:00:13.048899 #2937:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered Hosts] invoking action: [generate_widget] for target: [rss_newest_hosts] [----] I, [2016-09-13T10:00:13.054191 #2928:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered VMs] invoking action: [generate_widget] for target: [rss_newest_vms] [----] I, [2016-09-13T10:00:13.097841 #2928:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [222], Name: [Generate Widget: 'EVM: Recently Discovered VMs'] for: [1] groups [----] I, [2016-09-13T10:00:13.097841 #2937:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [221], Name: [Generate Widget: 'EVM: Recently Discovered Hosts'] for: [1] groups [----] I, [2016-09-13T10:00:13.124954 #2928:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered VMs] ID: [19] Queueing Content Generation [----] I, [2016-09-13T10:00:13.124952 #2937:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered Hosts] ID: [18] Queueing Content Generation [----] I, [2016-09-13T10:00:13.165995 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79358], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T10:00:13.165972 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79357], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T10:00:13.166310 #2928:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered VMs] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered VMs] [----] I, [2016-09-13T10:00:13.166313 #2937:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered Hosts] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered Hosts] [----] I, [2016-09-13T10:00:13.201300 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79352], State: [ok], Delivered in [0.16151787] seconds [----] I, [2016-09-13T10:00:13.210994 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79353], State: [ok], Delivered in [0.16550544] seconds [----] I, [2016-09-13T10:00:16.625713 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=reporting, wcount=2, priority=200 [----] I, [2016-09-13T10:00:16.627392 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003625631332397461, :worker_monitor=>1.1251466274261475, :worker_dequeue=>0.006937742233276367, :total_time=>1.1360242366790771} [----] I, [2016-09-13T10:00:18.372699 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [79357], MiqWorker id: [18], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [5.236548231] seconds [----] I, [2016-09-13T10:00:18.372879 #2978:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79357], Delivering... [----] I, [2016-09-13T10:00:18.384312 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T10:00:18.406537 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T10:00:18.406923 #2978:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79357], State: [ok], Delivered in [0.034031191] seconds [----] I, [2016-09-13T10:00:18.409448 #2978:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [79357], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T10:00:18.409623 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [19], MiqTask ID: [222], Status: [ok] [----] I, [2016-09-13T10:00:18.414837 #2978:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [222] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T10:00:18.464268 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [79358], MiqWorker id: [17], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [5.328088978] seconds [----] I, [2016-09-13T10:00:18.464524 #2967:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79358], Delivering... [----] I, [2016-09-13T10:00:18.482225 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T10:00:18.515070 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T10:00:18.515547 #2967:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79358], State: [ok], Delivered in [0.051023285] seconds [----] I, [2016-09-13T10:00:18.518007 #2967:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [79358], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T10:00:18.518165 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [18], MiqTask ID: [221], Status: [ok] [----] I, [2016-09-13T10:00:18.523543 #2967:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [221] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T10:00:21.627811 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:00:21 UTC]... [----] I, [2016-09-13T10:00:21.640920 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:00:21 UTC]...Complete [----] I, [2016-09-13T10:00:24.709596 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:00:24.737734 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79359], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:00:24.745411 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered Hosts] with id: [18] [----] I, [2016-09-13T10:00:24.745607 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_18 [----] I, [2016-09-13T10:00:24.749186 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T10:00:24.749660 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 15:00:00 UTC [----] I, [2016-09-13T10:00:24.751476 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered Hosts] schedule updated to run at 2016-09-13 15:00:00 UTC with interval 3600 [----] I, [2016-09-13T10:00:24.751850 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered VMs] with id: [19] [----] I, [2016-09-13T10:00:24.751981 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_19 [----] I, [2016-09-13T10:00:24.755088 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T10:00:24.755533 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 15:00:00 UTC [----] I, [2016-09-13T10:00:24.757235 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered VMs] schedule updated to run at 2016-09-13 15:00:00 UTC with interval 3600 [----] I, [2016-09-13T10:00:26.662279 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:00:27.423992 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79359], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.705897114] seconds [----] I, [2016-09-13T10:00:27.424155 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79359], Delivering... [----] I, [2016-09-13T10:00:27.429902 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028564929962158203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029020309448242188, :pending_vm_jobs=>0.0007588863372802734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005405426025390625} [----] I, [2016-09-13T10:00:27.430251 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79359], State: [ok], Delivered in [0.00608374] seconds [----] I, [2016-09-13T10:00:32.871120 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033435821533203125, :worker_monitor=>1.1954569816589355, :worker_dequeue=>0.005289554595947266, :total_time=>1.2043755054473877} [----] I, [2016-09-13T10:00:39.760564 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:00:39.801020 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79360], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:00:39.818162 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79361], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:00:42.890136 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:00:43.329078 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79361], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.524256471] seconds [----] I, [2016-09-13T10:00:43.329259 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79361], Delivering... [----] I, [2016-09-13T10:00:43.333238 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79360], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.547179296] seconds [----] I, [2016-09-13T10:00:43.333512 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79360], Delivering... [----] I, [2016-09-13T10:00:43.338166 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004208564758300781, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004233598709106445, :pending_vm_jobs=>0.0012211799621582031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008416891098022461} [----] I, [2016-09-13T10:00:43.338699 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79361], State: [ok], Delivered in [0.009418628] seconds [----] I, [2016-09-13T10:00:43.339938 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79360], State: [ok], Delivered in [0.006414649] seconds [----] I, [2016-09-13T10:00:48.894603 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0026578903198242188, :worker_monitor=>0.9930150508880615, :worker_dequeue=>0.005902767181396484, :total_time=>1.0017893314361572} [----] I, [2016-09-13T10:00:53.895142 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:00:53 UTC]... [----] I, [2016-09-13T10:00:53.921314 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:00:53 UTC]...Complete [----] I, [2016-09-13T10:00:54.826310 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:00:54.869975 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79362], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:00:59.056927 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:00:59.653370 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79362], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.81765352] seconds [----] I, [2016-09-13T10:00:59.653615 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79362], Delivering... [----] I, [2016-09-13T10:00:59.661755 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034236907958984375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003446340560913086, :pending_vm_jobs=>0.001074075698852539, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007704019546508789} [----] I, [2016-09-13T10:00:59.662254 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79362], State: [ok], Delivered in [0.008612265] seconds [----] I, [2016-09-13T10:01:05.485995 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005135536193847656, :worker_monitor=>1.4133236408233643, :worker_dequeue=>0.0076618194580078125, :total_time=>1.4264323711395264} [----] I, [2016-09-13T10:01:10.204248 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T10:01:10.218759 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79363], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:01:10.247502 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79364], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:01:10.270407 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79365], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:01:10.294085 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79366], id: [], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:01:10.321860 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79367], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:01:10.500075 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:01:10.727857 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79363], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.517353889] seconds [----] I, [2016-09-13T10:01:10.728144 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79363], Delivering... [----] I, [2016-09-13T10:01:10.762189 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79367], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.46210621] seconds [----] I, [2016-09-13T10:01:10.762536 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79367], Delivering... [----] I, [2016-09-13T10:01:10.770532 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00484013557434082, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0048639774322509766, :pending_vm_jobs=>0.0007631778717041016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00745844841003418} [----] I, [2016-09-13T10:01:10.770895 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79367], State: [ok], Delivered in [0.008383517] seconds [----] I, [2016-09-13T10:01:10.824613 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79363], State: [ok], Delivered in [0.096473612] seconds [----] I, [2016-09-13T10:01:13.527429 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79365], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.271475373] seconds [----] I, [2016-09-13T10:01:13.527559 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79365], Delivering... [----] I, [2016-09-13T10:01:13.530682 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79365], State: [ok], Delivered in [0.003121644] seconds [----] I, [2016-09-13T10:01:13.533032 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79364], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.307882159] seconds [----] I, [2016-09-13T10:01:13.533142 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79364], Delivering... [----] I, [2016-09-13T10:01:13.537336 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79364], State: [ok], Delivered in [0.00418752] seconds [----] I, [2016-09-13T10:01:13.573302 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79366], MiqWorker id: [14], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.290797748] seconds [----] I, [2016-09-13T10:01:13.573597 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79366], Delivering... [----] I, [2016-09-13T10:01:22.393292 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004637002944946289, :worker_monitor=>1.8708772659301758, :worker_dequeue=>0.00538945198059082, :total_time=>1.881234884262085} [----] I, [2016-09-13T10:01:25.333614 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:01:25.379957 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79368], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:01:27.393912 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:01:27 UTC]... [----] I, [2016-09-13T10:01:27.471694 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:01:27 UTC]...Complete [----] I, [2016-09-13T10:01:27.478875 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:01:27.930282 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79368], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.592014349] seconds [----] I, [2016-09-13T10:01:27.930438 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79368], Delivering... [----] I, [2016-09-13T10:01:27.939964 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037097930908203125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003756999969482422, :pending_vm_jobs=>0.001650094985961914, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00917816162109375} [----] I, [2016-09-13T10:01:27.940492 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79368], State: [ok], Delivered in [0.009976775] seconds [----] I, [2016-09-13T10:01:39.376051 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041522979736328125, :worker_monitor=>1.863590955734253, :worker_dequeue=>0.0076982975006103516, :total_time=>1.8757429122924805} [----] I, [2016-09-13T10:01:40.400368 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:01:40.427616 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79369], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:01:40.469139 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79370], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:01:44.386410 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:01:45.067968 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79370], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.632284729] seconds [----] I, [2016-09-13T10:01:45.068104 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79370], Delivering... [----] I, [2016-09-13T10:01:45.073065 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026695728302001953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026886463165283203, :pending_vm_jobs=>0.0006279945373535156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004668235778808594} [----] I, [2016-09-13T10:01:45.073347 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79370], State: [ok], Delivered in [0.005233483] seconds [----] I, [2016-09-13T10:01:46.668454 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79369], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.261218922] seconds [----] I, [2016-09-13T10:01:46.668689 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79369], Delivering... [----] I, [2016-09-13T10:01:46.674996 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79369], State: [ok], Delivered in [0.006285225] seconds [----] I, [2016-09-13T10:01:55.476960 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:01:55.525051 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79371], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:01:57.227056 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:01:57.230870 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002672433853149414, :server_monitor=>0.09074854850769043, :worker_monitor=>2.7248144149780273, :worker_dequeue=>0.008405208587646484, :total_time=>2.826953172683716} [----] I, [2016-09-13T10:01:58.235155 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79371], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.75422881] seconds [----] I, [2016-09-13T10:01:58.235293 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79371], Delivering... [----] I, [2016-09-13T10:01:58.239577 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002328157424926758, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023446083068847656, :pending_vm_jobs=>0.0004782676696777344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003964662551879883} [----] I, [2016-09-13T10:01:58.239835 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79371], State: [ok], Delivered in [0.004529172] seconds [----] I, [2016-09-13T10:02:02.231451 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:02:02 UTC]... [----] I, [2016-09-13T10:02:02.296873 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:02:02 UTC]...Complete [----] I, [2016-09-13T10:02:10.537050 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:02:10.565819 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79372], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:02:10.640079 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79373], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:02:10.723320 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79374], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:02:10.758953 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79375], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:02:14.556175 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:02:14.561461 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004490375518798828, :worker_monitor=>2.2191171646118164, :worker_dequeue=>0.011840581893920898, :total_time=>2.235832452774048} [----] I, [2016-09-13T10:02:15.376247 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79372], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.833190273] seconds [----] I, [2016-09-13T10:02:15.376525 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79372], Delivering... [----] I, [2016-09-13T10:02:15.496739 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79372], State: [ok], Delivered in [0.12020598] seconds [----] I, [2016-09-13T10:02:15.496855 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79375], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.763969812] seconds [----] I, [2016-09-13T10:02:15.496977 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79375], Delivering... [----] I, [2016-09-13T10:02:15.505118 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004244089126586914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004291057586669922, :pending_vm_jobs=>0.0010576248168945312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00782918930053711} [----] I, [2016-09-13T10:02:15.505555 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79375], State: [ok], Delivered in [0.008545108] seconds [----] I, [2016-09-13T10:02:16.908705 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79373], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.335193097] seconds [----] I, [2016-09-13T10:02:16.909018 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79373], Delivering... [----] I, [2016-09-13T10:02:16.917814 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79373], State: [ok], Delivered in [0.008750017] seconds [----] I, [2016-09-13T10:02:16.999722 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79374], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.347974404] seconds [----] I, [2016-09-13T10:02:16.999942 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79374], Delivering... [----] I, [2016-09-13T10:02:17.004731 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79374], State: [ok], Delivered in [0.004785964] seconds [----] I, [2016-09-13T10:02:25.771531 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:02:25.797514 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79376], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:02:31.518686 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:02:31.523485 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038912296295166016, :worker_monitor=>1.9192447662353516, :worker_dequeue=>0.010411977767944336, :total_time=>1.9338696002960205} [----] I, [2016-09-13T10:02:31.726525 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79376], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.948836462] seconds [----] I, [2016-09-13T10:02:31.726660 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79376], Delivering... [----] I, [2016-09-13T10:02:31.732606 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034732818603515625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035080909729003906, :pending_vm_jobs=>0.0008304119110107422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005658388137817383} [----] I, [2016-09-13T10:02:31.733771 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79376], State: [ok], Delivered in [0.00709385] seconds [----] I, [2016-09-13T10:02:36.524057 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:02:36 UTC]... [----] I, [2016-09-13T10:02:36.607822 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:02:36 UTC]...Complete [----] I, [2016-09-13T10:02:40.808038 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:02:40.829637 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79377], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:02:40.869836 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79378], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:02:41.629048 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:02:41.782385 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79378], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.947900547] seconds [----] I, [2016-09-13T10:02:41.782604 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79378], Delivering... [----] I, [2016-09-13T10:02:41.787138 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024421215057373047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002455472946166992, :pending_vm_jobs=>0.000537872314453125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004240512847900391} [----] I, [2016-09-13T10:02:41.787434 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79378], State: [ok], Delivered in [0.004800679] seconds [----] I, [2016-09-13T10:02:44.175209 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79377], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.362711869] seconds [----] I, [2016-09-13T10:02:44.175351 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79377], Delivering... [----] I, [2016-09-13T10:02:44.179050 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79377], State: [ok], Delivered in [0.00367342] seconds [----] I, [2016-09-13T10:02:48.961475 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0061686038970947266, :worker_monitor=>2.3052048683166504, :worker_dequeue=>0.01592254638671875, :total_time=>2.3277482986450195} [----] I, [2016-09-13T10:02:49.746348 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79366], State: [ok], Delivered in [96.172718707] seconds [----] I, [2016-09-13T10:02:55.881594 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:02:55.922562 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79379], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:02:59.187291 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:02:59.351975 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79379], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.462762014] seconds [----] I, [2016-09-13T10:02:59.352166 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79379], Delivering... [----] I, [2016-09-13T10:02:59.358255 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003206014633178711, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032274723052978516, :pending_vm_jobs=>0.00079345703125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005697727203369141} [----] I, [2016-09-13T10:02:59.358602 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79379], State: [ok], Delivered in [0.006435267] seconds [----] I, [2016-09-13T10:03:05.706062 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004665374755859375, :worker_monitor=>1.5040690898895264, :worker_dequeue=>0.005924701690673828, :total_time=>1.5149314403533936} [----] I, [2016-09-13T10:03:10.706821 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:03:10 UTC]... [----] I, [2016-09-13T10:03:10.736795 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:03:10 UTC]...Complete [----] I, [2016-09-13T10:03:10.935148 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:03:10.959578 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79380], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:03:10.988122 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79381], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:03:11.016968 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79382], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:03:11.074083 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79383], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:03:15.768135 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:03:16.061309 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79380], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.121694176] seconds [----] I, [2016-09-13T10:03:16.061480 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79380], Delivering... [----] I, [2016-09-13T10:03:16.071864 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79383], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.046126153] seconds [----] I, [2016-09-13T10:03:16.072134 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79383], Delivering... [----] I, [2016-09-13T10:03:16.081598 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004835367202758789, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004866361618041992, :pending_vm_jobs=>0.0011365413665771484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008874893188476562} [----] I, [2016-09-13T10:03:16.082064 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79383], State: [ok], Delivered in [0.009943958] seconds [----] I, [2016-09-13T10:03:16.134438 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79380], State: [ok], Delivered in [0.072881318] seconds [----] I, [2016-09-13T10:03:16.869404 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79381], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.904479371] seconds [----] I, [2016-09-13T10:03:16.869621 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79381], Delivering... [----] I, [2016-09-13T10:03:16.876612 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79381], State: [ok], Delivered in [0.006993222] seconds [----] I, [2016-09-13T10:03:16.921709 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79382], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.925568634] seconds [----] I, [2016-09-13T10:03:16.921904 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79382], Delivering... [----] I, [2016-09-13T10:03:16.925956 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79382], State: [ok], Delivered in [0.00405997] seconds [----] I, [2016-09-13T10:03:21.962276 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.008686065673828125, :worker_monitor=>1.1732802391052246, :worker_dequeue=>0.008901357650756836, :total_time=>1.1911466121673584} [----] I, [2016-09-13T10:03:26.085152 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:03:26.121587 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79384], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:03:26.971399 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:03:27.230714 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79384], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.140486982] seconds [----] I, [2016-09-13T10:03:27.230912 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79384], Delivering... [----] I, [2016-09-13T10:03:27.237072 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003385782241821289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034112930297851562, :pending_vm_jobs=>0.0006878376007080078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005819082260131836} [----] I, [2016-09-13T10:03:27.237453 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79384], State: [ok], Delivered in [0.006497025] seconds [----] I, [2016-09-13T10:03:38.241040 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005164623260498047, :worker_monitor=>1.2258658409118652, :worker_dequeue=>0.00775599479675293, :total_time=>1.2391986846923828} [----] I, [2016-09-13T10:03:41.135063 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T10:03:41.155974 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79385], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:03:41.178560 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79386], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:03:41.209384 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79387], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:03:41.242663 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79388], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:03:43.241631 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:03:43 UTC]... [----] I, [2016-09-13T10:03:43.259706 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:03:43 UTC]...Complete [----] I, [2016-09-13T10:03:43.271839 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:03:43.351646 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79386], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.191305215] seconds [----] I, [2016-09-13T10:03:43.351827 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79386], Delivering... [----] I, [2016-09-13T10:03:43.352733 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T10:03:43.352917 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4557529088 [----] I, [2016-09-13T10:03:43.353002 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4325728256 [----] I, [2016-09-13T10:03:43.353069 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 231800832 [----] I, [2016-09-13T10:03:43.353137 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T10:03:43.353221 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4271624192 [----] I, [2016-09-13T10:03:43.353293 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T10:03:43.353361 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T10:03:43.353505 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 554184704 [----] I, [2016-09-13T10:03:43.353580 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T10:03:43.353644 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6654095360 [----] I, [2016-09-13T10:03:43.353708 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T10:03:43.353768 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T10:03:43.353831 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T10:03:43.353893 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 708608 [----] I, [2016-09-13T10:03:43.353960 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T10:03:43.354051 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T10:03:43.354120 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T10:03:43.354185 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T10:03:43.354244 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T10:03:43.354306 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T10:03:43.354382 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 274501632 [----] I, [2016-09-13T10:03:43.354506 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 57425920 [----] I, [2016-09-13T10:03:43.354576 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217075712 [----] I, [2016-09-13T10:03:43.354640 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6111232 [----] I, [2016-09-13T10:03:43.354700 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142495744 [----] I, [2016-09-13T10:03:43.354766 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3395084288 [----] I, [2016-09-13T10:03:43.354829 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3068047360 [----] I, [2016-09-13T10:03:43.354891 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T10:03:43.354952 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T10:03:43.355009 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T10:03:43.355066 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36642816 [----] I, [2016-09-13T10:03:43.355133 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102281216 [----] I, [2016-09-13T10:03:43.355193 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53862400 [----] I, [2016-09-13T10:03:43.355250 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111529984 [----] I, [2016-09-13T10:03:43.355310 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 156143616 [----] I, [2016-09-13T10:03:43.355384 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T10:03:43.355498 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T10:03:43.355568 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T10:03:43.355632 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T10:03:43.355692 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T10:03:43.355779 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T10:03:43.355850 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T10:03:43.355912 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T10:03:43.355973 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T10:03:43.368835 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79387], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.187002149] seconds [----] I, [2016-09-13T10:03:43.369080 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79387], Delivering... [----] I, [2016-09-13T10:03:43.380476 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:03:33 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347778000], Memory % [5.04], CPU Time [105794.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T10:03:43.381405 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:03:37 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202685000], Memory % [3.38], CPU Time [152757.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:03:43.382277 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:03:36 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169744000], Memory % [3.14], CPU Time [52268.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:03:43.383019 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:03:28 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [213405000], Memory % [3.5], CPU Time [49505.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T10:03:43.383737 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:03:35 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163149000], Memory % [3.1], CPU Time [38492.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T10:03:43.384237 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:03:38 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359293000], Memory % [5.28], CPU Time [206945.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T10:03:43.384745 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:03:26 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [206035000], Memory % [3.5], CPU Time [243436.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T10:03:43.385279 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:03:37 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201169000], Memory % [3.36], CPU Time [153665.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:03:43.388067 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:03:30 UTC], Process Info: Memory Usage [602501120], Memory Size [934297600], Proportional Set Size: [440998000], Memory % [7.35], CPU Time [787.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T10:03:43.390185 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:03:37 UTC], Process Info: Memory Usage [601300992], Memory Size [945086464], Proportional Set Size: [439435000], Memory % [7.33], CPU Time [301.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T10:03:43.390729 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:03:35 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358592000], Memory % [5.27], CPU Time [212828.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T10:03:43.391221 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:03:37 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178471000], Memory % [3.2], CPU Time [52254.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:03:43.391686 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:03:35 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166757000], Memory % [3.16], CPU Time [39392.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T10:03:43.392025 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79387], State: [ok], Delivered in [0.022963157] seconds [----] I, [2016-09-13T10:03:43.396277 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T10:03:43.396565 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T10:03:43.401605 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T10:03:43.405519 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T10:03:43.410048 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T10:03:43.414705 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T10:03:43.419183 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T10:03:43.423744 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 852 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T10:03:43.428270 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T10:03:43.431582 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T10:03:43.434572 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.8 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T10:03:43.437308 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T10:03:43.441443 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 183 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T10:03:43.446284 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T10:03:43.448891 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:03:43.449024 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:03:43.449119 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T10:03:43.453135 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202685000], Memory % [3.38], CPU Time [153660.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:03:43.453469 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79386], State: [ok], Delivered in [0.101603331] seconds [----] I, [2016-09-13T10:03:43.454132 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79388], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.240360081] seconds [----] I, [2016-09-13T10:03:43.454294 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79388], Delivering... [----] I, [2016-09-13T10:03:43.460310 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031554698944091797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003175497055053711, :pending_vm_jobs=>0.0007653236389160156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0056264400482177734} [----] I, [2016-09-13T10:03:43.460668 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79388], State: [ok], Delivered in [0.006355647] seconds [----] I, [2016-09-13T10:03:44.071120 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79385], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.931489174] seconds [----] I, [2016-09-13T10:03:44.071330 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79385], Delivering... [----] I, [2016-09-13T10:03:44.075641 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79385], State: [ok], Delivered in [0.004300149] seconds [----] I, [2016-09-13T10:03:54.669843 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038738250732421875, :worker_monitor=>1.3681397438049316, :worker_dequeue=>0.012873649597167969, :total_time=>1.3852136135101318} [----] I, [2016-09-13T10:03:56.258610 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:03:56.289047 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79389], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:03:59.784775 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:04:00.693399 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79389], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.427425678] seconds [----] I, [2016-09-13T10:04:00.693645 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79389], Delivering... [----] I, [2016-09-13T10:04:00.702346 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0045659542083740234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0045928955078125, :pending_vm_jobs=>0.0009303092956542969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008257389068603516} [----] I, [2016-09-13T10:04:00.702971 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79389], State: [ok], Delivered in [0.009291251] seconds [----] I, [2016-09-13T10:04:11.043732 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0024688243865966797, :worker_monitor=>1.2256815433502197, :worker_dequeue=>0.010054826736450195, :total_time=>1.2384371757507324} [----] I, [2016-09-13T10:04:11.306087 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 14. [----] I, [2016-09-13T10:04:11.327548 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79390], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:04:11.356269 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79391], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:04:11.396389 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79392], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:04:11.419245 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79393], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:04:11.464714 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79394], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:04:16.044275 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:04:16 UTC]... [----] I, [2016-09-13T10:04:16.076372 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:04:16 UTC]...Complete [----] I, [2016-09-13T10:04:16.083849 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:04:16.801893 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79390], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.490439524] seconds [----] I, [2016-09-13T10:04:16.802066 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79390], Delivering... [----] I, [2016-09-13T10:04:16.830648 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79393], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.427440122] seconds [----] I, [2016-09-13T10:04:16.830862 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79393], Delivering... [----] I, [2016-09-13T10:04:16.840315 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003976345062255859, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004010438919067383, :pending_vm_jobs=>0.0014743804931640625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008965253829956055} [----] I, [2016-09-13T10:04:16.841851 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79393], State: [ok], Delivered in [0.010951696] seconds [----] I, [2016-09-13T10:04:16.876094 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79390], State: [ok], Delivered in [0.073986609] seconds [----] I, [2016-09-13T10:04:17.242117 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79391], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.908456079] seconds [----] I, [2016-09-13T10:04:17.242533 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79391], Delivering... [----] I, [2016-09-13T10:04:17.245899 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79391], State: [ok], Delivered in [0.003572387] seconds [----] I, [2016-09-13T10:04:17.282097 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79392], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.916410858] seconds [----] I, [2016-09-13T10:04:17.282274 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79392], Delivering... [----] I, [2016-09-13T10:04:17.286996 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79392], State: [ok], Delivered in [0.004701414] seconds [----] I, [2016-09-13T10:04:17.316669 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79394], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.87913156] seconds [----] I, [2016-09-13T10:04:17.316845 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79394], Delivering... [----] I, [2016-09-13T10:04:17.344912 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79395], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T10:04:17.345346 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79394], State: [ok], Delivered in [0.028466201] seconds [----] I, [2016-09-13T10:04:21.100060 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T10:04:26.476808 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:04:26.493059 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79396], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:04:27.461092 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:04:27.465473 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T10:04:27.465662 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005723237991333008, :worker_monitor=>1.3490614891052246, :worker_dequeue=>0.009896278381347656, :total_time=>1.3650553226470947} [----] I, [2016-09-13T10:04:27.944802 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79396], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.462883762] seconds [----] I, [2016-09-13T10:04:27.944973 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79396], Delivering... [----] I, [2016-09-13T10:04:27.951703 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003661632537841797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003682374954223633, :pending_vm_jobs=>0.0008590221405029297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063703060150146484} [----] I, [2016-09-13T10:04:27.952033 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79396], State: [ok], Delivered in [0.007050021] seconds [----] I, [2016-09-13T10:04:30.905513 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [79395], MiqWorker id: [102], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [13.57318824] seconds [----] I, [2016-09-13T10:04:30.905745 #17546:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79395], Delivering... [----] I, [2016-09-13T10:04:30.909813 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T10:04:30.910016 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T10:04:30.910155 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T10:04:30.910393 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T10:04:30.910623 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:37.429024 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:37.733466 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:37.733662 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:38.238809 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:38.555249 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:38.555433 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:39.050848 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:39.352989 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:39.353234 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:39.830115 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:40.143200 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:40.143407 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:40.632153 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:40.931618 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:40.931803 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:41.417126 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:41.505032 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:04:41.523739 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79397], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:04:41.539012 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79398], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:04:41.723292 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:41.723507 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:42.197699 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:42.520046 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:42.520217 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:43.072579 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:43.380261 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:43.380439 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:43.687046 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:04:43.691292 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004319667816162109, :worker_monitor=>1.185300350189209, :worker_dequeue=>0.009502410888671875, :total_time=>1.1994457244873047} [----] I, [2016-09-13T10:04:43.902265 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:44.076571 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79398], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.546504943] seconds [----] I, [2016-09-13T10:04:44.076742 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79398], Delivering... [----] I, [2016-09-13T10:04:44.082590 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030188560485839844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030395984649658203, :pending_vm_jobs=>0.0007386207580566406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055201053619384766} [----] I, [2016-09-13T10:04:44.082938 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79398], State: [ok], Delivered in [0.006191771] seconds [----] I, [2016-09-13T10:04:44.188581 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:44.188755 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:44.430770 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79397], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.920639238] seconds [----] I, [2016-09-13T10:04:44.430953 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79397], Delivering... [----] I, [2016-09-13T10:04:44.435585 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79397], State: [ok], Delivered in [0.004621501] seconds [----] I, [2016-09-13T10:04:44.641643 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:44.944237 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:44.944453 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:45.439330 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:45.741390 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:45.741588 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:46.207844 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:46.518562 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:46.518730 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:47.020323 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:47.312034 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:47.312265 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:47.771625 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:48.691862 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:04:48 UTC]... [----] I, [2016-09-13T10:04:48.710481 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:04:48 UTC]...Complete [----] I, [2016-09-13T10:04:53.952686 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:54.089616 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:54.222863 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:54.352934 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:54.484639 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:54.626704 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:54.767267 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:54.909062 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:55.046862 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:55.183954 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:55.316457 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:55.448942 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:55.589342 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:55.724350 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:56.249275 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:56.396409 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:56.544231 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:56.552154 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:04:56.574608 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79399], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:04:56.680997 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:56.813406 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:56.949042 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:57.095057 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:57.295387 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:57.442704 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:57.599939 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:57.739179 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:57.876901 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:58.014651 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:58.154596 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:58.294842 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:58.468780 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:58.616550 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:59.060220 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:59.220710 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:59.363172 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:59.509173 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:59.644559 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:59.781506 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:04:59.918862 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:00.060010 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:00.193817 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:00.206716 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:05:00.211179 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003770589828491211, :worker_monitor=>1.4467658996582031, :worker_dequeue=>0.009598016738891602, :total_time=>1.4604358673095703} [----] I, [2016-09-13T10:05:00.253155 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79399], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.695215932] seconds [----] I, [2016-09-13T10:05:00.253357 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79399], Delivering... [----] I, [2016-09-13T10:05:00.259644 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003309011459350586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033273696899414062, :pending_vm_jobs=>0.0007426738739013672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058557987213134766} [----] I, [2016-09-13T10:05:00.259944 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79399], State: [ok], Delivered in [0.00659469] seconds [----] I, [2016-09-13T10:05:00.330408 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:00.468073 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:00.610702 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:00.751978 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:00.890334 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:01.088587 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:01.234113 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:01.384525 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:01.794262 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:01.949076 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:02.089652 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:02.222202 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:02.364555 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:02.528679 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:02.668555 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:02.808637 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:02.946005 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:03.085204 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:03.219537 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:03.357951 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:03.493515 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:03.630148 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:03.772314 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:03.914341 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:04.054750 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:04.440173 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:04.586002 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:04.718519 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:04.857502 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:10.346107 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T10:05:11.014264 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:11.152204 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:11.293531 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:11.433755 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:11.576582 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:11.586474 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:05:11.626658 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79400], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:05:11.668637 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79401], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:05:11.695515 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79402], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:05:11.718136 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79403], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:05:11.740846 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:11.881057 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:12.044217 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:12.183613 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:12.325224 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:12.468789 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:12.608191 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:12.746500 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:13.137848 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:13.294922 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:13.430177 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:13.571953 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:13.735660 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:13.900063 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:14.040682 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:14.180606 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:14.325876 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:14.458863 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:14.598356 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:14.737291 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:14.877519 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:15.015752 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:15.150637 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:15.294135 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:15.432473 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:15.851685 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:16.012725 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:16.151387 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:16.292568 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:16.433437 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:16.574249 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:16.721504 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:16.869789 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:16.900253 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:05:16.904647 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006851911544799805, :worker_monitor=>1.5316870212554932, :worker_dequeue=>0.010320901870727539, :total_time=>1.5492010116577148} [----] I, [2016-09-13T10:05:17.014175 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:17.157679 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:17.288304 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79400], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.697316793] seconds [----] I, [2016-09-13T10:05:17.288550 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79400], Delivering... [----] I, [2016-09-13T10:05:17.297240 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:17.345302 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79400], State: [ok], Delivered in [0.056735194] seconds [----] I, [2016-09-13T10:05:17.391195 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79403], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.689554875] seconds [----] I, [2016-09-13T10:05:17.391485 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79403], Delivering... [----] I, [2016-09-13T10:05:17.400626 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0050847530364990234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005108833312988281, :pending_vm_jobs=>0.0010533332824707031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008667469024658203} [----] I, [2016-09-13T10:05:17.401053 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79403], State: [ok], Delivered in [0.009587053] seconds [----] I, [2016-09-13T10:05:17.436869 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:17.562783 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79401], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.930540766] seconds [----] I, [2016-09-13T10:05:17.563042 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79401], Delivering... [----] I, [2016-09-13T10:05:17.567767 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79401], State: [ok], Delivered in [0.004723675] seconds [----] I, [2016-09-13T10:05:17.583771 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:17.614120 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79402], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.937152214] seconds [----] I, [2016-09-13T10:05:17.614408 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79402], Delivering... [----] I, [2016-09-13T10:05:17.620992 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79402], State: [ok], Delivered in [0.006591207] seconds [----] I, [2016-09-13T10:05:17.736382 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:17.884172 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:18.024975 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:18.172132 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:18.572956 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:18.774844 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:18.914658 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:19.063493 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:19.207527 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:19.350866 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:19.485018 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:19.618572 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:19.761389 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:19.898481 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:20.044023 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:20.190561 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:20.363394 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:20.509658 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:20.666720 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:20.804067 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:20.947924 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:21.349591 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:21.512389 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:21.652126 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:21.807065 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:21.905156 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:05:21 UTC]... [----] I, [2016-09-13T10:05:21.919784 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:05:21 UTC]...Complete [----] I, [2016-09-13T10:05:21.947350 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:22.081934 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:22.225150 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:22.364315 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:22.507116 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:22.647851 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:22.793645 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:22.933211 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:23.071615 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:23.210598 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:23.353648 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:23.497482 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:23.647683 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:24.000532 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:24.148464 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:24.292081 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:24.432299 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:24.567347 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:24.729799 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:24.872403 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:25.017033 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:25.159903 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:25.298073 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:25.440910 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:25.580985 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:25.734445 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:25.875651 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:26.027638 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:26.168204 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:26.316709 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:26.660143 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:26.729540 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:05:26.754567 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79404], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:05:26.808606 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:26.940637 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:05:26.954617 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:27.107840 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:27.258091 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:27.394969 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:27.469058 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79404], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.733709097] seconds [----] I, [2016-09-13T10:05:27.469231 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79404], Delivering... [----] I, [2016-09-13T10:05:27.475167 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003175973892211914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003196239471435547, :pending_vm_jobs=>0.0006632804870605469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005588531494140625} [----] I, [2016-09-13T10:05:27.475542 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79404], State: [ok], Delivered in [0.006305396] seconds [----] I, [2016-09-13T10:05:27.535773 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:27.716001 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:27.858963 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:27.992119 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:28.129559 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:28.271285 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:28.417567 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:28.555168 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:28.699644 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:28.833939 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:28.971730 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:29.359715 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:29.507795 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:29.640461 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:29.798467 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:29.943989 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:30.085322 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:30.227587 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:30.370145 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:30.511118 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:30.650816 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:30.796869 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:30.933446 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:31.076653 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:31.213672 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:31.349474 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:31.489108 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:31.631114 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:32.157181 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:32.316411 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:32.456870 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:32.596627 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:32.737044 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:32.871090 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:33.013739 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:33.126351 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0059146881103515625, :worker_monitor=>1.1635706424713135, :worker_dequeue=>0.010775566101074219, :total_time=>1.1807880401611328} [----] I, [2016-09-13T10:05:33.151011 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:33.283890 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:33.431469 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:33.576286 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:33.716278 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:33.851013 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:34.003704 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:34.142580 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:34.276880 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:34.421605 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:34.768451 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:34.918739 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:35.053759 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:35.193012 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:35.335674 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:35.475765 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:35.619842 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:35.759983 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:35.893111 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:36.033288 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:36.177392 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:36.322899 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:36.463945 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:36.599884 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:36.747004 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:36.890319 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:05:37.024715 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T10:05:37.220998 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T10:05:37.221322 #17546:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T10:05:37.221652 #17546:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T10:05:37.221770 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T10:05:37.221874 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T10:05:37.246200 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T10:05:37.246715 #17546:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [79395], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T10:05:37.247000 #17546:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T10:05:37.247240 #17546:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T10:05:37.247465 #17546:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79395], State: [error], Delivered in [66.341711385] seconds [----] I, [2016-09-13T10:05:41.766771 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:05:41.777263 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79405], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:05:41.788765 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79406], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:05:43.153624 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:05:43.577658 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79406], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.794779876] seconds [----] I, [2016-09-13T10:05:43.577825 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79406], Delivering... [----] I, [2016-09-13T10:05:43.583562 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002957582473754883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029740333557128906, :pending_vm_jobs=>0.0007371902465820312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005427122116088867} [----] I, [2016-09-13T10:05:43.583899 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79406], State: [ok], Delivered in [0.006068368] seconds [----] I, [2016-09-13T10:05:44.714743 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79405], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.9434574] seconds [----] I, [2016-09-13T10:05:44.714921 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79405], Delivering... [----] I, [2016-09-13T10:05:44.719347 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79405], State: [ok], Delivered in [0.004406282] seconds [----] I, [2016-09-13T10:05:49.226028 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004721164703369141, :worker_monitor=>1.0524263381958008, :worker_dequeue=>0.010087013244628906, :total_time=>1.0676329135894775} [----] I, [2016-09-13T10:05:54.226693 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:05:54 UTC]... [----] I, [2016-09-13T10:05:54.257839 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:05:54 UTC]...Complete [----] I, [2016-09-13T10:05:56.799988 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:05:56.823300 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79407], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:05:59.284624 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:05:59.686859 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79407], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.878256369] seconds [----] I, [2016-09-13T10:05:59.687060 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79407], Delivering... [----] I, [2016-09-13T10:05:59.693290 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033605098724365234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003387451171875, :pending_vm_jobs=>0.0007190704345703125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005849599838256836} [----] I, [2016-09-13T10:05:59.693678 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79407], State: [ok], Delivered in [0.006627345] seconds [----] I, [2016-09-13T10:06:05.448524 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006459712982177734, :worker_monitor=>1.1464745998382568, :worker_dequeue=>0.006096601486206055, :total_time=>1.159294843673706} [----] I, [2016-09-13T10:06:11.836763 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:06:11.875212 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79408], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:06:11.892076 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79409], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:06:11.913679 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79410], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:06:11.942248 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79411], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:06:15.605023 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:06:15.809520 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79408], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.968357416] seconds [----] I, [2016-09-13T10:06:15.809764 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79408], Delivering... [----] I, [2016-09-13T10:06:15.815108 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79411], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.895555471] seconds [----] I, [2016-09-13T10:06:15.815267 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79411], Delivering... [----] I, [2016-09-13T10:06:15.821519 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032401084899902344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003265380859375, :pending_vm_jobs=>0.0008366107940673828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005864143371582031} [----] I, [2016-09-13T10:06:15.821879 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79411], State: [ok], Delivered in [0.006603515] seconds [----] I, [2016-09-13T10:06:15.866750 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79408], State: [ok], Delivered in [0.056976276] seconds [----] I, [2016-09-13T10:06:17.849387 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79409], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.968590792] seconds [----] I, [2016-09-13T10:06:17.849615 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79409], Delivering... [----] I, [2016-09-13T10:06:17.853020 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79409], State: [ok], Delivered in [0.003389198] seconds [----] I, [2016-09-13T10:06:17.866512 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79410], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.966348144] seconds [----] I, [2016-09-13T10:06:17.866714 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79410], Delivering... [----] I, [2016-09-13T10:06:17.873084 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79410], State: [ok], Delivered in [0.006341214] seconds [----] I, [2016-09-13T10:06:21.725853 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039560794830322266, :worker_monitor=>1.1059784889221191, :worker_dequeue=>0.0061070919036865234, :total_time=>1.1162970066070557} [----] I, [2016-09-13T10:06:26.726497 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:06:26 UTC]... [----] I, [2016-09-13T10:06:26.746493 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:06:26 UTC]...Complete [----] I, [2016-09-13T10:06:26.953945 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:06:26.969236 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79412], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:06:31.769832 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:06:31.952929 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79412], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.992473593] seconds [----] I, [2016-09-13T10:06:31.953094 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79412], Delivering... [----] I, [2016-09-13T10:06:31.959068 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003151416778564453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031692981719970703, :pending_vm_jobs=>0.0007042884826660156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005613803863525391} [----] I, [2016-09-13T10:06:31.959385 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79412], State: [ok], Delivered in [0.006270642] seconds [----] I, [2016-09-13T10:06:37.972896 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00399017333984375, :worker_monitor=>1.1874899864196777, :worker_dequeue=>0.007160186767578125, :total_time=>1.1989123821258545} [----] I, [2016-09-13T10:06:41.980769 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:06:41.998187 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79413], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:06:42.009309 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79414], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:06:42.984145 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:06:43.055558 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79414], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.051602849] seconds [----] I, [2016-09-13T10:06:43.055744 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79414], Delivering... [----] I, [2016-09-13T10:06:43.061669 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030164718627929688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030364990234375, :pending_vm_jobs=>0.0007729530334472656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005577564239501953} [----] I, [2016-09-13T10:06:43.061993 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79414], State: [ok], Delivered in [0.006241869] seconds [----] I, [2016-09-13T10:06:44.935306 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79413], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.95011176] seconds [----] I, [2016-09-13T10:06:44.935577 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79413], Delivering... [----] I, [2016-09-13T10:06:44.939882 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79413], State: [ok], Delivered in [0.004352723] seconds [----] I, [2016-09-13T10:06:57.021140 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:06:57.039528 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79415], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:06:58.853047 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:06:58 UTC]... [----] I, [2016-09-13T10:06:58.878532 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:06:58 UTC]...Complete [----] I, [2016-09-13T10:06:58.890278 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:06:59.158267 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79415], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.130984343] seconds [----] I, [2016-09-13T10:06:59.158496 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79415], Delivering... [----] I, [2016-09-13T10:06:59.164472 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031027793884277344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031218528747558594, :pending_vm_jobs=>0.0007348060607910156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005563974380493164} [----] I, [2016-09-13T10:06:59.164798 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79415], State: [ok], Delivered in [0.006304811] seconds [----] I, [2016-09-13T10:07:10.110060 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038900375366210938, :worker_monitor=>1.1893763542175293, :worker_dequeue=>0.007761955261230469, :total_time=>1.2013192176818848} [----] I, [2016-09-13T10:07:12.051135 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:07:12.067014 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79416], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:07:12.083761 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79417], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:07:12.111681 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79418], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:07:12.123935 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79419], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:07:15.225055 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:07:15.301565 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79416], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.245766461] seconds [----] I, [2016-09-13T10:07:15.301751 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79416], Delivering... [----] I, [2016-09-13T10:07:15.307073 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79419], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.189804332] seconds [----] I, [2016-09-13T10:07:15.307253 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79419], Delivering... [----] I, [2016-09-13T10:07:15.313245 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003210783004760742, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003227710723876953, :pending_vm_jobs=>0.000728607177734375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0056209564208984375} [----] I, [2016-09-13T10:07:15.313599 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79419], State: [ok], Delivered in [0.006335087] seconds [----] I, [2016-09-13T10:07:15.362485 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79416], State: [ok], Delivered in [0.060645455] seconds [----] I, [2016-09-13T10:07:15.408024 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79417], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.335901494] seconds [----] I, [2016-09-13T10:07:15.408194 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79417], Delivering... [----] I, [2016-09-13T10:07:15.415325 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79417], State: [ok], Delivered in [0.007121907] seconds [----] I, [2016-09-13T10:07:15.430807 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79418], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.337628796] seconds [----] I, [2016-09-13T10:07:15.430954 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79418], Delivering... [----] I, [2016-09-13T10:07:15.434891 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79418], State: [ok], Delivered in [0.003928762] seconds [----] I, [2016-09-13T10:07:26.488073 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041828155517578125, :worker_monitor=>1.227769136428833, :worker_dequeue=>0.007891178131103516, :total_time=>1.240217924118042} [----] I, [2016-09-13T10:07:27.135828 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:07:27.157057 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79420], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:07:31.489244 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:07:31 UTC]... [----] I, [2016-09-13T10:07:31.512018 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:07:31 UTC]...Complete [----] I, [2016-09-13T10:07:31.524212 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:07:31.865717 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79420], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.723715547] seconds [----] I, [2016-09-13T10:07:31.865994 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79420], Delivering... [----] I, [2016-09-13T10:07:31.873862 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0045795440673828125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004603385925292969, :pending_vm_jobs=>0.0008335113525390625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007382392883300781} [----] I, [2016-09-13T10:07:31.874266 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79420], State: [ok], Delivered in [0.008289515] seconds [----] I, [2016-09-13T10:07:42.169482 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:07:42.179185 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79421], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:07:42.196608 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79422], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:07:43.016601 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:07:43.023380 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003958702087402344, :worker_monitor=>1.4598913192749023, :worker_dequeue=>0.01498270034790039, :total_time=>1.479140281677246} [----] I, [2016-09-13T10:07:44.003146 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79422], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.820285022] seconds [----] I, [2016-09-13T10:07:44.003301 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79422], Delivering... [----] I, [2016-09-13T10:07:44.008963 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002893686294555664, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029115676879882812, :pending_vm_jobs=>0.0006616115570068359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005303621292114258} [----] I, [2016-09-13T10:07:44.009276 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79422], State: [ok], Delivered in [0.005969888] seconds [----] I, [2016-09-13T10:07:45.553800 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79421], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.380274426] seconds [----] I, [2016-09-13T10:07:45.553968 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79421], Delivering... [----] I, [2016-09-13T10:07:45.557900 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79421], State: [ok], Delivered in [0.003931897] seconds [----] I, [2016-09-13T10:07:57.205911 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:07:57.227029 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79423], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:07:59.620682 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:07:59.623549 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005894184112548828, :worker_monitor=>1.5546574592590332, :worker_dequeue=>0.005739688873291016, :total_time=>1.5666565895080566} [----] I, [2016-09-13T10:08:00.130575 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79423], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.918665149] seconds [----] I, [2016-09-13T10:08:00.130859 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79423], Delivering... [----] I, [2016-09-13T10:08:00.138369 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0039827823638916016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004012107849121094, :pending_vm_jobs=>0.0008685588836669922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006964445114135742} [----] I, [2016-09-13T10:08:00.138828 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79423], State: [ok], Delivered in [0.007992415] seconds [----] I, [2016-09-13T10:08:04.624123 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:08:04 UTC]... [----] I, [2016-09-13T10:08:04.652026 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:08:04 UTC]...Complete [----] I, [2016-09-13T10:08:12.237070 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:08:12.250807 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79424], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:08:12.260937 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79425], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:08:12.272385 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79426], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:08:12.283905 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79427], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:08:15.952530 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:08:15.955706 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039784908294677734, :worker_monitor=>1.2591674327850342, :worker_dequeue=>0.006926059722900391, :total_time=>1.2704415321350098} [----] I, [2016-09-13T10:08:16.238860 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79424], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.998783654] seconds [----] I, [2016-09-13T10:08:16.239072 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79424], Delivering... [----] I, [2016-09-13T10:08:16.268594 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79427], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.993332485] seconds [----] I, [2016-09-13T10:08:16.268780 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79427], Delivering... [----] I, [2016-09-13T10:08:16.275662 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036385059356689453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036611557006835938, :pending_vm_jobs=>0.000865936279296875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006514787673950195} [----] I, [2016-09-13T10:08:16.275991 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79427], State: [ok], Delivered in [0.00720476] seconds [----] I, [2016-09-13T10:08:16.301208 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79424], State: [ok], Delivered in [0.062128485] seconds [----] I, [2016-09-13T10:08:18.702012 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79425], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.448064601] seconds [----] I, [2016-09-13T10:08:18.702251 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79425], Delivering... [----] I, [2016-09-13T10:08:18.705936 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79425], State: [ok], Delivered in [0.003681931] seconds [----] I, [2016-09-13T10:08:18.741961 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79426], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.476946103] seconds [----] I, [2016-09-13T10:08:18.742147 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79426], Delivering... [----] I, [2016-09-13T10:08:18.747436 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79426], State: [ok], Delivered in [0.005247749] seconds [----] I, [2016-09-13T10:08:27.296455 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:08:27.318917 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79428], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:08:32.236802 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:08:32.239098 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005886077880859375, :worker_monitor=>1.1289348602294922, :worker_dequeue=>0.005008220672607422, :total_time=>1.1402039527893066} [----] I, [2016-09-13T10:08:32.392815 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79428], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.08807133] seconds [----] I, [2016-09-13T10:08:32.392938 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79428], Delivering... [----] I, [2016-09-13T10:08:32.396819 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002077817916870117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020933151245117188, :pending_vm_jobs=>0.00048160552978515625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003647327423095703} [----] I, [2016-09-13T10:08:32.397029 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79428], State: [ok], Delivered in [0.004098207] seconds [----] I, [2016-09-13T10:08:37.239613 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:08:37 UTC]... [----] I, [2016-09-13T10:08:37.255808 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:08:37 UTC]...Complete [----] I, [2016-09-13T10:08:42.334312 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T10:08:42.349092 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79429], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:08:42.354584 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79430], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:08:42.360328 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79431], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:08:42.365974 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79432], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:08:48.308219 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:08:48.310585 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003999471664428711, :worker_monitor=>1.0132927894592285, :worker_dequeue=>0.005148887634277344, :total_time=>1.0227124691009521} [----] I, [2016-09-13T10:08:48.515293 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79430], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.163675292] seconds [----] I, [2016-09-13T10:08:48.515488 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79430], Delivering... [----] I, [2016-09-13T10:08:48.516558 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T10:08:48.516727 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4572405760 [----] I, [2016-09-13T10:08:48.516800 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4340113408 [----] I, [2016-09-13T10:08:48.516861 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 232292352 [----] I, [2016-09-13T10:08:48.516919 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T10:08:48.516979 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4283400192 [----] I, [2016-09-13T10:08:48.517034 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T10:08:48.517091 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T10:08:48.517144 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 554446848 [----] I, [2016-09-13T10:08:48.517200 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T10:08:48.517255 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6805491712 [----] I, [2016-09-13T10:08:48.517307 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T10:08:48.517380 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T10:08:48.517470 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T10:08:48.517537 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 24576 [----] I, [2016-09-13T10:08:48.517593 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T10:08:48.517648 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T10:08:48.517701 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T10:08:48.517756 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T10:08:48.517811 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T10:08:48.517862 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T10:08:48.517917 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 271659008 [----] I, [2016-09-13T10:08:48.517973 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 54812672 [----] I, [2016-09-13T10:08:48.518056 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216846336 [----] I, [2016-09-13T10:08:48.518115 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6094848 [----] I, [2016-09-13T10:08:48.518169 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142495744 [----] I, [2016-09-13T10:08:48.518225 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3384389632 [----] I, [2016-09-13T10:08:48.518279 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3057090560 [----] I, [2016-09-13T10:08:48.518332 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T10:08:48.518456 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T10:08:48.518534 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T10:08:48.518591 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36868096 [----] I, [2016-09-13T10:08:48.518647 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102281216 [----] I, [2016-09-13T10:08:48.518704 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53846016 [----] I, [2016-09-13T10:08:48.518764 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111529984 [----] I, [2016-09-13T10:08:48.518817 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 156127232 [----] I, [2016-09-13T10:08:48.518874 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T10:08:48.518929 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T10:08:48.518985 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T10:08:48.519038 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T10:08:48.519098 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T10:08:48.519155 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T10:08:48.519206 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T10:08:48.519266 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T10:08:48.519321 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T10:08:48.521036 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79431], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.164332921] seconds [----] I, [2016-09-13T10:08:48.521163 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79431], Delivering... [----] I, [2016-09-13T10:08:48.526810 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:08:46 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169745000], Memory % [3.14], CPU Time [52283.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:08:48.527187 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:08:40 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [213405000], Memory % [3.5], CPU Time [49541.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T10:08:48.527635 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:08:42 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [206036000], Memory % [3.5], CPU Time [243559.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T10:08:48.528041 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:08:47 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163149000], Memory % [3.1], CPU Time [38502.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T10:08:48.528481 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:08:45 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359293000], Memory % [5.28], CPU Time [207034.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T10:08:48.528899 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:08:47 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202685000], Memory % [3.38], CPU Time [152871.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:08:48.529222 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:08:45 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347778000], Memory % [5.04], CPU Time [105811.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T10:08:48.529631 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:08:47 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201169000], Memory % [3.36], CPU Time [153777.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:08:48.531793 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:08:47 UTC], Process Info: Memory Usage [613838848], Memory Size [1071538176], Proportional Set Size: [452183000], Memory % [7.48], CPU Time [921.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T10:08:48.533317 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:08:47 UTC], Process Info: Memory Usage [601530368], Memory Size [959766528], Proportional Set Size: [439730000], Memory % [7.33], CPU Time [314.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T10:08:48.533761 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:08:45 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358592000], Memory % [5.27], CPU Time [212891.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T10:08:48.534135 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:08:46 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178471000], Memory % [3.2], CPU Time [52270.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:08:48.534502 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:08:47 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166758000], Memory % [3.16], CPU Time [39403.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T10:08:48.534693 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79431], State: [ok], Delivered in [0.013527915] seconds [----] I, [2016-09-13T10:08:48.548100 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T10:08:48.548321 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T10:08:48.553261 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T10:08:48.557124 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T10:08:48.561549 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T10:08:48.564208 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T10:08:48.566928 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79432], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.20363556] seconds [----] I, [2016-09-13T10:08:48.567030 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T10:08:48.567131 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79432], Delivering... [----] I, [2016-09-13T10:08:48.569805 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 852 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T10:08:48.572479 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T10:08:48.574610 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003984928131103516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004010438919067383, :pending_vm_jobs=>0.0009081363677978516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007040500640869141} [----] I, [2016-09-13T10:08:48.574949 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79432], State: [ok], Delivered in [0.007831442] seconds [----] I, [2016-09-13T10:08:48.575055 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T10:08:48.577658 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T10:08:48.580270 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T10:08:48.582940 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T10:08:48.585434 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T10:08:48.588018 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:08:48.588169 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:08:48.588280 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T10:08:48.592816 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201169000], Memory % [3.36], CPU Time [152861.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:08:48.593161 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79430], State: [ok], Delivered in [0.07764998] seconds [----] I, [2016-09-13T10:08:48.806776 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79429], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.46953822] seconds [----] I, [2016-09-13T10:08:48.806927 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79429], Delivering... [----] I, [2016-09-13T10:08:48.810973 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79429], State: [ok], Delivered in [0.00404231] seconds [----] I, [2016-09-13T10:08:57.374153 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:08:57.389712 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79433], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:08:58.342946 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:08:58.687079 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79433], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.307079331] seconds [----] I, [2016-09-13T10:08:58.687287 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79433], Delivering... [----] I, [2016-09-13T10:08:58.694916 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038967132568359375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003922700881958008, :pending_vm_jobs=>0.0009829998016357422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007126808166503906} [----] I, [2016-09-13T10:08:58.695334 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79433], State: [ok], Delivered in [0.008032975] seconds [----] I, [2016-09-13T10:09:04.608142 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041484832763671875, :worker_monitor=>1.2471542358398438, :worker_dequeue=>0.008948802947998047, :total_time=>1.2605431079864502} [----] I, [2016-09-13T10:09:09.608794 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:09:09 UTC]... [----] I, [2016-09-13T10:09:09.623889 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:09:09 UTC]...Complete [----] I, [2016-09-13T10:09:12.404763 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:09:12.418224 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79434], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:09:12.429792 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79435], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:09:12.446941 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79436], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:09:12.458180 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79437], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:09:14.650472 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:09:14.790069 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79434], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.380569137] seconds [----] I, [2016-09-13T10:09:14.790292 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79434], Delivering... [----] I, [2016-09-13T10:09:14.829909 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79437], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.377441351] seconds [----] I, [2016-09-13T10:09:14.830075 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79437], Delivering... [----] I, [2016-09-13T10:09:14.836584 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003325223922729492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00336456298828125, :pending_vm_jobs=>0.0008342266082763672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006147146224975586} [----] I, [2016-09-13T10:09:14.836941 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79437], State: [ok], Delivered in [0.00685858] seconds [----] I, [2016-09-13T10:09:14.854207 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79434], State: [ok], Delivered in [0.063920191] seconds [----] I, [2016-09-13T10:09:15.932992 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79435], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.509833316] seconds [----] I, [2016-09-13T10:09:15.933192 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79435], Delivering... [----] I, [2016-09-13T10:09:15.936943 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79435], State: [ok], Delivered in [0.003745451] seconds [----] I, [2016-09-13T10:09:15.938829 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79436], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.501542269] seconds [----] I, [2016-09-13T10:09:15.939088 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79436], Delivering... [----] I, [2016-09-13T10:09:15.945388 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79436], State: [ok], Delivered in [0.006247122] seconds [----] I, [2016-09-13T10:09:20.825044 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003314495086669922, :worker_monitor=>1.1572644710540771, :worker_dequeue=>0.009145498275756836, :total_time=>1.1699676513671875} [----] I, [2016-09-13T10:09:27.470376 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:09:27.487076 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79438], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:09:30.956605 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:09:30.996006 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79438], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.519349984] seconds [----] I, [2016-09-13T10:09:30.996191 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79438], Delivering... [----] I, [2016-09-13T10:09:31.003234 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034096240997314453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003430604934692383, :pending_vm_jobs=>0.0008707046508789062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00652003288269043} [----] I, [2016-09-13T10:09:31.003612 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79438], State: [ok], Delivered in [0.007414293] seconds [----] I, [2016-09-13T10:09:41.942491 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:09:41 UTC]... [----] I, [2016-09-13T10:09:41.961546 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:09:41 UTC]...Complete [----] I, [2016-09-13T10:09:42.499176 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:09:42.511463 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79439], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:09:42.527307 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79440], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:09:46.985468 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:09:47.053629 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79440], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.536643785] seconds [----] I, [2016-09-13T10:09:47.053856 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79440], Delivering... [----] I, [2016-09-13T10:09:47.060658 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035648345947265625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036377906799316406, :pending_vm_jobs=>0.0008442401885986328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006394147872924805} [----] I, [2016-09-13T10:09:47.061025 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79440], State: [ok], Delivered in [0.007174275] seconds [----] I, [2016-09-13T10:09:49.047475 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79439], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.543789315] seconds [----] I, [2016-09-13T10:09:49.047649 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79439], Delivering... [----] I, [2016-09-13T10:09:49.052572 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79439], State: [ok], Delivered in [0.004913372] seconds [----] I, [2016-09-13T10:09:53.140611 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003633260726928711, :worker_monitor=>1.14180326461792, :worker_dequeue=>0.004811286926269531, :total_time=>1.1505074501037598} [----] I, [2016-09-13T10:09:57.541164 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:09:57.561833 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79441], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:09:58.150124 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:09:58.180789 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79441], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.630767256] seconds [----] I, [2016-09-13T10:09:58.181024 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79441], Delivering... [----] I, [2016-09-13T10:09:58.189870 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005315542221069336, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005343437194824219, :pending_vm_jobs=>0.0008494853973388672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008282661437988281} [----] I, [2016-09-13T10:09:58.190221 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79441], State: [ok], Delivered in [0.009227598] seconds [----] I, [2016-09-13T10:10:09.472999 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004107952117919922, :worker_monitor=>1.2855262756347656, :worker_dequeue=>0.009088516235351562, :total_time=>1.2990148067474365} [----] I, [2016-09-13T10:10:12.573253 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 8. [----] I, [2016-09-13T10:10:12.607950 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79442], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:10:12.624835 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79443], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:10:12.648051 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79444], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:10:12.664835 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79445], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:10:12.676155 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79446], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:10:12.699362 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79447], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:10:12.710577 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79448], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:10:14.473548 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:10:14 UTC]... [----] I, [2016-09-13T10:10:14.493396 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:10:14 UTC]...Complete [----] I, [2016-09-13T10:10:14.510459 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T10:10:14.516116 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 7 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:10:15.328785 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79442], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.750967462] seconds [----] I, [2016-09-13T10:10:15.329026 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79442], Delivering... [----] I, [2016-09-13T10:10:15.346692 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79448], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.641568132] seconds [----] I, [2016-09-13T10:10:15.347007 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79448], Delivering... [----] I, [2016-09-13T10:10:15.359141 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.006213665008544922, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.006251096725463867, :pending_vm_jobs=>0.0015866756439208984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.011379241943359375} [----] I, [2016-09-13T10:10:15.359715 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79448], State: [ok], Delivered in [0.012698787] seconds [----] I, [2016-09-13T10:10:15.396539 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79442], State: [ok], Delivered in [0.067499793] seconds [----] I, [2016-09-13T10:10:16.127999 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79443], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.514578365] seconds [----] I, [2016-09-13T10:10:16.128203 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79443], Delivering... [----] I, [2016-09-13T10:10:16.133148 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79443], State: [ok], Delivered in [0.004941324] seconds [----] I, [2016-09-13T10:10:16.156375 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79444], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.523424985] seconds [----] I, [2016-09-13T10:10:16.156574 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79444], Delivering... [----] I, [2016-09-13T10:10:16.161667 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79444], State: [ok], Delivered in [0.005091608] seconds [----] I, [2016-09-13T10:10:16.162157 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79445], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.508466835] seconds [----] I, [2016-09-13T10:10:16.162366 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79445], Delivering... [----] I, [2016-09-13T10:10:16.164916 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79445], State: [ok], Delivered in [0.002568328] seconds [----] I, [2016-09-13T10:10:16.184888 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79446], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.514536973] seconds [----] I, [2016-09-13T10:10:16.185059 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79446], Delivering... [----] I, [2016-09-13T10:10:16.190589 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79447], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.509190355] seconds [----] I, [2016-09-13T10:10:16.190755 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79447], Delivering... [----] I, [2016-09-13T10:10:16.195605 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79446], State: [ok], Delivered in [0.010533421] seconds [----] I, [2016-09-13T10:10:16.201236 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79447], State: [ok], Delivered in [0.010468132] seconds [----] I, [2016-09-13T10:10:25.986881 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003907203674316406, :worker_monitor=>1.4417741298675537, :worker_dequeue=>0.0069980621337890625, :total_time=>1.452972412109375} [----] I, [2016-09-13T10:10:27.722832 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:10:27.737389 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79449], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:10:31.067072 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:10:31.332053 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79449], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.60243907] seconds [----] I, [2016-09-13T10:10:31.332285 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79449], Delivering... [----] I, [2016-09-13T10:10:31.340096 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004083156585693359, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004113435745239258, :pending_vm_jobs=>0.0009846687316894531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007291316986083984} [----] I, [2016-09-13T10:10:31.340574 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79449], State: [ok], Delivered in [0.008304739] seconds [----] I, [2016-09-13T10:10:42.748296 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:10:42.771807 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79450], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:10:42.789115 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79451], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:10:46.783984 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:10:46 UTC]... [----] I, [2016-09-13T10:10:46.823305 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:10:46 UTC]...Complete [----] I, [2016-09-13T10:10:46.834183 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:10:47.594725 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79451], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.817237856] seconds [----] I, [2016-09-13T10:10:47.594902 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79451], Delivering... [----] I, [2016-09-13T10:10:47.601548 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034160614013671875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034677982330322266, :pending_vm_jobs=>0.0007982254028320312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006267070770263672} [----] I, [2016-09-13T10:10:47.601910 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79451], State: [ok], Delivered in [0.007011266] seconds [----] I, [2016-09-13T10:10:49.373326 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79450], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.621762208] seconds [----] I, [2016-09-13T10:10:49.373552 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79450], Delivering... [----] I, [2016-09-13T10:10:49.378604 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79450], State: [ok], Delivered in [0.005048708] seconds [----] I, [2016-09-13T10:10:57.800397 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:10:57.817571 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79452], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:10:58.248641 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:10:58.253478 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00385284423828125, :worker_monitor=>1.3870441913604736, :worker_dequeue=>0.010127067565917969, :total_time=>1.401319980621338} [----] I, [2016-09-13T10:10:58.464280 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79452], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.65609638] seconds [----] I, [2016-09-13T10:10:58.464637 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79452], Delivering... [----] I, [2016-09-13T10:10:58.473844 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0056362152099609375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0056688785552978516, :pending_vm_jobs=>0.0009186267852783203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00852823257446289} [----] I, [2016-09-13T10:10:58.474330 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79452], State: [ok], Delivered in [0.009692007] seconds [----] I, [2016-09-13T10:11:12.827834 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:11:12.840330 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79453], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:11:12.851642 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79454], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:11:12.863067 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79455], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:11:12.874543 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79456], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:11:14.498149 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:11:14.501438 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003984689712524414, :worker_monitor=>1.2084553241729736, :worker_dequeue=>0.007106781005859375, :total_time=>1.2198143005371094} [----] I, [2016-09-13T10:11:14.823890 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79453], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.991647427] seconds [----] I, [2016-09-13T10:11:14.824078 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79453], Delivering... [----] I, [2016-09-13T10:11:14.829956 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79456], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.961866573] seconds [----] I, [2016-09-13T10:11:14.830235 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79456], Delivering... [----] I, [2016-09-13T10:11:14.838442 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004557609558105469, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004582405090332031, :pending_vm_jobs=>0.0009546279907226562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007601499557495117} [----] I, [2016-09-13T10:11:14.838895 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79456], State: [ok], Delivered in [0.008662073] seconds [----] I, [2016-09-13T10:11:14.876617 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79453], State: [ok], Delivered in [0.052526928] seconds [----] I, [2016-09-13T10:11:16.503758 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79454], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.658285859] seconds [----] I, [2016-09-13T10:11:16.503970 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79454], Delivering... [----] I, [2016-09-13T10:11:16.507763 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79454], State: [ok], Delivered in [0.003790429] seconds [----] I, [2016-09-13T10:11:16.532208 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79455], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.673518731] seconds [----] I, [2016-09-13T10:11:16.532450 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79455], Delivering... [----] I, [2016-09-13T10:11:16.537976 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79455], State: [ok], Delivered in [0.00554842] seconds [----] I, [2016-09-13T10:11:19.501942 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:11:19 UTC]... [----] I, [2016-09-13T10:11:19.520691 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:11:19 UTC]...Complete [----] I, [2016-09-13T10:11:27.885722 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:11:27.897653 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79457], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:11:30.740535 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:11:30.744925 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005293846130371094, :worker_monitor=>1.1745762825012207, :worker_dequeue=>0.009529829025268555, :total_time=>1.1897196769714355} [----] I, [2016-09-13T10:11:30.974037 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79457], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.082365749] seconds [----] I, [2016-09-13T10:11:30.974213 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79457], Delivering... [----] I, [2016-09-13T10:11:30.980208 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031995773315429688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032181739807128906, :pending_vm_jobs=>0.0007064342498779297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005650043487548828} [----] I, [2016-09-13T10:11:30.980578 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79457], State: [ok], Delivered in [0.006345659] seconds [----] I, [2016-09-13T10:11:42.908608 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:11:42.926248 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79458], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:11:42.937578 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79459], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:11:47.108981 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:11:47.111842 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004160165786743164, :worker_monitor=>1.2277770042419434, :worker_dequeue=>0.00626063346862793, :total_time=>1.2385129928588867} [----] I, [2016-09-13T10:11:48.109862 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79459], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.179585838] seconds [----] I, [2016-09-13T10:11:48.110050 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79459], Delivering... [----] I, [2016-09-13T10:11:48.117049 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003709554672241211, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003730297088623047, :pending_vm_jobs=>0.0008826255798339844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006647348403930664} [----] I, [2016-09-13T10:11:48.117386 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79459], State: [ok], Delivered in [0.007318541] seconds [----] I, [2016-09-13T10:11:49.652528 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79458], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.740498027] seconds [----] I, [2016-09-13T10:11:49.652764 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79458], Delivering... [----] I, [2016-09-13T10:11:49.658546 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79458], State: [ok], Delivered in [0.005780552] seconds [----] I, [2016-09-13T10:11:52.112308 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:11:52 UTC]... [----] I, [2016-09-13T10:11:52.132182 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:11:52 UTC]...Complete [----] I, [2016-09-13T10:11:57.947135 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:11:57.975030 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79460], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:12:03.634874 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:12:03.639463 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005101919174194336, :worker_monitor=>1.4590404033660889, :worker_dequeue=>0.009647369384765625, :total_time=>1.4741601943969727} [----] I, [2016-09-13T10:12:04.243712 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79460], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.290096712] seconds [----] I, [2016-09-13T10:12:04.243919 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79460], Delivering... [----] I, [2016-09-13T10:12:04.251775 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0039119720458984375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00405430793762207, :pending_vm_jobs=>0.0008993148803710938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007379293441772461} [----] I, [2016-09-13T10:12:04.252201 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79460], State: [ok], Delivered in [0.008266041] seconds [----] I, [2016-09-13T10:12:12.987548 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:12:13.009592 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79461], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:12:13.026757 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79462], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:12:13.043870 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79463], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:12:13.060980 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79464], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:12:13.663119 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:12:13.747236 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79461], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.755163392] seconds [----] I, [2016-09-13T10:12:13.747488 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79461], Delivering... [----] I, [2016-09-13T10:12:13.764239 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79464], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.714605844] seconds [----] I, [2016-09-13T10:12:13.764555 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79464], Delivering... [----] I, [2016-09-13T10:12:13.772448 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038797855377197266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003907918930053711, :pending_vm_jobs=>0.0010807514190673828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007300138473510742} [----] I, [2016-09-13T10:12:13.772847 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79464], State: [ok], Delivered in [0.008307382] seconds [----] I, [2016-09-13T10:12:13.798112 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79462], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.783179884] seconds [----] I, [2016-09-13T10:12:13.798302 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79462], Delivering... [----] I, [2016-09-13T10:12:13.802398 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79462], State: [ok], Delivered in [0.004047219] seconds [----] I, [2016-09-13T10:12:13.820961 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79461], State: [ok], Delivered in [0.073481864] seconds [----] I, [2016-09-13T10:12:13.826783 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79463], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.791769691] seconds [----] I, [2016-09-13T10:12:13.826968 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79463], Delivering... [----] I, [2016-09-13T10:12:13.831909 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79463], State: [ok], Delivered in [0.00494265] seconds [----] I, [2016-09-13T10:12:20.020588 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0027587413787841797, :worker_monitor=>1.3414032459259033, :worker_dequeue=>0.008248567581176758, :total_time=>1.3526873588562012} [----] I, [2016-09-13T10:12:25.021162 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:12:25 UTC]... [----] I, [2016-09-13T10:12:25.042320 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:12:25 UTC]...Complete [----] I, [2016-09-13T10:12:28.072612 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:12:28.099688 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79465], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:12:30.069684 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:12:30.396995 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79465], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.31873426] seconds [----] I, [2016-09-13T10:12:30.397177 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79465], Delivering... [----] I, [2016-09-13T10:12:30.403653 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003389120101928711, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003408193588256836, :pending_vm_jobs=>0.0008184909820556641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00603032112121582} [----] I, [2016-09-13T10:12:30.404018 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79465], State: [ok], Delivered in [0.006838163] seconds [----] I, [2016-09-13T10:12:36.542261 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004165172576904297, :worker_monitor=>1.457578182220459, :worker_dequeue=>0.005393505096435547, :total_time=>1.4674546718597412} [----] I, [2016-09-13T10:12:43.111363 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:12:43.134323 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79466], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:12:43.151253 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79467], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:12:46.645471 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:12:46.922634 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79467], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.782661396] seconds [----] I, [2016-09-13T10:12:46.922816 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79467], Delivering... [----] I, [2016-09-13T10:12:46.929220 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033278465270996094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003368854522705078, :pending_vm_jobs=>0.0007967948913574219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006051540374755859} [----] I, [2016-09-13T10:12:46.929534 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79467], State: [ok], Delivered in [0.006721951] seconds [----] I, [2016-09-13T10:12:46.940024 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79466], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.824166113] seconds [----] I, [2016-09-13T10:12:46.940197 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79466], Delivering... [----] I, [2016-09-13T10:12:46.945066 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79466], State: [ok], Delivered in [0.004864863] seconds [----] I, [2016-09-13T10:12:52.802745 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004179477691650391, :worker_monitor=>1.1383488178253174, :worker_dequeue=>0.011931419372558594, :total_time=>1.1548378467559814} [----] I, [2016-09-13T10:12:57.803562 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:12:57 UTC]... [----] I, [2016-09-13T10:12:57.820800 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:12:57 UTC]...Complete [----] I, [2016-09-13T10:12:58.162952 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:12:58.179869 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79468], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:13:02.844857 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:13:03.701765 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79468], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.532877388] seconds [----] I, [2016-09-13T10:13:03.701986 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79468], Delivering... [----] I, [2016-09-13T10:13:03.709169 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038292407989501953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003880023956298828, :pending_vm_jobs=>0.0008623600006103516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006770610809326172} [----] I, [2016-09-13T10:13:03.709612 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79468], State: [ok], Delivered in [0.00760555] seconds [----] I, [2016-09-13T10:13:09.395490 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003942728042602539, :worker_monitor=>1.5325648784637451, :worker_dequeue=>0.009152650833129883, :total_time=>1.5459282398223877} [----] I, [2016-09-13T10:13:13.191763 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:13:13.212107 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79469], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:13:13.223169 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79470], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:13:13.240685 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79471], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:13:13.252916 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79472], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:13:14.404802 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:13:14.755138 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79469], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.558872346] seconds [----] I, [2016-09-13T10:13:14.755330 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79469], Delivering... [----] I, [2016-09-13T10:13:14.800845 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79472], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.554540256] seconds [----] I, [2016-09-13T10:13:14.801061 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79472], Delivering... [----] I, [2016-09-13T10:13:14.807520 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034160614013671875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034329891204833984, :pending_vm_jobs=>0.0007519721984863281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006089448928833008} [----] I, [2016-09-13T10:13:14.807871 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79472], State: [ok], Delivered in [0.006804801] seconds [----] I, [2016-09-13T10:13:14.817973 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79469], State: [ok], Delivered in [0.062617424] seconds [----] I, [2016-09-13T10:13:17.069182 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79470], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.851690905] seconds [----] I, [2016-09-13T10:13:17.069331 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79470], Delivering... [----] I, [2016-09-13T10:13:17.075492 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79470], State: [ok], Delivered in [0.006157816] seconds [----] I, [2016-09-13T10:13:17.076040 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79471], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.845325222] seconds [----] I, [2016-09-13T10:13:17.076218 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79471], Delivering... [----] I, [2016-09-13T10:13:17.081829 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79471], State: [ok], Delivered in [0.005600236] seconds [----] I, [2016-09-13T10:13:25.423935 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039484500885009766, :worker_monitor=>0.9911863803863525, :worker_dequeue=>0.004799842834472656, :total_time=>1.0001864433288574} [----] I, [2016-09-13T10:13:28.264703 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:13:28.293918 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79473], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:13:30.424442 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:13:30 UTC]... [----] I, [2016-09-13T10:13:30.446200 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:13:30 UTC]...Complete [----] I, [2016-09-13T10:13:30.457158 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:13:30.949612 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79473], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.678814738] seconds [----] I, [2016-09-13T10:13:30.949821 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79473], Delivering... [----] I, [2016-09-13T10:13:30.956633 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003598451614379883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003649473190307617, :pending_vm_jobs=>0.0008604526519775391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006461143493652344} [----] I, [2016-09-13T10:13:30.956988 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79473], State: [ok], Delivered in [0.007169342] seconds [----] I, [2016-09-13T10:13:41.669890 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037353038787841797, :worker_monitor=>1.1809685230255127, :worker_dequeue=>0.009162425994873047, :total_time=>1.1941602230072021} [----] I, [2016-09-13T10:13:43.304921 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T10:13:43.320953 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79474], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:13:43.332021 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79475], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:13:43.343475 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79476], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:13:43.354854 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79477], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:13:46.826472 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:13:47.018118 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79475], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.693085389] seconds [----] I, [2016-09-13T10:13:47.018275 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79475], Delivering... [----] I, [2016-09-13T10:13:47.019107 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T10:13:47.019271 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4574449664 [----] I, [2016-09-13T10:13:47.019362 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4341956608 [----] I, [2016-09-13T10:13:47.019457 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 232493056 [----] I, [2016-09-13T10:13:47.019552 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T10:13:47.019614 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4285243392 [----] I, [2016-09-13T10:13:47.019672 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T10:13:47.019727 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T10:13:47.019788 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 554684416 [----] I, [2016-09-13T10:13:47.019849 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T10:13:47.019905 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6826917888 [----] I, [2016-09-13T10:13:47.019960 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T10:13:47.020015 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T10:13:47.020067 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T10:13:47.020123 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 24576 [----] I, [2016-09-13T10:13:47.020180 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T10:13:47.020234 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T10:13:47.020291 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T10:13:47.020361 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T10:13:47.020447 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T10:13:47.020522 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T10:13:47.020580 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 271675392 [----] I, [2016-09-13T10:13:47.020637 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 54824960 [----] I, [2016-09-13T10:13:47.020694 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 216850432 [----] I, [2016-09-13T10:13:47.020750 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6127616 [----] I, [2016-09-13T10:13:47.020811 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142508032 [----] I, [2016-09-13T10:13:47.020869 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3380998144 [----] I, [2016-09-13T10:13:47.020927 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3053494272 [----] I, [2016-09-13T10:13:47.020982 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T10:13:47.021046 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T10:13:47.021105 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T10:13:47.021159 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37183488 [----] I, [2016-09-13T10:13:47.021217 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102281216 [----] I, [2016-09-13T10:13:47.021280 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53940224 [----] I, [2016-09-13T10:13:47.021345 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111562752 [----] I, [2016-09-13T10:13:47.021411 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 156221440 [----] I, [2016-09-13T10:13:47.021505 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T10:13:47.021565 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T10:13:47.021618 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T10:13:47.021679 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T10:13:47.021736 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T10:13:47.021794 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T10:13:47.021849 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T10:13:47.021901 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T10:13:47.021955 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T10:13:47.056124 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T10:13:47.056329 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T10:13:47.058678 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T10:13:47.060583 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T10:13:47.062827 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T10:13:47.065003 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T10:13:47.070903 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T10:13:47.074437 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 852 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T10:13:47.077028 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T10:13:47.079610 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T10:13:47.082065 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.8 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T10:13:47.084361 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T10:13:47.086892 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T10:13:47.090383 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T10:13:47.092530 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79477], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.743950863] seconds [----] I, [2016-09-13T10:13:47.092662 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79477], Delivering... [----] I, [2016-09-13T10:13:47.093066 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1, "smartstate"=>1}} [----] I, [2016-09-13T10:13:47.093181 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:13:47.093266 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T10:13:47.096923 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359291000], Memory % [5.28], CPU Time [152931.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T10:13:47.097200 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79475], State: [ok], Delivered in [0.07891654] seconds [----] I, [2016-09-13T10:13:47.097978 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027887821197509766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028302669525146484, :pending_vm_jobs=>0.0006315708160400391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005033254623413086} [----] I, [2016-09-13T10:13:47.098224 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79477], State: [ok], Delivered in [0.005557929] seconds [----] I, [2016-09-13T10:13:47.180599 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79474], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.871171617] seconds [----] I, [2016-09-13T10:13:47.180780 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79474], Delivering... [----] I, [2016-09-13T10:13:47.185321 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79474], State: [ok], Delivered in [0.004524808] seconds [----] I, [2016-09-13T10:13:51.844380 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:13:52.172551 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79476], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.836860855] seconds [----] I, [2016-09-13T10:13:52.172751 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79476], Delivering... [----] I, [2016-09-13T10:13:52.179660 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:13:38 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169745000], Memory % [3.14], CPU Time [52330.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:13:52.180107 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:13:41 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [213404000], Memory % [3.5], CPU Time [49610.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T10:13:52.180691 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:13:39 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163149000], Memory % [3.1], CPU Time [38537.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T10:13:52.181175 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:13:41 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359291000], Memory % [5.28], CPU Time [207072.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T10:13:52.181754 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:13:41 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201169000], Memory % [3.36], CPU Time [153839.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:13:52.182253 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:13:28 UTC], Process Info: Memory Usage [286867456], Memory Size [623292416], Proportional Set Size: [206036000], Memory % [3.5], CPU Time [243670.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T10:13:52.182762 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:13:40 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202685000], Memory % [3.38], CPU Time [152938.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:13:52.183174 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:13:34 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347777000], Memory % [5.04], CPU Time [105859.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T10:13:52.185705 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:13:37 UTC], Process Info: Memory Usage [613838848], Memory Size [1071538176], Proportional Set Size: [452185000], Memory % [7.48], CPU Time [932.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T10:13:52.187711 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:13:37 UTC], Process Info: Memory Usage [601968640], Memory Size [976035840], Proportional Set Size: [440195000], Memory % [7.34], CPU Time [324.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T10:13:52.188196 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:13:41 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358590000], Memory % [5.27], CPU Time [212927.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T10:13:52.188771 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:13:38 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178471000], Memory % [3.2], CPU Time [52314.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:13:52.189195 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:13:36 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166757000], Memory % [3.16], CPU Time [39437.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T10:13:52.189571 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79476], State: [ok], Delivered in [0.016811028] seconds [----] I, [2016-09-13T10:13:58.366699 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:13:58.383729 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79478], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:14:02.801931 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:14:02 UTC]... [----] I, [2016-09-13T10:14:02.830970 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:14:02 UTC]...Complete [----] I, [2016-09-13T10:14:02.840596 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:14:03.248208 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79478], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.87477399] seconds [----] I, [2016-09-13T10:14:03.248388 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79478], Delivering... [----] I, [2016-09-13T10:14:03.253449 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027010440826416016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027348995208740234, :pending_vm_jobs=>0.0005359649658203125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004708051681518555} [----] I, [2016-09-13T10:14:03.253741 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79478], State: [ok], Delivered in [0.005381191] seconds [----] I, [2016-09-13T10:14:13.392539 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:14:13.418620 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79479], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:14:13.435617 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79480], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:14:13.481441 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79481], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:14:13.504445 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79482], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:14:14.528998 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:14:14.533068 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004051685333251953, :worker_monitor=>1.661633014678955, :worker_dequeue=>0.009124279022216797, :total_time=>1.6751408576965332} [----] I, [2016-09-13T10:14:15.436886 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79479], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.038883881] seconds [----] I, [2016-09-13T10:14:15.437147 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79479], Delivering... [----] I, [2016-09-13T10:14:15.447382 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79482], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.96008565] seconds [----] I, [2016-09-13T10:14:15.447581 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79482], Delivering... [----] I, [2016-09-13T10:14:15.454217 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035691261291503906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003591775894165039, :pending_vm_jobs=>0.00074005126953125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00627446174621582} [----] I, [2016-09-13T10:14:15.454550 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79482], State: [ok], Delivered in [0.006964074] seconds [----] I, [2016-09-13T10:14:15.504160 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79479], State: [ok], Delivered in [0.066988835] seconds [----] I, [2016-09-13T10:14:17.282517 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79480], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.858047025] seconds [----] I, [2016-09-13T10:14:17.282855 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79480], Delivering... [----] I, [2016-09-13T10:14:17.288537 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79480], State: [ok], Delivered in [0.005639405] seconds [----] I, [2016-09-13T10:14:17.304907 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79481], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.861024035] seconds [----] I, [2016-09-13T10:14:17.305125 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79481], Delivering... [----] I, [2016-09-13T10:14:17.310497 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79481], State: [ok], Delivered in [0.005336505] seconds [----] I, [2016-09-13T10:14:28.521015 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:14:28.533034 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79483], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:14:30.992608 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:14:30.997386 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004862546920776367, :worker_monitor=>1.4182806015014648, :worker_dequeue=>0.00989222526550293, :total_time=>1.4333510398864746} [----] I, [2016-09-13T10:14:31.590667 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79483], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.063847915] seconds [----] I, [2016-09-13T10:14:31.590844 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79483], Delivering... [----] I, [2016-09-13T10:14:31.597503 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035092830657958984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003554105758666992, :pending_vm_jobs=>0.0008218288421630859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006287574768066406} [----] I, [2016-09-13T10:14:31.597836 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79483], State: [ok], Delivered in [0.006987262] seconds [----] I, [2016-09-13T10:14:35.997918 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:14:35 UTC]... [----] I, [2016-09-13T10:14:36.024718 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:14:35 UTC]...Complete [----] I, [2016-09-13T10:14:43.548298 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:14:43.562927 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79484], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:14:43.584847 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79485], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:14:47.344548 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:14:47.348797 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040891170501708984, :worker_monitor=>1.2801978588104248, :worker_dequeue=>0.009440422058105469, :total_time=>1.294001579284668} [----] I, [2016-09-13T10:14:47.410584 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79485], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.842102171] seconds [----] I, [2016-09-13T10:14:47.410756 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79485], Delivering... [----] I, [2016-09-13T10:14:47.417364 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003484010696411133, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035028457641601562, :pending_vm_jobs=>0.0007700920104980469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006211519241333008} [----] I, [2016-09-13T10:14:47.417735 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79485], State: [ok], Delivered in [0.00697177] seconds [----] I, [2016-09-13T10:14:47.440487 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79484], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.88781438] seconds [----] I, [2016-09-13T10:14:47.440717 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79484], Delivering... [----] I, [2016-09-13T10:14:47.445785 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79484], State: [ok], Delivered in [0.005059952] seconds [----] I, [2016-09-13T10:14:58.597000 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:14:58.616161 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79486], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:15:03.996574 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:15:04.001103 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003242969512939453, :worker_monitor=>1.5189201831817627, :worker_dequeue=>0.009726285934448242, :total_time=>1.53214430809021} [----] I, [2016-09-13T10:15:04.873813 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79486], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.270911197] seconds [----] I, [2016-09-13T10:15:04.874018 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79486], Delivering... [----] I, [2016-09-13T10:15:04.882035 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036673545837402344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036885738372802734, :pending_vm_jobs=>0.0008680820465087891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007481575012207031} [----] I, [2016-09-13T10:15:04.882557 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79486], State: [ok], Delivered in [0.008509516] seconds [----] I, [2016-09-13T10:15:09.001730 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:15:09 UTC]... [----] I, [2016-09-13T10:15:09.021501 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:15:09 UTC]...Complete [----] I, [2016-09-13T10:15:13.626393 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:15:13.648476 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79487], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:15:13.676930 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79488], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:15:13.705463 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79489], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:15:13.734113 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79490], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:15:14.046673 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:15:14.580543 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79487], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.951285002] seconds [----] I, [2016-09-13T10:15:14.580758 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79487], Delivering... [----] I, [2016-09-13T10:15:14.683625 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79487], State: [ok], Delivered in [0.10281269] seconds [----] I, [2016-09-13T10:15:14.706209 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79490], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.99520465] seconds [----] I, [2016-09-13T10:15:14.706469 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79490], Delivering... [----] I, [2016-09-13T10:15:14.713805 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004072427749633789, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004096269607543945, :pending_vm_jobs=>0.0008482933044433594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068895816802978516} [----] I, [2016-09-13T10:15:14.714127 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79490], State: [ok], Delivered in [0.007684245] seconds [----] I, [2016-09-13T10:15:14.758175 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79488], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.104141296] seconds [----] I, [2016-09-13T10:15:14.758567 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79488], Delivering... [----] I, [2016-09-13T10:15:14.764075 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79488], State: [ok], Delivered in [0.005493447] seconds [----] I, [2016-09-13T10:15:14.791960 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79489], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.107162788] seconds [----] I, [2016-09-13T10:15:14.792175 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79489], Delivering... [----] I, [2016-09-13T10:15:14.797204 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79489], State: [ok], Delivered in [0.005024467] seconds [----] I, [2016-09-13T10:15:19.069909 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T10:15:20.819252 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00418853759765625, :log_active_servers=>0.014333009719848633, :worker_monitor=>1.7412724494934082, :worker_dequeue=>0.00771021842956543, :total_time=>1.7679383754730225} [----] I, [2016-09-13T10:15:28.745289 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:15:28.764909 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79491], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:15:30.842576 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:15:30.987931 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79491], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.236652083] seconds [----] I, [2016-09-13T10:15:30.988125 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79491], Delivering... [----] I, [2016-09-13T10:15:30.995033 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034058094024658203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034241676330566406, :pending_vm_jobs=>0.0008780956268310547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006321430206298828} [----] I, [2016-09-13T10:15:30.995454 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79491], State: [ok], Delivered in [0.007291277] seconds [----] I, [2016-09-13T10:15:38.073984 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003930807113647461, :worker_monitor=>2.2116856575012207, :worker_dequeue=>0.010196447372436523, :total_time=>2.226090431213379} [----] I, [2016-09-13T10:15:43.078186 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:15:43 UTC]... [----] I, [2016-09-13T10:15:43.119223 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:15:43 UTC]...Complete [----] I, [2016-09-13T10:15:43.776146 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:15:43.832859 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79492], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:15:43.867203 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79493], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:15:48.142984 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:15:49.136305 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79493], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.297830516] seconds [----] I, [2016-09-13T10:15:49.136551 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79493], Delivering... [----] I, [2016-09-13T10:15:49.142654 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031936168670654297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032100677490234375, :pending_vm_jobs=>0.0007481575012207031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005750179290771484} [----] I, [2016-09-13T10:15:49.142991 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79493], State: [ok], Delivered in [0.006439057] seconds [----] I, [2016-09-13T10:15:50.942233 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79492], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.161513793] seconds [----] I, [2016-09-13T10:15:50.942495 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79492], Delivering... [----] I, [2016-09-13T10:15:50.947690 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79492], State: [ok], Delivered in [0.005212444] seconds [----] I, [2016-09-13T10:15:54.493108 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003934383392333984, :server_monitor=>0.11023497581481934, :worker_monitor=>1.224416732788086, :worker_dequeue=>0.006539344787597656, :total_time=>1.3454656600952148} [----] I, [2016-09-13T10:15:58.878652 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:15:58.909083 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79494], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:15:59.505100 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:16:00.028202 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79494], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.139972989] seconds [----] I, [2016-09-13T10:16:00.028437 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79494], Delivering... [----] I, [2016-09-13T10:16:00.034939 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034677982330322266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034856796264648438, :pending_vm_jobs=>0.0008072853088378906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0061304569244384766} [----] I, [2016-09-13T10:16:00.035298 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79494], State: [ok], Delivered in [0.006888671] seconds [----] I, [2016-09-13T10:16:10.663107 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0024404525756835938, :worker_monitor=>1.1259441375732422, :worker_dequeue=>0.009701967239379883, :total_time=>1.1383476257324219} [----] I, [2016-09-13T10:16:14.256526 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:16:14.319144 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79495], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:16:14.336145 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79496], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:16:14.353230 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79497], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:16:14.393411 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79498], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:16:15.663782 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:16:15 UTC]... [----] I, [2016-09-13T10:16:15.685968 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:16:15 UTC]...Complete [----] I, [2016-09-13T10:16:15.703782 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:16:16.296507 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79495], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.996714829] seconds [----] I, [2016-09-13T10:16:16.296685 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79495], Delivering... [----] I, [2016-09-13T10:16:16.324839 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79498], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.965682364] seconds [----] I, [2016-09-13T10:16:16.325013 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79498], Delivering... [----] I, [2016-09-13T10:16:16.330104 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026214122772216797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002637624740600586, :pending_vm_jobs=>0.0006761550903320312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004773855209350586} [----] I, [2016-09-13T10:16:16.330430 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79498], State: [ok], Delivered in [0.005406689] seconds [----] I, [2016-09-13T10:16:16.376250 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79495], State: [ok], Delivered in [0.079540077] seconds [----] I, [2016-09-13T10:16:18.091123 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79496], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.765641033] seconds [----] I, [2016-09-13T10:16:18.091322 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79496], Delivering... [----] I, [2016-09-13T10:16:18.099655 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79496], State: [ok], Delivered in [0.008313413] seconds [----] I, [2016-09-13T10:16:18.109695 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79497], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.765050309] seconds [----] I, [2016-09-13T10:16:18.109892 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79497], Delivering... [----] I, [2016-09-13T10:16:18.115893 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79497], State: [ok], Delivered in [0.005974694] seconds [----] I, [2016-09-13T10:16:27.045888 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003951311111450195, :worker_monitor=>1.3083627223968506, :worker_dequeue=>0.009261131286621094, :total_time=>1.3218586444854736} [----] I, [2016-09-13T10:16:29.405496 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:16:29.422974 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79499], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:16:32.056068 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:16:32.479653 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79499], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.068181593] seconds [----] I, [2016-09-13T10:16:32.479839 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79499], Delivering... [----] I, [2016-09-13T10:16:32.486307 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034008026123046875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034208297729492188, :pending_vm_jobs=>0.0008542537689208984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006141185760498047} [----] I, [2016-09-13T10:16:32.486716 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79499], State: [ok], Delivered in [0.006871327] seconds [----] I, [2016-09-13T10:16:43.182991 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00433802604675293, :worker_monitor=>1.0977723598480225, :worker_dequeue=>0.005124092102050781, :total_time=>1.1075804233551025} [----] I, [2016-09-13T10:16:44.434234 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:16:44.450762 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79500], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:16:44.462040 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79501], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:16:48.184651 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:16:48 UTC]... [----] I, [2016-09-13T10:16:48.212042 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:16:48 UTC]...Complete [----] I, [2016-09-13T10:16:48.227442 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:16:48.582854 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79501], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.126637406] seconds [----] I, [2016-09-13T10:16:48.583047 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79501], Delivering... [----] I, [2016-09-13T10:16:48.589485 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003350973129272461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033698081970214844, :pending_vm_jobs=>0.0007307529449462891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006014347076416016} [----] I, [2016-09-13T10:16:48.589933 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79501], State: [ok], Delivered in [0.006852606] seconds [----] I, [2016-09-13T10:16:51.234011 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79500], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.795554926] seconds [----] I, [2016-09-13T10:16:51.234169 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79500], Delivering... [----] I, [2016-09-13T10:16:51.238147 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79500], State: [ok], Delivered in [0.003970775] seconds [----] I, [2016-09-13T10:16:59.472968 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T10:16:59.489250 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79502], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:16:59.516801 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79503], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:16:59.527704 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79504], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:16:59.610200 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:16:59.614724 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00757598876953125, :worker_monitor=>1.2752444744110107, :worker_dequeue=>0.009653091430664062, :total_time=>1.2931230068206787} [----] I, [2016-09-13T10:16:59.745526 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79502], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.266483156] seconds [----] I, [2016-09-13T10:16:59.745747 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79502], Delivering... [----] I, [2016-09-13T10:16:59.752473 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003579854965209961, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036263465881347656, :pending_vm_jobs=>0.0008184909820556641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006291389465332031} [----] I, [2016-09-13T10:16:59.752813 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79502], State: [ok], Delivered in [0.007078674] seconds [----] I, [2016-09-13T10:16:59.763660 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79503], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.268037212] seconds [----] I, [2016-09-13T10:16:59.763872 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79503], Delivering... [----] I, [2016-09-13T10:16:59.819261 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79503], State: [ok], Delivered in [0.055372203] seconds [----] I, [2016-09-13T10:17:00.265340 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79504], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.743112146] seconds [----] I, [2016-09-13T10:17:00.265629 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79504], Delivering... [----] I, [2016-09-13T10:17:00.269150 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79504], State: [ok], Delivered in [0.003529441] seconds [----] I, [2016-09-13T10:17:14.542830 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:17:14.568411 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79505], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:17:14.579809 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79506], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:17:15.979491 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:17:15.982672 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004117012023925781, :worker_monitor=>1.323702096939087, :worker_dequeue=>0.006455421447753906, :total_time=>1.3345401287078857} [----] I, [2016-09-13T10:17:16.903929 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79506], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.329645987] seconds [----] I, [2016-09-13T10:17:16.904130 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79506], Delivering... [----] I, [2016-09-13T10:17:16.910492 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033364295959472656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033562183380126953, :pending_vm_jobs=>0.0007834434509277344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005969524383544922} [----] I, [2016-09-13T10:17:16.910808 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79506], State: [ok], Delivered in [0.006669701] seconds [----] I, [2016-09-13T10:17:18.318685 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79505], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.771084552] seconds [----] I, [2016-09-13T10:17:18.318894 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79505], Delivering... [----] I, [2016-09-13T10:17:18.323872 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79505], State: [ok], Delivered in [0.004950775] seconds [----] I, [2016-09-13T10:17:20.983225 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:17:20 UTC]... [----] I, [2016-09-13T10:17:21.014129 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:17:20 UTC]...Complete [----] I, [2016-09-13T10:17:29.593023 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:17:29.614120 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79507], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:17:32.345193 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:17:32.350161 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005743980407714844, :worker_monitor=>1.2898309230804443, :worker_dequeue=>0.009529352188110352, :total_time=>1.3054285049438477} [----] I, [2016-09-13T10:17:33.018148 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79507], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.419248592] seconds [----] I, [2016-09-13T10:17:33.018342 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79507], Delivering... [----] I, [2016-09-13T10:17:33.024002 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028963088989257812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002912282943725586, :pending_vm_jobs=>0.0006999969482421875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0052852630615234375} [----] I, [2016-09-13T10:17:33.024341 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79507], State: [ok], Delivered in [0.00600983] seconds [----] I, [2016-09-13T10:17:44.625906 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 21. [----] I, [2016-09-13T10:17:44.646767 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79508], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:17:44.669607 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79509], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:17:44.680809 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79510], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vmdb::Appliance.log_config], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:17:44.698242 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79511], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.log_all_database_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:17:44.709529 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79512], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Host.authentication_check_schedule], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:17:44.726751 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79513], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ExtManagementSystem.authentication_check_schedule], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:17:44.737865 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79514], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [StorageManager.authentication_check_schedule], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:17:48.482045 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 7 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:17:48.484616 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040361881256103516, :worker_monitor=>1.1020731925964355, :worker_dequeue=>0.006640434265136719, :total_time=>1.1130452156066895} [----] I, [2016-09-13T10:17:49.138847 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79509], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.486439444] seconds [----] I, [2016-09-13T10:17:49.139030 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79509], Delivering... [----] I, [2016-09-13T10:17:49.145237 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032927989959716797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003312349319458008, :pending_vm_jobs=>0.0007579326629638672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005867719650268555} [----] I, [2016-09-13T10:17:49.145648 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79509], State: [ok], Delivered in [0.006592755] seconds [----] I, [2016-09-13T10:17:51.472259 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79508], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.841765393] seconds [----] I, [2016-09-13T10:17:51.472617 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79508], Delivering... [----] I, [2016-09-13T10:17:51.480600 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79508], State: [ok], Delivered in [0.007974144] seconds [----] I, [2016-09-13T10:17:51.484200 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79510], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vmdb::Appliance.log_config], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.810237831] seconds [----] I, [2016-09-13T10:17:51.484518 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79510], Delivering... [----] I, [2016-09-13T10:17:51.484897 #2937:34713c] INFO -- : ************************ [----] I, [2016-09-13T10:17:51.485091 #2937:34713c] INFO -- : * [VMDB] configuration * [----] I, [2016-09-13T10:17:51.485181 #2937:34713c] INFO -- : ************************ [----] I, [2016-09-13T10:17:51.485255 #2937:34713c] INFO -- : Version: master [----] I, [2016-09-13T10:17:51.485351 #2937:34713c] INFO -- : Build: 20160907101630_30b49fa [----] I, [2016-09-13T10:17:51.485463 #2937:34713c] INFO -- : RUBY Environment: ruby 2.3.1p112 (2016-04-26 revision 54768) [x86_64-linux] [----] I, [2016-09-13T10:17:51.485569 #2937:34713c] INFO -- : RAILS Environment: production version 5.0.0.1 [----] I, [2016-09-13T10:17:51.485639 #2937:34713c] INFO -- : VMDB settings: [----] I, [2016-09-13T10:17:51.518773 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79511], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.log_all_database_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.833671728] seconds [----] I, [2016-09-13T10:17:51.519060 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79511], Delivering... [----] I, [2016-09-13T10:17:51.588018 #2937:34713c] INFO -- : :api: [----] I, [2016-09-13T10:17:51.588227 #2937:34713c] INFO -- : :token_ttl: 10.minutes [----] I, [2016-09-13T10:17:51.588339 #2937:34713c] INFO -- : :authentication_timeout: 30.seconds [----] I, [2016-09-13T10:17:51.588456 #2937:34713c] INFO -- : :authentication: [----] I, [2016-09-13T10:17:51.588553 #2937:34713c] INFO -- : :basedn: [----] I, [2016-09-13T10:17:51.588626 #2937:34713c] INFO -- : :bind_dn: [----] I, [2016-09-13T10:17:51.588710 #2937:34713c] INFO -- : :get_direct_groups: true [----] I, [2016-09-13T10:17:51.588789 #2937:34713c] INFO -- : :group_memberships_max_depth: 2 [----] I, [2016-09-13T10:17:51.588859 #2937:34713c] INFO -- : :ldaphost: [----] I, [2016-09-13T10:17:51.588959 #2937:34713c] INFO -- : :ldapport: '389' [----] I, [2016-09-13T10:17:51.589035 #2937:34713c] INFO -- : :mode: database [----] I, [2016-09-13T10:17:51.589102 #2937:34713c] INFO -- : :user_suffix: [----] I, [2016-09-13T10:17:51.589177 #2937:34713c] INFO -- : :user_type: userprincipalname [----] I, [2016-09-13T10:17:51.589252 #2937:34713c] INFO -- : :amazon_key: [----] I, [2016-09-13T10:17:51.589351 #2937:34713c] INFO -- : :broker_notify_properties: [----] I, [2016-09-13T10:17:51.589462 #2937:34713c] INFO -- : :exclude: [----] I, [2016-09-13T10:17:51.589555 #2937:34713c] INFO -- : :HostSystem: [----] I, [2016-09-13T10:17:51.589627 #2937:34713c] INFO -- : - config.consoleReservation [----] I, [2016-09-13T10:17:51.589693 #2937:34713c] INFO -- : - config.dateTimeInfo [----] I, [2016-09-13T10:17:51.589771 #2937:34713c] INFO -- : - config.network [----] I, [2016-09-13T10:17:51.589849 #2937:34713c] INFO -- : - config.service [----] I, [2016-09-13T10:17:51.589918 #2937:34713c] INFO -- : - summary [----] I, [2016-09-13T10:17:51.589981 #2937:34713c] INFO -- : - summary.overallStatus [----] I, [2016-09-13T10:17:51.590053 #2937:34713c] INFO -- : - summary.runtime.bootTime [----] I, [2016-09-13T10:17:51.590122 #2937:34713c] INFO -- : - summary.runtime.healthSystemRuntime.systemHealthInfo.numericSensorInfo [----] I, [2016-09-13T10:17:51.590196 #2937:34713c] INFO -- : :VirtualMachine: [----] I, [2016-09-13T10:17:51.590273 #2937:34713c] INFO -- : - config.locationId [----] I, [2016-09-13T10:17:51.590362 #2937:34713c] INFO -- : - config.memoryAllocation.overheadLimit [----] I, [2016-09-13T10:17:51.590485 #2937:34713c] INFO -- : - config.npivWorldWideNameType [----] I, [2016-09-13T10:17:51.590573 #2937:34713c] INFO -- : - guest.disk [----] I, [2016-09-13T10:17:51.590651 #2937:34713c] INFO -- : - guest.guestFamily [----] I, [2016-09-13T10:17:51.590731 #2937:34713c] INFO -- : - guest.guestFullName [----] I, [2016-09-13T10:17:51.590811 #2937:34713c] INFO -- : - guest.guestId [----] I, [2016-09-13T10:17:51.590888 #2937:34713c] INFO -- : - guest.ipStack [----] I, [2016-09-13T10:17:51.590958 #2937:34713c] INFO -- : - guest.net [----] I, [2016-09-13T10:17:51.591028 #2937:34713c] INFO -- : - guest.screen [----] I, [2016-09-13T10:17:51.591100 #2937:34713c] INFO -- : - guest.screen.height [----] I, [2016-09-13T10:17:51.591174 #2937:34713c] INFO -- : - guest.screen.width [----] I, [2016-09-13T10:17:51.591251 #2937:34713c] INFO -- : - guest.toolsRunningStatus [----] I, [2016-09-13T10:17:51.591340 #2937:34713c] INFO -- : - guest.toolsStatus [----] I, [2016-09-13T10:17:51.591448 #2937:34713c] INFO -- : - resourceConfig [----] I, [2016-09-13T10:17:51.591539 #2937:34713c] INFO -- : - summary [----] I, [2016-09-13T10:17:51.591612 #2937:34713c] INFO -- : - summary.guest.guestFullName [----] I, [2016-09-13T10:17:51.591686 #2937:34713c] INFO -- : - summary.guest.guestId [----] I, [2016-09-13T10:17:51.591767 #2937:34713c] INFO -- : - summary.guest.toolsRunningStatus [----] I, [2016-09-13T10:17:51.591846 #2937:34713c] INFO -- : - summary.overallStatus [----] I, [2016-09-13T10:17:51.591927 #2937:34713c] INFO -- : - summary.runtime.bootTime [----] I, [2016-09-13T10:17:51.591997 #2937:34713c] INFO -- : - summary.runtime.memoryOverhead [----] I, [2016-09-13T10:17:51.592071 #2937:34713c] INFO -- : - summary.runtime.numMksConnections [----] I, [2016-09-13T10:17:51.592137 #2937:34713c] INFO -- : - summary.storage [----] I, [2016-09-13T10:17:51.592202 #2937:34713c] INFO -- : - summary.storage.committed [----] I, [2016-09-13T10:17:51.592266 #2937:34713c] INFO -- : - summary.storage.unshared [----] I, [2016-09-13T10:17:51.592343 #2937:34713c] INFO -- : :capacity: [----] I, [2016-09-13T10:17:51.592445 #2937:34713c] INFO -- : :profile: [----] I, [2016-09-13T10:17:51.592543 #2937:34713c] INFO -- : :1: [----] I, [2016-09-13T10:17:51.592618 #2937:34713c] INFO -- : :vcpu_commitment_ratio: 2.0 [----] I, [2016-09-13T10:17:51.592684 #2937:34713c] INFO -- : :vcpu_method: vcpu_average [----] I, [2016-09-13T10:17:51.592769 #2937:34713c] INFO -- : :vcpu_method_description: Average of Allocated vCPU [----] I, [2016-09-13T10:17:51.592850 #2937:34713c] INFO -- : :memory_commitment_ratio: 1.2 [----] I, [2016-09-13T10:17:51.592921 #2937:34713c] INFO -- : :memory_method: mem_average [----] I, [2016-09-13T10:17:51.592984 #2937:34713c] INFO -- : :memory_method_description: Average of Allocated Memory [----] I, [2016-09-13T10:17:51.593054 #2937:34713c] INFO -- : :2: [----] I, [2016-09-13T10:17:51.593117 #2937:34713c] INFO -- : :vcpu_commitment_ratio: 1.0 [----] I, [2016-09-13T10:17:51.593187 #2937:34713c] INFO -- : :vcpu_method: vcpu_high_norm [----] I, [2016-09-13T10:17:51.593256 #2937:34713c] INFO -- : :vcpu_method_description: High Normal Range of Allocated vCPU [----] I, [2016-09-13T10:17:51.593346 #2937:34713c] INFO -- : :memory_commitment_ratio: 1.0 [----] I, [2016-09-13T10:17:51.593461 #2937:34713c] INFO -- : :memory_method: mem_high_norm [----] I, [2016-09-13T10:17:51.593567 #2937:34713c] INFO -- : :memory_method_description: High Normal Range of Allocated Memory [----] I, [2016-09-13T10:17:51.593650 #2937:34713c] INFO -- : :failover: [----] I, [2016-09-13T10:17:51.593722 #2937:34713c] INFO -- : :rule: discovered [----] I, [2016-09-13T10:17:51.593806 #2937:34713c] INFO -- : :coresident_miqproxy: [----] I, [2016-09-13T10:17:51.593881 #2937:34713c] INFO -- : :concurrent_per_ems: 1 [----] I, [2016-09-13T10:17:51.593953 #2937:34713c] INFO -- : :concurrent_per_host: 1 [----] I, [2016-09-13T10:17:51.594022 #2937:34713c] INFO -- : :scan_via_host: true [----] I, [2016-09-13T10:17:51.594094 #2937:34713c] INFO -- : :use_vim_broker: true [----] I, [2016-09-13T10:17:51.594159 #2937:34713c] INFO -- : :container_scanning: [----] I, [2016-09-13T10:17:51.594231 #2937:34713c] INFO -- : :concurrent_per_ems: 3 [----] I, [2016-09-13T10:17:51.594301 #2937:34713c] INFO -- : :database: [----] I, [2016-09-13T10:17:51.594393 #2937:34713c] INFO -- : :metrics_collection: [----] I, [2016-09-13T10:17:51.594515 #2937:34713c] INFO -- : :collection_schedule: 1 * * * * [----] I, [2016-09-13T10:17:51.594600 #2937:34713c] INFO -- : :daily_rollup_schedule: 23 0 * * * [----] I, [2016-09-13T10:17:51.594671 #2937:34713c] INFO -- : :metrics_history: [----] I, [2016-09-13T10:17:51.594740 #2937:34713c] INFO -- : :keep_daily_metrics: 6.months [----] I, [2016-09-13T10:17:51.594818 #2937:34713c] INFO -- : :keep_hourly_metrics: 6.months [----] I, [2016-09-13T10:17:51.594889 #2937:34713c] INFO -- : :purge_schedule: 50 * * * * [----] I, [2016-09-13T10:17:51.594959 #2937:34713c] INFO -- : :purge_window_size: 100000 [----] I, [2016-09-13T10:17:51.595030 #2937:34713c] INFO -- : :drift_states: [----] I, [2016-09-13T10:17:51.595103 #2937:34713c] INFO -- : :history: [----] I, [2016-09-13T10:17:51.595172 #2937:34713c] INFO -- : :keep_drift_states: 6.months [----] I, [2016-09-13T10:17:51.595243 #2937:34713c] INFO -- : :purge_window_size: 10000 [----] I, [2016-09-13T10:17:51.595310 #2937:34713c] INFO -- : :ems: [----] I, [2016-09-13T10:17:51.595439 #2937:34713c] INFO -- : :ems_redhat: [----] I, [2016-09-13T10:17:51.595539 #2937:34713c] INFO -- : :service: [----] I, [2016-09-13T10:17:51.595625 #2937:34713c] INFO -- : :read_timeout: 1.hour [----] I, [2016-09-13T10:17:51.595703 #2937:34713c] INFO -- : :ems_kubernetes: [----] I, [2016-09-13T10:17:51.595782 #2937:34713c] INFO -- : :miq_namespace: management-infra [----] I, [2016-09-13T10:17:51.595854 #2937:34713c] INFO -- : :ems_events: [----] I, [2016-09-13T10:17:51.595923 #2937:34713c] INFO -- : :history: [----] I, [2016-09-13T10:17:51.596012 #2937:34713c] INFO -- : :keep_ems_events: 6.months [----] I, [2016-09-13T10:17:51.596087 #2937:34713c] INFO -- : :purge_window_size: 1000 [----] I, [2016-09-13T10:17:51.596160 #2937:34713c] INFO -- : :ems_refresh: [----] I, [2016-09-13T10:17:51.596236 #2937:34713c] INFO -- : :capture_vm_created_on_date: false [----] I, [2016-09-13T10:17:51.596309 #2937:34713c] INFO -- : :ec2: [----] I, [2016-09-13T10:17:51.596410 #2937:34713c] INFO -- : :get_private_images: true [----] I, [2016-09-13T10:17:51.596537 #2937:34713c] INFO -- : :get_shared_images: true [----] I, [2016-09-13T10:17:51.596624 #2937:34713c] INFO -- : :get_public_images: false [----] I, [2016-09-13T10:17:51.596705 #2937:34713c] INFO -- : :public_images_filters: [----] I, [2016-09-13T10:17:51.596784 #2937:34713c] INFO -- : - :name: image-type [----] I, [2016-09-13T10:17:51.596861 #2937:34713c] INFO -- : :values: [----] I, [2016-09-13T10:17:51.596934 #2937:34713c] INFO -- : - machine [----] I, [2016-09-13T10:17:51.597006 #2937:34713c] INFO -- : :ignore_terminated_instances: true [----] I, [2016-09-13T10:17:51.597072 #2937:34713c] INFO -- : :ansible_tower_configuration: [----] I, [2016-09-13T10:17:51.597146 #2937:34713c] INFO -- : :refresh_interval: 15.minutes [----] I, [2016-09-13T10:17:51.597222 #2937:34713c] INFO -- : :foreman_configuration: [----] I, [2016-09-13T10:17:51.597297 #2937:34713c] INFO -- : :refresh_interval: 15.minutes [----] I, [2016-09-13T10:17:51.597393 #2937:34713c] INFO -- : :foreman_provisioning: [----] I, [2016-09-13T10:17:51.597530 #2937:34713c] INFO -- : :refresh_interval: 1.hour [----] I, [2016-09-13T10:17:51.597616 #2937:34713c] INFO -- : :full_refresh_threshold: 100 [----] I, [2016-09-13T10:17:51.597693 #2937:34713c] INFO -- : :hawkular: [----] I, [2016-09-13T10:17:51.597763 #2937:34713c] INFO -- : :refresh_interval: 15.minutes [----] I, [2016-09-13T10:17:51.597837 #2937:34713c] INFO -- : :kubernetes: [----] I, [2016-09-13T10:17:51.597908 #2937:34713c] INFO -- : :refresh_interval: 15.minutes [----] I, [2016-09-13T10:17:51.597976 #2937:34713c] INFO -- : :openshift: [----] I, [2016-09-13T10:17:51.598039 #2937:34713c] INFO -- : :refresh_interval: 15.minutes [----] I, [2016-09-13T10:17:51.598105 #2937:34713c] INFO -- : :atomic: [----] I, [2016-09-13T10:17:51.598178 #2937:34713c] INFO -- : :refresh_interval: 15.minutes [----] I, [2016-09-13T10:17:51.598246 #2937:34713c] INFO -- : :openshift_enterprise: [----] I, [2016-09-13T10:17:51.598317 #2937:34713c] INFO -- : :refresh_interval: 15.minutes [----] I, [2016-09-13T10:17:51.598445 #2937:34713c] INFO -- : :atomic_enterprise: [----] I, [2016-09-13T10:17:51.598541 #2937:34713c] INFO -- : :refresh_interval: 15.minutes [----] I, [2016-09-13T10:17:51.598622 #2937:34713c] INFO -- : :raise_vm_snapshot_complete_if_created_within: 15.minutes [----] I, [2016-09-13T10:17:51.598697 #2937:34713c] INFO -- : :refresh_interval: 24.hours [----] I, [2016-09-13T10:17:51.598768 #2937:34713c] INFO -- : :scvmm: [----] I, [2016-09-13T10:17:51.598845 #2937:34713c] INFO -- : :refresh_interval: 15.minutes [----] I, [2016-09-13T10:17:51.598915 #2937:34713c] INFO -- : :vmware_cloud: [----] I, [2016-09-13T10:17:51.598979 #2937:34713c] INFO -- : :get_public_images: false [----] I, [2016-09-13T10:17:51.599047 #2937:34713c] INFO -- : :event_handling: [----] I, [2016-09-13T10:17:51.599125 #2937:34713c] INFO -- : :bottleneck_event_groups: [----] I, [2016-09-13T10:17:51.599196 #2937:34713c] INFO -- : :Capacity: [----] I, [2016-09-13T10:17:51.599271 #2937:34713c] INFO -- : :detail: [----] I, [2016-09-13T10:17:51.599360 #2937:34713c] INFO -- : - DiskUsage [----] I, [2016-09-13T10:17:51.599478 #2937:34713c] INFO -- : :name: Capacity [----] I, [2016-09-13T10:17:51.599561 #2937:34713c] INFO -- : :Utilization: [----] I, [2016-09-13T10:17:51.599649 #2937:34713c] INFO -- : :detail: [----] I, [2016-09-13T10:17:51.599730 #2937:34713c] INFO -- : - CpuUsage [----] I, [2016-09-13T10:17:51.599811 #2937:34713c] INFO -- : - MemoryUsage [----] I, [2016-09-13T10:17:51.599880 #2937:34713c] INFO -- : :name: Utilization [----] I, [2016-09-13T10:17:51.599955 #2937:34713c] INFO -- : :event_groups: [----] I, [2016-09-13T10:17:51.600027 #2937:34713c] INFO -- : :addition: [----] I, [2016-09-13T10:17:51.600091 #2937:34713c] INFO -- : :critical: [----] I, [2016-09-13T10:17:51.600161 #2937:34713c] INFO -- : - CloneTaskEvent [----] I, [2016-09-13T10:17:51.600232 #2937:34713c] INFO -- : - ClusterCreatedEvent [----] I, [2016-09-13T10:17:51.600295 #2937:34713c] INFO -- : - CreateFolder [----] I, [2016-09-13T10:17:51.600394 #2937:34713c] INFO -- : - DatacenterCreatedEvent [----] I, [2016-09-13T10:17:51.600522 #2937:34713c] INFO -- : - DatastoreDiscoveredEvent [----] I, [2016-09-13T10:17:51.600608 #2937:34713c] INFO -- : - HostConnectedEvent [----] I, [2016-09-13T10:17:51.600687 #2937:34713c] INFO -- : - HOST_DETECTED [----] I, [2016-09-13T10:17:51.600763 #2937:34713c] INFO -- : - HOST_REGISTER_AUTO_APPROVE_PATTERN [----] I, [2016-09-13T10:17:51.600847 #2937:34713c] INFO -- : - HOST_REGISTER_ERROR_UPDATING_HOST [----] I, [2016-09-13T10:17:51.600917 #2937:34713c] INFO -- : - HOST_REGISTER_ERROR_UPDATING_HOST_ALL_TAKEN [----] I, [2016-09-13T10:17:51.600987 #2937:34713c] INFO -- : - HOST_REGISTER_ERROR_UPDATING_NAME [----] I, [2016-09-13T10:17:51.601061 #2937:34713c] INFO -- : - HOST_REGISTER_ERROR_UPDATING_NAMES_ALL_TAKEN [----] I, [2016-09-13T10:17:51.601130 #2937:34713c] INFO -- : - HOST_REGISTER_EXISTING_HOST_UPDATE_FAILED [----] I, [2016-09-13T10:17:51.601206 #2937:34713c] INFO -- : - HOST_REGISTER_FAILED [----] I, [2016-09-13T10:17:51.601277 #2937:34713c] INFO -- : - HOST_REGISTER_HOST_IS_ACTIVE [----] I, [2016-09-13T10:17:51.601367 #2937:34713c] INFO -- : - HOST_REGISTER_NAME_IS_ACTIVE [----] I, [2016-09-13T10:17:51.601483 #2937:34713c] INFO -- : - HOST_REGISTER_SUCCEEDED [----] I, [2016-09-13T10:17:51.601571 #2937:34713c] INFO -- : - IMPORTEXPORT_STARTING_EXPORT_TEMPLATE [----] I, [2016-09-13T10:17:51.601650 #2937:34713c] INFO -- : - IMPORTEXPORT_EXPORT_TEMPLATE [----] I, [2016-09-13T10:17:51.601733 #2937:34713c] INFO -- : - ResourcePoolCreatedEvent [----] I, [2016-09-13T10:17:51.601821 #2937:34713c] INFO -- : - TemplateDeployedEvent [----] I, [2016-09-13T10:17:51.601892 #2937:34713c] INFO -- : - USER_ADD [----] I, [2016-09-13T10:17:51.601959 #2937:34713c] INFO -- : - USER_ADD_HOST [----] I, [2016-09-13T10:17:51.602048 #2937:34713c] INFO -- : - USER_ADD_VM [----] I, [2016-09-13T10:17:51.602126 #2937:34713c] INFO -- : - USER_ADD_VM_FINISHED_FAILURE [----] I, [2016-09-13T10:17:51.602193 #2937:34713c] INFO -- : - USER_ADD_VM_FINISHED_SUCCESS [----] I, [2016-09-13T10:17:51.602263 #2937:34713c] INFO -- : - USER_ADD_VM_TEMPLATE [----] I, [2016-09-13T10:17:51.602356 #2937:34713c] INFO -- : - USER_ADD_VM_TEMPLATE_FINISHED_FAILURE [----] I, [2016-09-13T10:17:51.602475 #2937:34713c] INFO -- : - USER_ADD_VM_TEMPLATE_FINISHED_SUCCESS [----] I, [2016-09-13T10:17:51.602561 #2937:34713c] INFO -- : - USER_FAILED_ADD_HOST [----] I, [2016-09-13T10:17:51.602630 #2937:34713c] INFO -- : - USER_FAILED_ADD_VM_TEMPLATE [----] I, [2016-09-13T10:17:51.602698 #2937:34713c] INFO -- : - virtualMachines_write_EndRequest [----] I, [2016-09-13T10:17:51.602777 #2937:34713c] INFO -- : - GceOperationDone_compute.instances.insert [----] I, [2016-09-13T10:17:51.602849 #2937:34713c] INFO -- : - VmConnectedEvent [----] I, [2016-09-13T10:17:51.602919 #2937:34713c] INFO -- : - VmCreatedEvent [----] I, [2016-09-13T10:17:51.602984 #2937:34713c] INFO -- : - VmDeployedEvent [----] I, [2016-09-13T10:17:51.603068 #2937:34713c] INFO -- : - VmRegisteredEvent [----] I, [2016-09-13T10:17:51.603146 #2937:34713c] INFO -- : - image.update [----] I, [2016-09-13T10:17:51.603219 #2937:34713c] INFO -- : - image.create [----] I, [2016-09-13T10:17:51.603287 #2937:34713c] INFO -- : - image.upload [----] I, [2016-09-13T10:17:51.603386 #2937:34713c] INFO -- : - orchestration.stack.create.end [----] I, [2016-09-13T10:17:51.603509 #2937:34713c] INFO -- : - orchestration.stack.create.error [----] I, [2016-09-13T10:17:51.603592 #2937:34713c] INFO -- : - servergroup.create [----] I, [2016-09-13T10:17:51.603666 #2937:34713c] INFO -- : - REPLICATOR_SUCCESSFULCREATE [----] I, [2016-09-13T10:17:51.603739 #2937:34713c] INFO -- : - REPLICATOR_FAILEDCREATE [----] I, [2016-09-13T10:17:51.603819 #2937:34713c] INFO -- : - CONTAINER_CREATED [----] I, [2016-09-13T10:17:51.603891 #2937:34713c] INFO -- : :detail: [----] I, [2016-09-13T10:17:51.603965 #2937:34713c] INFO -- : - CloneVM_Task [----] I, [2016-09-13T10:17:51.604044 #2937:34713c] INFO -- : - CloneVM_Task_Complete [----] I, [2016-09-13T10:17:51.604115 #2937:34713c] INFO -- : - CreateClusterEx [----] I, [2016-09-13T10:17:51.604185 #2937:34713c] INFO -- : - CreateClusterEx_Complete [----] I, [2016-09-13T10:17:51.604258 #2937:34713c] INFO -- : - CreateDatacenter [----] I, [2016-09-13T10:17:51.604351 #2937:34713c] INFO -- : - CreateDatacenter_Complete [----] I, [2016-09-13T10:17:51.604464 #2937:34713c] INFO -- : - CreateResourcePool [----] I, [2016-09-13T10:17:51.604557 #2937:34713c] INFO -- : - CreateResourcePool_Complete [----] I, [2016-09-13T10:17:51.604630 #2937:34713c] INFO -- : - CreateVM_Task [----] I, [2016-09-13T10:17:51.604701 #2937:34713c] INFO -- : - CreateVM_Task_Complete [----] I, [2016-09-13T10:17:51.604778 #2937:34713c] INFO -- : - ReconnectHost_Task [----] I, [2016-09-13T10:17:51.604852 #2937:34713c] INFO -- : - RegisterVM_Task [----] I, [2016-09-13T10:17:51.604922 #2937:34713c] INFO -- : - RegisterVM_Task_Complete [----] I, [2016-09-13T10:17:51.604991 #2937:34713c] INFO -- : - VmBeingClonedEvent [----] I, [2016-09-13T10:17:51.605066 #2937:34713c] INFO -- : - VmBeingCreatedEvent [----] I, [2016-09-13T10:17:51.605135 #2937:34713c] INFO -- : - VmBeingDeployedEvent [----] I, [2016-09-13T10:17:51.605206 #2937:34713c] INFO -- : :name: Creation/Addition [----] I, [2016-09-13T10:17:51.605275 #2937:34713c] INFO -- : :application: [----] I, [2016-09-13T10:17:51.605369 #2937:34713c] INFO -- : :critical: [----] I, [2016-09-13T10:17:51.605495 #2937:34713c] INFO -- : - hawkular_datasource.error [----] I, [2016-09-13T10:17:51.605581 #2937:34713c] INFO -- : - hawkular_datasource_remove.error [----] I, [2016-09-13T10:17:51.605660 #2937:34713c] INFO -- : - hawkular_deployment.error [----] I, [2016-09-13T10:17:51.605734 #2937:34713c] INFO -- : - hawkular_deployment_remove.error [----] I, [2016-09-13T10:17:51.605811 #2937:34713c] INFO -- : - hawkular_event.critical [----] I, [2016-09-13T10:17:51.605881 #2937:34713c] INFO -- : :detail: [----] I, [2016-09-13T10:17:51.605953 #2937:34713c] INFO -- : - hawkular_datasource.ok [----] I, [2016-09-13T10:17:51.606024 #2937:34713c] INFO -- : - hawkular_datasource_remove.ok [----] I, [2016-09-13T10:17:51.606104 #2937:34713c] INFO -- : - hawkular_deployment.ok [----] I, [2016-09-13T10:17:51.606174 #2937:34713c] INFO -- : - hawkular_deployment_remove.ok [----] I, [2016-09-13T10:17:51.606241 #2937:34713c] INFO -- : - hawkular_event [----] I, [2016-09-13T10:17:51.606313 #2937:34713c] INFO -- : :name: Application [----] I, [2016-09-13T10:17:51.606409 #2937:34713c] INFO -- : :configuration: [----] I, [2016-09-13T10:17:51.606540 #2937:34713c] INFO -- : :critical: [----] I, [2016-09-13T10:17:51.606626 #2937:34713c] INFO -- : - ClusterReconfiguredEvent [----] I, [2016-09-13T10:17:51.606704 #2937:34713c] INFO -- : - EnterMaintenanceMode_Task_Complete [----] I, [2016-09-13T10:17:51.606779 #2937:34713c] INFO -- : - ExitMaintenanceMode_Task_Complete [----] I, [2016-09-13T10:17:51.606862 #2937:34713c] INFO -- : - FailoverLevelRestored [----] I, [2016-09-13T10:17:51.606934 #2937:34713c] INFO -- : - MarkAsTemplate_Complete [----] I, [2016-09-13T10:17:51.607011 #2937:34713c] INFO -- : - RefreshStorageSystem [----] I, [2016-09-13T10:17:51.607079 #2937:34713c] INFO -- : - ResourcePoolReconfiguredEvent [----] I, [2016-09-13T10:17:51.607153 #2937:34713c] INFO -- : - TemplateToVm [----] I, [2016-09-13T10:17:51.607232 #2937:34713c] INFO -- : - USER_ADD_DISK_TO_VM [----] I, [2016-09-13T10:17:51.607303 #2937:34713c] INFO -- : - USER_ADD_DISK_TO_VM_FINISHED_FAILURE [----] I, [2016-09-13T10:17:51.607404 #2937:34713c] INFO -- : - USER_ADD_DISK_TO_VM_FINISHED_SUCCESS [----] I, [2016-09-13T10:17:51.607533 #2937:34713c] INFO -- : - USER_CHANGE_FLOPPY_VM [----] I, [2016-09-13T10:17:51.607611 #2937:34713c] INFO -- : - USER_EJECT_VM_DISK [----] I, [2016-09-13T10:17:51.607685 #2937:34713c] INFO -- : - USER_EJECT_VM_FLOPPY [----] I, [2016-09-13T10:17:51.607756 #2937:34713c] INFO -- : - USER_FAILED_ADD_DISK_TO_VM [----] I, [2016-09-13T10:17:51.607831 #2937:34713c] INFO -- : - USER_FAILED_CHANGE_DISK_VM [----] I, [2016-09-13T10:17:51.607916 #2937:34713c] INFO -- : - USER_FAILED_CHANGE_FLOPPY_VM [----] I, [2016-09-13T10:17:51.607982 #2937:34713c] INFO -- : - USER_FAILED_REMOVE_DISK_FROM_VM [----] I, [2016-09-13T10:17:51.608051 #2937:34713c] INFO -- : - USER_FAILED_UPDATE_HOST [----] I, [2016-09-13T10:17:51.608125 #2937:34713c] INFO -- : - USER_FAILED_UPDATE_VM [----] I, [2016-09-13T10:17:51.608197 #2937:34713c] INFO -- : - USER_FAILED_UPDATE_VM_DISK [----] I, [2016-09-13T10:17:51.608262 #2937:34713c] INFO -- : - USER_FAILED_UPDATE_VM_TEMPLATE [----] I, [2016-09-13T10:17:51.608355 #2937:34713c] INFO -- : - USER_REMOVE_DISK_FROM_VM [----] I, [2016-09-13T10:17:51.608477 #2937:34713c] INFO -- : - USER_UPDATE_HOST [----] I, [2016-09-13T10:17:51.608562 #2937:34713c] INFO -- : - USER_UPDATE_VM [----] I, [2016-09-13T10:17:51.608639 #2937:34713c] INFO -- : - USER_UPDATE_VM_DISK [----] I, [2016-09-13T10:17:51.608713 #2937:34713c] INFO -- : - USER_UPDATE_VM_TEMPLATE [----] I, [2016-09-13T10:17:51.608791 #2937:34713c] INFO -- : - VmReconfiguredEvent [----] I, [2016-09-13T10:17:51.608869 #2937:34713c] INFO -- : - VmResourcePoolMovedEvent [----] I, [2016-09-13T10:17:51.608935 #2937:34713c] INFO -- : - VmToTemplate [----] I, [2016-09-13T10:17:51.609006 #2937:34713c] INFO -- : - compute.instance.rebuild.end [----] I, [2016-09-13T10:17:51.609075 #2937:34713c] INFO -- : - compute.instance.resize.end [----] I, [2016-09-13T10:17:51.609143 #2937:34713c] INFO -- : - orchestration.stack.update.end [----] I, [2016-09-13T10:17:51.609220 #2937:34713c] INFO -- : - orchestration.stack.update.error [----] I, [2016-09-13T10:17:51.609294 #2937:34713c] INFO -- : - orchestration.stack.suspend.end [----] I, [2016-09-13T10:17:51.609388 #2937:34713c] INFO -- : - orchestration.stack.suspend.error [----] I, [2016-09-13T10:17:51.609501 #2937:34713c] INFO -- : - orchestration.stack.resume.end [----] I, [2016-09-13T10:17:51.609577 #2937:34713c] INFO -- : - orchestration.stack.resume.error [----] I, [2016-09-13T10:17:51.609652 #2937:34713c] INFO -- : - orchestration.autoscaling.end [----] I, [2016-09-13T10:17:51.609730 #2937:34713c] INFO -- : - orchestration.autoscaling.error [----] I, [2016-09-13T10:17:51.609803 #2937:34713c] INFO -- : - servergroup.update [----] I, [2016-09-13T10:17:51.609888 #2937:34713c] INFO -- : - servergroup.addmemeber [----] I, [2016-09-13T10:17:51.609961 #2937:34713c] INFO -- : :detail: [----] I, [2016-09-13T10:17:51.610030 #2937:34713c] INFO -- : - EnterMaintenanceMode_Task [----] I, [2016-09-13T10:17:51.610105 #2937:34713c] INFO -- : - ExitMaintenanceMode_Task [----] I, [2016-09-13T10:17:51.610173 #2937:34713c] INFO -- : - MarkAsTemplate [----] I, [2016-09-13T10:17:51.610243 #2937:34713c] INFO -- : - MoveIntoFolder_Task [----] I, [2016-09-13T10:17:51.610336 #2937:34713c] INFO -- : - MoveInto_Task [----] I, [2016-09-13T10:17:51.610450 #2937:34713c] INFO -- : - MoveIntoResourcePool [----] I, [2016-09-13T10:17:51.610543 #2937:34713c] INFO -- : - MoveIntoResourcePool_Complete [----] I, [2016-09-13T10:17:51.610627 #2937:34713c] INFO -- : - ReconfigVM_Task [----] I, [2016-09-13T10:17:51.610708 #2937:34713c] INFO -- : - ReconfigVM_Task_Complete [----] I, [2016-09-13T10:17:51.610785 #2937:34713c] INFO -- : - VmMacAssignedEvent [----] I, [2016-09-13T10:17:51.610858 #2937:34713c] INFO -- : - VmResourceReallocatedEvent [----] I, [2016-09-13T10:17:51.610929 #2937:34713c] INFO -- : - VmUuidAssignedEvent [----] I, [2016-09-13T10:17:51.611000 #2937:34713c] INFO -- : :name: Configuration/Reconfiguration [----] I, [2016-09-13T10:17:51.611069 #2937:34713c] INFO -- : :console: [----] I, [2016-09-13T10:17:51.611142 #2937:34713c] INFO -- : :critical: [----] I, [2016-09-13T10:17:51.611211 #2937:34713c] INFO -- : - USER_LOGGED_IN_VM [----] I, [2016-09-13T10:17:51.611281 #2937:34713c] INFO -- : - USER_LOGGED_OUT_VM [----] I, [2016-09-13T10:17:51.611375 #2937:34713c] INFO -- : - UserLoginSessionEvent [----] I, [2016-09-13T10:17:51.611503 #2937:34713c] INFO -- : - UserLogoutSessionEvent [----] I, [2016-09-13T10:17:51.611590 #2937:34713c] INFO -- : - VmAcquiredMksTicketEvent [----] I, [2016-09-13T10:17:51.611668 #2937:34713c] INFO -- : - VmRemoteConsoleConnectedEvent [----] I, [2016-09-13T10:17:51.611744 #2937:34713c] INFO -- : :detail: [] [----] I, [2016-09-13T10:17:51.611823 #2937:34713c] INFO -- : :name: Console Activity [----] I, [2016-09-13T10:17:51.611889 #2937:34713c] INFO -- : :deletion: [----] I, [2016-09-13T10:17:51.611963 #2937:34713c] INFO -- : :critical: [----] I, [2016-09-13T10:17:51.612036 #2937:34713c] INFO -- : - ClusterDestroyedEvent [----] I, [2016-09-13T10:17:51.612105 #2937:34713c] INFO -- : - DestroyDatacenter_Task [----] I, [2016-09-13T10:17:51.612173 #2937:34713c] INFO -- : - DestroyFolder_Task [----] I, [2016-09-13T10:17:51.612240 #2937:34713c] INFO -- : - HostConnectionLostEvent [----] I, [2016-09-13T10:17:51.612311 #2937:34713c] INFO -- : - HostDisconnectedEvent [----] I, [2016-09-13T10:17:51.612409 #2937:34713c] INFO -- : - ResourcePoolDestroyedEvent [----] I, [2016-09-13T10:17:51.612532 #2937:34713c] INFO -- : - UnregisterVM_Complete [----] I, [2016-09-13T10:17:51.612601 #2937:34713c] INFO -- : - USER_FAILED_REMOVE_HOST [----] I, [2016-09-13T10:17:51.612673 #2937:34713c] INFO -- : - USER_FAILED_REMOVE_VM [----] I, [2016-09-13T10:17:51.612741 #2937:34713c] INFO -- : - USER_FAILED_REMOVE_VM_TEMPLATE [----] I, [2016-09-13T10:17:51.612820 #2937:34713c] INFO -- : - USER_REMOVE_HOST [----] I, [2016-09-13T10:17:51.612887 #2937:34713c] INFO -- : - USER_REMOVE_VM [----] I, [2016-09-13T10:17:51.612956 #2937:34713c] INFO -- : - USER_REMOVE_VM_FINISHED [----] I, [2016-09-13T10:17:51.613017 #2937:34713c] INFO -- : - USER_REMOVE_VM_TEMPLATE [----] I, [2016-09-13T10:17:51.613090 #2937:34713c] INFO -- : - USER_REMOVE_VM_TEMPLATE_FINISHED [----] I, [2016-09-13T10:17:51.613161 #2937:34713c] INFO -- : - virtualMachines_delete_EndRequest [----] I, [2016-09-13T10:17:51.613233 #2937:34713c] INFO -- : - GceOperationDone_compute.instances.delete [----] I, [2016-09-13T10:17:51.613339 #2937:34713c] INFO -- : - VmDisconnectedEvent [----] I, [2016-09-13T10:17:51.613452 #2937:34713c] INFO -- : - VmRemovedEvent [----] I, [2016-09-13T10:17:51.613542 #2937:34713c] INFO -- : - image.delete [----] I, [2016-09-13T10:17:51.613614 #2937:34713c] INFO -- : - orchestration.stack.delete.end [----] I, [2016-09-13T10:17:51.613678 #2937:34713c] INFO -- : - orchestration.stack.delete.error [----] I, [2016-09-13T10:17:51.613747 #2937:34713c] INFO -- : - servergroup.delete [----] I, [2016-09-13T10:17:51.613817 #2937:34713c] INFO -- : :detail: [----] I, [2016-09-13T10:17:51.613880 #2937:34713c] INFO -- : - Destroy_Task [----] I, [2016-09-13T10:17:51.613948 #2937:34713c] INFO -- : - Destroy_Task_Complete [----] I, [2016-09-13T10:17:51.614027 #2937:34713c] INFO -- : - DestroyCluster_Task_Complete [----] I, [2016-09-13T10:17:51.614094 #2937:34713c] INFO -- : - DestroyCluster_Task [----] I, [2016-09-13T10:17:51.614159 #2937:34713c] INFO -- : - DestroyResourcePool_Task [----] I, [2016-09-13T10:17:51.614228 #2937:34713c] INFO -- : - DestroyResourcePool_Task_Complete [----] I, [2016-09-13T10:17:51.614300 #2937:34713c] INFO -- : - DestroyVM_Task [----] I, [2016-09-13T10:17:51.614401 #2937:34713c] INFO -- : - DestroyVM_Task_Complete [----] I, [2016-09-13T10:17:51.614521 #2937:34713c] INFO -- : - DisconnectHost_Task [----] I, [2016-09-13T10:17:51.614601 #2937:34713c] INFO -- : - UnregisterVM [----] I, [2016-09-13T10:17:51.614675 #2937:34713c] INFO -- : :name: Deletion/Removal [----] I, [2016-09-13T10:17:51.614752 #2937:34713c] INFO -- : :general: [----] I, [2016-09-13T10:17:51.614828 #2937:34713c] INFO -- : :critical: [----] I, [2016-09-13T10:17:51.614902 #2937:34713c] INFO -- : - AD_COMPUTER_ACCOUNT_FAILED [----] I, [2016-09-13T10:17:51.614971 #2937:34713c] INFO -- : - AD_COMPUTER_ACCOUNT_SUCCEEDED [----] I, [2016-09-13T10:17:51.615043 #2937:34713c] INFO -- : - CPU_FLAGS_NX_IS_MISSING [----] I, [2016-09-13T10:17:51.615121 #2937:34713c] INFO -- : - HOST_APPROVE [----] I, [2016-09-13T10:17:51.615195 #2937:34713c] INFO -- : - HOST_APPROVE_FAILED [----] I, [2016-09-13T10:17:51.615269 #2937:34713c] INFO -- : - HOST_DOMAIN_DELAY_INTERVAL [----] I, [2016-09-13T10:17:51.615361 #2937:34713c] INFO -- : - HOST_INITIALIZING [----] I, [2016-09-13T10:17:51.615485 #2937:34713c] INFO -- : - HOST_INSTALL [----] I, [2016-09-13T10:17:51.615570 #2937:34713c] INFO -- : - HOST_INSTALL_FAILED [----] I, [2016-09-13T10:17:51.615648 #2937:34713c] INFO -- : - HOST_INSTALL_IN_PROGRESS [----] I, [2016-09-13T10:17:51.615721 #2937:34713c] INFO -- : - HOST_INSTALL_IN_PROGRESS_ERROR [----] I, [2016-09-13T10:17:51.615800 #2937:34713c] INFO -- : - HOST_INSTALL_IN_PROGRESS_WARNING [----] I, [2016-09-13T10:17:51.615873 #2937:34713c] INFO -- : - HOST_RECOVER_FAILED_VMS_UNKNOWN [----] I, [2016-09-13T10:17:51.615944 #2937:34713c] INFO -- : - HOST_RUN_IN_NO_KVM_MODE [----] I, [2016-09-13T10:17:51.616022 #2937:34713c] INFO -- : - HOST_SET_NONOPERATIONAL [----] I, [2016-09-13T10:17:51.616095 #2937:34713c] INFO -- : - HOST_SET_NONOPERATIONAL_DOMAIN [----] I, [2016-09-13T10:17:51.616170 #2937:34713c] INFO -- : - HOST_SET_NONOPERATIONAL_DOMAIN_FAILED [----] I, [2016-09-13T10:17:51.616248 #2937:34713c] INFO -- : - HOST_SET_NONOPERATIONAL_FAILED [----] I, [2016-09-13T10:17:51.616345 #2937:34713c] INFO -- : - HOST_SET_NONOPERATIONAL_IFACE_DOWN [----] I, [2016-09-13T10:17:51.616465 #2937:34713c] INFO -- : - HOST_SET_NONOPERATIONAL_NETWORK [----] I, [2016-09-13T10:17:51.616564 #2937:34713c] INFO -- : - HOST_VERSION_NOT_SUPPORTED_FOR_CLUSTER [----] I, [2016-09-13T10:17:51.616640 #2937:34713c] INFO -- : - IMAGES_SYNCRONIZER_DESKTOP_NOT_EXIST_IN_IRS [----] I, [2016-09-13T10:17:51.616721 #2937:34713c] INFO -- : - IMAGES_SYNCRONIZER_DESKTOP_NOT_EXIST_IN_VDC [----] I, [2016-09-13T10:17:51.616803 #2937:34713c] INFO -- : - IMAGES_SYNCRONIZER_DESKTOP_WITHOUT_TEMPLATE_VDC [----] I, [2016-09-13T10:17:51.616891 #2937:34713c] INFO -- : - IMAGES_SYNCRONIZER_IMAGE_TEMPLATE_NOT_EXIST [----] I, [2016-09-13T10:17:51.616964 #2937:34713c] INFO -- : - IMAGES_SYNCRONIZER_SNAPSHOT_NOT_EXIST_IN_IRS [----] I, [2016-09-13T10:17:51.617038 #2937:34713c] INFO -- : - IMAGES_SYNCRONIZER_SNAPSHOT_NOT_EXIST_IN_VDC [----] I, [2016-09-13T10:17:51.617115 #2937:34713c] INFO -- : - IMAGES_SYNCRONIZER_SNAPSHOTS_NOT_ATTACHED_TO_VM_IN_VDC [----] I, [2016-09-13T10:17:51.617186 #2937:34713c] INFO -- : - IMAGES_SYNCRONIZER_TEMPLATE_NOT_EXIST_IMAGE_EXIST [----] I, [2016-09-13T10:17:51.617266 #2937:34713c] INFO -- : - IMAGES_SYNCRONIZER_TEMPLATE_NOT_EXIST_IN_VDC [----] I, [2016-09-13T10:17:51.617358 #2937:34713c] INFO -- : - IRS_HOSTED_ON_HOST [----] I, [2016-09-13T10:17:51.617466 #2937:34713c] INFO -- : - RECONSTRUCT_MASTER_DONE [----] I, [2016-09-13T10:17:51.617558 #2937:34713c] INFO -- : - RECONSTRUCT_MASTER_FAILED [----] I, [2016-09-13T10:17:51.617631 #2937:34713c] INFO -- : - RECONSTRUCT_MASTER_FAILED_NO_MASTER [----] I, [2016-09-13T10:17:51.617705 #2937:34713c] INFO -- : - RescanAllHBA [----] I, [2016-09-13T10:17:51.617783 #2937:34713c] INFO -- : - RescanVMFS [----] I, [2016-09-13T10:17:51.617853 #2937:34713c] INFO -- : - ScheduledTaskStartedEvent [----] I, [2016-09-13T10:17:51.617926 #2937:34713c] INFO -- : - SYSTEM_CHANGE_STORAGE_POOL_STATUS_PROBLEMATIC_SEARCHING_NEW_SPM [----] I, [2016-09-13T10:17:51.617999 #2937:34713c] INFO -- : - SYSTEM_CHANGE_STORAGE_POOL_STATUS_PROBLEMATIC_WITH_ERROR [----] I, [2016-09-13T10:17:51.618074 #2937:34713c] INFO -- : - SYSTEM_UPDATE_HOST_GROUP [----] I, [2016-09-13T10:17:51.618151 #2937:34713c] INFO -- : - SYSTEM_UPDATE_HOST_GROUP_FAILED [----] I, [2016-09-13T10:17:51.618228 #2937:34713c] INFO -- : - TaskTimeoutEvent [----] I, [2016-09-13T10:17:51.618301 #2937:34713c] INFO -- : - TASK_CLEARING_ASYNC_TASK [----] I, [2016-09-13T10:17:51.618400 #2937:34713c] INFO -- : - TASK_STOPPING_ASYNC_TASK [----] I, [2016-09-13T10:17:51.618516 #2937:34713c] INFO -- : - UPDATE_TAGS_VM_DEFAULT_DISPLAY_TYPE [----] I, [2016-09-13T10:17:51.618600 #2937:34713c] INFO -- : - UPDATE_TAGS_VM_DEFAULT_DISPLAY_TYPE_FAILED [----] I, [2016-09-13T10:17:51.618672 #2937:34713c] INFO -- : - USER_ADD_BOOKMARK [----] I, [2016-09-13T10:17:51.618742 #2937:34713c] INFO -- : - USER_ADD_BOOKMARK_FAILED [----] I, [2016-09-13T10:17:51.618825 #2937:34713c] INFO -- : - USER_ADD_HOST_GROUP [----] I, [2016-09-13T10:17:51.618894 #2937:34713c] INFO -- : - USER_ADD_HOST_GROUP_FAILED [----] I, [2016-09-13T10:17:51.618965 #2937:34713c] INFO -- : - USER_ADD_PERMISSION [----] I, [2016-09-13T10:17:51.619033 #2937:34713c] INFO -- : - USER_ADD_PERMISSION_FAILED [----] I, [2016-09-13T10:17:51.619103 #2937:34713c] INFO -- : - USER_ADD_ROLE [----] I, [2016-09-13T10:17:51.619178 #2937:34713c] INFO -- : - USER_ADD_ROLE_FAILED [----] I, [2016-09-13T10:17:51.619252 #2937:34713c] INFO -- : - USER_ADD_ROLE_WITH_ACTION_GROUP [----] I, [2016-09-13T10:17:51.619317 #2937:34713c] INFO -- : - USER_ADD_ROLE_WITH_ACTION_GROUP_FAILED [----] I, [2016-09-13T10:17:51.619439 #2937:34713c] INFO -- : - USER_ADD_TAG [----] I, [2016-09-13T10:17:51.619535 #2937:34713c] INFO -- : - USER_ADD_TAG_FAILED [----] I, [2016-09-13T10:17:51.619614 #2937:34713c] INFO -- : - USER_ATTACH_TAG_TO_HOST [----] I, [2016-09-13T10:17:51.619507 #2928:34713c] INFO -- : Current database bloat data table_name | index_name | otta | pages | pagesize | percent_bloat | rows | wasted_bytes | wasted_pages | wasted_size ------------------------+-----------------------------------------------+------+-------+----------+---------------+--------+--------------+--------------+------------- event_streams | | 22 | 32 | 0 | 1.5 | 975 | 81920 | 10 | 81920 event_streams | event_streams_pkey | 16 | 5 | 0 | 0.3 | 975 | 0 | 0 | 0 event_streams | index_event_streams_on_chain_id_and_ems_id | 16 | 7 | 0 | 0.4 | 975 | 0 | 0 | 0 event_streams | index_event_streams_on_dest_host_id | 16 | 7 | 0 | 0.4 | 975 | 0 | 0 | 0 event_streams | index_event_streams_on_dest_vm_or_template_id | 16 | 6 | 0 | 0.4 | 975 | 0 | 0 | 0 event_streams | index_event_streams_on_ems_cluster_id | 16 | 7 | 0 | 0.4 | 975 | 0 | 0 | 0 event_streams | index_event_streams_on_ems_id | 16 | 7 | 0 | 0.4 | 975 | 0 | 0 | 0 event_streams | index_event_streams_on_event_type | 16 | 9 | 0 | 0.6 | 975 | 0 | 0 | 0 event_streams | index_event_streams_on_host_id | 16 | 7 | 0 | 0.4 | 975 | 0 | 0 | 0 event_streams | index_event_streams_on_timestamp | 16 | 5 | 0 | 0.3 | 975 | 0 | 0 | 0 event_streams | index_event_streams_on_vm_or_template_id | 16 | 6 | 0 | 0.4 | 975 | 0 | 0 | 0 ext_management_systems | | 1 | 1 | 0 | 0.0 | 2 | 0 | 0 | 0 ext_management_systems | ext_management_systems_pkey | 1 | 2 | 0 | 2.0 | 2 | 8192 | 1 | 8192 ext_management_systems | index_ext_management_systems_on_guid | 1 | 2 | 0 | 2.0 | 2 | 8192 | 1 | 8192 ext_management_systems | index_ext_management_systems_on_parent_ems_id | 1 | 2 | 0 | 2.0 | 2 | 8192 | 1 | 8192 middleware_messagings | | 2 | 14 | 0 | 7.0 | 21 | 98304 | 12 | 98304 middleware_messagings | middleware_messagings_pkey | 2 | 2 | 0 | 0.0 | 21 | 0 | 0 | 0 miq_ae_fields | | 23 | 21 | 0 | 0.9 | 1016 | 0 | 0 | 0 miq_ae_fields | index_miq_ae_fields_on_ae_class_id | 17 | 5 | 0 | 0.3 | 1016 | 0 | 0 | 0 miq_ae_fields | index_miq_ae_fields_on_method_id | 17 | 7 | 0 | 0.4 | 1016 | 0 | 0 | 0 miq_ae_fields | index_miq_ae_fields_on_updated_by_user_id | 17 | 6 | 0 | 0.4 | 1016 | 0 | 0 | 0 miq_ae_fields | miq_ae_fields_pkey | 17 | 5 | 0 | 0.3 | 1016 | 0 | 0 | 0 miq_ae_instances | | 8 | 13 | 0 | 1.6 | 513 | 40960 | 5 | 40960 miq_ae_instances | index_miq_ae_instances_on_ae_class_id | 5 | 5 | 0 | 0.0 | 513 | 0 | 0 | 0 miq_ae_instances | index_miq_ae_instances_on_updated_by_user_id | 5 | 5 | 0 | 0.0 | 513 | 0 | 0 | 0 miq_ae_instances | miq_ae_instances_pkey | 5 | 6 | 0 | 1.2 | 513 | 8192 | 1 | 8192 miq_ae_values | | 13 | 11 | 0 | 0.8 | 637 | 0 | 0 | 0 miq_ae_values | index_miq_ae_values_on_field_id | 9 | 4 | 0 | 0.4 | 637 | 0 | 0 | 0 miq_ae_values | index_miq_ae_values_on_instance_id | 9 | 4 | 0 | 0.4 | 637 | 0 | 0 | 0 miq_ae_values | index_miq_ae_values_on_updated_by_user_id | 9 | 5 | 0 | 0.6 | 637 | 0 | 0 | 0 miq_ae_values | miq_ae_values_pkey | 9 | 4 | 0 | 0.4 | 637 | 0 | 0 | 0 miq_product_features | | 20 | 20 | 0 | 0.0 | 1135 | 0 | 0 | 0 miq_product_features | index_miq_product_features_on_parent_id | 15 | 6 | 0 | 0.4 | 1135 | 0 | 0 | 0 miq_product_features | miq_product_features_pkey | 15 | 5 | 0 | 0.3 | 1135 | 0 | 0 | 0 miq_queue | | 1 | 4 | 0 | 4.0 | 6 | 24576 | 3 | 24576 miq_queue | index_miq_queue_on_task_id | 1 | 8 | 0 | 8.0 | 6 | 57344 | 7 | 57344 miq_queue | miq_queue_get_idx | 1 | 12 | 0 | 12.0 | 5 | 90112 | 11 | 90112 miq_queue | miq_queue_get_sub_idx | 0 | 2 | 0 | 0.0 | 0 | 16384 | 2 | 16384 miq_queue | miq_queue_pkey | 1 | 7 | 0 | 7.0 | 6 | 49152 | 6 | 49152 miq_queue | miq_queue_put_idx | 1 | 16 | 0 | 16.0 | 6 | 122880 | 15 | 122880 miq_roles_features | | 6 | 6 | 0 | 0.0 | 908 | 0 | 0 | 0 miq_roles_features | miq_roles_features_pkey | 4 | 5 | 0 | 1.3 | 908 | 8192 | 1 | 8192 miq_servers | | 1 | 1 | 0 | 0.0 | 1 | 0 | 0 | 0 miq_servers | index_miq_servers_on_guid | 1 | 2 | 0 | 2.0 | 1 | 8192 | 1 | 8192 miq_servers | index_miq_servers_on_vm_id | 1 | 2 | 0 | 2.0 | 1 | 8192 | 1 | 8192 miq_servers | index_miq_servers_on_zone_id | 1 | 2 | 0 | 2.0 | 1 | 8192 | 1 | 8192 miq_servers | miq_servers_pkey | 1 | 2 | 0 | 2.0 | 1 | 8192 | 1 | 8192 miq_tasks | | 5 | 7 | 0 | 1.4 | 168 | 16384 | 2 | 16384 miq_tasks | index_miq_tasks_on_miq_server_id | 4 | 2 | 0 | 0.5 | 168 | 0 | 0 | 0 miq_tasks | miq_tasks_pkey | 4 | 2 | 0 | 0.5 | 168 | 0 | 0 | 0 miq_workers | | 1 | 2 | 0 | 2.0 | 13 | 8192 | 1 | 8192 miq_workers | index_miq_workers_on_guid | 1 | 5 | 0 | 5.0 | 13 | 32768 | 4 | 32768 miq_workers | index_miq_workers_on_miq_server_id | 1 | 4 | 0 | 4.0 | 13 | 24576 | 3 | 24576 miq_workers | index_miq_workers_on_queue_name | 1 | 5 | 0 | 5.0 | 13 | 32768 | 4 | 32768 miq_workers | index_miq_workers_on_status | 1 | 5 | 0 | 5.0 | 13 | 32768 | 4 | 32768 miq_workers | index_miq_workers_on_worker_type | 1 | 7 | 0 | 7.0 | 13 | 49152 | 6 | 49152 miq_workers | miq_workers_pkey | 1 | 2 | 0 | 2.0 | 13 | 8192 | 1 | 8192 vmdb_indexes | | 13 | 14 | 0 | 1.1 | 820 | 8192 | 1 | 8192 vmdb_indexes | vmdb_indexes_pkey | 11 | 7 | 0 | 0.6 | 820 | 0 | 0 | 0 vmdb_metrics | | 3566 | 3315 | 0 | 0.9 | 169413 | 0 | 0 | 0 vmdb_metrics | index_vmdb_metrics_on_resource_and_timestamp | 2545 | 1219 | 0 | 0.5 | 169413 | 0 | 0 | 0 vmdb_metrics | vmdb_metrics_pkey | 2545 | 467 | 0 | 0.2 | 169413 | 0 | 0 | 0 vmdb_tables | | 15 | 16 | 0 | 1.1 | 605 | 8192 | 1 | 8192 vmdb_tables | vmdb_tables_pkey | 12 | 5 | 0 | 0.4 | 605 | 0 | 0 | 0 [----] I, [2016-09-13T10:17:51.619681 #2937:34713c] INFO -- : - USER_ATTACH_TAG_TO_HOST_EXISTS [----] I, [2016-09-13T10:17:51.619757 #2937:34713c] INFO -- : - USER_ATTACH_TAG_TO_HOST_FAILED [----] I, [2016-09-13T10:17:51.619841 #2937:34713c] INFO -- : - USER_ATTACH_TAG_TO_USER [----] I, [2016-09-13T10:17:51.619918 #2937:34713c] INFO -- : - USER_ATTACH_TAG_TO_USER_EXISTS [----] I, [2016-09-13T10:17:51.619994 #2937:34713c] INFO -- : - USER_ATTACH_TAG_TO_USER_FAILED [----] I, [2016-09-13T10:17:51.620067 #2937:34713c] INFO -- : - USER_ATTACH_TAG_TO_USER_GROUP [----] I, [2016-09-13T10:17:51.620146 #2937:34713c] INFO -- : - USER_ATTACH_TAG_TO_USER_GROUP_EXISTS [----] I, [2016-09-13T10:17:51.620220 #2937:34713c] INFO -- : - USER_ATTACH_TAG_TO_USER_GROUP_FAILED [----] I, [2016-09-13T10:17:51.620289 #2937:34713c] INFO -- : - USER_ATTACH_TAG_TO_VM [----] I, [2016-09-13T10:17:51.620390 #2937:34713c] INFO -- : - USER_ATTACH_TAG_TO_VM_EXISTS [----] I, [2016-09-13T10:17:51.620510 #2937:34713c] INFO -- : - USER_ATTACH_TAG_TO_VM_FAILED [----] I, [2016-09-13T10:17:51.620590 #2937:34713c] INFO -- : - USER_ATTACHED_ACTION_GROUP_TO_ROLE [----] I, [2016-09-13T10:17:51.620663 #2937:34713c] INFO -- : - USER_ATTACHED_ACTION_GROUP_TO_ROLE_FAILED [----] I, [2016-09-13T10:17:51.620752 #2937:34713c] INFO -- : - USER_CHANGE_DISK_VM [----] I, [2016-09-13T10:17:51.620836 #2937:34713c] INFO -- : - USER_CLEAR_UNKNOWN_VMS [----] I, [2016-09-13T10:17:51.620908 #2937:34713c] INFO -- : - USER_COPIED_TEMPLATE [----] I, [2016-09-13T10:17:51.620984 #2937:34713c] INFO -- : - USER_COPIED_TEMPLATE_FINISHED_FAILURE [----] I, [2016-09-13T10:17:51.621061 #2937:34713c] INFO -- : - USER_COPIED_TEMPLATE_FINISHED_SUCCESS [----] I, [2016-09-13T10:17:51.621137 #2937:34713c] INFO -- : - USER_DEDICATE_VM_TO_POWERCLIENT [----] I, [2016-09-13T10:17:51.621208 #2937:34713c] INFO -- : - USER_DEDICATE_VM_TO_POWERCLIENT_FAILED [----] I, [2016-09-13T10:17:51.621279 #2937:34713c] INFO -- : - USER_DETACH_HOST_FROM_TAG [----] I, [2016-09-13T10:17:51.621380 #2937:34713c] INFO -- : - USER_DETACH_HOST_FROM_TAG_FAILED [----] I, [2016-09-13T10:17:51.621499 #2937:34713c] INFO -- : - USER_DETACH_USER_FROM_TAG [----] I, [2016-09-13T10:17:51.621579 #2937:34713c] INFO -- : - USER_DETACH_USER_FROM_TAG_FAILED [----] I, [2016-09-13T10:17:51.621652 #2937:34713c] INFO -- : - USER_DETACH_USER_GROUP_FROM_TAG [----] I, [2016-09-13T10:17:51.621723 #2937:34713c] INFO -- : - USER_DETACH_USER_GROUP_FROM_TAG_FAILED [----] I, [2016-09-13T10:17:51.621805 #2937:34713c] INFO -- : - USER_DETACH_VM_FROM_TAG [----] I, [2016-09-13T10:17:51.621880 #2937:34713c] INFO -- : - USER_DETACH_VM_FROM_TAG_FAILED [----] I, [2016-09-13T10:17:51.621951 #2937:34713c] INFO -- : - USER_DETACHED_ACTION_GROUP_FROM_ROLE [----] I, [2016-09-13T10:17:51.622031 #2937:34713c] INFO -- : - USER_DETACHED_ACTION_GROUP_FROM_ROLE_FAILED [----] I, [2016-09-13T10:17:51.622098 #2937:34713c] INFO -- : - USER_FAILED_ADD_ADUSER [----] I, [2016-09-13T10:17:51.622167 #2937:34713c] INFO -- : - USER_FAILED_CLEAR_UNKNOWN_VMS [----] I, [2016-09-13T10:17:51.622236 #2937:34713c] INFO -- : - USER_FAILED_COPY_TEMPLATE [----] I, [2016-09-13T10:17:51.622307 #2937:34713c] INFO -- : - USER_FAILED_REMOVE_ADUSER [----] I, [2016-09-13T10:17:51.622403 #2937:34713c] INFO -- : - USER_LOCKED_VM [----] I, [2016-09-13T10:17:51.622518 #2937:34713c] INFO -- : - USER_MOVE_TAG [----] I, [2016-09-13T10:17:51.622597 #2937:34713c] INFO -- : - USER_MOVE_TAG_FAILED [----] I, [2016-09-13T10:17:51.622663 #2937:34713c] INFO -- : - USER_PASSWORD_CHANGE_FAILED [----] I, [2016-09-13T10:17:51.622741 #2937:34713c] INFO -- : - USER_PASSWORD_CHANGED [----] I, [2016-09-13T10:17:51.622820 #2937:34713c] INFO -- : - USER_REMOVE_ADUSER [----] I, [2016-09-13T10:17:51.622885 #2937:34713c] INFO -- : - USER_REMOVE_BOOKMARK [----] I, [2016-09-13T10:17:51.622954 #2937:34713c] INFO -- : - USER_REMOVE_BOOKMARK_FAILED [----] I, [2016-09-13T10:17:51.623018 #2937:34713c] INFO -- : - USER_REMOVE_HOST_GROUP [----] I, [2016-09-13T10:17:51.623086 #2937:34713c] INFO -- : - USER_REMOVE_HOST_GROUP_FAILED [----] I, [2016-09-13T10:17:51.623154 #2937:34713c] INFO -- : - USER_REMOVE_PERMISSION [----] I, [2016-09-13T10:17:51.623216 #2937:34713c] INFO -- : - USER_REMOVE_PERMISSION_FAILED [----] I, [2016-09-13T10:17:51.623280 #2937:34713c] INFO -- : - USER_REMOVE_ROLE [----] I, [2016-09-13T10:17:51.623401 #2937:34713c] INFO -- : - USER_REMOVE_ROLE_FAILED [----] I, [2016-09-13T10:17:51.623527 #2937:34713c] INFO -- : - USER_REMOVE_TAG [----] I, [2016-09-13T10:17:51.623614 #2937:34713c] INFO -- : - USER_REMOVE_TAG_FAILED [----] I, [2016-09-13T10:17:51.623690 #2937:34713c] INFO -- : - USER_UNLOCKED_VM [----] I, [2016-09-13T10:17:51.623762 #2937:34713c] INFO -- : - USER_UPDATE_BOOKMARK [----] I, [2016-09-13T10:17:51.623841 #2937:34713c] INFO -- : - USER_UPDATE_BOOKMARK_FAILED [----] I, [2016-09-13T10:17:51.623910 #2937:34713c] INFO -- : - USER_UPDATE_HOST_GROUP [----] I, [2016-09-13T10:17:51.623995 #2937:34713c] INFO -- : - USER_UPDATE_HOST_GROUP_FAILED [----] I, [2016-09-13T10:17:51.624070 #2937:34713c] INFO -- : - USER_UPDATE_ROLE [----] I, [2016-09-13T10:17:51.624140 #2937:34713c] INFO -- : - USER_UPDATE_ROLE_FAILED [----] I, [2016-09-13T10:17:51.624212 #2937:34713c] INFO -- : - USER_UPDATE_TAG [----] I, [2016-09-13T10:17:51.624281 #2937:34713c] INFO -- : - USER_UPDATE_TAG_FAILED [----] I, [2016-09-13T10:17:51.624370 #2937:34713c] INFO -- : - USER_UPDATE_VM_CLUSTER_DEFAULT_HOST_CLEARED [----] I, [2016-09-13T10:17:51.624486 #2937:34713c] INFO -- : - USER_VDC_LOGIN_FAILED [----] I, [2016-09-13T10:17:51.624567 #2937:34713c] INFO -- : - USER_VDC_LOGOUT_FAILED [----] I, [2016-09-13T10:17:51.624652 #2937:34713c] INFO -- : - VDC_START [----] I, [2016-09-13T10:17:51.624730 #2937:34713c] INFO -- : - VDC_STOP [----] I, [2016-09-13T10:17:51.624810 #2937:34713c] INFO -- : - VM_BLK_VIRTIO_NO_CACHE [----] I, [2016-09-13T10:17:51.624902 #2937:34713c] INFO -- : - VM_CLEARED [----] I, [2016-09-13T10:17:51.624980 #2937:34713c] INFO -- : - VM_SET_TO_UNKNOWN_STATUS [----] I, [2016-09-13T10:17:51.625056 #2937:34713c] INFO -- : - VM_WAS_SET_DOWN_DUE_TO_HOST_REBOOT_OR_MANUAL_FENCE [----] I, [2016-09-13T10:17:51.625134 #2937:34713c] INFO -- : - VM_RENAMED [----] I, [2016-09-13T10:17:51.625209 #2937:34713c] INFO -- : - hardware.ipmi.metrics.update [----] I, [2016-09-13T10:17:51.625277 #2937:34713c] INFO -- : :detail: [] [----] I, [2016-09-13T10:17:51.625371 #2937:34713c] INFO -- : :name: General Activity [----] I, [2016-09-13T10:17:51.625491 #2937:34713c] INFO -- : :import_export: [----] I, [2016-09-13T10:17:51.625578 #2937:34713c] INFO -- : :critical: [----] I, [2016-09-13T10:17:51.625656 #2937:34713c] INFO -- : - IMPORTEXPORT_EXPORT_TEMPLATE [----] I, [2016-09-13T10:17:51.625724 #2937:34713c] INFO -- : - IMPORTEXPORT_EXPORT_TEMPLATE_FAILED [----] I, [2016-09-13T10:17:51.625827 #2937:34713c] INFO -- : - IMPORTEXPORT_EXPORT_VM [----] I, [2016-09-13T10:17:51.625915 #2937:34713c] INFO -- : - IMPORTEXPORT_EXPORT_VM_FAILED [----] I, [2016-09-13T10:17:51.625998 #2937:34713c] INFO -- : - IMPORTEXPORT_FAILED_TO_IMPORT_TEMPLATE [----] I, [2016-09-13T10:17:51.626077 #2937:34713c] INFO -- : - IMPORTEXPORT_FAILED_TO_IMPORT_VM [----] I, [2016-09-13T10:17:51.626151 #2937:34713c] INFO -- : - IMPORTEXPORT_IMPORT_TEMPLATE [----] I, [2016-09-13T10:17:51.626221 #2937:34713c] INFO -- : - IMPORTEXPORT_IMPORT_TEMPLATE_FAILED [----] I, [2016-09-13T10:17:51.626290 #2937:34713c] INFO -- : - IMPORTEXPORT_IMPORT_VM [----] I, [2016-09-13T10:17:51.626397 #2937:34713c] INFO -- : - IMPORTEXPORT_IMPORT_VM_FAILED [----] I, [2016-09-13T10:17:51.626518 #2937:34713c] INFO -- : - IMPORTEXPORT_REMOVE_TEMPLATE [----] I, [2016-09-13T10:17:51.626599 #2937:34713c] INFO -- : - IMPORTEXPORT_REMOVE_TEMPLATE_FAILED [----] I, [2016-09-13T10:17:51.626672 #2937:34713c] INFO -- : - IMPORTEXPORT_REMOVE_VM [----] I, [2016-09-13T10:17:51.626745 #2937:34713c] INFO -- : - IMPORTEXPORT_REMOVE_VM_FAILED [----] I, [2016-09-13T10:17:51.626825 #2937:34713c] INFO -- : - IMPORTEXPORT_STARTING_EXPORT_TEMPLATE [----] I, [2016-09-13T10:17:51.626898 #2937:34713c] INFO -- : - IMPORTEXPORT_STARTING_EXPORT_VM [----] I, [2016-09-13T10:17:51.626969 #2937:34713c] INFO -- : - IMPORTEXPORT_STARTING_IMPORT_TEMPLATE [----] I, [2016-09-13T10:17:51.627043 #2937:34713c] INFO -- : - IMPORTEXPORT_STARTING_IMPORT_VM [----] I, [2016-09-13T10:17:51.627112 #2937:34713c] INFO -- : - IMPORTEXPORT_STARTING_REMOVE_TEMPLATE [----] I, [2016-09-13T10:17:51.627182 #2937:34713c] INFO -- : - IMPORTEXPORT_STARTING_REMOVE_VM [----] I, [2016-09-13T10:17:51.627257 #2937:34713c] INFO -- : - TEMPLATE_IMPORT [----] I, [2016-09-13T10:17:51.627341 #2937:34713c] INFO -- : - TEMPLATE_IMPORT_FAILED [----] I, [2016-09-13T10:17:51.627459 #2937:34713c] INFO -- : - USER_EXPORT_TEMPLATE [----] I, [2016-09-13T10:17:51.627555 #2937:34713c] INFO -- : - USER_EXPORT_TEMPLATE_FAILED [----] I, [2016-09-13T10:17:51.627631 #2937:34713c] INFO -- : - USER_EXPORT_VM [----] I, [2016-09-13T10:17:51.627711 #2937:34713c] INFO -- : - USER_EXPORT_VM_FAILED [----] I, [2016-09-13T10:17:51.627786 #2937:34713c] INFO -- : - VM_IMPORT [----] I, [2016-09-13T10:17:51.627863 #2937:34713c] INFO -- : - VM_IMPORT_FAILED [----] I, [2016-09-13T10:17:51.627936 #2937:34713c] INFO -- : - VM_IMPORT_INFO [----] I, [2016-09-13T10:17:51.628003 #2937:34713c] INFO -- : :detail: [] [----] I, [2016-09-13T10:17:51.628070 #2937:34713c] INFO -- : :name: Import / Export [----] I, [2016-09-13T10:17:51.628144 #2937:34713c] INFO -- : :migration: [----] I, [2016-09-13T10:17:51.628212 #2937:34713c] INFO -- : :critical: [----] I, [2016-09-13T10:17:51.628280 #2937:34713c] INFO -- : - DatastoreFileMovedEvent [----] I, [2016-09-13T10:17:51.628376 #2937:34713c] INFO -- : - DrsMigrateVM_Task [----] I, [2016-09-13T10:17:51.628510 #2937:34713c] INFO -- : - DrsVmMigratedEvent [----] I, [2016-09-13T10:17:51.628587 #2937:34713c] INFO -- : - MigrateTaskEvent [----] I, [2016-09-13T10:17:51.628660 #2937:34713c] INFO -- : - MigrateVM_Task [----] I, [2016-09-13T10:17:51.628736 #2937:34713c] INFO -- : - RelocateVM_Task [----] I, [2016-09-13T10:17:51.628820 #2937:34713c] INFO -- : - USER_FAILED_MOVE_TEMPLATE [----] I, [2016-09-13T10:17:51.628888 #2937:34713c] INFO -- : - USER_FAILED_MOVE_VM [----] I, [2016-09-13T10:17:51.628960 #2937:34713c] INFO -- : - USER_HOST_MAINTENANCE_MIGRATION_FAILED [----] I, [2016-09-13T10:17:51.629037 #2937:34713c] INFO -- : - USER_MOVED_TEMPLATE [----] I, [2016-09-13T10:17:51.629109 #2937:34713c] INFO -- : - USER_MOVED_TEMPLATE_FINISHED_FAILURE [----] I, [2016-09-13T10:17:51.629185 #2937:34713c] INFO -- : - USER_MOVED_TEMPLATE_FINISHED_SUCCESS [----] I, [2016-09-13T10:17:51.629255 #2937:34713c] INFO -- : - USER_MOVED_VM [----] I, [2016-09-13T10:17:51.629342 #2937:34713c] INFO -- : - USER_MOVED_VM_FINISHED_FAILURE [----] I, [2016-09-13T10:17:51.629473 #2937:34713c] INFO -- : - USER_MOVED_VM_FINISHED_SUCCESS [----] I, [2016-09-13T10:17:51.629574 #2937:34713c] INFO -- : - VM_MIGRATION_ABORT [----] I, [2016-09-13T10:17:51.629654 #2937:34713c] INFO -- : - VM_MIGRATION_DONE [----] I, [2016-09-13T10:17:51.629731 #2937:34713c] INFO -- : - VM_MIGRATION_FAILED [----] I, [2016-09-13T10:17:51.629816 #2937:34713c] INFO -- : - VM_MIGRATION_FAILED_DURING_MOVE_TO_MAINTANANCE [----] I, [2016-09-13T10:17:51.629894 #2937:34713c] INFO -- : - VM_MIGRATION_FAILED_FROM_TO [----] I, [2016-09-13T10:17:51.629969 #2937:34713c] INFO -- : - VM_MIGRATION_ON_CONNECT_CHECK_FAILED [----] I, [2016-09-13T10:17:51.630040 #2937:34713c] INFO -- : - VM_MIGRATION_ON_CONNECT_CHECK_SUCCEEDED [----] I, [2016-09-13T10:17:51.630110 #2937:34713c] INFO -- : - VM_MIGRATION_START [----] I, [2016-09-13T10:17:51.630182 #2937:34713c] INFO -- : - VM_MIGRATION_TRYING_RERUN [----] I, [2016-09-13T10:17:51.630250 #2937:34713c] INFO -- : - VmMigratedEvent [----] I, [2016-09-13T10:17:51.630339 #2937:34713c] INFO -- : - VmRelocatedEvent [----] I, [2016-09-13T10:17:51.630446 #2937:34713c] INFO -- : :detail: [----] I, [2016-09-13T10:17:51.630540 #2937:34713c] INFO -- : - DrsMigrateVM_Task_Complete [----] I, [2016-09-13T10:17:51.630618 #2937:34713c] INFO -- : - MigrateVM_Task_Complete [----] I, [2016-09-13T10:17:51.630701 #2937:34713c] INFO -- : - MigrationHostWarningEvent [----] I, [2016-09-13T10:17:51.630780 #2937:34713c] INFO -- : - Move_Task [----] I, [2016-09-13T10:17:51.630857 #2937:34713c] INFO -- : - Move_Task_Complete [----] I, [2016-09-13T10:17:51.630948 #2937:34713c] INFO -- : - RelocateTaskEvent [----] I, [2016-09-13T10:17:51.631030 #2937:34713c] INFO -- : - RelocateVM_Task_Complete [----] I, [2016-09-13T10:17:51.631102 #2937:34713c] INFO -- : - VmBeingRelocatedEvent [----] I, [2016-09-13T10:17:51.631173 #2937:34713c] INFO -- : :name: Migration/Vmotion [----] I, [2016-09-13T10:17:51.631240 #2937:34713c] INFO -- : :network: [----] I, [2016-09-13T10:17:51.631304 #2937:34713c] INFO -- : :critical: [----] I, [2016-09-13T10:17:51.631403 #2937:34713c] INFO -- : - HOST_ALERT_FENCING_IS_NOT_CONFIGURED [----] I, [2016-09-13T10:17:51.631525 #2937:34713c] INFO -- : - HOST_ALERT_FENCING_NO_PROXY_HOST [----] I, [2016-09-13T10:17:51.631597 #2937:34713c] INFO -- : - HOST_ALERT_FENCING_OPERATION_FAILED [----] I, [2016-09-13T10:17:51.631672 #2937:34713c] INFO -- : - HOST_ALERT_FENCING_OPERATION_SKIPPED [----] I, [2016-09-13T10:17:51.631755 #2937:34713c] INFO -- : - HOST_ALERT_FENCING_TEST_FAILED [----] I, [2016-09-13T10:17:51.631833 #2937:34713c] INFO -- : - HOST_FENCE_STATUS [----] I, [2016-09-13T10:17:51.631899 #2937:34713c] INFO -- : - HOST_FENCE_STATUS_FAILED [----] I, [2016-09-13T10:17:51.631968 #2937:34713c] INFO -- : - HOST_MANUAL_FENCE_FAILED_CALL_FENCE_SPM [----] I, [2016-09-13T10:17:51.632030 #2937:34713c] INFO -- : - HOST_MANUAL_FENCE_STATUS [----] I, [2016-09-13T10:17:51.632099 #2937:34713c] INFO -- : - HOST_MANUAL_FENCE_STATUS_FAILED [----] I, [2016-09-13T10:17:51.632171 #2937:34713c] INFO -- : - NETWORK_ADD_BOND [----] I, [2016-09-13T10:17:51.632237 #2937:34713c] INFO -- : - NETWORK_ADD_BOND_FAILED [----] I, [2016-09-13T10:17:51.632306 #2937:34713c] INFO -- : - NETWORK_ADD_NETWORK [----] I, [2016-09-13T10:17:51.632401 #2937:34713c] INFO -- : - NETWORK_ADD_NETWORK_FAILED [----] I, [2016-09-13T10:17:51.632519 #2937:34713c] INFO -- : - NETWORK_ADD_TEMPLATE_INTERFACE [----] I, [2016-09-13T10:17:51.632593 #2937:34713c] INFO -- : - NETWORK_ADD_TEMPLATE_INTERFACE_FAILED [----] I, [2016-09-13T10:17:51.632659 #2937:34713c] INFO -- : - NETWORK_ADD_VM_INTERFACE [----] I, [2016-09-13T10:17:51.632722 #2937:34713c] INFO -- : - NETWORK_ADD_VM_INTERFACE_FAILED [----] I, [2016-09-13T10:17:51.632792 #2937:34713c] INFO -- : - NETWORK_INTERFACE_PLUGGED_INTO_VM [----] I, [2016-09-13T10:17:51.632870 #2937:34713c] INFO -- : - NETWORK_ATTACH_NETWORK_TO_HOST [----] I, [2016-09-13T10:17:51.632941 #2937:34713c] INFO -- : - NETWORK_ATTACH_NETWORK_TO_HOST_FAILED [----] I, [2016-09-13T10:17:51.633013 #2937:34713c] INFO -- : - NETWORK_ATTACH_NETWORK_TO_HOST_GROUP [----] I, [2016-09-13T10:17:51.633082 #2937:34713c] INFO -- : - NETWORK_ATTACH_NETWORK_TO_HOST_GROUP_FAILED [----] I, [2016-09-13T10:17:51.633156 #2937:34713c] INFO -- : - NETWORK_COMMINT_NETWORK_CHANGES [----] I, [2016-09-13T10:17:51.633227 #2937:34713c] INFO -- : - NETWORK_COMMINT_NETWORK_CHANGES_FAILED [----] I, [2016-09-13T10:17:51.633294 #2937:34713c] INFO -- : - NETWORK_DETACH_NETWORK_FROM_HOST [----] I, [2016-09-13T10:17:51.633391 #2937:34713c] INFO -- : - NETWORK_DETACH_NETWORK_FROM_HOST_FAILED [----] I, [2016-09-13T10:17:51.633514 #2937:34713c] INFO -- : - NETWORK_DETACH_NETWORK_TO_HOST_GROUP [----] I, [2016-09-13T10:17:51.633596 #2937:34713c] INFO -- : - NETWORK_DETACH_NETWORK_TO_HOST_GROUP_FAILED [----] I, [2016-09-13T10:17:51.633667 #2937:34713c] INFO -- : - NETWORK_HOST_MISSING_CLUSER_VLAN [----] I, [2016-09-13T10:17:51.633746 #2937:34713c] INFO -- : - NETWORK_HOST_NETWORK_MATCH_CLUSTER [----] I, [2016-09-13T10:17:51.633823 #2937:34713c] INFO -- : - NETWORK_HOST_NETWORK_NOT_MATCH_CLUSTER [----] I, [2016-09-13T10:17:51.633894 #2937:34713c] INFO -- : - NETWORK_HOST_USING_WRONG_CLUSER_VLAN [----] I, [2016-09-13T10:17:51.633965 #2937:34713c] INFO -- : - NETWORK_REMOVE_BOND [----] I, [2016-09-13T10:17:51.634053 #2937:34713c] INFO -- : - NETWORK_REMOVE_BOND_FAILED [----] I, [2016-09-13T10:17:51.634139 #2937:34713c] INFO -- : - NETWORK_REMOVE_NETWORK [----] I, [2016-09-13T10:17:51.634216 #2937:34713c] INFO -- : - NETWORK_REMOVE_NETWORK_FAILED [----] I, [2016-09-13T10:17:51.634287 #2937:34713c] INFO -- : - NETWORK_REMOVE_TEMPLATE_INTERFACE [----] I, [2016-09-13T10:17:51.634381 #2937:34713c] INFO -- : - NETWORK_REMOVE_TEMPLATE_INTERFACE_FAILED [----] I, [2016-09-13T10:17:51.634498 #2937:34713c] INFO -- : - NETWORK_REMOVE_VM_INTERFACE [----] I, [2016-09-13T10:17:51.634580 #2937:34713c] INFO -- : - NETWORK_REMOVE_VM_INTERFACE_FAILED [----] I, [2016-09-13T10:17:51.634654 #2937:34713c] INFO -- : - NETWORK_UPDATE_DISPLAY_TO_HOST_GROUP [----] I, [2016-09-13T10:17:51.634730 #2937:34713c] INFO -- : - NETWORK_UPDATE_DISPLAY_TO_HOST_GROUP_FAILED [----] I, [2016-09-13T10:17:51.634810 #2937:34713c] INFO -- : - NETWORK_UPDATE_NETWORK_TO_HOST_INTERFACE [----] I, [2016-09-13T10:17:51.634884 #2937:34713c] INFO -- : - NETWORK_UPDATE_NETWORK_TO_HOST_INTERFACE_FAILED [----] I, [2016-09-13T10:17:51.634962 #2937:34713c] INFO -- : - NETWORK_UPDATE_TEMPLATE_INTERFACE [----] I, [2016-09-13T10:17:51.635036 #2937:34713c] INFO -- : - NETWORK_UPDATE_TEMPLATE_INTERFACE_FAILED [----] I, [2016-09-13T10:17:51.635110 #2937:34713c] INFO -- : - NETWORK_UPDATE_VM_INTERFACE [----] I, [2016-09-13T10:17:51.635189 #2937:34713c] INFO -- : - NETWORK_UPDATE_VM_INTERFACE_FAILED [----] I, [2016-09-13T10:17:51.635263 #2937:34713c] INFO -- : - network.floating_ip.allocate [----] I, [2016-09-13T10:17:51.635362 #2937:34713c] INFO -- : - network.floating_ip.deallocate [----] I, [2016-09-13T10:17:51.635487 #2937:34713c] INFO -- : - network.floating_ip.associate [----] I, [2016-09-13T10:17:51.635572 #2937:34713c] INFO -- : - network.floating_ip.disassociate [----] I, [2016-09-13T10:17:51.635647 #2937:34713c] INFO -- : - POD_HOSTPORTCONFLICT [----] I, [2016-09-13T10:17:51.635717 #2937:34713c] INFO -- : :detail: [] [----] I, [2016-09-13T10:17:51.635786 #2937:34713c] INFO -- : :name: Network [----] I, [2016-09-13T10:17:51.635862 #2937:34713c] INFO -- : :power: [----] I, [2016-09-13T10:17:51.635942 #2937:34713c] INFO -- : :critical: [----] I, [2016-09-13T10:17:51.636018 #2937:34713c] INFO -- : - AUTO_FAILED_SUSPEND_VM [----] I, [2016-09-13T10:17:51.636093 #2937:34713c] INFO -- : - AUTO_SUSPEND_VM [----] I, [2016-09-13T10:17:51.636169 #2937:34713c] INFO -- : - AUTO_SUSPEND_VM_FINISH_FAILURE [----] I, [2016-09-13T10:17:51.636238 #2937:34713c] INFO -- : - AUTO_SUSPEND_VM_FINISH_SUCCESS [----] I, [2016-09-13T10:17:51.636312 #2937:34713c] INFO -- : - DrsVmPoweredOnEvent [----] I, [2016-09-13T10:17:51.636408 #2937:34713c] INFO -- : - HOST_FAILED_TO_RUN_VMS [----] I, [2016-09-13T10:17:51.636525 #2937:34713c] INFO -- : - HOST_INITIATED_RUN_VM [----] I, [2016-09-13T10:17:51.636601 #2937:34713c] INFO -- : - HOST_INITIATED_RUN_VM_FAILED [----] I, [2016-09-13T10:17:51.636670 #2937:34713c] INFO -- : - RebootGuest_Complete [----] I, [2016-09-13T10:17:51.636743 #2937:34713c] INFO -- : - RecommendHostsForVm [----] I, [2016-09-13T10:17:51.636823 #2937:34713c] INFO -- : - RUN_VM_FAILED [----] I, [2016-09-13T10:17:51.636903 #2937:34713c] INFO -- : - SYSTEM_HOST_RESTART [----] I, [2016-09-13T10:17:51.636970 #2937:34713c] INFO -- : - SYSTEM_FAILED_HOST_RESTART [----] I, [2016-09-13T10:17:51.637043 #2937:34713c] INFO -- : - ShutdownGuest [----] I, [2016-09-13T10:17:51.637111 #2937:34713c] INFO -- : - USER_ADD_VM_STARTED [----] I, [2016-09-13T10:17:51.637175 #2937:34713c] INFO -- : - USER_FAILED_ADD_VM [----] I, [2016-09-13T10:17:51.637252 #2937:34713c] INFO -- : - USER_FAILED_HOST_RESTART [----] I, [2016-09-13T10:17:51.637367 #2937:34713c] INFO -- : - USER_FAILED_HOST_SHUTDOWN [----] I, [2016-09-13T10:17:51.637493 #2937:34713c] INFO -- : - USER_FAILED_HOST_START [----] I, [2016-09-13T10:17:51.637577 #2937:34713c] INFO -- : - USER_FAILED_HOST_STOP [----] I, [2016-09-13T10:17:51.637648 #2937:34713c] INFO -- : - USER_FAILED_PAUSE_VM [----] I, [2016-09-13T10:17:51.637721 #2937:34713c] INFO -- : - USER_FAILED_RESUME_VM [----] I, [2016-09-13T10:17:51.637796 #2937:34713c] INFO -- : - USER_FAILED_RUN_VM [----] I, [2016-09-13T10:17:51.637870 #2937:34713c] INFO -- : - USER_FAILED_SHUTDOWN_VM [----] I, [2016-09-13T10:17:51.637947 #2937:34713c] INFO -- : - USER_FAILED_STOP_VM [----] I, [2016-09-13T10:17:51.638015 #2937:34713c] INFO -- : - USER_FAILED_STOPPING_VM_INSTEAD_OF_SHUTDOWN [----] I, [2016-09-13T10:17:51.638086 #2937:34713c] INFO -- : - USER_FAILED_SUSPEND_VM [----] I, [2016-09-13T10:17:51.638156 #2937:34713c] INFO -- : - USER_HOST_MAINTENANCE [----] I, [2016-09-13T10:17:51.638225 #2937:34713c] INFO -- : - USER_HOST_RESTART [----] I, [2016-09-13T10:17:51.638307 #2937:34713c] INFO -- : - USER_HOST_SHUTDOWN [----] I, [2016-09-13T10:17:51.638411 #2937:34713c] INFO -- : - USER_HOST_START [----] I, [2016-09-13T10:17:51.638534 #2937:34713c] INFO -- : - USER_HOST_STOP [----] I, [2016-09-13T10:17:51.638619 #2937:34713c] INFO -- : - USER_INITIATED_RUN_VM [----] I, [2016-09-13T10:17:51.638690 #2937:34713c] INFO -- : - USER_INITIATED_RUN_VM_FAILED [----] I, [2016-09-13T10:17:51.638765 #2937:34713c] INFO -- : - USER_INITIATED_SHUTDOWN_VM [----] I, [2016-09-13T10:17:51.638840 #2937:34713c] INFO -- : - USER_PAUSE_VM [----] I, [2016-09-13T10:17:51.638914 #2937:34713c] INFO -- : - USER_RESUME_VM [----] I, [2016-09-13T10:17:51.638986 #2937:34713c] INFO -- : - USER_RUN_VM [----] I, [2016-09-13T10:17:51.639061 #2937:34713c] INFO -- : - USER_RUN_VM_AS_STATELESS_FINISHED_FAILURE [----] I, [2016-09-13T10:17:51.639133 #2937:34713c] INFO -- : - USER_RUN_VM_ON_NON_DEFAULT_HOST [----] I, [2016-09-13T10:17:51.639207 #2937:34713c] INFO -- : - USER_STARTED_VM [----] I, [2016-09-13T10:17:51.639277 #2937:34713c] INFO -- : - USER_STOP_VM [----] I, [2016-09-13T10:17:51.639370 #2937:34713c] INFO -- : - USER_STOP_SUSPENDED_VM [----] I, [2016-09-13T10:17:51.639500 #2937:34713c] INFO -- : - USER_STOP_SUSPENDED_VM_FAILED [----] I, [2016-09-13T10:17:51.639586 #2937:34713c] INFO -- : - USER_STOPPED_VM_INSTEAD_OF_SHUTDOWN [----] I, [2016-09-13T10:17:51.639664 #2937:34713c] INFO -- : - USER_SUSPEND_VM [----] I, [2016-09-13T10:17:51.639736 #2937:34713c] INFO -- : - USER_SUSPEND_VM_FINISH_FAILURE [----] I, [2016-09-13T10:17:51.639818 #2937:34713c] INFO -- : - USER_SUSPEND_VM_FINISH_SUCCESS [----] I, [2016-09-13T10:17:51.639898 #2937:34713c] INFO -- : - USER_SUSPEND_VM_OK [----] I, [2016-09-13T10:17:51.639971 #2937:34713c] INFO -- : - virtualMachines_deallocate_EndRequest [----] I, [2016-09-13T10:17:51.640042 #2937:34713c] INFO -- : - virtualMachines_start_EndRequest [----] I, [2016-09-13T10:17:51.640114 #2937:34713c] INFO -- : - virtualMachines_restart_EndRequest [----] I, [2016-09-13T10:17:51.640183 #2937:34713c] INFO -- : - GceOperationDone_compute.instances.start [----] I, [2016-09-13T10:17:51.640254 #2937:34713c] INFO -- : - GceOperationDone_compute.instances.stop [----] I, [2016-09-13T10:17:51.640356 #2937:34713c] INFO -- : - VM_DOWN [----] I, [2016-09-13T10:17:51.640479 #2937:34713c] INFO -- : - VM_DOWN_ERROR [----] I, [2016-09-13T10:17:51.640564 #2937:34713c] INFO -- : - VM_PAUSED_ENOSPC [----] I, [2016-09-13T10:17:51.640640 #2937:34713c] INFO -- : - VM_PAUSED_ERROR [----] I, [2016-09-13T10:17:51.640709 #2937:34713c] INFO -- : - VM_SHUTDOWN_FAILED [----] I, [2016-09-13T10:17:51.640802 #2937:34713c] INFO -- : - VmGuestRebootEvent [----] I, [2016-09-13T10:17:51.640877 #2937:34713c] INFO -- : - VmGuestShutdownEvent [----] I, [2016-09-13T10:17:51.640946 #2937:34713c] INFO -- : - VmPoweredOffEvent [----] I, [2016-09-13T10:17:51.641016 #2937:34713c] INFO -- : - VmPoweredOnEvent [----] I, [2016-09-13T10:17:51.641088 #2937:34713c] INFO -- : - VmResumingEvent [----] I, [2016-09-13T10:17:51.641160 #2937:34713c] INFO -- : - VmStartedOnEvent [----] I, [2016-09-13T10:17:51.641230 #2937:34713c] INFO -- : - VmStoppedEvent [----] I, [2016-09-13T10:17:51.641294 #2937:34713c] INFO -- : - VmSuspendedEvent [----] I, [2016-09-13T10:17:51.641388 #2937:34713c] INFO -- : - compute.instance.create.end [----] I, [2016-09-13T10:17:51.641510 #2937:34713c] INFO -- : - compute.instance.create.error [----] I, [2016-09-13T10:17:51.641586 #2937:34713c] INFO -- : - compute.instance.shutdown.end [----] I, [2016-09-13T10:17:51.641660 #2937:34713c] INFO -- : - compute.instance.shutdown.error [----] I, [2016-09-13T10:17:51.641727 #2937:34713c] INFO -- : - compute.instance.delete.end [----] I, [2016-09-13T10:17:51.641806 #2937:34713c] INFO -- : - compute.instance.power_off.end [----] I, [2016-09-13T10:17:51.641880 #2937:34713c] INFO -- : - compute.instance.power_on.end [----] I, [2016-09-13T10:17:51.641954 #2937:34713c] INFO -- : - compute.instance.soft_delete.end [----] I, [2016-09-13T10:17:51.642027 #2937:34713c] INFO -- : - compute.instance.reboot.end [----] I, [2016-09-13T10:17:51.642098 #2937:34713c] INFO -- : - compute.instance.suspend [----] I, [2016-09-13T10:17:51.642165 #2937:34713c] INFO -- : - compute.instance.resume [----] I, [2016-09-13T10:17:51.642244 #2937:34713c] INFO -- : - compute.instance.pause.end [----] I, [2016-09-13T10:17:51.642318 #2937:34713c] INFO -- : - compute.instance.unpause.end [----] I, [2016-09-13T10:17:51.642448 #2937:34713c] INFO -- : - compute.instance.shelve.end [----] I, [2016-09-13T10:17:51.642548 #2937:34713c] INFO -- : - compute.instance.unshelve.end [----] I, [2016-09-13T10:17:51.642625 #2937:34713c] INFO -- : - compute.instance.shelve_offload.end [----] I, [2016-09-13T10:17:51.642693 #2937:34713c] INFO -- : - NODE_REBOOTED [----] I, [2016-09-13T10:17:51.642760 #2937:34713c] INFO -- : - NODE_NODESCHEDULABLE [----] I, [2016-09-13T10:17:51.642845 #2937:34713c] INFO -- : - NODE_NODENOTSCHEDULABLE [----] I, [2016-09-13T10:17:51.642917 #2937:34713c] INFO -- : :detail: [----] I, [2016-09-13T10:17:51.642986 #2937:34713c] INFO -- : - PowerOffVM_Task [----] I, [2016-09-13T10:17:51.643055 #2937:34713c] INFO -- : - PowerOffVM_Task_Complete [----] I, [2016-09-13T10:17:51.643121 #2937:34713c] INFO -- : - PowerOnMultiVM_Task [----] I, [2016-09-13T10:17:51.643198 #2937:34713c] INFO -- : - PowerOnVM_Task [----] I, [2016-09-13T10:17:51.643272 #2937:34713c] INFO -- : - PowerOnVM_Task_Complete [----] I, [2016-09-13T10:17:51.643362 #2937:34713c] INFO -- : - RebootGuest [----] I, [2016-09-13T10:17:51.643476 #2937:34713c] INFO -- : - ResetVM_Task [----] I, [2016-09-13T10:17:51.643558 #2937:34713c] INFO -- : - ResetVM_Task_Complete [----] I, [2016-09-13T10:17:51.643630 #2937:34713c] INFO -- : - ShutdownGuest_Complete [----] I, [2016-09-13T10:17:51.643708 #2937:34713c] INFO -- : - SuspendVM_Task [----] I, [2016-09-13T10:17:51.643784 #2937:34713c] INFO -- : - SuspendVM_Task_Complete [----] I, [2016-09-13T10:17:51.643860 #2937:34713c] INFO -- : - VmStartingEvent [----] I, [2016-09-13T10:17:51.643930 #2937:34713c] INFO -- : - VmStoppingEvent [----] I, [2016-09-13T10:17:51.644015 #2937:34713c] INFO -- : - VmSuspendingEvent [----] I, [2016-09-13T10:17:51.644089 #2937:34713c] INFO -- : :name: Power Activity [----] I, [2016-09-13T10:17:51.644177 #2937:34713c] INFO -- : :snapshot: [----] I, [2016-09-13T10:17:51.644256 #2937:34713c] INFO -- : :critical: [----] I, [2016-09-13T10:17:51.644349 #2937:34713c] INFO -- : - CreateSnapshot_Task [----] I, [2016-09-13T10:17:51.644461 #2937:34713c] INFO -- : - RemoveAllSnapshots_Task [----] I, [2016-09-13T10:17:51.644557 #2937:34713c] INFO -- : - RemoveSnapshot_Task [----] I, [2016-09-13T10:17:51.644631 #2937:34713c] INFO -- : - RevertToSnapshot_Task [----] I, [2016-09-13T10:17:51.644702 #2937:34713c] INFO -- : - USER_CREATE_SNAPSHOT [----] I, [2016-09-13T10:17:51.644776 #2937:34713c] INFO -- : - USER_CREATE_SNAPSHOT_FINISHED_FAILURE [----] I, [2016-09-13T10:17:51.644853 #2937:34713c] INFO -- : - USER_CREATE_SNAPSHOT_FINISHED_SUCCESS [----] I, [2016-09-13T10:17:51.644926 #2937:34713c] INFO -- : - USER_FAILED_CREATE_SNAPSHOT [----] I, [2016-09-13T10:17:51.645003 #2937:34713c] INFO -- : - USER_FAILED_MERGE_SNAPSHOT [----] I, [2016-09-13T10:17:51.645088 #2937:34713c] INFO -- : - USER_FAILED_RESTORE_FROM_SNAPSHOT [----] I, [2016-09-13T10:17:51.645163 #2937:34713c] INFO -- : - USER_FAILED_TRY_BACK_TO_SNAPSHOT [----] I, [2016-09-13T10:17:51.645238 #2937:34713c] INFO -- : - USER_MERGE_SNAPSHOT [----] I, [2016-09-13T10:17:51.645313 #2937:34713c] INFO -- : - USER_MERGE_SNAPSHOT_FINISHED_FAILURE [----] I, [2016-09-13T10:17:51.645407 #2937:34713c] INFO -- : - USER_MERGE_SNAPSHOT_FINISHED_SUCCESS [----] I, [2016-09-13T10:17:51.645526 #2937:34713c] INFO -- : - USER_RESTORE_FROM_SNAPSHOT [----] I, [2016-09-13T10:17:51.645612 #2937:34713c] INFO -- : - USER_RESTORE_FROM_SNAPSHOT_FINISH_FAILURE [----] I, [2016-09-13T10:17:51.645685 #2937:34713c] INFO -- : - USER_RESTORE_FROM_SNAPSHOT_FINISH_SUCCESS [----] I, [2016-09-13T10:17:51.645765 #2937:34713c] INFO -- : - USER_TRY_BACK_TO_SNAPSHOT [----] I, [2016-09-13T10:17:51.645848 #2937:34713c] INFO -- : - USER_TRY_BACK_TO_SNAPSHOT_FINISH_FAILURE [----] I, [2016-09-13T10:17:51.645921 #2937:34713c] INFO -- : - USER_TRY_BACK_TO_SNAPSHOT_FINISH_SUCCESS [----] I, [2016-09-13T10:17:51.645999 #2937:34713c] INFO -- : - compute.instance.snapshot.end [----] I, [2016-09-13T10:17:51.646077 #2937:34713c] INFO -- : :detail: [] [----] I, [2016-09-13T10:17:51.646154 #2937:34713c] INFO -- : :name: Snapshot Activity [----] I, [2016-09-13T10:17:51.646227 #2937:34713c] INFO -- : :status: [----] I, [2016-09-13T10:17:51.646294 #2937:34713c] INFO -- : :critical: [----] I, [2016-09-13T10:17:51.646393 #2937:34713c] INFO -- : - AlarmCreatedEvent [----] I, [2016-09-13T10:17:51.646516 #2937:34713c] INFO -- : - AlarmRemovedEvent [----] I, [2016-09-13T10:17:51.646598 #2937:34713c] INFO -- : - AlarmStatusChangedEventVm [----] I, [2016-09-13T10:17:51.646671 #2937:34713c] INFO -- : - CERTIFICATE_FILE_NOT_FOUND [----] I, [2016-09-13T10:17:51.646742 #2937:34713c] INFO -- : - ClusterStatusChangedEvent [----] I, [2016-09-13T10:17:51.646822 #2937:34713c] INFO -- : - DasHostFailedEvent [----] I, [2016-09-13T10:17:51.646899 #2937:34713c] INFO -- : - DuplicateIpDetectedEvent [----] I, [2016-09-13T10:17:51.646968 #2937:34713c] INFO -- : - EVMAlertEvent [----] I, [2016-09-13T10:17:51.647041 #2937:34713c] INFO -- : - GeneralHostWarningEvent [----] I, [2016-09-13T10:17:51.647113 #2937:34713c] INFO -- : - HostDasErrorEvent [----] I, [2016-09-13T10:17:51.647176 #2937:34713c] INFO -- : - HOST_ACTIVATE [----] I, [2016-09-13T10:17:51.647247 #2937:34713c] INFO -- : - HOST_ACTIVATE_FAILED [----] I, [2016-09-13T10:17:51.647335 #2937:34713c] INFO -- : - HOST_CPU_LOWER_THAN_CLUSTER [----] I, [2016-09-13T10:17:51.647411 #2937:34713c] INFO -- : - HOST_CPU_RETRIEVE_FAILED [----] I, [2016-09-13T10:17:51.647537 #2937:34713c] INFO -- : - HOST_FAILURE [----] I, [2016-09-13T10:17:51.647625 #2937:34713c] INFO -- : - HOST_LOW_MEM [----] I, [2016-09-13T10:17:51.647705 #2937:34713c] INFO -- : - HOST_MAINTENANCE [----] I, [2016-09-13T10:17:51.647780 #2937:34713c] INFO -- : - HOST_MAINTENANCE_FAILED [----] I, [2016-09-13T10:17:51.647855 #2937:34713c] INFO -- : - HOST_RECOVER [----] I, [2016-09-13T10:17:51.647930 #2937:34713c] INFO -- : - HOST_RECOVER_FAILED [----] I, [2016-09-13T10:17:51.647998 #2937:34713c] INFO -- : - HOST_SLOW_STORAGE_RESPONSE_TIME [----] I, [2016-09-13T10:17:51.648069 #2937:34713c] INFO -- : - IRS_DISK_SPACE_LOW [----] I, [2016-09-13T10:17:51.648142 #2937:34713c] INFO -- : - IRS_DISK_SPACE_LOW_ERROR [----] I, [2016-09-13T10:17:51.648207 #2937:34713c] INFO -- : - IRS_FAILURE [----] I, [2016-09-13T10:17:51.648280 #2937:34713c] INFO -- : - MAC_ADDRESS_IS_IN_USE [----] I, [2016-09-13T10:17:51.648371 #2937:34713c] INFO -- : - MAC_POOL_EMPTY [----] I, [2016-09-13T10:17:51.648486 #2937:34713c] INFO -- : - RemoveAlarm [----] I, [2016-09-13T10:17:51.648575 #2937:34713c] INFO -- : - SYSTEM_CHANGE_STORAGE_POOL_STATUS_PROBLEMATIC_FROM_NON_OPERATIONAL [----] I, [2016-09-13T10:17:51.648653 #2937:34713c] INFO -- : - SYSTEM_CHANGE_STORAGE_POOL_STATUS_PROBLEMATIC_WITH_ERROR [----] I, [2016-09-13T10:17:51.648735 #2937:34713c] INFO -- : - SYSTEM_MASTER_DOMAIN_NOT_IN_SYNC [----] I, [2016-09-13T10:17:51.649041 #2937:34713c] INFO -- : - USER_FAILED_ATTACH_USER_TO_VM [----] I, [2016-09-13T10:17:51.649132 #2937:34713c] INFO -- : - VM_FAILURE [----] I, [2016-09-13T10:17:51.649209 #2937:34713c] INFO -- : - VM_NOT_RESPONDING [----] I, [2016-09-13T10:17:51.649284 #2937:34713c] INFO -- : - VmConfigMissingEvent [----] I, [2016-09-13T10:17:51.649373 #2937:34713c] INFO -- : - NODE_NODEREADY [----] I, [2016-09-13T10:17:51.649497 #2937:34713c] INFO -- : - NODE_NODENOTREADY [----] I, [2016-09-13T10:17:51.649579 #2937:34713c] INFO -- : - POD_FAILEDVALIDATION [----] I, [2016-09-13T10:17:51.649655 #2937:34713c] INFO -- : - POD_DEADLINEEXCEEDED [----] I, [2016-09-13T10:17:51.649725 #2937:34713c] INFO -- : - POD_FAILEDSYNC [----] I, [2016-09-13T10:17:51.649807 #2937:34713c] INFO -- : - POD_INSUFFICIENTFREECPU [----] I, [2016-09-13T10:17:51.649880 #2937:34713c] INFO -- : - CONTAINER_UNHEALTHY [----] I, [2016-09-13T10:17:51.649962 #2937:34713c] INFO -- : - POD_NODESELECTORMISMATCHING [----] I, [2016-09-13T10:17:51.650045 #2937:34713c] INFO -- : - CONTAINER_KILLING [----] I, [2016-09-13T10:17:51.650122 #2937:34713c] INFO -- : - CONTAINER_STARTED [----] I, [2016-09-13T10:17:51.650189 #2937:34713c] INFO -- : - CONTAINER_STOPPED [----] I, [2016-09-13T10:17:51.650264 #2937:34713c] INFO -- : - POD_SCHEDULED [----] I, [2016-09-13T10:17:51.650348 #2937:34713c] INFO -- : - POD_FAILEDSCHEDULING [----] I, [2016-09-13T10:17:51.650456 #2937:34713c] INFO -- : :detail: [----] I, [2016-09-13T10:17:51.650547 #2937:34713c] INFO -- : - DatacenterRenamedEvent [----] I, [2016-09-13T10:17:51.650622 #2937:34713c] INFO -- : - GeneralUserEvent [----] I, [2016-09-13T10:17:51.650695 #2937:34713c] INFO -- : - LicenseServerUnavailableEvent [----] I, [2016-09-13T10:17:51.650765 #2937:34713c] INFO -- : - Rename_Task [----] I, [2016-09-13T10:17:51.650842 #2937:34713c] INFO -- : - Rename_Task_Complete [----] I, [2016-09-13T10:17:51.650909 #2937:34713c] INFO -- : - RenameCluster_Task [----] I, [2016-09-13T10:17:51.650980 #2937:34713c] INFO -- : - RenameDatacenter_Task [----] I, [2016-09-13T10:17:51.651053 #2937:34713c] INFO -- : - RenameDatacenter_Task_Complete [----] I, [2016-09-13T10:17:51.651129 #2937:34713c] INFO -- : - RenameFolder_Task [----] I, [2016-09-13T10:17:51.651200 #2937:34713c] INFO -- : - RenameResourcePool_Task [----] I, [2016-09-13T10:17:51.651285 #2937:34713c] INFO -- : - RenameVM_Task [----] I, [2016-09-13T10:17:51.651383 #2937:34713c] INFO -- : - RenameVM_Task_Complete [----] I, [2016-09-13T10:17:51.651506 #2937:34713c] INFO -- : - VmRenamedEvent [----] I, [2016-09-13T10:17:51.651587 #2937:34713c] INFO -- : :name: Alarm/Status change/Errors [----] I, [2016-09-13T10:17:51.651658 #2937:34713c] INFO -- : :storage: [----] I, [2016-09-13T10:17:51.651724 #2937:34713c] INFO -- : :critical: [----] I, [2016-09-13T10:17:51.651799 #2937:34713c] INFO -- : - CONNECT_STORAGE_POOL_FAILED [----] I, [2016-09-13T10:17:51.651868 #2937:34713c] INFO -- : - CONNECT_STORAGE_SERVERS_FAILED [----] I, [2016-09-13T10:17:51.651935 #2937:34713c] INFO -- : - RECOVERY_STORAGE_POOL [----] I, [2016-09-13T10:17:51.652002 #2937:34713c] INFO -- : - RECOVERY_STORAGE_POOL_FAILED [----] I, [2016-09-13T10:17:51.652066 #2937:34713c] INFO -- : - STORAGE_DOMAIN_ERROR [----] I, [2016-09-13T10:17:51.652130 #2937:34713c] INFO -- : - SYSTEM_CHANGE_STORAGE_POOL_STATUS_NO_HOST_FOR_SPM [----] I, [2016-09-13T10:17:51.652202 #2937:34713c] INFO -- : - SYSTEM_CHANGE_STORAGE_POOL_STATUS_PROBLEMATIC [----] I, [2016-09-13T10:17:51.652280 #2937:34713c] INFO -- : - SYSTEM_CHANGE_STORAGE_POOL_STATUS_RESET_IRS [----] I, [2016-09-13T10:17:51.652379 #2937:34713c] INFO -- : - SYSTEM_DEACTIVATE_STORAGE_DOMAIN_FAILED [----] I, [2016-09-13T10:17:51.652498 #2937:34713c] INFO -- : - SYSTEM_DEACTIVATED_STORAGE_DOMAIN [----] I, [2016-09-13T10:17:51.652580 #2937:34713c] INFO -- : - SYSTEM_FAILED_CHANGE_STORAGE_POOL_STATUS [----] I, [2016-09-13T10:17:51.652653 #2937:34713c] INFO -- : - USER_ACTIVATE_STORAGE_DOMAIN_FAILED [----] I, [2016-09-13T10:17:51.652723 #2937:34713c] INFO -- : - USER_ACTIVATE_STORAGE_POOL [----] I, [2016-09-13T10:17:51.652800 #2937:34713c] INFO -- : - USER_ACTIVATE_STORAGE_POOL_FAILED [----] I, [2016-09-13T10:17:51.652871 #2937:34713c] INFO -- : - USER_ACTIVATED_STORAGE_DOMAIN [----] I, [2016-09-13T10:17:51.652942 #2937:34713c] INFO -- : - USER_ADD_STORAGE_DOMAIN [----] I, [2016-09-13T10:17:51.653010 #2937:34713c] INFO -- : - USER_ADD_STORAGE_DOMAIN_FAILED [----] I, [2016-09-13T10:17:51.653078 #2937:34713c] INFO -- : - USER_ADD_STORAGE_POOL [----] I, [2016-09-13T10:17:51.653142 #2937:34713c] INFO -- : - USER_ADD_STORAGE_POOL_FAILED [----] I, [2016-09-13T10:17:51.653220 #2937:34713c] INFO -- : - USER_ATTACH_STORAGE_DOMAIN_TO_POOL [----] I, [2016-09-13T10:17:51.653288 #2937:34713c] INFO -- : - USER_ATTACH_STORAGE_DOMAIN_TO_POOL_FAILED [----] I, [2016-09-13T10:17:51.653385 #2937:34713c] INFO -- : - USER_CONNECT_HOSTS_TO_LUN_FAILED [----] I, [2016-09-13T10:17:51.653514 #2937:34713c] INFO -- : - USER_DEACTIVATE_STORAGE_DOMAIN_FAILED [----] I, [2016-09-13T10:17:51.653596 #2937:34713c] INFO -- : - USER_DEACTIVATED_STORAGE_DOMAIN [----] I, [2016-09-13T10:17:51.653672 #2937:34713c] INFO -- : - USER_DETACH_STORAGE_DOMAIN_FROM_POOL [----] I, [2016-09-13T10:17:51.653747 #2937:34713c] INFO -- : - USER_DETACH_STORAGE_DOMAIN_FROM_POOL_FAILED [----] I, [2016-09-13T10:17:51.653825 #2937:34713c] INFO -- : - USER_EXTENDED_STORAGE_DOMAIN [----] I, [2016-09-13T10:17:51.653896 #2937:34713c] INFO -- : - USER_EXTENDED_STORAGE_DOMAIN_FAILED [----] I, [2016-09-13T10:17:51.653968 #2937:34713c] INFO -- : - USER_FORCE_REMOVE_STORAGE_DOMAIN [----] I, [2016-09-13T10:17:51.654034 #2937:34713c] INFO -- : - USER_FORCE_REMOVE_STORAGE_DOMAIN_FAILED [----] I, [2016-09-13T10:17:51.654101 #2937:34713c] INFO -- : - USER_REMOVE_STORAGE_DOMAIN [----] I, [2016-09-13T10:17:51.654167 #2937:34713c] INFO -- : - USER_REMOVE_STORAGE_DOMAIN_FAILED [----] I, [2016-09-13T10:17:51.654234 #2937:34713c] INFO -- : - USER_REMOVE_STORAGE_POOL [----] I, [2016-09-13T10:17:51.654299 #2937:34713c] INFO -- : - USER_REMOVE_STORAGE_POOL_FAILED [----] I, [2016-09-13T10:17:51.654442 #2937:34713c] INFO -- : - USER_UPDATE_STORAGE_DOMAIN [----] I, [2016-09-13T10:17:51.654544 #2937:34713c] INFO -- : - USER_UPDATE_STORAGE_DOMAIN_FAILED [----] I, [2016-09-13T10:17:51.654628 #2937:34713c] INFO -- : - USER_UPDATE_STORAGE_POOL [----] I, [2016-09-13T10:17:51.654707 #2937:34713c] INFO -- : - USER_UPDATE_STORAGE_POOL_FAILED [----] I, [2016-09-13T10:17:51.654781 #2937:34713c] INFO -- : - volume.create.end [----] I, [2016-09-13T10:17:51.654862 #2937:34713c] INFO -- : - volume.delete.end [----] I, [2016-09-13T10:17:51.654933 #2937:34713c] INFO -- : - POD_OUTOFDISK [----] I, [2016-09-13T10:17:51.655004 #2937:34713c] INFO -- : - POD_INSUFFICIENTFREEMEMORY [----] I, [2016-09-13T10:17:51.655067 #2937:34713c] INFO -- : - NODE_FAILEDMOUNT [----] I, [2016-09-13T10:17:51.655137 #2937:34713c] INFO -- : - NODE_INVALIDDISKCAPACITY [----] I, [2016-09-13T10:17:51.655213 #2937:34713c] INFO -- : :detail: [] [----] I, [2016-09-13T10:17:51.655286 #2937:34713c] INFO -- : :name: Storage [----] I, [2016-09-13T10:17:51.655386 #2937:34713c] INFO -- : :task_final_events: [----] I, [2016-09-13T10:17:51.655512 #2937:34713c] INFO -- : :ClusterCreatedEvent: [----] I, [2016-09-13T10:17:51.655593 #2937:34713c] INFO -- : - CreateClusterEx [----] I, [2016-09-13T10:17:51.655662 #2937:34713c] INFO -- : :ClusterDestroyedEvent: [----] I, [2016-09-13T10:17:51.655738 #2937:34713c] INFO -- : - DestroyCluster_Task [----] I, [2016-09-13T10:17:51.655820 #2937:34713c] INFO -- : :DatacenterCreatedEvent: [----] I, [2016-09-13T10:17:51.655892 #2937:34713c] INFO -- : - CreateDatacenter [----] I, [2016-09-13T10:17:51.655954 #2937:34713c] INFO -- : :DatacenterRenamedEvent: [----] I, [2016-09-13T10:17:51.656024 #2937:34713c] INFO -- : - RenameDatacenter_Task [----] I, [2016-09-13T10:17:51.656096 #2937:34713c] INFO -- : :DatastoreFileMovedEvent: [----] I, [2016-09-13T10:17:51.656159 #2937:34713c] INFO -- : - Move_Task [----] I, [2016-09-13T10:17:51.656226 #2937:34713c] INFO -- : :DrsVmMigratedEvent: [----] I, [2016-09-13T10:17:51.656297 #2937:34713c] INFO -- : - DrsMigrateVM_Task [----] I, [2016-09-13T10:17:51.656388 #2937:34713c] INFO -- : :DrsVmPoweredOnEvent: [----] I, [2016-09-13T10:17:51.656504 #2937:34713c] INFO -- : - PowerOnVM_Task [----] I, [2016-09-13T10:17:51.656583 #2937:34713c] INFO -- : :EnteredMaintenanceModeEvent: [----] I, [2016-09-13T10:17:51.656656 #2937:34713c] INFO -- : - EnterMaintenanceMode_Task [----] I, [2016-09-13T10:17:51.656731 #2937:34713c] INFO -- : :ExitMaintenanceModeEvent: [----] I, [2016-09-13T10:17:51.656814 #2937:34713c] INFO -- : - ExitMaintenanceMode_Task [----] I, [2016-09-13T10:17:51.656885 #2937:34713c] INFO -- : :ResourcePoolCreatedEvent: [----] I, [2016-09-13T10:17:51.656955 #2937:34713c] INFO -- : - CreateResourcePool [----] I, [2016-09-13T10:17:51.657025 #2937:34713c] INFO -- : :ResourcePoolDestroyedEvent: [----] I, [2016-09-13T10:17:51.657101 #2937:34713c] INFO -- : - DestroyResourcePool_Task [----] I, [2016-09-13T10:17:51.657170 #2937:34713c] INFO -- : :ResourcePoolMovedEvent: [----] I, [2016-09-13T10:17:51.657238 #2937:34713c] INFO -- : - MoveIntoResourcePool [----] I, [2016-09-13T10:17:51.657309 #2937:34713c] INFO -- : :VmClonedEvent: [----] I, [2016-09-13T10:17:51.657402 #2937:34713c] INFO -- : - CloneVM_Task [----] I, [2016-09-13T10:17:51.657520 #2937:34713c] INFO -- : :VmCreatedEvent: [----] I, [2016-09-13T10:17:51.657595 #2937:34713c] INFO -- : - CreateVM_Task [----] I, [2016-09-13T10:17:51.657664 #2937:34713c] INFO -- : :VmDeployedEvent: [----] I, [2016-09-13T10:17:51.657746 #2937:34713c] INFO -- : - CloneVM_Task [----] I, [2016-09-13T10:17:51.657824 #2937:34713c] INFO -- : :VmGuestRebootEvent: [----] I, [2016-09-13T10:17:51.657913 #2937:34713c] INFO -- : - RebootGuest [----] I, [2016-09-13T10:17:51.657987 #2937:34713c] INFO -- : :VmGuestShutdownEvent: [----] I, [2016-09-13T10:17:51.658052 #2937:34713c] INFO -- : - ShutdownGuest [----] I, [2016-09-13T10:17:51.658127 #2937:34713c] INFO -- : :VmGuestStandbyEvent: [----] I, [2016-09-13T10:17:51.658204 #2937:34713c] INFO -- : - StandbyGuest [----] I, [2016-09-13T10:17:51.658273 #2937:34713c] INFO -- : :VmMigratedEvent: [----] I, [2016-09-13T10:17:51.658364 #2937:34713c] INFO -- : - MigrateVM_Task [----] I, [2016-09-13T10:17:51.658480 #2937:34713c] INFO -- : - RelocateVM_Task [----] I, [2016-09-13T10:17:51.658573 #2937:34713c] INFO -- : :VmPoweredOffEvent: [----] I, [2016-09-13T10:17:51.658645 #2937:34713c] INFO -- : - PowerOffVM_Task [----] I, [2016-09-13T10:17:51.658717 #2937:34713c] INFO -- : :VmPoweredOnEvent: [----] I, [2016-09-13T10:17:51.658788 #2937:34713c] INFO -- : - PowerOnVM_Task [----] I, [2016-09-13T10:17:51.658862 #2937:34713c] INFO -- : - ResetVM_Task [----] I, [2016-09-13T10:17:51.658933 #2937:34713c] INFO -- : :VmReconfiguredEvent: [----] I, [2016-09-13T10:17:51.659002 #2937:34713c] INFO -- : - ReconfigVM_Task [----] I, [2016-09-13T10:17:51.659079 #2937:34713c] INFO -- : :VmRegisteredEvent: [----] I, [2016-09-13T10:17:51.659153 #2937:34713c] INFO -- : - RegisterVM_Task [----] I, [2016-09-13T10:17:51.659222 #2937:34713c] INFO -- : :VmRelocatedEvent: [----] I, [2016-09-13T10:17:51.659298 #2937:34713c] INFO -- : - RelocateVM_Task [----] I, [2016-09-13T10:17:51.659395 #2937:34713c] INFO -- : :VmRemovedEvent: [----] I, [2016-09-13T10:17:51.659516 #2937:34713c] INFO -- : - DestroyVM_Task [----] I, [2016-09-13T10:17:51.659590 #2937:34713c] INFO -- : - UnregisterVM [----] I, [2016-09-13T10:17:51.659664 #2937:34713c] INFO -- : :VmRenamedEvent: [----] I, [2016-09-13T10:17:51.659734 #2937:34713c] INFO -- : - RenameVM_Task [----] I, [2016-09-13T10:17:51.659809 #2937:34713c] INFO -- : :VmResourcePoolMovedEvent: [----] I, [2016-09-13T10:17:51.659878 #2937:34713c] INFO -- : - MarkAsTemplate [----] I, [2016-09-13T10:17:51.659949 #2937:34713c] INFO -- : - MoveIntoResourcePool [----] I, [2016-09-13T10:17:51.660014 #2937:34713c] INFO -- : :VmSuspendedEvent: [----] I, [2016-09-13T10:17:51.660092 #2937:34713c] INFO -- : - SuspendVM_Task [----] I, [2016-09-13T10:17:51.660160 #2937:34713c] INFO -- : :host_scan: [----] I, [2016-09-13T10:17:51.660232 #2937:34713c] INFO -- : :queue_timeout: 20.minutes [----] I, [2016-09-13T10:17:51.660299 #2937:34713c] INFO -- : :http_proxy: [----] I, [2016-09-13T10:17:51.660389 #2937:34713c] INFO -- : :host: [----] I, [2016-09-13T10:17:51.660510 #2937:34713c] INFO -- : :port: [----] I, [2016-09-13T10:17:51.660583 #2937:34713c] INFO -- : :user: [----] I, [2016-09-13T10:17:51.660657 #2937:34713c] INFO -- : :ldap_synchronization: [----] I, [2016-09-13T10:17:51.660722 #2937:34713c] INFO -- : :ldap_synchronization_schedule: 0 2 * * * [----] I, [2016-09-13T10:17:51.660799 #2937:34713c] INFO -- : :log: [----] I, [2016-09-13T10:17:51.660872 #2937:34713c] INFO -- : :collection: [----] I, [2016-09-13T10:17:51.660936 #2937:34713c] INFO -- : :archive: [----] I, [2016-09-13T10:17:51.661003 #2937:34713c] INFO -- : :pattern: [----] I, [2016-09-13T10:17:51.661074 #2937:34713c] INFO -- : :current: [----] I, [2016-09-13T10:17:51.661143 #2937:34713c] INFO -- : :pattern: [----] I, [2016-09-13T10:17:51.661213 #2937:34713c] INFO -- : - log/*.log [----] I, [2016-09-13T10:17:51.661295 #2937:34713c] INFO -- : - log/apache/*.log [----] I, [2016-09-13T10:17:51.661390 #2937:34713c] INFO -- : - log/*.txt [----] I, [2016-09-13T10:17:51.661515 #2937:34713c] INFO -- : - config/* [----] I, [2016-09-13T10:17:51.661595 #2937:34713c] INFO -- : - "/var/log/syslog*" [----] I, [2016-09-13T10:17:51.661686 #2937:34713c] INFO -- : - "/var/log/daemon.log*" [----] I, [2016-09-13T10:17:51.661765 #2937:34713c] INFO -- : - "/etc/default/ntp*" [----] I, [2016-09-13T10:17:51.661845 #2937:34713c] INFO -- : - "/var/log/messages*" [----] I, [2016-09-13T10:17:51.661921 #2937:34713c] INFO -- : - "/var/log/cron*" [----] I, [2016-09-13T10:17:51.661996 #2937:34713c] INFO -- : - BUILD [----] I, [2016-09-13T10:17:51.662062 #2937:34713c] INFO -- : - GUID [----] I, [2016-09-13T10:17:51.662131 #2937:34713c] INFO -- : - VERSION [----] I, [2016-09-13T10:17:51.662201 #2937:34713c] INFO -- : :ping_depot: true [----] I, [2016-09-13T10:17:51.662270 #2937:34713c] INFO -- : :ping_depot_timeout: 20 [----] I, [2016-09-13T10:17:51.662353 #2937:34713c] INFO -- : :level: info [----] I, [2016-09-13T10:17:51.662458 #2937:34713c] INFO -- : :level_rails: info [----] I, [2016-09-13T10:17:51.662550 #2937:34713c] INFO -- : :level_aws: info [----] I, [2016-09-13T10:17:51.662623 #2937:34713c] INFO -- : :level_aws_in_evm: error [----] I, [2016-09-13T10:17:51.662692 #2937:34713c] INFO -- : :level_mw: info [----] I, [2016-09-13T10:17:51.662763 #2937:34713c] INFO -- : :level_mw_in_evm: error [----] I, [2016-09-13T10:17:51.662844 #2937:34713c] INFO -- : :level_kube: info [----] I, [2016-09-13T10:17:51.662920 #2937:34713c] INFO -- : :level_kube_in_evm: error [----] I, [2016-09-13T10:17:51.662991 #2937:34713c] INFO -- : :level_api: info [----] I, [2016-09-13T10:17:51.663071 #2937:34713c] INFO -- : :level_api_in_evm: error [----] I, [2016-09-13T10:17:51.663144 #2937:34713c] INFO -- : :level_fog: info [----] I, [2016-09-13T10:17:51.663218 #2937:34713c] INFO -- : :level_fog_in_evm: error [----] I, [2016-09-13T10:17:51.663294 #2937:34713c] INFO -- : :level_rhevm: info [----] I, [2016-09-13T10:17:51.663394 #2937:34713c] INFO -- : :level_rhevm_in_evm: error [----] I, [2016-09-13T10:17:51.663515 #2937:34713c] INFO -- : :level_scvmm: info [----] I, [2016-09-13T10:17:51.663592 #2937:34713c] INFO -- : :level_scvmm_in_evm: error [----] I, [2016-09-13T10:17:51.663665 #2937:34713c] INFO -- : :level_vim: warn [----] I, [2016-09-13T10:17:51.663734 #2937:34713c] INFO -- : :level_vim_in_evm: error [----] I, [2016-09-13T10:17:51.663809 #2937:34713c] INFO -- : :management_system: [----] I, [2016-09-13T10:17:51.663885 #2937:34713c] INFO -- : :power_operation_expiration: 10.minutes [----] I, [2016-09-13T10:17:51.663954 #2937:34713c] INFO -- : :performance: [----] I, [2016-09-13T10:17:51.664028 #2937:34713c] INFO -- : :capture_threshold: [----] I, [2016-09-13T10:17:51.664110 #2937:34713c] INFO -- : :ems_cluster: 50.minutes [----] I, [2016-09-13T10:17:51.664186 #2937:34713c] INFO -- : :host: 50.minutes [----] I, [2016-09-13T10:17:51.664262 #2937:34713c] INFO -- : :storage: 60.minutes [----] I, [2016-09-13T10:17:51.664358 #2937:34713c] INFO -- : :vm: 50.minutes [----] I, [2016-09-13T10:17:51.664482 #2937:34713c] INFO -- : :capture_threshold_with_alerts: [----] I, [2016-09-13T10:17:51.664566 #2937:34713c] INFO -- : :host: 20.minutes [----] I, [2016-09-13T10:17:51.664642 #2937:34713c] INFO -- : :vm: 20.minutes [----] I, [2016-09-13T10:17:51.664709 #2937:34713c] INFO -- : :concurrent_requests: [----] I, [2016-09-13T10:17:51.664786 #2937:34713c] INFO -- : :hourly: 1 [----] I, [2016-09-13T10:17:51.664865 #2937:34713c] INFO -- : :realtime: 20 [----] I, [2016-09-13T10:17:51.664937 #2937:34713c] INFO -- : :history: [----] I, [2016-09-13T10:17:51.665012 #2937:34713c] INFO -- : :initial_capture_days: 0 [----] I, [2016-09-13T10:17:51.665090 #2937:34713c] INFO -- : :keep_daily_performances: 6.months [----] I, [2016-09-13T10:17:51.665160 #2937:34713c] INFO -- : :keep_hourly_performances: 6.months [----] I, [2016-09-13T10:17:51.665233 #2937:34713c] INFO -- : :keep_realtime_performances: 4.hours [----] I, [2016-09-13T10:17:51.665343 #2937:34713c] INFO -- : :purge_window_size: 1000 [----] I, [2016-09-13T10:17:51.665460 #2937:34713c] INFO -- : :host_overhead: [----] I, [2016-09-13T10:17:51.665558 #2937:34713c] INFO -- : :memory: 2.01.percent [----] I, [2016-09-13T10:17:51.665629 #2937:34713c] INFO -- : :cpu: 0.15.percent [----] I, [2016-09-13T10:17:51.665699 #2937:34713c] INFO -- : :policy_events: [----] I, [2016-09-13T10:17:51.665772 #2937:34713c] INFO -- : :history: [----] I, [2016-09-13T10:17:51.665847 #2937:34713c] INFO -- : :keep_policy_events: 6.months [----] I, [2016-09-13T10:17:51.665911 #2937:34713c] INFO -- : :purge_window_size: 1000 [----] I, [2016-09-13T10:17:51.665979 #2937:34713c] INFO -- : :product: [----] I, [2016-09-13T10:17:51.666051 #2937:34713c] INFO -- : :maindb: ExtManagementSystem [----] I, [2016-09-13T10:17:51.666113 #2937:34713c] INFO -- : :replication: [----] I, [2016-09-13T10:17:51.666184 #2937:34713c] INFO -- : :exclude_tables: [----] I, [2016-09-13T10:17:51.666252 #2937:34713c] INFO -- : - ar_internal_metadata [----] I, [2016-09-13T10:17:51.666336 #2937:34713c] INFO -- : - assigned_server_roles [----] I, [2016-09-13T10:17:51.666454 #2937:34713c] INFO -- : - audit_events [----] I, [2016-09-13T10:17:51.666541 #2937:34713c] INFO -- : - binary_blobs [----] I, [2016-09-13T10:17:51.666618 #2937:34713c] INFO -- : - binary_blob_parts [----] I, [2016-09-13T10:17:51.666693 #2937:34713c] INFO -- : - chargeback_rate_details [----] I, [2016-09-13T10:17:51.666766 #2937:34713c] INFO -- : - chargeback_rates [----] I, [2016-09-13T10:17:51.666845 #2937:34713c] INFO -- : - conditions [----] I, [2016-09-13T10:17:51.666919 #2937:34713c] INFO -- : - conditions_miq_policies [----] I, [2016-09-13T10:17:51.666986 #2937:34713c] INFO -- : - custom_buttons [----] I, [2016-09-13T10:17:51.667059 #2937:34713c] INFO -- : - customization_specs [----] I, [2016-09-13T10:17:51.667127 #2937:34713c] INFO -- : - database_backups [----] I, [2016-09-13T10:17:51.667192 #2937:34713c] INFO -- : - event_logs [----] I, [2016-09-13T10:17:51.667266 #2937:34713c] INFO -- : - file_depots [----] I, [2016-09-13T10:17:51.667359 #2937:34713c] INFO -- : - jobs [----] I, [2016-09-13T10:17:51.667480 #2937:34713c] INFO -- : - log_files [----] I, [2016-09-13T10:17:51.667564 #2937:34713c] INFO -- : - metrics [----] I, [2016-09-13T10:17:51.667632 #2937:34713c] INFO -- : - metrics_00 [----] I, [2016-09-13T10:17:51.667703 #2937:34713c] INFO -- : - metrics_01 [----] I, [2016-09-13T10:17:51.667780 #2937:34713c] INFO -- : - metrics_02 [----] I, [2016-09-13T10:17:51.667853 #2937:34713c] INFO -- : - metrics_03 [----] I, [2016-09-13T10:17:51.667921 #2937:34713c] INFO -- : - metrics_04 [----] I, [2016-09-13T10:17:51.668003 #2937:34713c] INFO -- : - metrics_05 [----] I, [2016-09-13T10:17:51.668082 #2937:34713c] INFO -- : - metrics_06 [----] I, [2016-09-13T10:17:51.668156 #2937:34713c] INFO -- : - metrics_07 [----] I, [2016-09-13T10:17:51.668230 #2937:34713c] INFO -- : - metrics_08 [----] I, [2016-09-13T10:17:51.668300 #2937:34713c] INFO -- : - metrics_09 [----] I, [2016-09-13T10:17:51.668398 #2937:34713c] INFO -- : - metrics_10 [----] I, [2016-09-13T10:17:51.668515 #2937:34713c] INFO -- : - metrics_11 [----] I, [2016-09-13T10:17:51.668597 #2937:34713c] INFO -- : - metrics_12 [----] I, [2016-09-13T10:17:51.668668 #2937:34713c] INFO -- : - metrics_13 [----] I, [2016-09-13T10:17:51.668741 #2937:34713c] INFO -- : - metrics_14 [----] I, [2016-09-13T10:17:51.668818 #2937:34713c] INFO -- : - metrics_15 [----] I, [2016-09-13T10:17:51.668895 #2937:34713c] INFO -- : - metrics_16 [----] I, [2016-09-13T10:17:51.668972 #2937:34713c] INFO -- : - metrics_17 [----] I, [2016-09-13T10:17:51.669040 #2937:34713c] INFO -- : - metrics_18 [----] I, [2016-09-13T10:17:51.669106 #2937:34713c] INFO -- : - metrics_19 [----] I, [2016-09-13T10:17:51.669188 #2937:34713c] INFO -- : - metrics_20 [----] I, [2016-09-13T10:17:51.669268 #2937:34713c] INFO -- : - metrics_21 [----] I, [2016-09-13T10:17:51.669360 #2937:34713c] INFO -- : - metrics_22 [----] I, [2016-09-13T10:17:51.669480 #2937:34713c] INFO -- : - metrics_23 [----] I, [2016-09-13T10:17:51.669563 #2937:34713c] INFO -- : - metric_rollups [----] I, [2016-09-13T10:17:51.669636 #2937:34713c] INFO -- : - miq_actions [----] I, [2016-09-13T10:17:51.669711 #2937:34713c] INFO -- : - miq_ae_classes [----] I, [2016-09-13T10:17:51.669783 #2937:34713c] INFO -- : - miq_ae_fields [----] I, [2016-09-13T10:17:51.669861 #2937:34713c] INFO -- : - miq_ae_instances [----] I, [2016-09-13T10:17:51.669929 #2937:34713c] INFO -- : - miq_ae_methods [----] I, [2016-09-13T10:17:51.670004 #2937:34713c] INFO -- : - miq_ae_namespaces [----] I, [2016-09-13T10:17:51.670072 #2937:34713c] INFO -- : - miq_ae_values [----] I, [2016-09-13T10:17:51.670140 #2937:34713c] INFO -- : - miq_ae_workspaces [----] I, [2016-09-13T10:17:51.670203 #2937:34713c] INFO -- : - miq_alert_statuses [----] I, [2016-09-13T10:17:51.670270 #2937:34713c] INFO -- : - miq_alerts [----] I, [2016-09-13T10:17:51.670356 #2937:34713c] INFO -- : - miq_databases [----] I, [2016-09-13T10:17:51.670462 #2937:34713c] INFO -- : - miq_enterprises [----] I, [2016-09-13T10:17:51.670555 #2937:34713c] INFO -- : - miq_event_definitions [----] I, [2016-09-13T10:17:51.670628 #2937:34713c] INFO -- : - miq_globals [----] I, [2016-09-13T10:17:51.670698 #2937:34713c] INFO -- : - miq_groups [----] I, [2016-09-13T10:17:51.670780 #2937:34713c] INFO -- : - miq_policies [----] I, [2016-09-13T10:17:51.670849 #2937:34713c] INFO -- : - miq_policy_contents [----] I, [2016-09-13T10:17:51.670922 #2937:34713c] INFO -- : - miq_product_features [----] I, [2016-09-13T10:17:51.670990 #2937:34713c] INFO -- : - miq_queue [----] I, [2016-09-13T10:17:51.671057 #2937:34713c] INFO -- : - miq_roles_features [----] I, [2016-09-13T10:17:51.671122 #2937:34713c] INFO -- : - miq_report_result_details [----] I, [2016-09-13T10:17:51.671198 #2937:34713c] INFO -- : - miq_report_results [----] I, [2016-09-13T10:17:51.671264 #2937:34713c] INFO -- : - miq_reports [----] I, [2016-09-13T10:17:51.671345 #2937:34713c] INFO -- : - miq_searches [----] I, [2016-09-13T10:17:51.671446 #2937:34713c] INFO -- : - miq_sets [----] I, [2016-09-13T10:17:51.671534 #2937:34713c] INFO -- : - miq_schedules [----] I, [2016-09-13T10:17:51.671610 #2937:34713c] INFO -- : - miq_shortcuts [----] I, [2016-09-13T10:17:51.671683 #2937:34713c] INFO -- : - miq_tasks [----] I, [2016-09-13T10:17:51.671752 #2937:34713c] INFO -- : - miq_user_roles [----] I, [2016-09-13T10:17:51.671828 #2937:34713c] INFO -- : - miq_widgets [----] I, [2016-09-13T10:17:51.671898 #2937:34713c] INFO -- : - miq_widget_contents [----] I, [2016-09-13T10:17:51.671965 #2937:34713c] INFO -- : - miq_workers [----] I, [2016-09-13T10:17:51.672039 #2937:34713c] INFO -- : - notifications [----] I, [2016-09-13T10:17:51.672110 #2937:34713c] INFO -- : - notification_recipients [----] I, [2016-09-13T10:17:51.672180 #2937:34713c] INFO -- : - notification_types [----] I, [2016-09-13T10:17:51.672247 #2937:34713c] INFO -- : - rss_feeds [----] I, [2016-09-13T10:17:51.672315 #2937:34713c] INFO -- : - scan_items [----] I, [2016-09-13T10:17:51.672411 #2937:34713c] INFO -- : - schema_migrations [----] I, [2016-09-13T10:17:51.672529 #2937:34713c] INFO -- : - server_roles [----] I, [2016-09-13T10:17:51.672603 #2937:34713c] INFO -- : - sessions [----] I, [2016-09-13T10:17:51.672681 #2937:34713c] INFO -- : - vim_performance_states [----] I, [2016-09-13T10:17:51.672766 #2937:34713c] INFO -- : - vim_performance_tag_values [----] I, [2016-09-13T10:17:51.672844 #2937:34713c] INFO -- : - vmdb_database_metrics [----] I, [2016-09-13T10:17:51.672918 #2937:34713c] INFO -- : - vmdb_databases [----] I, [2016-09-13T10:17:51.673005 #2937:34713c] INFO -- : - vmdb_indexes [----] I, [2016-09-13T10:17:51.673080 #2937:34713c] INFO -- : - vmdb_metrics [----] I, [2016-09-13T10:17:51.673154 #2937:34713c] INFO -- : - vmdb_tables [----] I, [2016-09-13T10:17:51.673224 #2937:34713c] INFO -- : :reporting: [----] I, [2016-09-13T10:17:51.673292 #2937:34713c] INFO -- : :format_by_class: [----] I, [2016-09-13T10:17:51.673387 #2937:34713c] INFO -- : :Fixnum: [----] I, [2016-09-13T10:17:51.673500 #2937:34713c] INFO -- : :function: [----] I, [2016-09-13T10:17:51.673579 #2937:34713c] INFO -- : :name: number_with_delimiter [----] I, [2016-09-13T10:17:51.673648 #2937:34713c] INFO -- : :Float: [----] I, [2016-09-13T10:17:51.673720 #2937:34713c] INFO -- : :function: [----] I, [2016-09-13T10:17:51.673811 #2937:34713c] INFO -- : :name: number_with_delimiter [----] I, [2016-09-13T10:17:51.673887 #2937:34713c] INFO -- : :format_by_column: {} [----] I, [2016-09-13T10:17:51.673969 #2937:34713c] INFO -- : :history: [----] I, [2016-09-13T10:17:51.674050 #2937:34713c] INFO -- : :keep_reports: 6.months [----] I, [2016-09-13T10:17:51.674120 #2937:34713c] INFO -- : :purge_window_size: 100 [----] I, [2016-09-13T10:17:51.674192 #2937:34713c] INFO -- : :precision: [----] I, [2016-09-13T10:17:51.674260 #2937:34713c] INFO -- : :default: 2 [----] I, [2016-09-13T10:17:51.674349 #2937:34713c] INFO -- : :precision_by_column: [----] I, [2016-09-13T10:17:51.674451 #2937:34713c] INFO -- : :slope: 4 [----] I, [2016-09-13T10:17:51.674547 #2937:34713c] INFO -- : :queue_timeout: 1.hour [----] I, [2016-09-13T10:17:51.674629 #2937:34713c] INFO -- : :repository_scanning: [----] I, [2016-09-13T10:17:51.674704 #2937:34713c] INFO -- : :defaultsmartproxy: [----] I, [2016-09-13T10:17:51.674780 #2937:34713c] INFO -- : :server: [----] I, [2016-09-13T10:17:51.674853 #2937:34713c] INFO -- : :case_sensitive_name_search: false [----] I, [2016-09-13T10:17:51.674929 #2937:34713c] INFO -- : :company: My Company [----] I, [2016-09-13T10:17:51.675003 #2937:34713c] INFO -- : :custom_logo: false [----] I, [2016-09-13T10:17:51.675069 #2937:34713c] INFO -- : :events: [----] I, [2016-09-13T10:17:51.675137 #2937:34713c] INFO -- : :disk_usage_gt_percent: 80 [----] I, [2016-09-13T10:17:51.675210 #2937:34713c] INFO -- : :host: 192.168.100.106 [----] I, [2016-09-13T10:17:51.675280 #2937:34713c] INFO -- : :listening_port: '443' [----] I, [2016-09-13T10:17:51.675369 #2937:34713c] INFO -- : :mks_classid: 338095E4-1806-4BA3-AB51-38A3179200E9 [----] I, [2016-09-13T10:17:51.675492 #2937:34713c] INFO -- : :mks_version: 2.1.0.0 [----] I, [2016-09-13T10:17:51.675570 #2937:34713c] INFO -- : :monitor_poll: 5.seconds [----] I, [2016-09-13T10:17:51.675646 #2937:34713c] INFO -- : :name: EVM [----] I, [2016-09-13T10:17:51.675716 #2937:34713c] INFO -- : :rails_server: puma [----] I, [2016-09-13T10:17:51.675790 #2937:34713c] INFO -- : :remote_console_type: VMRC [----] I, [2016-09-13T10:17:51.675866 #2937:34713c] INFO -- : :role: database_operations,event,reporting,scheduler,smartstate,ems_operations,ems_inventory,user_interface,websocket,web_services,automate [----] I, [2016-09-13T10:17:51.675942 #2937:34713c] INFO -- : :server_dequeue_frequency: 5.seconds [----] I, [2016-09-13T10:17:51.676008 #2937:34713c] INFO -- : :session_store: cache [----] I, [2016-09-13T10:17:51.676076 #2937:34713c] INFO -- : :startup_timeout: 300 [----] I, [2016-09-13T10:17:51.676145 #2937:34713c] INFO -- : :timezone: UTC [----] I, [2016-09-13T10:17:51.676211 #2937:34713c] INFO -- : :worker_monitor: [----] I, [2016-09-13T10:17:51.676281 #2937:34713c] INFO -- : :kill_algorithm: [----] I, [2016-09-13T10:17:51.676375 #2937:34713c] INFO -- : :name: :used_swap_percent_gt_value [----] I, [2016-09-13T10:17:51.676493 #2937:34713c] INFO -- : :value: 80 [----] I, [2016-09-13T10:17:51.676591 #2937:34713c] INFO -- : :miq_server_time_threshold: 2.minutes [----] I, [2016-09-13T10:17:51.676668 #2937:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:17:51.676743 #2937:34713c] INFO -- : :poll: 2.seconds [----] I, [2016-09-13T10:17:51.676820 #2937:34713c] INFO -- : :start_algorithm: [----] I, [2016-09-13T10:17:51.676890 #2937:34713c] INFO -- : :name: :used_swap_percent_lt_value [----] I, [2016-09-13T10:17:51.676963 #2937:34713c] INFO -- : :value: 60 [----] I, [2016-09-13T10:17:51.677040 #2937:34713c] INFO -- : :sync_interval: 30.minutes [----] I, [2016-09-13T10:17:51.677108 #2937:34713c] INFO -- : :wait_for_started_timeout: 10.minutes [----] I, [2016-09-13T10:17:51.677177 #2937:34713c] INFO -- : :zone: default [----] I, [2016-09-13T10:17:51.677255 #2937:34713c] INFO -- : :hostname: host-192-168-100-106 [----] I, [2016-09-13T10:17:51.677339 #2937:34713c] INFO -- : :session: [----] I, [2016-09-13T10:17:51.677448 #2937:34713c] INFO -- : :interval: 60 [----] I, [2016-09-13T10:17:51.677543 #2937:34713c] INFO -- : :memcache_server: 127.0.0.1:11211 [----] I, [2016-09-13T10:17:51.677627 #2937:34713c] INFO -- : :memcache_server_opts: "-l 127.0.0.1 -I 1M" [----] I, [2016-09-13T10:17:51.677700 #2937:34713c] INFO -- : :show_login_info: true [----] I, [2016-09-13T10:17:51.677779 #2937:34713c] INFO -- : :timeout: 3600 [----] I, [2016-09-13T10:17:51.677859 #2937:34713c] INFO -- : :smartproxy_deploy: [----] I, [2016-09-13T10:17:51.677936 #2937:34713c] INFO -- : :queue_timeout: 30.minutes [----] I, [2016-09-13T10:17:51.678004 #2937:34713c] INFO -- : :smtp: [----] I, [2016-09-13T10:17:51.678080 #2937:34713c] INFO -- : :authentication: login [----] I, [2016-09-13T10:17:51.678148 #2937:34713c] INFO -- : :domain: mydomain.com [----] I, [2016-09-13T10:17:51.678220 #2937:34713c] INFO -- : :from: cfadmin@cfserver.com [----] I, [2016-09-13T10:17:51.678295 #2937:34713c] INFO -- : :host: localhost [----] I, [2016-09-13T10:17:51.678391 #2937:34713c] INFO -- : :port: '25' [----] I, [2016-09-13T10:17:51.678507 #2937:34713c] INFO -- : :user_name: evmadmin [----] I, [2016-09-13T10:17:51.678587 #2937:34713c] INFO -- : :snapshots: [----] I, [2016-09-13T10:17:51.678661 #2937:34713c] INFO -- : :create_free_percent: 100 [----] I, [2016-09-13T10:17:51.678731 #2937:34713c] INFO -- : :remove_free_percent: 100 [----] I, [2016-09-13T10:17:51.678805 #2937:34713c] INFO -- : :ssl: [----] I, [2016-09-13T10:17:51.678874 #2937:34713c] INFO -- : :ssl_ca_file: [----] I, [2016-09-13T10:17:51.678952 #2937:34713c] INFO -- : :ssl_ca_path: [----] I, [2016-09-13T10:17:51.679022 #2937:34713c] INFO -- : :storage: [----] I, [2016-09-13T10:17:51.679090 #2937:34713c] INFO -- : :alignment: [----] I, [2016-09-13T10:17:51.679155 #2937:34713c] INFO -- : :boundary: 4.kilobytes [----] I, [2016-09-13T10:17:51.679229 #2937:34713c] INFO -- : :collection: [----] I, [2016-09-13T10:17:51.679306 #2937:34713c] INFO -- : :timeout: 1800 [----] I, [2016-09-13T10:17:51.679399 #2937:34713c] INFO -- : :debris: [----] I, [2016-09-13T10:17:51.679523 #2937:34713c] INFO -- : :filters: [----] I, [2016-09-13T10:17:51.679600 #2937:34713c] INFO -- : :ext_name: [----] I, [2016-09-13T10:17:51.679673 #2937:34713c] INFO -- : - log [----] I, [2016-09-13T10:17:51.679747 #2937:34713c] INFO -- : - nvram [----] I, [2016-09-13T10:17:51.679822 #2937:34713c] INFO -- : - vmdk [----] I, [2016-09-13T10:17:51.679889 #2937:34713c] INFO -- : - vmsn [----] I, [2016-09-13T10:17:51.679951 #2937:34713c] INFO -- : - vmx [----] I, [2016-09-13T10:17:51.680020 #2937:34713c] INFO -- : - vmsd [----] I, [2016-09-13T10:17:51.680081 #2937:34713c] INFO -- : - vmxf [----] I, [2016-09-13T10:17:51.680147 #2937:34713c] INFO -- : - vmtx [----] I, [2016-09-13T10:17:51.680212 #2937:34713c] INFO -- : - vswp [----] I, [2016-09-13T10:17:51.680290 #2937:34713c] INFO -- : - "%redo%" [----] I, [2016-09-13T10:17:51.680381 #2937:34713c] INFO -- : :inventory: [----] I, [2016-09-13T10:17:51.680536 #2937:34713c] INFO -- : :full_refresh_schedule: 38 * * * * [----] I, [2016-09-13T10:17:51.680619 #2937:34713c] INFO -- : :metrics_collection: [----] I, [2016-09-13T10:17:51.680686 #2937:34713c] INFO -- : :collection_schedule: 0,15,30,45 * * * * [----] I, [2016-09-13T10:17:51.680755 #2937:34713c] INFO -- : :hourly_rollup_schedule: 8 * * * * [----] I, [2016-09-13T10:17:51.680828 #2937:34713c] INFO -- : :daily_rollup_schedule: 23 0 * * * [----] I, [2016-09-13T10:17:51.680899 #2937:34713c] INFO -- : :collection_interval: 15.minutes [----] I, [2016-09-13T10:17:51.680965 #2937:34713c] INFO -- : :max_gap_to_fill: 6.hours [----] I, [2016-09-13T10:17:51.681035 #2937:34713c] INFO -- : :metrics_history: [----] I, [2016-09-13T10:17:51.681105 #2937:34713c] INFO -- : :purge_schedule: 50 * * * * [----] I, [2016-09-13T10:17:51.681172 #2937:34713c] INFO -- : :keep_daily_metrics: 6.months [----] I, [2016-09-13T10:17:51.681244 #2937:34713c] INFO -- : :keep_hourly_metrics: 6.months [----] I, [2016-09-13T10:17:51.681319 #2937:34713c] INFO -- : :keep_realtime_metrics: 4.hours [----] I, [2016-09-13T10:17:51.681436 #2937:34713c] INFO -- : :purge_window_size: 1000 [----] I, [2016-09-13T10:17:51.681525 #2937:34713c] INFO -- : :ui: [----] I, [2016-09-13T10:17:51.681602 #2937:34713c] INFO -- : :mark_translated_strings: false [----] I, [2016-09-13T10:17:51.681671 #2937:34713c] INFO -- : :webservices: [----] I, [2016-09-13T10:17:51.681740 #2937:34713c] INFO -- : :consume_protocol: https [----] I, [2016-09-13T10:17:51.681818 #2937:34713c] INFO -- : :contactwith: ipaddress [----] I, [2016-09-13T10:17:51.681886 #2937:34713c] INFO -- : :integrate: [----] I, [2016-09-13T10:17:51.681951 #2937:34713c] INFO -- : :security: basic [----] I, [2016-09-13T10:17:51.682018 #2937:34713c] INFO -- : :mode: invoke [----] I, [2016-09-13T10:17:51.682091 #2937:34713c] INFO -- : :nameresolution: false [----] I, [2016-09-13T10:17:51.682158 #2937:34713c] INFO -- : :provide_protocol: https [----] I, [2016-09-13T10:17:51.682223 #2937:34713c] INFO -- : :security: none [----] I, [2016-09-13T10:17:51.682290 #2937:34713c] INFO -- : :timeout: 120 [----] I, [2016-09-13T10:17:51.682384 #2937:34713c] INFO -- : :use_vim_broker: true [----] I, [2016-09-13T10:17:51.682514 #2937:34713c] INFO -- : :authentication_timeout: 30.seconds [----] I, [2016-09-13T10:17:51.682605 #2937:34713c] INFO -- : :workers: [----] I, [2016-09-13T10:17:51.682680 #2937:34713c] INFO -- : :worker_base: [----] I, [2016-09-13T10:17:51.682751 #2937:34713c] INFO -- : :defaults: [----] I, [2016-09-13T10:17:51.682829 #2937:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T10:17:51.682905 #2937:34713c] INFO -- : :gc_interval: 15.minutes [----] I, [2016-09-13T10:17:51.682980 #2937:34713c] INFO -- : :heartbeat_freq: 10.seconds [----] I, [2016-09-13T10:17:51.683049 #2937:34713c] INFO -- : :heartbeat_timeout: 2.minutes [----] I, [2016-09-13T10:17:51.683121 #2937:34713c] INFO -- : :memory_threshold: 200.megabytes [----] I, [2016-09-13T10:17:51.683189 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T10:17:51.683256 #2937:34713c] INFO -- : :parent_time_threshold: 3.minutes [----] I, [2016-09-13T10:17:51.683352 #2937:34713c] INFO -- : :poll: 3.seconds [----] I, [2016-09-13T10:17:51.683471 #2937:34713c] INFO -- : :poll_escalate_max: 30.seconds [----] I, [2016-09-13T10:17:51.683572 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:17:51.683653 #2937:34713c] INFO -- : :restart_interval: 0.hours [----] I, [2016-09-13T10:17:51.683730 #2937:34713c] INFO -- : :starting_timeout: 10.minutes [----] I, [2016-09-13T10:17:51.683813 #2937:34713c] INFO -- : :ems_refresh_core_worker: [----] I, [2016-09-13T10:17:51.683904 #2937:34713c] INFO -- : :poll: 1.seconds [----] I, [2016-09-13T10:17:51.683982 #2937:34713c] INFO -- : :memory_threshold: 400.megabytes [----] I, [2016-09-13T10:17:51.684050 #2937:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:17:51.684116 #2937:34713c] INFO -- : :thread_shutdown_timeout: 10.seconds [----] I, [2016-09-13T10:17:51.684190 #2937:34713c] INFO -- : :event_catcher: [----] I, [2016-09-13T10:17:51.684261 #2937:34713c] INFO -- : :defaults: [----] I, [2016-09-13T10:17:51.684354 #2937:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T10:17:51.684477 #2937:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T10:17:51.684572 #2937:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T10:17:51.684655 #2937:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10.seconds [----] I, [2016-09-13T10:17:51.684729 #2937:34713c] INFO -- : :memory_threshold: 2.gigabytes [----] I, [2016-09-13T10:17:51.684804 #2937:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:17:51.684878 #2937:34713c] INFO -- : :poll: 1.seconds [----] I, [2016-09-13T10:17:51.684952 #2937:34713c] INFO -- : :event_catcher_redhat: [----] I, [2016-09-13T10:17:51.685018 #2937:34713c] INFO -- : :poll: 15.seconds [----] I, [2016-09-13T10:17:51.685089 #2937:34713c] INFO -- : :event_catcher_vmware: [----] I, [2016-09-13T10:17:51.685161 #2937:34713c] INFO -- : :flooding_monitor_enabled: true [----] I, [2016-09-13T10:17:51.685222 #2937:34713c] INFO -- : :poll: 1.seconds [----] I, [2016-09-13T10:17:51.685293 #2937:34713c] INFO -- : :ems_event_max_wait: 60 [----] I, [2016-09-13T10:17:51.685388 #2937:34713c] INFO -- : :event_catcher_openstack: [----] I, [2016-09-13T10:17:51.685507 #2937:34713c] INFO -- : :poll: 15.seconds [----] I, [2016-09-13T10:17:51.685591 #2937:34713c] INFO -- : :topics: [----] I, [2016-09-13T10:17:51.685669 #2937:34713c] INFO -- : :nova: notifications.* [----] I, [2016-09-13T10:17:51.685745 #2937:34713c] INFO -- : :cinder: notifications.* [----] I, [2016-09-13T10:17:51.685827 #2937:34713c] INFO -- : :glance: notifications.* [----] I, [2016-09-13T10:17:51.685893 #2937:34713c] INFO -- : :heat: notifications.* [----] I, [2016-09-13T10:17:51.685958 #2937:34713c] INFO -- : :duration: 10.seconds [----] I, [2016-09-13T10:17:51.686032 #2937:34713c] INFO -- : :capacity: 50 [----] I, [2016-09-13T10:17:51.686102 #2937:34713c] INFO -- : :amqp_port: 5672 [----] I, [2016-09-13T10:17:51.686178 #2937:34713c] INFO -- : :amqp_heartbeat: 30 [----] I, [2016-09-13T10:17:51.686247 #2937:34713c] INFO -- : :amqp_recovery_attempts: 4 [----] I, [2016-09-13T10:17:51.686311 #2937:34713c] INFO -- : :ceilometer: [----] I, [2016-09-13T10:17:51.686409 #2937:34713c] INFO -- : :event_types_regex: "\\A(?!firewall|floatingip|gateway|net|port|router|subnet|security-group|vpn)" [----] I, [2016-09-13T10:17:51.686530 #2937:34713c] INFO -- : :event_catcher_openstack_infra: [----] I, [2016-09-13T10:17:51.686619 #2937:34713c] INFO -- : :poll: 15.seconds [----] I, [2016-09-13T10:17:51.686700 #2937:34713c] INFO -- : :topics: [----] I, [2016-09-13T10:17:51.686771 #2937:34713c] INFO -- : :nova: notifications.* [----] I, [2016-09-13T10:17:51.686851 #2937:34713c] INFO -- : :cinder: notifications.* [----] I, [2016-09-13T10:17:51.686930 #2937:34713c] INFO -- : :glance: notifications.* [----] I, [2016-09-13T10:17:51.687003 #2937:34713c] INFO -- : :heat: notifications.* [----] I, [2016-09-13T10:17:51.687076 #2937:34713c] INFO -- : :ironic: notifications.* [----] I, [2016-09-13T10:17:51.687149 #2937:34713c] INFO -- : :duration: 10.seconds [----] I, [2016-09-13T10:17:51.687237 #2937:34713c] INFO -- : :capacity: 50 [----] I, [2016-09-13T10:17:51.687334 #2937:34713c] INFO -- : :amqp_port: 5672 [----] I, [2016-09-13T10:17:51.687449 #2937:34713c] INFO -- : :amqp_heartbeat: 30 [----] I, [2016-09-13T10:17:51.687543 #2937:34713c] INFO -- : :amqp_recovery_attempts: 4 [----] I, [2016-09-13T10:17:51.687631 #2937:34713c] INFO -- : :ceilometer: [----] I, [2016-09-13T10:17:51.687712 #2937:34713c] INFO -- : :event_types_regex: "\\A(?!firewall|floatingip|gateway|net|port|router|subnet|security-group|vpn)" [----] I, [2016-09-13T10:17:51.687795 #2937:34713c] INFO -- : :event_catcher_openstack_network: [----] I, [2016-09-13T10:17:51.687871 #2937:34713c] INFO -- : :poll: 15.seconds [----] I, [2016-09-13T10:17:51.687947 #2937:34713c] INFO -- : :topics: [----] I, [2016-09-13T10:17:51.688014 #2937:34713c] INFO -- : :neutron: notifications.* [----] I, [2016-09-13T10:17:51.688087 #2937:34713c] INFO -- : :duration: 10.seconds [----] I, [2016-09-13T10:17:51.688155 #2937:34713c] INFO -- : :capacity: 50 [----] I, [2016-09-13T10:17:51.688229 #2937:34713c] INFO -- : :amqp_port: 5672 [----] I, [2016-09-13T10:17:51.688305 #2937:34713c] INFO -- : :amqp_heartbeat: 30 [----] I, [2016-09-13T10:17:51.688401 #2937:34713c] INFO -- : :amqp_recovery_attempts: 4 [----] I, [2016-09-13T10:17:51.688523 #2937:34713c] INFO -- : :ceilometer: [----] I, [2016-09-13T10:17:51.688608 #2937:34713c] INFO -- : :event_types_regex: "\\A(firewall|floatingip|gateway|net|port|router|subnet|security-group|vpn)" [----] I, [2016-09-13T10:17:51.688689 #2937:34713c] INFO -- : :event_catcher_amazon: [----] I, [2016-09-13T10:17:51.688770 #2937:34713c] INFO -- : :poll: 15.seconds [----] I, [2016-09-13T10:17:51.688849 #2937:34713c] INFO -- : :event_catcher_azure: [----] I, [2016-09-13T10:17:51.688918 #2937:34713c] INFO -- : :poll: 15.seconds [----] I, [2016-09-13T10:17:51.688993 #2937:34713c] INFO -- : :event_catcher_hawkular: [----] I, [2016-09-13T10:17:51.689064 #2937:34713c] INFO -- : :poll: 10.seconds [----] I, [2016-09-13T10:17:51.689130 #2937:34713c] INFO -- : :event_catcher_google: [----] I, [2016-09-13T10:17:51.689201 #2937:34713c] INFO -- : :poll: 15.seconds [----] I, [2016-09-13T10:17:51.689265 #2937:34713c] INFO -- : :event_catcher_kubernetes: [----] I, [2016-09-13T10:17:51.689359 #2937:34713c] INFO -- : :poll: 1.seconds [----] I, [2016-09-13T10:17:51.689481 #2937:34713c] INFO -- : :event_catcher_openshift: [----] I, [2016-09-13T10:17:51.689564 #2937:34713c] INFO -- : :poll: 1.seconds [----] I, [2016-09-13T10:17:51.689637 #2937:34713c] INFO -- : :event_catcher_atomic: [----] I, [2016-09-13T10:17:51.689710 #2937:34713c] INFO -- : :poll: 1.seconds [----] I, [2016-09-13T10:17:51.689784 #2937:34713c] INFO -- : :event_catcher_openshift_enterprise: [----] I, [2016-09-13T10:17:51.689861 #2937:34713c] INFO -- : :poll: 1.seconds [----] I, [2016-09-13T10:17:51.689928 #2937:34713c] INFO -- : :event_catcher_atomic_enterprise: [----] I, [2016-09-13T10:17:51.689996 #2937:34713c] INFO -- : :poll: 1.seconds [----] I, [2016-09-13T10:17:51.690065 #2937:34713c] INFO -- : :queue_worker_base: [----] I, [2016-09-13T10:17:51.690134 #2937:34713c] INFO -- : :defaults: [----] I, [2016-09-13T10:17:51.690198 #2937:34713c] INFO -- : :cpu_usage_threshold: 100.percent [----] I, [2016-09-13T10:17:51.690270 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T10:17:51.690375 #2937:34713c] INFO -- : :memory_threshold: 400.megabytes [----] I, [2016-09-13T10:17:51.690497 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:17:51.690585 #2937:34713c] INFO -- : :queue_timeout: 10.minutes [----] I, [2016-09-13T10:17:51.690674 #2937:34713c] INFO -- : :ems_metrics_collector_worker: [----] I, [2016-09-13T10:17:51.690749 #2937:34713c] INFO -- : :defaults: [----] I, [2016-09-13T10:17:51.690824 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:17:51.690898 #2937:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T10:17:51.690969 #2937:34713c] INFO -- : :poll_method: :escalate [----] I, [2016-09-13T10:17:51.691040 #2937:34713c] INFO -- : :ems_metrics_collector_worker_azure: {} [----] I, [2016-09-13T10:17:51.691113 #2937:34713c] INFO -- : :ems_metrics_collector_worker_amazon: {} [----] I, [2016-09-13T10:17:51.691186 #2937:34713c] INFO -- : :ems_metrics_collector_worker_atomic: {} [----] I, [2016-09-13T10:17:51.691264 #2937:34713c] INFO -- : :ems_metrics_collector_worker_atomic_enterprise: {} [----] I, [2016-09-13T10:17:51.691357 #2937:34713c] INFO -- : :ems_metrics_collector_worker_google: {} [----] I, [2016-09-13T10:17:51.691476 #2937:34713c] INFO -- : :ems_metrics_collector_worker_kubernetes: [----] I, [2016-09-13T10:17:51.691563 #2937:34713c] INFO -- : :metrics_port: 5000 [----] I, [2016-09-13T10:17:51.691637 #2937:34713c] INFO -- : :metrics_path: "/hawkular/metrics" [----] I, [2016-09-13T10:17:51.691709 #2937:34713c] INFO -- : :ems_metrics_collector_worker_openshift: {} [----] I, [2016-09-13T10:17:51.691784 #2937:34713c] INFO -- : :ems_metrics_collector_worker_openshift_enterprise: {} [----] I, [2016-09-13T10:17:51.691866 #2937:34713c] INFO -- : :ems_metrics_collector_worker_openstack: {} [----] I, [2016-09-13T10:17:51.691941 #2937:34713c] INFO -- : :ems_metrics_collector_worker_openstack_infra: {} [----] I, [2016-09-13T10:17:51.692015 #2937:34713c] INFO -- : :ems_metrics_collector_worker_openstack_network: {} [----] I, [2016-09-13T10:17:51.692086 #2937:34713c] INFO -- : :ems_metrics_collector_worker_redhat: {} [----] I, [2016-09-13T10:17:51.692160 #2937:34713c] INFO -- : :ems_metrics_collector_worker_vmware: {} [----] I, [2016-09-13T10:17:51.692237 #2937:34713c] INFO -- : :ems_metrics_processor_worker: [----] I, [2016-09-13T10:17:51.692315 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:17:51.692437 #2937:34713c] INFO -- : :memory_threshold: 400.megabytes [----] I, [2016-09-13T10:17:51.692535 #2937:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T10:17:51.692614 #2937:34713c] INFO -- : :poll_method: :escalate [----] I, [2016-09-13T10:17:51.692688 #2937:34713c] INFO -- : :ems_refresh_worker: [----] I, [2016-09-13T10:17:51.692764 #2937:34713c] INFO -- : :defaults: [----] I, [2016-09-13T10:17:51.692839 #2937:34713c] INFO -- : :memory_threshold: 2.gigabytes [----] I, [2016-09-13T10:17:51.692916 #2937:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T10:17:51.692996 #2937:34713c] INFO -- : :poll: 10.seconds [----] I, [2016-09-13T10:17:51.693068 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:17:51.693139 #2937:34713c] INFO -- : :queue_timeout: 120.minutes [----] I, [2016-09-13T10:17:51.693207 #2937:34713c] INFO -- : :restart_interval: 2.hours [----] I, [2016-09-13T10:17:51.693279 #2937:34713c] INFO -- : :ems_refresh_worker_amazon: {} [----] I, [2016-09-13T10:17:51.693375 #2937:34713c] INFO -- : :ems_refresh_worker_amazon_network: {} [----] I, [2016-09-13T10:17:51.693506 #2937:34713c] INFO -- : :ems_refresh_worker_ansible_tower_configuration: {} [----] I, [2016-09-13T10:17:51.693596 #2937:34713c] INFO -- : :ems_refresh_worker_atomic: {} [----] I, [2016-09-13T10:17:51.693676 #2937:34713c] INFO -- : :ems_refresh_worker_atomic_enterprise: {} [----] I, [2016-09-13T10:17:51.693756 #2937:34713c] INFO -- : :ems_refresh_worker_azure: {} [----] I, [2016-09-13T10:17:51.693844 #2937:34713c] INFO -- : :ems_refresh_worker_azure_network: {} [----] I, [2016-09-13T10:17:51.693924 #2937:34713c] INFO -- : :ems_refresh_worker_foreman_configuration: {} [----] I, [2016-09-13T10:17:51.693990 #2937:34713c] INFO -- : :ems_refresh_worker_foreman_provisioning: {} [----] I, [2016-09-13T10:17:51.694067 #2937:34713c] INFO -- : :ems_refresh_worker_google: {} [----] I, [2016-09-13T10:17:51.694144 #2937:34713c] INFO -- : :ems_refresh_worker_google_network: {} [----] I, [2016-09-13T10:17:51.694219 #2937:34713c] INFO -- : :ems_refresh_worker_hawkular: {} [----] I, [2016-09-13T10:17:51.694295 #2937:34713c] INFO -- : :ems_refresh_worker_kubernetes: {} [----] I, [2016-09-13T10:17:51.694401 #2937:34713c] INFO -- : :ems_refresh_worker_microsoft: {} [----] I, [2016-09-13T10:17:51.694522 #2937:34713c] INFO -- : :ems_refresh_worker_openshift: {} [----] I, [2016-09-13T10:17:51.694608 #2937:34713c] INFO -- : :ems_refresh_worker_openshift_enterprise: {} [----] I, [2016-09-13T10:17:51.694679 #2937:34713c] INFO -- : :ems_refresh_worker_openstack: {} [----] I, [2016-09-13T10:17:51.694758 #2937:34713c] INFO -- : :ems_refresh_worker_openstack_infra: {} [----] I, [2016-09-13T10:17:51.694838 #2937:34713c] INFO -- : :ems_refresh_worker_openstack_network: {} [----] I, [2016-09-13T10:17:51.694908 #2937:34713c] INFO -- : :ems_refresh_worker_nuage_network: {} [----] I, [2016-09-13T10:17:51.694977 #2937:34713c] INFO -- : :ems_refresh_worker_redhat: {} [----] I, [2016-09-13T10:17:51.695046 #2937:34713c] INFO -- : :ems_refresh_worker_vmware: {} [----] I, [2016-09-13T10:17:51.695109 #2937:34713c] INFO -- : :ems_refresh_worker_vmware_cloud: {} [----] I, [2016-09-13T10:17:51.695181 #2937:34713c] INFO -- : :ems_refresh_worker_vmware_cloud_network: {} [----] I, [2016-09-13T10:17:51.695262 #2937:34713c] INFO -- : :event_handler: [----] I, [2016-09-13T10:17:51.695349 #2937:34713c] INFO -- : :cpu_usage_threshold: 0.percent [----] I, [2016-09-13T10:17:51.695460 #2937:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T10:17:51.695551 #2937:34713c] INFO -- : :generic_worker: [----] I, [2016-09-13T10:17:51.695623 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:17:51.695702 #2937:34713c] INFO -- : :netapp_refresh_worker: [----] I, [2016-09-13T10:17:51.695776 #2937:34713c] INFO -- : :memory_threshold: 2.gigabytes [----] I, [2016-09-13T10:17:51.695852 #2937:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T10:17:51.695930 #2937:34713c] INFO -- : :poll: 10.seconds [----] I, [2016-09-13T10:17:51.696016 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:17:51.696096 #2937:34713c] INFO -- : :queue_timeout: 60.minutes [----] I, [2016-09-13T10:17:51.696179 #2937:34713c] INFO -- : :priority_worker: [----] I, [2016-09-13T10:17:51.696255 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:17:51.696345 #2937:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:17:51.696457 #2937:34713c] INFO -- : :poll: 1.seconds [----] I, [2016-09-13T10:17:51.696549 #2937:34713c] INFO -- : :reporting_worker: [----] I, [2016-09-13T10:17:51.696624 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:17:51.696691 #2937:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T10:17:51.696765 #2937:34713c] INFO -- : :smart_proxy_worker: [----] I, [2016-09-13T10:17:51.696847 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:17:51.696928 #2937:34713c] INFO -- : :memory_threshold: 600.megabytes [----] I, [2016-09-13T10:17:51.696994 #2937:34713c] INFO -- : :queue_timeout: 20.minutes [----] I, [2016-09-13T10:17:51.697066 #2937:34713c] INFO -- : :restart_interval: 2.hours [----] I, [2016-09-13T10:17:51.697161 #2937:34713c] INFO -- : :storage_metrics_collector_worker: [----] I, [2016-09-13T10:17:51.697238 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:17:51.697313 #2937:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T10:17:51.697410 #2937:34713c] INFO -- : :poll_method: :escalate [----] I, [2016-09-13T10:17:51.697538 #2937:34713c] INFO -- : :vmdb_storage_bridge_worker: [----] I, [2016-09-13T10:17:51.697627 #2937:34713c] INFO -- : :memory_threshold: 2.gigabytes [----] I, [2016-09-13T10:17:51.697705 #2937:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T10:17:51.697781 #2937:34713c] INFO -- : :poll: 10.seconds [----] I, [2016-09-13T10:17:51.697860 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:17:51.697937 #2937:34713c] INFO -- : :queue_timeout: 120.minutes [----] I, [2016-09-13T10:17:51.698007 #2937:34713c] INFO -- : :schedule_worker: [----] I, [2016-09-13T10:17:51.698081 #2937:34713c] INFO -- : :authentication_check_interval: 1.day [----] I, [2016-09-13T10:17:51.698155 #2937:34713c] INFO -- : :db_diagnostics_interval: 30.minutes [----] I, [2016-09-13T10:17:51.698231 #2937:34713c] INFO -- : :ems_events_purge_interval: 1.day [----] I, [2016-09-13T10:17:51.698311 #2937:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 1.hour [----] I, [2016-09-13T10:17:51.698409 #2937:34713c] INFO -- : :evm_snapshot_interval: 1.hour [----] I, [2016-09-13T10:17:51.698531 #2937:34713c] INFO -- : :job_proxy_dispatcher_interval: 15.seconds [----] I, [2016-09-13T10:17:51.698608 #2937:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60.seconds [----] I, [2016-09-13T10:17:51.698684 #2937:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 2.minutes [----] I, [2016-09-13T10:17:51.698767 #2937:34713c] INFO -- : :job_timeout_interval: 60.seconds [----] I, [2016-09-13T10:17:51.698845 #2937:34713c] INFO -- : :log_active_configuration_interval: 1.days [----] I, [2016-09-13T10:17:51.698922 #2937:34713c] INFO -- : :log_database_statistics_interval: 1.days [----] I, [2016-09-13T10:17:51.698987 #2937:34713c] INFO -- : :memory_threshold: 300.megabytes [----] I, [2016-09-13T10:17:51.699058 #2937:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T10:17:51.699126 #2937:34713c] INFO -- : :orchestration_stack_retired_interval: 10.minutes [----] I, [2016-09-13T10:17:51.699204 #2937:34713c] INFO -- : :performance_collection_interval: 3.minutes [----] I, [2016-09-13T10:17:51.699273 #2937:34713c] INFO -- : :performance_collection_start_delay: 5.minutes [----] I, [2016-09-13T10:17:51.699367 #2937:34713c] INFO -- : :performance_realtime_purging_interval: 15.minutes [----] I, [2016-09-13T10:17:51.699487 #2937:34713c] INFO -- : :performance_realtime_purging_start_delay: 5.minutes [----] I, [2016-09-13T10:17:51.699571 #2937:34713c] INFO -- : :performance_rollup_purging_interval: 4.hours [----] I, [2016-09-13T10:17:51.699649 #2937:34713c] INFO -- : :performance_rollup_purging_start_delay: 5.minutes [----] I, [2016-09-13T10:17:51.699719 #2937:34713c] INFO -- : :policy_events_purge_interval: 1.day [----] I, [2016-09-13T10:17:51.699800 #2937:34713c] INFO -- : :poll: 15.seconds [----] I, [2016-09-13T10:17:51.699871 #2937:34713c] INFO -- : :server_log_stats_interval: 5.minutes [----] I, [2016-09-13T10:17:51.699942 #2937:34713c] INFO -- : :server_stats_interval: 60.seconds [----] I, [2016-09-13T10:17:51.700007 #2937:34713c] INFO -- : :service_retired_interval: 10.minutes [----] I, [2016-09-13T10:17:51.700084 #2937:34713c] INFO -- : :session_timeout_interval: 30.seconds [----] I, [2016-09-13T10:17:51.700156 #2937:34713c] INFO -- : :storage_file_collection_interval: 1.days [----] I, [2016-09-13T10:17:51.700247 #2937:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T10:17:51.700334 #2937:34713c] INFO -- : :vm_retired_interval: 10.minutes [----] I, [2016-09-13T10:17:51.700442 #2937:34713c] INFO -- : :smis_refresh_worker: [----] I, [2016-09-13T10:17:51.700538 #2937:34713c] INFO -- : :memory_threshold: 1.gigabytes [----] I, [2016-09-13T10:17:51.700615 #2937:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T10:17:51.700685 #2937:34713c] INFO -- : :poll: 15.seconds [----] I, [2016-09-13T10:17:51.700755 #2937:34713c] INFO -- : :smis_update_period: 1.hours [----] I, [2016-09-13T10:17:51.700832 #2937:34713c] INFO -- : :stats_update_period: 10.minutes [----] I, [2016-09-13T10:17:51.700903 #2937:34713c] INFO -- : :status_update_period: 5.minutes [----] I, [2016-09-13T10:17:51.700966 #2937:34713c] INFO -- : :ui_worker: [----] I, [2016-09-13T10:17:51.701032 #2937:34713c] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T10:17:51.701100 #2937:34713c] INFO -- : :memory_threshold: 1.gigabytes [----] I, [2016-09-13T10:17:51.701170 #2937:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:17:51.701236 #2937:34713c] INFO -- : :vim_broker_worker: [----] I, [2016-09-13T10:17:51.701303 #2937:34713c] INFO -- : :memory_threshold: 2.gigabytes [----] I, [2016-09-13T10:17:51.701404 #2937:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T10:17:51.701528 #2937:34713c] INFO -- : :poll: 1.seconds [----] I, [2016-09-13T10:17:51.701609 #2937:34713c] INFO -- : :reconnect_retry_interval: 5.minutes [----] I, [2016-09-13T10:17:51.701685 #2937:34713c] INFO -- : :vim_broker_status_interval: 15.minutes [----] I, [2016-09-13T10:17:51.701761 #2937:34713c] INFO -- : :vim_broker_update_interval: 0.seconds [----] I, [2016-09-13T10:17:51.701839 #2937:34713c] INFO -- : :vim_broker_max_wait: 60 [----] I, [2016-09-13T10:17:51.701909 #2937:34713c] INFO -- : :vim_broker_max_objects: 250 [----] I, [2016-09-13T10:17:51.701979 #2937:34713c] INFO -- : :web_service_worker: [----] I, [2016-09-13T10:17:51.702054 #2937:34713c] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T10:17:51.702127 #2937:34713c] INFO -- : :memory_threshold: 1.gigabytes [----] I, [2016-09-13T10:17:51.702198 #2937:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:17:51.702276 #2937:34713c] INFO -- : :websocket_worker: [----] I, [2016-09-13T10:17:51.702372 #2937:34713c] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T10:17:51.702494 #2937:34713c] INFO -- : :memory_threshold: 1.gigabytes [----] I, [2016-09-13T10:17:51.702578 #2937:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:17:51.702648 #2937:34713c] INFO -- : VMDB settings END [----] I, [2016-09-13T10:17:51.702711 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T10:17:51.702779 #2937:34713c] INFO -- : DATABASE settings: [----] I, [2016-09-13T10:17:51.706610 #2937:34713c] INFO -- : adapter: postgresql [----] I, [2016-09-13T10:17:51.706738 #2937:34713c] INFO -- : encoding: utf8 [----] I, [2016-09-13T10:17:51.706831 #2937:34713c] INFO -- : username: root [----] I, [2016-09-13T10:17:51.706904 #2937:34713c] INFO -- : pool: 5 [----] I, [2016-09-13T10:17:51.706981 #2937:34713c] INFO -- : wait_timeout: 5 [----] I, [2016-09-13T10:17:51.707053 #2937:34713c] INFO -- : min_messages: warning [----] I, [2016-09-13T10:17:51.707122 #2937:34713c] INFO -- : database: vmdb_production [----] I, [2016-09-13T10:17:51.707186 #2937:34713c] INFO -- : DATABASE settings END [----] I, [2016-09-13T10:17:51.707259 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T10:17:51.707659 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79510], State: [ok], Delivered in [0.223177989] seconds [----] I, [2016-09-13T10:17:51.736930 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79512], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Host.authentication_check_schedule], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.033306179] seconds [----] I, [2016-09-13T10:17:51.737160 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79512], Delivering... [----] I, [2016-09-13T10:17:51.749825 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79512], State: [ok], Delivered in [0.012638246] seconds [----] I, [2016-09-13T10:17:51.782596 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79513], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ExtManagementSystem.authentication_check_schedule], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.067992171] seconds [----] I, [2016-09-13T10:17:51.782819 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79513], Delivering... [----] I, [2016-09-13T10:17:51.799956 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79515], id: [], Zone: [default], Role: [ems_operations], Server: [], Ident: [generic], Target id: [], Instance id: [17], Task id: [], Command: [ExtManagementSystem.authentication_check_types], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[], {}] [----] I, [2016-09-13T10:17:51.800460 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79513], State: [ok], Delivered in [0.017601389] seconds [----] I, [2016-09-13T10:17:51.834198 #2928:34713c] INFO -- : Current table statistics data table_name | index_rows_fetched | index_scans | last_analyze_date | last_autoanalyze_date | last_autovacuum_date | last_vacuum_date | rows_dead | rows_deleted | rows_hot_updated | rows_inserted | rows_live | rows_updated | sequential_rows_read | table_scans ----------------------------------------------------+--------------------+-------------+-------------------+-------------------------+-------------------------+------------------+-----------+--------------+------------------+---------------+-----------+--------------+----------------------+------------- accounts | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 advanced_settings | 0 | 2 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 13 ar_internal_metadata | 0 | 1 | | | | | 0 | 0 | 0 | 1 | 1 | 0 | 0 | 1 arbitration_profiles | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 8 arbitration_rules | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 arbitration_settings | 0 | 0 | | | | | 1 | 0 | 0 | 2 | 1 | 0 | 1 | 4 assigned_server_roles | 1459997 | 121793 | | | | | 44 | 0 | 44 | 12 | 12 | 44 | 0 | 4 audit_events | 0 | 0 | | | | | 0 | 0 | 0 | 373 | 373 | 0 | 0 | 2 authentications | 45486 | 45488 | | | | | 27 | 16 | 104 | 17 | 1 | 104 | 0 | 59 availability_zones | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 15 binary_blob_parts | 24 | 24 | | | | | 24 | 24 | 0 | 30 | 6 | 0 | 0 | 2 binary_blobs | 54 | 57 | | | | | 30 | 24 | 0 | 30 | 6 | 6 | 0 | 26 blacklisted_events | 0 | 0 | | | | | 35 | 0 | 0 | 70 | 35 | 0 | 17654 | 545 blueprints | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 bottleneck_events | 0 | 2 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 chargeback_rate_detail_currencies | 0 | 0 | | | | | 4 | 0 | 0 | 8 | 4 | 0 | 61 | 52 chargeback_rate_detail_measures | 0 | 0 | | | | | 3 | 0 | 0 | 6 | 3 | 0 | 102 | 49 chargeback_rate_details | 0 | 0 | | | | | 13 | 0 | 0 | 26 | 13 | 0 | 0 | 4 chargeback_rates | 0 | 0 | | | | | 2 | 0 | 0 | 4 | 2 | 0 | 9 | 28 chargeback_tiers | 28 | 28 | | | | | 42 | 0 | 28 | 42 | 28 | 28 | 0 | 1 classifications | 52300 | 14196 | | | | | 125 | 0 | 0 | 250 | 125 | 0 | 111875 | 1615 cloud_database_flavors | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 cloud_databases | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 cloud_networks | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 27 cloud_object_store_containers | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 cloud_object_store_objects | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14 cloud_resource_quotas | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 16 cloud_services | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 5 cloud_subnets | 0 | 16 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 18 cloud_subnets_network_ports | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 6 cloud_tenants | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 16 cloud_tenants_vms | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 cloud_volume_snapshots | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14 cloud_volumes | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 28 compliance_details | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 compliances | 0 | 2 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 computer_systems | 0 | 2 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 13 conditions | 12 | 24 | | | | | 4 | 0 | 2 | 4 | 2 | 2 | 47 | 44 conditions_miq_policies | 0 | 0 | | | | | 2 | 0 | 0 | 4 | 2 | 0 | 12 | 13 configuration_locations | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 15 configuration_locations_configuration_profiles | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 8 configuration_organizations | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 15 configuration_organizations_configuration_profiles | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 8 configuration_profiles | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 23 configuration_profiles_configuration_tags | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 12 configuration_scripts | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 configuration_tags | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 13 configuration_tags_configured_systems | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 8 configured_systems | 0 | 2 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 18 container_build_pods | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 container_builds | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 container_component_statuses | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 container_conditions | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14 container_definitions | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 container_deployment_nodes | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 container_deployments | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 container_env_vars | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 container_groups | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 16 container_groups_container_services | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 container_image_registries | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 container_images | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 container_label_tag_mappings | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 container_limit_items | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 5 container_limits | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 container_nodes | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 28 container_port_configs | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 container_projects | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 container_quota_items | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 container_quotas | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 container_replicators | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 container_routes | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 container_service_port_configs | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 container_services | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 6 container_volumes | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 10 containers | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 15 custom_attributes | 0 | 2 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 13 custom_buttons | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 customization_scripts | 0 | 2 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 15 customization_scripts_operating_system_flavors | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 8 customization_specs | 0 | 16 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 customization_templates | 0 | 0 | | | | | 8 | 0 | 0 | 16 | 8 | 0 | 8 | 17 database_backups | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 dialog_fields | 44 | 44 | | | | | 44 | 11 | 33 | 33 | 11 | 33 | 39 | 45 dialog_groups | 8 | 8 | | | | | 10 | 2 | 6 | 6 | 2 | 6 | 4 | 2 dialog_tabs | 4 | 4 | | | | | 5 | 1 | 3 | 3 | 1 | 3 | 2 | 2 dialogs | 0 | 0 | | | | | 1 | 0 | 0 | 2 | 1 | 0 | 2 | 9 direct_configuration_profiles_configuration_tags | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 direct_configuration_tags_configured_systems | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 8 disks | 0 | 37 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 53 drift_states | 0 | 2 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14 ems_clusters | 0 | 16 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 30 ems_folders | 0 | 16 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 5 endpoints | 22 | 22 | | | | | 22 | 16 | 6 | 17 | 1 | 6 | 2283 | 2079 entitlements | 0 | 0 | | | | | 0 | 0 | 0 | 16 | 16 | 0 | 13639 | 10176 event_logs | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 event_streams | 3099 | 3201 | | 2000-01-01 08:16:09 UTC | | | 300 | 117 | 1074 | 1099 | 982 | 1099 | 98515 | 379 ext_management_systems | 6859 | 6887 | | 2000-01-01 13:21:13 UTC | | | 18 | 16 | 475 | 17 | 1 | 475 | 906334 | 1281155 file_depots | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 17 filesystems | 0 | 2 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 29 firewall_rules | 0 | 2 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14 flavors | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 15 floating_ips | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 19 generic_object_definitions | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 generic_objects | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 git_references | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 git_repositories | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 guest_applications | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 guest_devices | 0 | 7 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 29 hardwares | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 45 host_aggregate_hosts | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 host_aggregates | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 host_service_groups | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 13 host_storages | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 5 host_switches | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 hosts | 0 | 25 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 232 import_file_uploads | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 iso_datastores | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 17 iso_images | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 jobs | 0 | 77377 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1746 key_pairs_vms | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 lans | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 ldap_domains | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 15 ldap_groups | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 ldap_managements | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 ldap_regions | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 ldap_servers | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 ldap_users | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 lifecycle_events | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 load_balancer_health_check_members | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 5 load_balancer_health_checks | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 6 load_balancer_listener_pools | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 5 load_balancer_listeners | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 7 load_balancer_pool_member_pools | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 load_balancer_pool_members | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 8 load_balancer_pools | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 load_balancers | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 log_files | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14 metric_rollups | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 36 metric_rollups_01 | 0 | 25 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 27 metric_rollups_02 | 0 | 25 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 27 metric_rollups_03 | 0 | 25 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 27 metric_rollups_04 | 0 | 25 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 27 metric_rollups_05 | 0 | 25 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 27 metric_rollups_06 | 0 | 25 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 27 metric_rollups_07 | 0 | 25 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 27 metric_rollups_08 | 0 | 25 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 27 metric_rollups_09 | 0 | 25 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 27 metric_rollups_10 | 0 | 25 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 27 metric_rollups_11 | 0 | 25 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 27 metric_rollups_12 | 0 | 25 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 27 metrics | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14 metrics_00 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_01 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_02 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_03 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_04 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_05 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_06 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_07 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_08 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_09 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_10 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_11 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_12 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_13 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_14 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_15 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_16 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_17 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_18 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_19 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_20 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_21 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_22 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 metrics_23 | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 middleware_datasources | 106 | 106 | | | | | 92 | 92 | 0 | 92 | 0 | 0 | 9391 | 1824 middleware_deployments | 225 | 225 | | | | | 203 | 203 | 0 | 203 | 0 | 0 | 39206 | 2914 middleware_domains | 61 | 61 | | | | | 13 | 13 | 0 | 13 | 0 | 0 | 880 | 1135 middleware_messagings | 288 | 288 | | 2000-01-01 17:29:59 UTC | | | 288 | 288 | 0 | 288 | 0 | 0 | 30373 | 1673 middleware_server_groups | 47 | 47 | | | | | 26 | 26 | 0 | 26 | 0 | 0 | 2178 | 1090 middleware_servers | 3803 | 3803 | | | | | 69 | 66 | 33 | 66 | 0 | 33 | 12838 | 3336 miq_actions | 0 | 0 | | | | | 36 | 0 | 0 | 72 | 36 | 0 | 6672 | 359 miq_ae_classes | 29350 | 11773 | | | | | 97 | 0 | 0 | 98 | 98 | 97 | 109754 | 1157 miq_ae_fields | 597251 | 13531 | | 2000-01-01 06:56:26 UTC | | | 0 | 0 | 0 | 1016 | 1016 | 0 | 29284 | 56 miq_ae_instances | 55821 | 8830 | | 2000-01-01 06:56:26 UTC | | | 465 | 0 | 1 | 513 | 513 | 466 | 567749 | 1141 miq_ae_methods | 34670 | 9503 | | | | | 23 | 0 | 7 | 226 | 226 | 30 | 2014 | 27 miq_ae_namespaces | 21862 | 20770 | | | | | 0 | 0 | 0 | 60 | 60 | 0 | 666886 | 11233 miq_ae_values | 3297 | 3297 | | 2000-01-01 06:56:26 UTC | | | 0 | 0 | 0 | 637 | 637 | 0 | 0 | 4 miq_ae_workspaces | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 miq_alert_statuses | 0 | 2 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14 miq_alerts | 50 | 50 | | | | | 29 | 0 | 48 | 50 | 25 | 50 | 3425 | 279 miq_approvals | 0 | 2 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 15 miq_cim_associations | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 5 miq_cim_derived_metrics | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 miq_cim_instances | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 31 miq_databases | 16 | 22 | | | | | 0 | 0 | 0 | 1 | 1 | 0 | 0 | 18 miq_dialogs | 0 | 0 | | | | | 7 | 0 | 0 | 22 | 15 | 0 | 386 | 76 miq_enterprises | 251 | 252 | | | | | 0 | 0 | 0 | 1 | 1 | 0 | 0 | 1 miq_event_definitions | 1238 | 1238 | | | | | 170 | 0 | 0 | 340 | 170 | 0 | 182875 | 2780 miq_globals | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 miq_groups | 10666 | 10650 | | | | | 0 | 0 | 0 | 16 | 16 | 0 | 84116 | 5650 miq_groups_users | 5342 | 5344 | | | | | 0 | 0 | 0 | 2 | 2 | 0 | 0 | 6 miq_policies | 0 | 0 | | | | | 3 | 0 | 0 | 6 | 3 | 0 | 222 | 120 miq_policy_contents | 8 | 13 | | | | | 8 | 4 | 0 | 12 | 4 | 0 | 0 | 4 miq_product_features | 12513 | 12514 | | 2000-01-01 06:56:26 UTC | | | 0 | 0 | 0 | 1135 | 1135 | 0 | 2794373 | 3056 miq_queue | 10469 | 11105 | | 2000-01-01 14:06:13 UTC | 2000-01-01 14:06:13 UTC | | 202 | 79506 | 0 | 79507 | 6 | 79508 | 2967378 | 1336561 miq_regions | 8037 | 8037 | | | | | 0 | 0 | 0 | 1 | 1 | 0 | 5407 | 5426 miq_report_result_details | 0 | 26 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 13 miq_report_results | 486 | 486 | | | | | 8 | 0 | 19 | 6 | 6 | 24 | 243 | 67 miq_reports | 864 | 52 | | | | | 0 | 0 | 0 | 137 | 137 | 0 | 67526 | 1009 miq_request_tasks | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 52 miq_requests | 0 | 4 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 53 miq_roles_features | 0 | 0 | | 2000-01-01 06:56:26 UTC | | | 0 | 0 | 0 | 908 | 908 | 0 | 3347796 | 3692 miq_schedules | 1662 | 1644 | | | | | 16 | 0 | 334 | 20 | 10 | 336 | 701250 | 70139 miq_scsi_luns | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 28 miq_scsi_targets | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 miq_searches | 125 | 125 | | | | | 112 | 0 | 13 | 117 | 117 | 125 | 411961 | 3776 miq_servers | 3051 | 3066 | | 2000-01-01 14:01:13 UTC | | | 9 | 0 | 24490 | 1 | 1 | 24490 | 125125 | 125141 miq_sets | 7013 | 1998 | | | | | 14 | 0 | 0 | 32 | 18 | 0 | 0 | 28 miq_shortcuts | 3 | 3 | | | | | 3 | 0 | 3 | 50 | 50 | 3 | 151082 | 3074 miq_storage_metrics | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14 miq_tasks | 1430 | 1432 | | 2000-01-01 14:00:54 UTC | | | 46 | 0 | 425 | 222 | 222 | 444 | 44718 | 332 miq_user_roles | 7172 | 7172 | | | | | 0 | 0 | 0 | 15 | 15 | 0 | 1299 | 141 miq_widget_contents | 1044 | 1700 | | | | | 24 | 0 | 214 | 8 | 8 | 214 | 0 | 6 miq_widget_shortcuts | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 miq_widgets | 1532 | 1534 | | | | | 256 | 0 | 222 | 20 | 10 | 464 | 13671 | 1459 miq_workers | 1461 | 2299 | | 2000-01-01 14:16:14 UTC | | | 481 | 90 | 688675 | 103 | 13 | 689059 | 36746897 | 2960596 network_groups | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 network_ports | 0 | 1 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 44 network_ports_security_groups | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 6 network_routers | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 16 networks | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 notification_recipients | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 notification_types | 2 | 4 | | | | | 0 | 0 | 0 | 2 | 2 | 0 | 0 | 2 notifications | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 5 ontap_aggregate_derived_metrics | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 ontap_aggregate_metrics_rollups | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 18 ontap_disk_derived_metrics | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 ontap_disk_metrics_rollups | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 18 ontap_lun_derived_metrics | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 ontap_lun_metrics_rollups | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 18 ontap_system_derived_metrics | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 ontap_system_metrics_rollups | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 18 ontap_volume_derived_metrics | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 ontap_volume_metrics_rollups | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 18 openscap_results | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 openscap_rule_results | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 operating_system_flavors | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 operating_systems | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 45 orchestration_stack_outputs | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 orchestration_stack_parameters | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 orchestration_stack_resources | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 orchestration_stacks | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 879 orchestration_templates | 0 | 2 | | | | | 0 | 0 | 0 | 1 | 1 | 0 | 1 | 21 os_processes | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 partitions | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 patches | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 persistent_volume_claims | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_1255 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 pg_toast_13125 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 pg_toast_13130 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 pg_toast_13135 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 pg_toast_13140 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 pg_toast_13145 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 pg_toast_13150 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 pg_toast_13155 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 pg_toast_16387 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16395 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16405 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16419 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16441 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16453 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16465 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16477 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16489 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16501 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16513 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16526 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16538 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16552 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16563 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16574 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16585 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16596 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16610 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16622 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16650 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16662 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16673 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16685 | 7 | 12 | | | | | 7 | 0 | 0 | 14 | 7 | 0 | 0 | 1 pg_toast_16696 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16708 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16719 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16730 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16741 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16752 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16769 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16782 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16795 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16816 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16829 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16842 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16857 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16869 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16883 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16895 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16907 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16918 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16932 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16950 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16966 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16980 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_16994 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17005 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17025 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17037 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17049 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17069 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17081 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17093 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17105 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17118 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17131 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17142 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17156 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17170 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17184 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17198 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17212 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17226 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17240 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17254 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17268 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17282 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17296 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17310 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17324 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17338 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17352 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17366 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17380 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17394 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17408 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17422 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17436 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17450 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17464 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17482 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17493 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17507 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17521 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17535 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17549 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17563 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17577 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17591 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17605 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17619 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17633 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17647 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17665 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17677 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17690 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17705 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17718 | 61 | 39 | | | | | 0 | 0 | 0 | 15 | 15 | 0 | 0 | 1 pg_toast_17731 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17744 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17758 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17769 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17782 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17793 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17807 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17831 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17849 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17860 | 22 | 26 | | | | | 8 | 0 | 0 | 30 | 22 | 0 | 0 | 1 pg_toast_17872 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17883 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17895 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17906 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17931 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17942 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17956 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_17987 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18000 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18011 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18023 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18037 | 30 | 33 | | | | | 0 | 0 | 0 | 3 | 3 | 0 | 0 | 1 pg_toast_18053 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18067 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18084 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18097 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18109 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18121 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18132 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18150 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18165 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18176 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18187 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18199 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18210 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18224 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18235 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18250 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18266 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18279 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18293 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18308 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18322 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18337 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18351 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18366 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18380 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18395 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18409 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18424 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18437 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18449 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18462 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18475 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18486 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18499 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18540 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18551 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18563 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18574 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18585 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18599 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18612 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18624 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18636 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18647 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18660 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18672 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18684 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18698 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18712 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18723 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18734 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18745 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18756 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18767 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18780 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18795 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18808 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18821 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18832 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18851 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18864 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18878 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18891 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18902 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_18925 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19032 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19045 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19057 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19069 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19080 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19091 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19102 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19114 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19125 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19149 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19161 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19172 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19198 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19214 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19225 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19236 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19250 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19262 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19275 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19287 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19299 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19311 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19334 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19350 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19364 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19378 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19391 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19421 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19432 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19444 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19456 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19468 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19479 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19490 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19501 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19514 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19538 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19550 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19574 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19587 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19598 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19613 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19635 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19646 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19657 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19668 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19679 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19703 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19723 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19751 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19763 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19774 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19785 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19796 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19807 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19818 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19829 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19863 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19874 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19885 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19896 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19909 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19928 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19939 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19950 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_19962 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20008 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20021 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20032 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20043 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20054 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20065 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20077 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20099 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20112 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20126 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20141 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20149 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20168 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20182 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20196 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20370 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20382 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20496 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20513 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20529 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20552 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20574 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20587 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20608 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20626 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20637 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20648 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20659 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20671 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20685 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20702 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20716 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20742 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20758 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20789 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_20801 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 pg_toast_2396 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 pg_toast_2604 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 pg_toast_2606 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 pg_toast_2609 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 pg_toast_2618 | 36 | 12 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 pg_toast_2619 | 701 | 577 | | | | | 21 | 21 | 0 | 27 | 6 | 0 | 0 | 0 pg_toast_2620 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 pg_toast_2964 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 pg_toast_3592 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 pg_toast_3596 | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 pictures | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14 policy_event_contents | 0 | 2 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14 policy_events | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 27 providers | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 61 pxe_image_types | 0 | 0 | | | | | 0 | 0 | 0 | 4 | 4 | 0 | 10 | 20 pxe_images | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 15 pxe_menus | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14 pxe_servers | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 registry_items | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 relationships | 7487 | 2756 | | | | | 183 | 0 | 0 | 386 | 203 | 0 | 43442 | 557 repositories | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 reserves | 0 | 2 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 13 resource_actions | 11 | 11 | | | | | 22 | 11 | 0 | 33 | 11 | 0 | 36 | 25 resource_groups | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 resource_pools | 0 | 16 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 rss_feeds | 274 | 350 | | | | | 19 | 0 | 0 | 38 | 19 | 0 | 114 | 8 scan_histories | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 scan_items | 9 | 19 | | | | | 0 | 0 | 0 | 6 | 6 | 0 | 42 | 23 schema_migrations | 0 | 8 | | | | | 0 | 0 | 0 | 433 | 433 | 0 | 1732 | 6 security_contexts | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 5 security_groups | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 19 security_groups_vms | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 server_roles | 385749 | 385749 | | | | | 0 | 0 | 0 | 24 | 24 | 0 | 1764877 | 73598 service_orders | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 service_resources | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 27 service_template_catalogs | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 service_templates | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 42 services | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 879 sessions | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 17248 settings_changes | 7338 | 11021 | | | | | 2 | 0 | 2 | 2 | 2 | 2 | 0 | 4 snapshots | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 148 storage_files | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 16 storage_managers | 0 | 5 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 29 storage_metrics_metadata | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14 storage_profile_storages | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 storage_profiles | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 17 storages | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 35 storages_vms_and_templates | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 6 switches | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 3 system_consoles | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 4 system_services | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 18 taggings | 4395 | 5110 | | | | | 219 | 187 | 0 | 251 | 32 | 0 | 0 | 16 tags | 81906 | 14902 | | | | | 127 | 0 | 0 | 254 | 127 | 0 | 56261 | 444 tenant_quotas | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 tenants | 12897 | 12902 | | | | | 1 | 0 | 1 | 1 | 1 | 1 | 0 | 34 time_profiles | 1 | 1 | | | | | 0 | 0 | 0 | 1 | 1 | 0 | 21 | 38 users | 12260 | 16311 | | | | | 39 | 0 | 158 | 2 | 2 | 160 | 0 | 129 vim_performance_operating_ranges | 0 | 18 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14 vim_performance_states | 0 | 2 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 13 vim_performance_tag_values | 0 | 2 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 26 vmdb_database_metrics | 0 | 0 | | | | | 0 | 0 | 0 | 144 | 144 | 0 | 20592 | 289 vmdb_databases | 471 | 472 | | | | | 2 | 0 | 2 | 1 | 1 | 2 | 0 | 1 vmdb_indexes | 5514 | 5514 | | 2000-01-01 02:06:04 UTC | | | 356 | 0 | 5185 | 820 | 820 | 5514 | 39706286 | 48734 vmdb_metrics | 14212 | 14214 | | 2000-01-01 14:06:14 UTC | | | 0 | 0 | 0 | 169413 | 169413 | 0 | 24043002 | 301 vmdb_tables | 6591 | 6591 | | 2000-01-01 12:06:12 UTC | | | 272 | 0 | 6339 | 605 | 605 | 6591 | 188206 | 486 vms | 0 | 1577 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 531 volumes | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 windows_images | 0 | 0 | | | | | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 zones | 132674 | 132674 | | | | | 0 | 0 | 0 | 1 | 1 | 0 | 38095 | 38099 [----] I, [2016-09-13T10:17:51.840127 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79514], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [StorageManager.authentication_check_schedule], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.108019449] seconds [----] I, [2016-09-13T10:17:51.840359 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79514], Delivering... [----] I, [2016-09-13T10:17:51.842939 #2928:34713c] INFO -- : Current table size data table_name | average_row_size | pages | rows | size -----------------------------------------------+--------------------+-------+--------+---------- vmdb_metrics | 160.29655164272137 | 3315 | 169413 | 27156480 index_vmdb_metrics_on_resource_and_timestamp | 58.94464448038533 | 1219 | 169413 | 9986048 vmdb_metrics_pkey | 22.581746490844914 | 467 | 169413 | 3825664 miq_product_features | 144.22535211267606 | 20 | 1135 | 163840 index_miq_product_features_on_parent_id | 43.267605633802816 | 6 | 1135 | 49152 miq_product_features_pkey | 36.056338028169016 | 5 | 1135 | 40960 miq_ae_fields | 169.15634218289085 | 21 | 1016 | 172032 index_miq_ae_fields_on_method_id | 56.38544739429695 | 7 | 1016 | 57344 index_miq_ae_fields_on_updated_by_user_id | 48.33038348082596 | 6 | 1016 | 49152 index_miq_ae_fields_on_ae_class_id | 40.27531956735496 | 5 | 1016 | 40960 miq_ae_fields_pkey | 40.27531956735496 | 5 | 1016 | 40960 event_streams | 268.59016393442624 | 32 | 975 | 262144 index_event_streams_on_event_type | 75.54098360655738 | 9 | 975 | 73728 index_event_streams_on_chain_id_and_ems_id | 58.75409836065574 | 7 | 975 | 57344 index_event_streams_on_dest_host_id | 58.75409836065574 | 7 | 975 | 57344 index_event_streams_on_ems_cluster_id | 58.75409836065574 | 7 | 975 | 57344 index_event_streams_on_ems_id | 58.75409836065574 | 7 | 975 | 57344 index_event_streams_on_host_id | 58.75409836065574 | 7 | 975 | 57344 index_event_streams_on_dest_vm_or_template_id | 50.36065573770492 | 6 | 975 | 49152 index_event_streams_on_vm_or_template_id | 50.36065573770492 | 6 | 975 | 49152 index_event_streams_on_timestamp | 41.967213114754095 | 5 | 975 | 40960 event_streams_pkey | 41.967213114754095 | 5 | 975 | 40960 miq_roles_features | 54.07260726072607 | 6 | 908 | 49152 miq_roles_features_pkey | 45.06050605060506 | 5 | 908 | 40960 vmdb_indexes | 139.69305724725945 | 14 | 820 | 114688 vmdb_indexes_pkey | 69.84652862362972 | 7 | 820 | 57344 sql_features | 85.33333333333333 | 7 | 671 | 57344 miq_ae_values | 141.24137931034483 | 11 | 637 | 90112 index_miq_ae_values_on_updated_by_user_id | 64.20062695924764 | 5 | 637 | 40960 miq_ae_values_pkey | 51.36050156739812 | 4 | 637 | 32768 index_miq_ae_values_on_field_id | 51.36050156739812 | 4 | 637 | 32768 index_miq_ae_values_on_instance_id | 51.36050156739812 | 4 | 637 | 32768 vmdb_tables | 216.2904290429043 | 16 | 605 | 131072 vmdb_tables_pkey | 67.59075907590758 | 5 | 605 | 40960 miq_ae_instances | 207.19066147859922 | 13 | 513 | 106496 miq_ae_instances_pkey | 95.62645914396887 | 6 | 513 | 49152 index_miq_ae_instances_on_updated_by_user_id | 79.6887159533074 | 5 | 513 | 40960 index_miq_ae_instances_on_ae_class_id | 79.6887159533074 | 5 | 513 | 40960 miq_tasks | 339.31360946745565 | 7 | 168 | 57344 miq_tasks_pkey | 96.94674556213018 | 2 | 168 | 16384 index_miq_tasks_on_miq_server_id | 96.94674556213018 | 2 | 168 | 16384 sql_sizing | 341.3333333333333 | 1 | 23 | 8192 middleware_messagings | 5213.090909090909 | 14 | 21 | 114688 middleware_messagings_pkey | 744.7272727272727 | 2 | 21 | 16384 index_miq_workers_on_worker_type | 4096.0 | 7 | 13 | 57344 index_miq_workers_on_queue_name | 2925.714285714286 | 5 | 13 | 40960 index_miq_workers_on_guid | 2925.714285714286 | 5 | 13 | 40960 index_miq_workers_on_status | 2925.714285714286 | 5 | 13 | 40960 index_miq_workers_on_miq_server_id | 2340.5714285714284 | 4 | 13 | 32768 miq_workers | 1170.2857142857142 | 2 | 13 | 16384 miq_workers_pkey | 1170.2857142857142 | 2 | 13 | 16384 sql_implementation_info | 630.1538461538462 | 1 | 12 | 8192 sql_packages | 744.7272727272727 | 1 | 10 | 8192 sql_parts | 819.2 | 1 | 9 | 8192 miq_queue_put_idx | 18724.571428571428 | 16 | 6 | 131072 index_miq_queue_on_task_id | 9362.285714285714 | 8 | 6 | 65536 miq_queue_pkey | 8192.0 | 7 | 6 | 57344 miq_queue | 4681.142857142857 | 4 | 6 | 32768 miq_queue_get_idx | 16384.0 | 12 | 5 | 98304 sql_languages | 1638.4 | 1 | 4 | 8192 index_ext_management_systems_on_parent_ems_id | 5461.333333333333 | 2 | 2 | 16384 ext_management_systems_pkey | 5461.333333333333 | 2 | 2 | 16384 index_ext_management_systems_on_guid | 5461.333333333333 | 2 | 2 | 16384 ext_management_systems | 2730.6666666666665 | 1 | 2 | 8192 [----] I, [2016-09-13T10:17:51.845584 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79514], State: [ok], Delivered in [0.00522283] seconds [----] I, [2016-09-13T10:17:51.847292 #2928:34713c] INFO -- : Current client connections data spid | client_address | database | is_waiting | query -------+----------------+-----------------+------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2782 | | vmdb_production | false | SELECT id, lock_version, priority, role FROM "miq_queue" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_17' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 14:17:48.483436') AND (priority <= 200)) ORDER BY "miq_queue"."priority" ASC, "miq_queue"."id" ASC LIMIT $1 2927 | | vmdb_production | false | SELECT pg_backend_pid() 2936 | | vmdb_production | false | SELECT client_addr AS client_address , datname AS database , pid AS spid , waiting AS is_waiting , query FROM pg_stat_activity ORDER BY 1, 2 2946 | | vmdb_production | false | SELECT "storage_managers".* FROM "storage_managers" WHERE "storage_managers"."zone_id" = $1 2955 | | vmdb_production | false | SELECT pg_backend_pid() 2966 | | vmdb_production | false | SELECT pg_backend_pid() 2975 | | vmdb_production | false | SELECT pg_backend_pid() 2986 | | vmdb_production | false | SELECT pg_backend_pid() 2997 | | vmdb_production | false | SELECT "miq_schedules".* FROM "miq_schedules" WHERE (updated_at > '2016-09-13 14:17:29.620835') 3011 | | vmdb_production | false | SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled 3019 | | vmdb_production | false | SELECT "miq_databases".* FROM "miq_databases" ORDER BY "miq_databases"."id" ASC LIMIT $1 3030 | | vmdb_production | false | SELECT 1 3054 | | vmdb_production | false | SELECT "miq_groups"."description" FROM "miq_groups" INNER JOIN "miq_groups_users" ON "miq_groups"."id" = "miq_groups_users"."miq_group_id" WHERE "miq_groups_users"."user_id" = $1 3062 | | vmdb_production | false | SELECT "miq_databases".* FROM "miq_databases" ORDER BY "miq_databases"."id" ASC LIMIT $1 3074 | | vmdb_production | false | SELECT "miq_databases".* FROM "miq_databases" ORDER BY "miq_databases"."id" ASC LIMIT $1 3160 | | vmdb_production | false | SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled 17554 | | vmdb_production | false | SELECT pg_backend_pid() 17563 | | vmdb_production | false | SELECT "blacklisted_events"."event_name" FROM "blacklisted_events" WHERE "blacklisted_events"."ems_id" = $1 AND "blacklisted_events"."enabled" = $2 27056 | | vmdb_production | false | SELECT "miq_servers".* FROM "miq_servers" WHERE "miq_servers"."guid" = $1 LIMIT $2 28888 | | vmdb_production | false | SELECT "ext_management_systems"."id" FROM "ext_management_systems" WHERE "ext_management_systems"."type" IN ('ManageIQ::Providers::Openstack::InfraManager') [----] I, [2016-09-13T10:17:51.847809 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79511], State: [ok], Delivered in [0.328757466] seconds [----] I, [2016-09-13T10:17:53.485052 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:17:53 UTC]... [----] I, [2016-09-13T10:17:53.508140 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:17:53 UTC]...Complete [----] I, [2016-09-13T10:17:53.610940 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:17:54.891465 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79515], MiqWorker id: [14], Zone: [default], Role: [ems_operations], Server: [], Ident: [generic], Target id: [], Instance id: [17], Task id: [], Command: [ExtManagementSystem.authentication_check_types], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[], {}], Dequeued in: [3.101004181] seconds [----] I, [2016-09-13T10:17:54.891652 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79515], Delivering... [----] I, [2016-09-13T10:17:55.348023 #2937:34713c] INFO -- : MIQ(AuthUseridPassword#validation_successful) [ExtManagementSystem] [17], previously valid/invalid on: [2016-09-13 13:29:38 UTC]/[], previous status: [Valid] [----] I, [2016-09-13T10:17:55.393231 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79516], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 17], "ems_auth_valid", {}] [----] I, [2016-09-13T10:17:55.393656 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79515], State: [ok], Delivered in [0.501994844] seconds [----] I, [2016-09-13T10:17:58.626698 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:17:59.771314 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T10:17:59.816801 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79517], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:17:59.838767 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79518], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:17:59.849741 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79519], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:17:59.861193 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79520], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:18:00.936760 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79516], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 17], "ems_auth_valid", {}], Dequeued in: [5.555019547] seconds [----] I, [2016-09-13T10:18:00.936926 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79516], Delivering... [----] I, [2016-09-13T10:18:00.994144 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"ems_auth_valid"> inputs=<{"MiqEvent::miq_event"=>1100, :miq_event_id=>1100, "EventStream::event_stream"=>1100, :event_stream_id=>1100}> [----] I, [2016-09-13T10:18:01.023563 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79521], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>17, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1100, :miq_event_id=>1100, "EventStream::event_stream"=>1100, :event_stream_id=>1100}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T10:18:01.023942 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79516], State: [ok], Delivered in [0.086980324] seconds [----] I, [2016-09-13T10:18:04.716744 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:18:04.721649 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030612945556640625, :worker_monitor=>1.0762102603912354, :worker_dequeue=>0.01060032844543457, :total_time=>1.0901157855987549} [----] I, [2016-09-13T10:18:05.268965 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79517], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.491554572] seconds [----] I, [2016-09-13T10:18:05.269182 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79517], Delivering... [----] I, [2016-09-13T10:18:05.276933 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003674745559692383, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00374603271484375, :pending_vm_jobs=>0.0012505054473876953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0072519779205322266} [----] I, [2016-09-13T10:18:05.277389 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79517], State: [ok], Delivered in [0.008185305] seconds [----] I, [2016-09-13T10:18:05.297703 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79518], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.477283918] seconds [----] I, [2016-09-13T10:18:05.298001 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79518], Delivering... [----] I, [2016-09-13T10:18:05.315024 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79521], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>17, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1100, :miq_event_id=>1100, "EventStream::event_stream"=>1100, :event_stream_id=>1100}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [4.305635641] seconds [----] I, [2016-09-13T10:18:05.315294 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79521], Delivering... [----] I, [2016-09-13T10:18:05.317606 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1100, :miq_event_id=>1100, "EventStream::event_stream"=>1100, :event_stream_id=>1100} for object [ManageIQ::Providers::Hawkular::MiddlewareManager.17] with state [] to Automate [----] I, [2016-09-13T10:18:05.323570 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1100&ExtManagementSystem%3A%3Aext_management_system=17&MiqEvent%3A%3Amiq_event=1100&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1100&event_type=ems_auth_valid&miq_event_id=1100&object_name=Event&vmdb_object_type=ext_management_system] [----] I, [2016-09-13T10:18:05.355965 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1100&ExtManagementSystem%3A%3Aext_management_system=17&MiqEvent%3A%3Amiq_event=1100&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1100&event_type=ems_auth_valid&miq_event_id=1100&object_name=Event&vmdb_object_type=ext_management_system ManageIQ/System] [----] I, [2016-09-13T10:18:05.365961 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79518], State: [ok], Delivered in [0.067947839] seconds [----] I, [2016-09-13T10:18:05.446520 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T10:18:05.469388 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T10:18:05.491652 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/ems_auth_valid] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T10:18:05.512283 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T10:18:05.518230 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T10:18:05.535727 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T10:18:05.544260 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T10:18:05.548656 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#] [----] I, [2016-09-13T10:18:05.548934 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [ems_auth_valid] [----] I, [2016-09-13T10:18:05.578375 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [ems_auth_valid] [----] I, [2016-09-13T10:18:05.578741 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [ems_auth_valid] Target: ManageIQ::Providers::Hawkular::MiddlewareManager Name: [Hawkular-Provider], Id: [17] [----] I, [2016-09-13T10:18:05.588336 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T10:18:05.588943 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T10:18:05.589777 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79521], State: [ok], Delivered in [0.274483009] seconds [----] I, [2016-09-13T10:18:07.074082 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79519], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.231053043] seconds [----] I, [2016-09-13T10:18:07.074218 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79519], Delivering... [----] I, [2016-09-13T10:18:07.076605 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79519], State: [ok], Delivered in [0.002390157] seconds [----] I, [2016-09-13T10:18:07.096908 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79520], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.241471682] seconds [----] I, [2016-09-13T10:18:07.097027 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79520], Delivering... [----] I, [2016-09-13T10:18:07.100448 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79520], State: [ok], Delivered in [0.003392399] seconds [----] I, [2016-09-13T10:18:14.870860 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T10:18:14.891869 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79522], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [3600] [----] I, [2016-09-13T10:18:14.908486 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79523], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:18:21.082752 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:18:21.087107 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003950357437133789, :worker_monitor=>1.3160951137542725, :worker_dequeue=>0.009703636169433594, :total_time=>1.330061435699463} [----] I, [2016-09-13T10:18:21.503140 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79523], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.602573576] seconds [----] I, [2016-09-13T10:18:21.503303 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79523], Delivering... [----] I, [2016-09-13T10:18:21.509379 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031976699829101562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003214597702026367, :pending_vm_jobs=>0.0007419586181640625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005667924880981445} [----] I, [2016-09-13T10:18:21.509741 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79523], State: [ok], Delivered in [0.00642763] seconds [----] I, [2016-09-13T10:18:22.149090 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79522], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [3600], Dequeued in: [7.271954202] seconds [----] I, [2016-09-13T10:18:22.149246 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79522], Delivering... [----] I, [2016-09-13T10:18:22.163721 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79522], State: [ok], Delivered in [0.014440622] seconds [----] I, [2016-09-13T10:18:26.087666 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:18:26 UTC]... [----] I, [2016-09-13T10:18:26.103073 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:18:26 UTC]...Complete [----] I, [2016-09-13T10:18:29.920859 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:18:29.971695 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79524], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:18:29.982889 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79525], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:18:31.126725 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:18:31.211984 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79524], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.285579883] seconds [----] I, [2016-09-13T10:18:31.212157 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79524], Delivering... [----] I, [2016-09-13T10:18:31.218265 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032732486724853516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032913684844970703, :pending_vm_jobs=>0.0007536411285400391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005736351013183594} [----] I, [2016-09-13T10:18:31.218614 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79524], State: [ok], Delivered in [0.006436844] seconds [----] I, [2016-09-13T10:18:31.241598 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79525], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.265613724] seconds [----] I, [2016-09-13T10:18:31.241811 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79525], Delivering... [----] I, [2016-09-13T10:18:31.247574 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79525], State: [ok], Delivered in [0.005737482] seconds [----] I, [2016-09-13T10:18:37.393241 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040111541748046875, :worker_monitor=>1.2505614757537842, :worker_dequeue=>0.006843090057373047, :total_time=>1.2616956233978271} [----] I, [2016-09-13T10:18:44.994729 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T10:18:45.011754 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79526], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:18:45.024444 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79527], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:18:45.035709 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79528], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:18:45.047409 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79529], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.queue_update_registration_status], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:18:47.416820 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:18:47.681771 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79526], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.682304596] seconds [----] I, [2016-09-13T10:18:47.681938 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79526], Delivering... [----] I, [2016-09-13T10:18:47.682791 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T10:18:47.682958 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4559659008 [----] I, [2016-09-13T10:18:47.683033 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4326809600 [----] I, [2016-09-13T10:18:47.683100 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 232849408 [----] I, [2016-09-13T10:18:47.683161 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T10:18:47.683220 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4270120960 [----] I, [2016-09-13T10:18:47.683276 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T10:18:47.683354 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T10:18:47.683443 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 555192320 [----] I, [2016-09-13T10:18:47.683519 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T10:18:47.683581 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6654488576 [----] I, [2016-09-13T10:18:47.683638 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T10:18:47.683695 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T10:18:47.683753 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T10:18:47.683809 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 28672 [----] I, [2016-09-13T10:18:47.683864 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T10:18:47.683922 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T10:18:47.683979 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T10:18:47.684065 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T10:18:47.684132 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T10:18:47.684189 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T10:18:47.684247 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 271867904 [----] I, [2016-09-13T10:18:47.684301 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 54800384 [----] I, [2016-09-13T10:18:47.684378 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217067520 [----] I, [2016-09-13T10:18:47.684474 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6144000 [----] I, [2016-09-13T10:18:47.684558 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141873152 [----] I, [2016-09-13T10:18:47.684659 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3396538368 [----] I, [2016-09-13T10:18:47.684749 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3068461056 [----] I, [2016-09-13T10:18:47.684813 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T10:18:47.684868 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T10:18:47.684924 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T10:18:47.684980 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36364288 [----] I, [2016-09-13T10:18:47.685035 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102281216 [----] I, [2016-09-13T10:18:47.685093 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53698560 [----] I, [2016-09-13T10:18:47.685147 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111497216 [----] I, [2016-09-13T10:18:47.685205 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155979776 [----] I, [2016-09-13T10:18:47.685258 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T10:18:47.685316 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T10:18:47.685393 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T10:18:47.685487 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T10:18:47.685551 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T10:18:47.685607 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T10:18:47.685664 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T10:18:47.685725 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T10:18:47.685788 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T10:18:47.734704 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T10:18:47.734924 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T10:18:47.738144 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T10:18:47.740512 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T10:18:47.743274 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T10:18:47.746050 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T10:18:47.748746 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T10:18:47.751293 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 854 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T10:18:47.753812 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T10:18:47.756245 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T10:18:47.758795 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T10:18:47.761305 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T10:18:47.763887 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T10:18:47.766455 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T10:18:47.768934 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:18:47.769051 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:18:47.769146 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T10:18:47.772873 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201169000], Memory % [3.36], CPU Time [152998.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:18:47.773219 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79526], State: [ok], Delivered in [0.091268104] seconds [----] I, [2016-09-13T10:18:47.813551 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79527], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.797343394] seconds [----] I, [2016-09-13T10:18:47.813735 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79527], Delivering... [----] I, [2016-09-13T10:18:47.820652 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:18:34 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347779000], Memory % [5.04], CPU Time [105876.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T10:18:47.821160 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:18:36 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202685000], Memory % [3.38], CPU Time [153007.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:18:47.821573 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:18:29 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [213405000], Memory % [3.5], CPU Time [49646.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T10:18:47.822038 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:18:36 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169745000], Memory % [3.14], CPU Time [52344.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:18:47.822532 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:18:34 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163149000], Memory % [3.1], CPU Time [38546.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T10:18:47.822991 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:18:34 UTC], Process Info: Memory Usage [433238016], Memory Size [734044160], Proportional Set Size: [359319000], Memory % [5.28], CPU Time [207134.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T10:18:47.823457 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:18:29 UTC], Process Info: Memory Usage [286867456], Memory Size [627494912], Proportional Set Size: [206068000], Memory % [3.5], CPU Time [243829.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T10:18:47.823900 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:18:36 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201169000], Memory % [3.36], CPU Time [153918.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:18:47.826499 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:18:28 UTC], Process Info: Memory Usage [601792512], Memory Size [932499456], Proportional Set Size: [440425000], Memory % [7.34], CPU Time [992.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T10:18:47.828243 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:18:28 UTC], Process Info: Memory Usage [601460736], Memory Size [945954816], Proportional Set Size: [439687000], Memory % [7.33], CPU Time [378.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T10:18:47.828739 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:18:34 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358594000], Memory % [5.27], CPU Time [212999.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T10:18:47.829169 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:18:36 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178471000], Memory % [3.2], CPU Time [52330.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:18:47.829589 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:18:36 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166758000], Memory % [3.16], CPU Time [39447.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T10:18:47.829924 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79527], State: [ok], Delivered in [0.016185832] seconds [----] I, [2016-09-13T10:18:47.865033 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79528], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.834853276] seconds [----] I, [2016-09-13T10:18:47.865239 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79528], Delivering... [----] I, [2016-09-13T10:18:47.871979 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036323070526123047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003651142120361328, :pending_vm_jobs=>0.0008516311645507812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00632786750793457} [----] I, [2016-09-13T10:18:47.872496 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79528], State: [ok], Delivered in [0.007217544] seconds [----] I, [2016-09-13T10:18:49.310475 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79529], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.queue_update_registration_status], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.270571841] seconds [----] I, [2016-09-13T10:18:49.310657 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79529], Delivering... [----] I, [2016-09-13T10:18:49.313295 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79529], State: [ok], Delivered in [0.002623575] seconds [----] I, [2016-09-13T10:18:58.117256 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:18:58 UTC]... [----] I, [2016-09-13T10:18:58.134745 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:18:58 UTC]...Complete [----] I, [2016-09-13T10:19:00.059559 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:19:00.076933 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79530], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:19:00.087196 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79531], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:19:00.098680 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79532], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:19:00.116080 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79533], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:19:03.252450 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:19:03.979216 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79530], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.913869291] seconds [----] I, [2016-09-13T10:19:03.979453 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79530], Delivering... [----] I, [2016-09-13T10:19:03.986308 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033676624298095703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003387451171875, :pending_vm_jobs=>0.0007946491241455078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006457805633544922} [----] I, [2016-09-13T10:19:03.986670 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79530], State: [ok], Delivered in [0.007241996] seconds [----] I, [2016-09-13T10:19:04.019148 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79531], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.938120817] seconds [----] I, [2016-09-13T10:19:04.019363 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79531], Delivering... [----] I, [2016-09-13T10:19:04.087675 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79531], State: [ok], Delivered in [0.068309013] seconds [----] I, [2016-09-13T10:19:04.402217 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79532], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.309753698] seconds [----] I, [2016-09-13T10:19:04.402507 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79532], Delivering... [----] I, [2016-09-13T10:19:04.405736 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79532], State: [ok], Delivered in [0.003221591] seconds [----] I, [2016-09-13T10:19:04.459592 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79533], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.353307566] seconds [----] I, [2016-09-13T10:19:04.459858 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79533], Delivering... [----] I, [2016-09-13T10:19:04.466209 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79533], State: [ok], Delivered in [0.00636791] seconds [----] I, [2016-09-13T10:19:09.593738 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004109859466552734, :worker_monitor=>1.3213834762573242, :worker_dequeue=>0.011760234832763672, :total_time=>1.3375439643859863} [----] I, [2016-09-13T10:19:15.128055 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T10:19:15.144725 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79534], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:19:15.179351 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79535], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:19:19.615369 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:19:20.110559 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79534], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.97659658] seconds [----] I, [2016-09-13T10:19:20.110764 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79534], Delivering... [----] I, [2016-09-13T10:19:20.117204 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034863948822021484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003505706787109375, :pending_vm_jobs=>0.0007681846618652344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006096363067626953} [----] I, [2016-09-13T10:19:20.117535 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79534], State: [ok], Delivered in [0.006761095] seconds [----] I, [2016-09-13T10:19:22.544785 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79535], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.384374846] seconds [----] I, [2016-09-13T10:19:22.544967 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79535], Delivering... [----] I, [2016-09-13T10:19:22.567920 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79536], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T10:19:22.568345 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79535], State: [ok], Delivered in [0.023356892] seconds [----] I, [2016-09-13T10:19:25.776884 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T10:19:25.777040 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003950834274291992, :worker_monitor=>1.1467928886413574, :worker_dequeue=>0.006858348846435547, :total_time=>1.157874345779419} [----] I, [2016-09-13T10:19:28.957651 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [79536], MiqWorker id: [102], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [6.397688113] seconds [----] I, [2016-09-13T10:19:28.957936 #17546:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79536], Delivering... [----] I, [2016-09-13T10:19:28.962358 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T10:19:28.962579 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T10:19:28.962717 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T10:19:28.962919 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T10:19:28.963142 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:29.460791 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:29.798308 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:29.798612 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:30.196083 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T10:19:30.213379 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79537], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:19:30.230746 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79538], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:19:30.250867 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79539], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:19:30.359513 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:30.679362 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:30.679524 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:30.777405 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:19:30 UTC]... [----] I, [2016-09-13T10:19:30.790566 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:19:30 UTC]...Complete [----] I, [2016-09-13T10:19:30.800989 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:19:31.213617 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79537], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.011436451] seconds [----] I, [2016-09-13T10:19:31.213780 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79537], Delivering... [----] I, [2016-09-13T10:19:31.219763 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030994415283203125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003118276596069336, :pending_vm_jobs=>0.0007810592651367188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005662679672241211} [----] I, [2016-09-13T10:19:31.220040 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79537], State: [ok], Delivered in [0.006257814] seconds [----] I, [2016-09-13T10:19:31.333151 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:31.608120 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79538], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.390416709] seconds [----] I, [2016-09-13T10:19:31.608292 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79538], Delivering... [----] I, [2016-09-13T10:19:31.649755 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:31.649939 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:31.653849 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79539], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.418676469] seconds [----] I, [2016-09-13T10:19:31.654082 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79539], Delivering... [----] I, [2016-09-13T10:19:31.659715 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79539], State: [ok], Delivered in [0.005624812] seconds [----] I, [2016-09-13T10:19:31.702093 #2928:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 14:19:30 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_17' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 14:19:30.803172') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2927,,2016-09-13 14:19:31 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2936,2016-09-13 14:19:31 UTC,2016-09-13 14:19:31 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2946,,2016-09-13 14:19:28 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3, 2955,,2016-09-13 14:19:31 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 14:19:31 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 14:19:30 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2986,,2016-09-13 14:19:30 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2997,,2016-09-13 14:19:30 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 14:19:15.191028')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 3011,,2016-09-13 13:55:47 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1424, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,518526, 3030,,2016-09-13 13:41:26 UTC,SELECT 1,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2285, 3054,,2016-09-13 14:18:25 UTC,"SELECT ""miq_groups"".""description"" FROM ""miq_groups"" INNER JOIN ""miq_groups_users"" ON ""miq_groups"".""id"" = ""miq_groups_users"".""miq_group_id"" WHERE ""miq_groups_users"".""user_id"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,66, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,518525, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,518524, 3160,,2016-09-13 13:55:44 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1426, 17554,,2016-09-13 14:19:28 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 17563,,2016-09-13 13:55:47 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1424, 27056,,2016-09-13 14:19:25 UTC,"SELECT ""miq_groups"".""description"" FROM ""miq_groups"" INNER JOIN ""miq_groups_users"" ON ""miq_groups"".""id"" = ""miq_groups_users"".""miq_group_id"" WHERE ""miq_groups_users"".""user_id"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,6, 28888,,2016-09-13 13:41:23 UTC,"SELECT ""ext_management_systems"".""id"" FROM ""ext_management_systems"" WHERE ""ext_management_systems"".""type"" IN ('ManageIQ::Providers::Openstack::InfraManager')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2288, ACTIVITY_STATS_CSV [----] I, [2016-09-13T10:19:31.702551 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79538], State: [ok], Delivered in [0.094236349] seconds [----] I, [2016-09-13T10:19:32.124156 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:32.434678 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:32.434856 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:32.968392 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:33.297066 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:33.297256 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:33.776625 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:34.098809 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:34.099044 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:34.636305 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:35.003297 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:35.003546 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:35.657733 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:35.964278 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:35.964487 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:36.432533 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:36.752145 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:36.752388 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:37.230489 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:37.526496 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:37.526690 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:37.989205 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:38.293995 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:38.294239 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:38.846952 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:39.214165 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:39.214378 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:39.776776 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:40.195186 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:40.195439 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:40.898850 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:41.073782 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:41.225389 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:41.367545 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:41.498747 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:41.634677 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:41.788544 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:41.942211 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:42.079588 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:42.218648 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:42.354277 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:42.487143 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:42.630136 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:42.765365 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:42.897143 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:43.229135 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:43.381647 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:43.591608 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:43.766593 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:43.916619 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:44.058796 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:44.197946 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:44.342284 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:44.479369 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:44.626237 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:44.764665 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:44.913329 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:45.052681 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:45.213001 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:45.262754 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:19:45.282000 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79540], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:19:45.353141 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:45.503273 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:45.649992 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:46.278992 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:46.781622 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:19:47.350989 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79540], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.081397008] seconds [----] I, [2016-09-13T10:19:47.351162 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79540], Delivering... [----] I, [2016-09-13T10:19:47.357621 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033838748931884766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034019947052001953, :pending_vm_jobs=>0.0007789134979248047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006042003631591797} [----] I, [2016-09-13T10:19:47.358002 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79540], State: [ok], Delivered in [0.006831765] seconds [----] I, [2016-09-13T10:19:52.479510 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:52.620139 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:52.777676 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:52.924380 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:53.057654 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:53.196061 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:53.330828 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:53.472453 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:53.610074 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:53.754222 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:53.896570 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:54.040139 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:54.179587 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:54.326823 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:54.467865 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:54.605808 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:55.112059 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:55.260636 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:55.399492 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:55.535670 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:55.673336 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:55.838247 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:55.979659 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:56.113751 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:56.250241 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:56.393568 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:56.536054 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:56.677301 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:56.817024 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:56.957933 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:57.097345 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:57.238143 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:57.373766 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:57.787056 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:57.939925 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002917766571044922, :worker_monitor=>1.1288323402404785, :worker_dequeue=>0.006791830062866211, :total_time=>1.1387641429901123} [----] I, [2016-09-13T10:19:58.932166 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:59.077117 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:59.218377 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:59.354338 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:59.496069 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:59.646304 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:59.791162 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:19:59.932500 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:00.074949 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:00.210454 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:00.293810 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:20:00.322300 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79541], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:20:00.339340 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79542], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:20:00.349068 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:00.356591 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79543], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:20:00.379505 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79544], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:20:00.486538 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:00.626719 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:00.766693 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:00.916207 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:01.067768 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:01.463829 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:01.631586 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:01.777224 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:01.915383 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:02.055285 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:02.188624 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:02.332720 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:02.481147 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:02.618839 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:02.765249 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:02.940504 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:20:02 UTC]... [----] I, [2016-09-13T10:20:02.961976 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:20:02 UTC]...Complete [----] I, [2016-09-13T10:20:03.100310 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:20:03.482693 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79541], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.181433945] seconds [----] I, [2016-09-13T10:20:03.482875 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79541], Delivering... [----] I, [2016-09-13T10:20:03.489511 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003222227096557617, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003239154815673828, :pending_vm_jobs=>0.0012676715850830078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062236785888671875} [----] I, [2016-09-13T10:20:03.489873 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79541], State: [ok], Delivered in [0.00699184] seconds [----] I, [2016-09-13T10:20:03.505366 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79542], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.179369531] seconds [----] I, [2016-09-13T10:20:03.505503 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79542], Delivering... [----] I, [2016-09-13T10:20:03.591801 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79542], State: [ok], Delivered in [0.08624839] seconds [----] I, [2016-09-13T10:20:04.797217 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79543], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.452960819] seconds [----] I, [2016-09-13T10:20:04.797565 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79543], Delivering... [----] I, [2016-09-13T10:20:04.802331 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79543], State: [ok], Delivered in [0.004746536] seconds [----] I, [2016-09-13T10:20:04.843286 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79544], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.479435336] seconds [----] I, [2016-09-13T10:20:04.843650 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79544], Delivering... [----] I, [2016-09-13T10:20:04.851062 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79544], State: [ok], Delivered in [0.007394279] seconds [----] I, [2016-09-13T10:20:08.922577 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:09.063168 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:09.199845 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:09.341549 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:09.485335 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:09.624494 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:09.764401 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:10.143234 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:10.293740 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:10.435694 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:10.575757 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:10.721245 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:10.859055 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:11.003205 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:11.144657 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:11.281552 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:11.422696 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:11.560193 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:11.708737 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:11.864219 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:12.014182 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:12.162718 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:12.300654 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:12.453125 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:12.875610 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:13.048923 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:13.186460 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:13.333208 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:13.469106 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:13.610823 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:13.755621 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:13.903951 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:14.043012 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:14.186342 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:14.275025 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038230419158935547, :worker_monitor=>1.13972806930542, :worker_dequeue=>0.006319761276245117, :total_time=>1.150099515914917} [----] I, [2016-09-13T10:20:14.329577 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:14.481577 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:14.620624 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:14.752349 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:14.892490 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:15.027908 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:15.164582 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:15.389658 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T10:20:15.408324 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79545], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:20:15.424528 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79546], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:20:15.453066 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79547], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:20:15.471017 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79548], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:20:15.639335 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:15.796667 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:15.934836 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:16.075405 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:16.218212 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:16.370290 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:16.511263 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:16.651103 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:16.789649 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:16.930778 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:17.071065 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:17.210627 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:17.352222 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:17.491591 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:17.635895 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:17.771094 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:17.912280 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:18.506599 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:18.657444 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:18.796342 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:18.945474 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:19.091259 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:19.229454 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:19.288034 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T10:20:19.292046 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:20:19.374715 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:19.510681 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:19.654524 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:19.694349 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79548], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.237108309] seconds [----] I, [2016-09-13T10:20:19.694562 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79548], Delivering... [----] I, [2016-09-13T10:20:19.700554 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031135082244873047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003133535385131836, :pending_vm_jobs=>0.0007748603820800781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005657672882080078} [----] I, [2016-09-13T10:20:19.700893 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79548], State: [ok], Delivered in [0.006328823] seconds [----] I, [2016-09-13T10:20:19.792680 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:19.871745 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79545], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.47614578] seconds [----] I, [2016-09-13T10:20:19.871946 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79545], Delivering... [----] I, [2016-09-13T10:20:19.874558 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79545], State: [ok], Delivered in [0.002599788] seconds [----] I, [2016-09-13T10:20:19.916358 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79546], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.504127215] seconds [----] I, [2016-09-13T10:20:19.916513 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79546], Delivering... [----] I, [2016-09-13T10:20:19.923102 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79546], State: [ok], Delivered in [0.006568388] seconds [----] I, [2016-09-13T10:20:19.928619 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79547], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.500310601] seconds [----] I, [2016-09-13T10:20:19.928749 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79547], Delivering... [----] I, [2016-09-13T10:20:19.931935 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79547], State: [ok], Delivered in [0.003176693] seconds [----] I, [2016-09-13T10:20:25.960350 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:26.097027 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:26.239790 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:26.383353 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:26.524031 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:26.668114 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:26.813386 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:27.395508 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:27.558243 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:27.701065 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:27.846283 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:27.982403 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:28.122720 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:28.263945 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:28.408581 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:28.630001 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:28.836051 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:28.975307 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:29.116961 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:29.256724 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:29.394248 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:29.541838 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:29.688221 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:29.832306 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:30.354593 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003672361373901367, :worker_monitor=>1.03322434425354, :worker_dequeue=>0.00812077522277832, :total_time=>1.0453698635101318} [----] I, [2016-09-13T10:20:30.362558 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:30.480246 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:20:30.500091 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79549], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:20:30.522614 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79550], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:20:30.529826 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:30.669436 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:30.813904 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:30.972437 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:31.127721 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:31.268289 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:31.416240 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:31.567639 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:31.708801 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:31.842338 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:31.983574 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:32.129085 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:32.277017 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:32.421722 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:32.561165 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:32.694401 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:33.019774 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:33.227056 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:33.362687 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:33.501965 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:33.642087 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:33.786396 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:33.929640 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:34.072502 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:34.213775 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:34.399309 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:34.540741 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:34.676283 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:34.820745 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:34.959112 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:35.103728 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:35.242611 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:35.355120 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:20:35 UTC]... [----] I, [2016-09-13T10:20:35.374121 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:20:35 UTC]...Complete [----] I, [2016-09-13T10:20:35.379383 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:35.388169 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:20:35.814691 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79549], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.329043859] seconds [----] I, [2016-09-13T10:20:35.814864 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79549], Delivering... [----] I, [2016-09-13T10:20:35.822698 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033690929412841797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003390789031982422, :pending_vm_jobs=>0.0012176036834716797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007435798645019531} [----] I, [2016-09-13T10:20:35.823120 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79549], State: [ok], Delivered in [0.008225651] seconds [----] I, [2016-09-13T10:20:35.890881 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:36.040980 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:36.185957 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:36.341845 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:36.487150 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:36.626190 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:36.764777 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:38.008787 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79550], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.504382933] seconds [----] I, [2016-09-13T10:20:38.008963 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79550], Delivering... [----] I, [2016-09-13T10:20:38.013679 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79550], State: [ok], Delivered in [0.004688044] seconds [----] I, [2016-09-13T10:20:42.961812 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:43.109948 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:43.249447 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:43.387041 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:43.524579 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:43.669128 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:43.808009 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:43.940558 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:44.076403 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:20:44.220958 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T10:20:44.429338 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T10:20:44.429697 #17546:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T10:20:44.430063 #17546:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T10:20:44.430146 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T10:20:44.430246 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T10:20:44.454548 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T10:20:44.454874 #17546:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [79536], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T10:20:44.455145 #17546:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T10:20:44.455401 #17546:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T10:20:44.455590 #17546:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79536], State: [error], Delivered in [75.49769021] seconds [----] I, [2016-09-13T10:20:45.532459 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:20:45.557358 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79551], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:20:46.840653 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:20:46.845349 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004117250442504883, :worker_monitor=>1.4285917282104492, :worker_dequeue=>0.010209083557128906, :total_time=>1.443298101425171} [----] I, [2016-09-13T10:20:46.934833 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79551], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.393163373] seconds [----] I, [2016-09-13T10:20:46.935060 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79551], Delivering... [----] I, [2016-09-13T10:20:46.942400 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003804922103881836, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038290023803710938, :pending_vm_jobs=>0.0009074211120605469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006928920745849609} [----] I, [2016-09-13T10:20:46.942871 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79551], State: [ok], Delivered in [0.007802418] seconds [----] I, [2016-09-13T10:21:00.572582 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:21:00.591381 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79552], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:21:00.608700 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79553], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:21:00.637544 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79554], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:21:00.659994 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79555], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:21:03.287118 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:21:03.291965 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0059812068939208984, :worker_monitor=>1.4038994312286377, :worker_dequeue=>0.010311126708984375, :total_time=>1.4206414222717285} [----] I, [2016-09-13T10:21:04.112369 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79552], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.533999305] seconds [----] I, [2016-09-13T10:21:04.112640 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79552], Delivering... [----] I, [2016-09-13T10:21:04.119849 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038361549377441406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038614273071289062, :pending_vm_jobs=>0.0009655952453613281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0067729949951171875} [----] I, [2016-09-13T10:21:04.120296 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79552], State: [ok], Delivered in [0.007661199] seconds [----] I, [2016-09-13T10:21:04.140649 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79553], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.546377881] seconds [----] I, [2016-09-13T10:21:04.140821 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79553], Delivering... [----] I, [2016-09-13T10:21:04.197752 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79553], State: [ok], Delivered in [0.056890031] seconds [----] I, [2016-09-13T10:21:05.100254 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79554], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.488064123] seconds [----] I, [2016-09-13T10:21:05.100397 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79554], Delivering... [----] I, [2016-09-13T10:21:05.102467 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79554], State: [ok], Delivered in [0.002069542] seconds [----] I, [2016-09-13T10:21:05.134724 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79555], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.488753939] seconds [----] I, [2016-09-13T10:21:05.134859 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79555], Delivering... [----] I, [2016-09-13T10:21:05.137764 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79555], State: [ok], Delivered in [0.002899652] seconds [----] I, [2016-09-13T10:21:08.292534 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:21:08 UTC]... [----] I, [2016-09-13T10:21:08.351733 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:21:08 UTC]...Complete [----] I, [2016-09-13T10:21:15.672351 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:21:15.694622 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79556], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:21:19.768378 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:21:19.774810 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038614273071289062, :worker_monitor=>1.2422492504119873, :worker_dequeue=>0.01344609260559082, :total_time=>1.2598443031311035} [----] I, [2016-09-13T10:21:20.163353 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79556], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.484971546] seconds [----] I, [2016-09-13T10:21:20.163480 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79556], Delivering... [----] I, [2016-09-13T10:21:20.167012 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0018773078918457031, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.001888275146484375, :pending_vm_jobs=>0.00042366981506347656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003308534622192383} [----] I, [2016-09-13T10:21:20.167219 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79556], State: [ok], Delivered in [0.003739916] seconds [----] I, [2016-09-13T10:21:30.708672 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:21:30.741880 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79557], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:21:30.758036 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79558], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:21:36.284022 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:21:36.287287 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036890506744384766, :worker_monitor=>1.473273754119873, :worker_dequeue=>0.006991863250732422, :total_time=>1.4842283725738525} [----] I, [2016-09-13T10:21:36.397786 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79557], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.683208923] seconds [----] I, [2016-09-13T10:21:36.397962 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79557], Delivering... [----] I, [2016-09-13T10:21:36.404219 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032978057861328125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003320932388305664, :pending_vm_jobs=>0.0007293224334716797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058863162994384766} [----] I, [2016-09-13T10:21:36.404590 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79557], State: [ok], Delivered in [0.00662061] seconds [----] I, [2016-09-13T10:21:38.250812 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79558], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.504774062] seconds [----] I, [2016-09-13T10:21:38.250987 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79558], Delivering... [----] I, [2016-09-13T10:21:38.255666 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79558], State: [ok], Delivered in [0.004636338] seconds [----] I, [2016-09-13T10:21:41.287790 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:21:41 UTC]... [----] I, [2016-09-13T10:21:41.300007 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:21:41 UTC]...Complete [----] I, [2016-09-13T10:21:45.769842 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:21:45.786015 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79559], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:21:46.313784 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:21:46.460255 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79559], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.684249168] seconds [----] I, [2016-09-13T10:21:46.460471 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79559], Delivering... [----] I, [2016-09-13T10:21:46.466279 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030269622802734375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030450820922851562, :pending_vm_jobs=>0.0007441043853759766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005460262298583984} [----] I, [2016-09-13T10:21:46.466618 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79559], State: [ok], Delivered in [0.006174214] seconds [----] I, [2016-09-13T10:21:52.677369 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005487680435180664, :worker_monitor=>1.3467581272125244, :worker_dequeue=>0.00830531120300293, :total_time=>1.3609602451324463} [----] I, [2016-09-13T10:22:00.796906 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:22:00.808714 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79560], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:22:00.826213 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79561], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:22:00.843266 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79562], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:22:00.860219 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79563], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:22:02.697703 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:22:03.603749 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79560], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.802940833] seconds [----] I, [2016-09-13T10:22:03.603926 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79560], Delivering... [----] I, [2016-09-13T10:22:03.609762 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79561], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.798299544] seconds [----] I, [2016-09-13T10:22:03.610040 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79561], Delivering... [----] I, [2016-09-13T10:22:03.610751 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003124237060546875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031557083129882812, :pending_vm_jobs=>0.0007302761077880859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006436347961425781} [----] I, [2016-09-13T10:22:03.611239 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79560], State: [ok], Delivered in [0.007284892] seconds [----] I, [2016-09-13T10:22:03.660785 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79561], State: [ok], Delivered in [0.050715145] seconds [----] I, [2016-09-13T10:22:05.318006 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79562], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.486255345] seconds [----] I, [2016-09-13T10:22:05.318211 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79562], Delivering... [----] I, [2016-09-13T10:22:05.325159 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79562], State: [ok], Delivered in [0.006938104] seconds [----] I, [2016-09-13T10:22:05.369725 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79563], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.520405536] seconds [----] I, [2016-09-13T10:22:05.369938 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79563], Delivering... [----] I, [2016-09-13T10:22:05.374334 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79563], State: [ok], Delivered in [0.004380796] seconds [----] I, [2016-09-13T10:22:09.061508 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036835670471191406, :worker_monitor=>1.3464794158935547, :worker_dequeue=>0.00860595703125, :total_time=>1.3590874671936035} [----] I, [2016-09-13T10:22:14.062116 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:22:14 UTC]... [----] I, [2016-09-13T10:22:14.083461 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:22:14 UTC]...Complete [----] I, [2016-09-13T10:22:15.868436 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:22:15.883469 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79564], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:22:19.218983 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:22:19.809221 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79564], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.935662022] seconds [----] I, [2016-09-13T10:22:19.809387 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79564], Delivering... [----] I, [2016-09-13T10:22:19.814212 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025358200073242188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025513172149658203, :pending_vm_jobs=>0.0006220340728759766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004501819610595703} [----] I, [2016-09-13T10:22:19.814510 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79564], State: [ok], Delivered in [0.005122685] seconds [----] I, [2016-09-13T10:22:25.364589 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003262042999267578, :worker_monitor=>1.1282615661621094, :worker_dequeue=>0.009218931198120117, :total_time=>1.1409831047058105} [----] I, [2016-09-13T10:22:30.892604 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:22:30.906633 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79565], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:22:30.924321 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79566], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:22:35.386552 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:22:35.815830 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79565], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.918611124] seconds [----] I, [2016-09-13T10:22:35.816000 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79565], Delivering... [----] I, [2016-09-13T10:22:35.820743 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026082992553710938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026237964630126953, :pending_vm_jobs=>0.0005512237548828125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0044405460357666016} [----] I, [2016-09-13T10:22:35.820994 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79565], State: [ok], Delivered in [0.005002159] seconds [----] I, [2016-09-13T10:22:35.884377 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79566], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.974392981] seconds [----] I, [2016-09-13T10:22:35.884586 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79566], Delivering... [----] I, [2016-09-13T10:22:35.888689 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79566], State: [ok], Delivered in [0.004097635] seconds [----] I, [2016-09-13T10:22:41.706402 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004067897796630859, :worker_monitor=>1.3006606101989746, :worker_dequeue=>0.007091522216796875, :total_time=>1.3121922016143799} [----] I, [2016-09-13T10:22:45.935925 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T10:22:45.981161 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79567], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:22:46.021223 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79568], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [EmsEvent.purge_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:22:46.045432 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79569], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [PolicyEvent.purge_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:22:46.707917 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:22:46 UTC]... [----] I, [2016-09-13T10:22:46.729599 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:22:46 UTC]...Complete [----] I, [2016-09-13T10:22:46.741804 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:22:47.325805 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79567], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.383229744] seconds [----] I, [2016-09-13T10:22:47.326076 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79567], Delivering... [----] I, [2016-09-13T10:22:47.334688 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004597902297973633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0046236515045166016, :pending_vm_jobs=>0.0009610652923583984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00807809829711914} [----] I, [2016-09-13T10:22:47.335062 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79567], State: [ok], Delivered in [0.009006291] seconds [----] I, [2016-09-13T10:22:47.890121 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79568], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [EmsEvent.purge_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.893662173] seconds [----] I, [2016-09-13T10:22:47.890286 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79568], Delivering... [----] I, [2016-09-13T10:22:47.930168 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79570], id: [], Zone: [default], Role: [event], Server: [], Ident: [ems], Target id: [], Instance id: [], Task id: [], Command: [EmsEvent.purge], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 14:22:47 UTC] [----] I, [2016-09-13T10:22:47.930594 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79568], State: [ok], Delivered in [0.040279106] seconds [----] I, [2016-09-13T10:22:47.964070 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79569], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [PolicyEvent.purge_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.930793986] seconds [----] I, [2016-09-13T10:22:47.964240 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79569], Delivering... [----] I, [2016-09-13T10:22:47.986779 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79571], id: [], Zone: [default], Role: [event], Server: [], Ident: [ems], Target id: [], Instance id: [], Task id: [], Command: [PolicyEvent.purge], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:22:47.987114 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79569], State: [ok], Delivered in [0.022916603] seconds [----] I, [2016-09-13T10:22:51.760262 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=ems, wcount=1, priority=200 [----] I, [2016-09-13T10:22:52.747560 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#get_message_via_drb) Message id: [79570], MiqWorker id: [12], Zone: [default], Role: [event], Server: [], Ident: [ems], Target id: [], Instance id: [], Task id: [], Command: [EmsEvent.purge], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 14:22:47 UTC], Dequeued in: [4.853875892] seconds [----] I, [2016-09-13T10:22:52.747742 #2918:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79570], Delivering... [----] I, [2016-09-13T10:22:52.748000 #2918:34713c] INFO -- : MIQ(EmsEvent.purge) Purging all events older than [2016-03-17 14:22:47 UTC]... [----] I, [2016-09-13T10:22:52.753055 #2918:34713c] INFO -- : MIQ(EmsEvent.purge) Purging all events older than [2016-03-17 14:22:47 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T10:22:52.753405 #2918:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79570], State: [ok], Delivered in [0.005647812] seconds [----] I, [2016-09-13T10:22:52.776815 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#get_message_via_drb) Message id: [79571], MiqWorker id: [12], Zone: [default], Role: [event], Server: [], Ident: [ems], Target id: [], Instance id: [], Task id: [], Command: [PolicyEvent.purge], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.809615583] seconds [----] I, [2016-09-13T10:22:52.776988 #2918:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79571], Delivering... [----] I, [2016-09-13T10:22:52.780109 #2918:34713c] INFO -- : MIQ(PolicyEvent.purge_by_date) Purging Policy events older than [2016-03-17 14:22:52 UTC]... [----] I, [2016-09-13T10:22:52.782035 #2918:34713c] INFO -- : MIQ(PolicyEvent.purge_by_date) Purging Policy events older than [2016-03-17 14:22:52 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T10:22:52.782375 #2918:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79571], State: [ok], Delivered in [0.005384026] seconds [----] I, [2016-09-13T10:22:58.452146 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004775524139404297, :worker_monitor=>1.6665043830871582, :worker_dequeue=>0.009124994277954102, :total_time=>1.6808712482452393} [----] I, [2016-09-13T10:23:01.055755 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T10:23:01.074815 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79572], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:23:01.098068 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79573], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:23:01.120899 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79574], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:23:01.149639 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79575], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:23:01.172295 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79576], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:23:03.471739 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:23:04.521067 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79572], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.459183855] seconds [----] I, [2016-09-13T10:23:04.521271 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79572], Delivering... [----] I, [2016-09-13T10:23:04.529452 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004105567932128906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004229307174682617, :pending_vm_jobs=>0.0009596347808837891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007646322250366211} [----] I, [2016-09-13T10:23:04.529873 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79572], State: [ok], Delivered in [0.008583766] seconds [----] I, [2016-09-13T10:23:04.543905 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79573], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.464762654] seconds [----] I, [2016-09-13T10:23:04.544110 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79573], Delivering... [----] I, [2016-09-13T10:23:04.611580 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79573], State: [ok], Delivered in [0.067445474] seconds [----] I, [2016-09-13T10:23:06.034713 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79574], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.92805824] seconds [----] I, [2016-09-13T10:23:06.034947 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79574], Delivering... [----] I, [2016-09-13T10:23:06.038547 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79574], State: [ok], Delivered in [0.003584473] seconds [----] I, [2016-09-13T10:23:06.063325 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79575], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.927562774] seconds [----] I, [2016-09-13T10:23:06.063606 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79575], Delivering... [----] I, [2016-09-13T10:23:06.064008 #2937:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Starting [----] I, [2016-09-13T10:23:06.072125 #2937:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Complete [----] I, [2016-09-13T10:23:06.072623 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79575], State: [ok], Delivered in [0.008990786] seconds [----] I, [2016-09-13T10:23:06.086045 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79576], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.931772108] seconds [----] I, [2016-09-13T10:23:06.086258 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79576], Delivering... [----] I, [2016-09-13T10:23:06.091841 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79576], State: [ok], Delivered in [0.005575147] seconds [----] I, [2016-09-13T10:23:14.700543 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003306150436401367, :worker_monitor=>1.1976573467254639, :worker_dequeue=>0.006489276885986328, :total_time=>1.2081091403961182} [----] I, [2016-09-13T10:23:16.183531 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:23:16.200281 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79577], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:23:19.701014 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:23:19 UTC]... [----] I, [2016-09-13T10:23:19.726057 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:23:19 UTC]...Complete [----] I, [2016-09-13T10:23:19.907054 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:23:20.749176 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79577], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.559979919] seconds [----] I, [2016-09-13T10:23:20.749439 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79577], Delivering... [----] I, [2016-09-13T10:23:20.757410 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004106044769287109, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004135847091674805, :pending_vm_jobs=>0.0010504722595214844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007517099380493164} [----] I, [2016-09-13T10:23:20.757799 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79577], State: [ok], Delivered in [0.008377634] seconds [----] I, [2016-09-13T10:23:31.211268 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T10:23:31.234493 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79578], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:23:31.274999 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79579], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:23:31.297407 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79580], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:23:31.297782 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:23:31.300778 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00299835205078125, :worker_monitor=>1.3643274307250977, :worker_dequeue=>0.006568193435668945, :total_time=>1.3741703033447266} [----] I, [2016-09-13T10:23:31.329030 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79581], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:23:31.812931 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79578], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.595576615] seconds [----] I, [2016-09-13T10:23:31.813171 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79578], Delivering... [----] I, [2016-09-13T10:23:31.821453 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038716793060302734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003903627395629883, :pending_vm_jobs=>0.001138925552368164, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0077056884765625} [----] I, [2016-09-13T10:23:31.821854 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79578], State: [ok], Delivered in [0.008672677] seconds [----] I, [2016-09-13T10:23:31.851780 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79580], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.570852015] seconds [----] I, [2016-09-13T10:23:31.851908 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79580], Delivering... [----] I, [2016-09-13T10:23:31.852836 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T10:23:31.852960 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4570808320 [----] I, [2016-09-13T10:23:31.853016 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4337680384 [----] I, [2016-09-13T10:23:31.853068 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 233127936 [----] I, [2016-09-13T10:23:31.853117 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T10:23:31.853165 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4280991744 [----] I, [2016-09-13T10:23:31.853210 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T10:23:31.853289 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T10:23:31.853354 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 555474944 [----] I, [2016-09-13T10:23:31.853407 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T10:23:31.853482 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6773125120 [----] I, [2016-09-13T10:23:31.853531 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T10:23:31.853574 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T10:23:31.853620 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T10:23:31.853669 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 28672 [----] I, [2016-09-13T10:23:31.853723 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T10:23:31.853769 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T10:23:31.853814 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T10:23:31.853859 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T10:23:31.853904 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T10:23:31.853943 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T10:23:31.853986 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 271872000 [----] I, [2016-09-13T10:23:31.854030 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 54800384 [----] I, [2016-09-13T10:23:31.854071 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217071616 [----] I, [2016-09-13T10:23:31.854111 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6111232 [----] I, [2016-09-13T10:23:31.854155 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141873152 [----] I, [2016-09-13T10:23:31.854202 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3385589760 [----] I, [2016-09-13T10:23:31.854244 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3057229824 [----] I, [2016-09-13T10:23:31.854289 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T10:23:31.854345 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T10:23:31.854391 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T10:23:31.854460 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36544512 [----] I, [2016-09-13T10:23:31.854513 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102281216 [----] I, [2016-09-13T10:23:31.854558 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53755904 [----] I, [2016-09-13T10:23:31.854601 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111497216 [----] I, [2016-09-13T10:23:31.854647 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 156037120 [----] I, [2016-09-13T10:23:31.854689 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T10:23:31.854739 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T10:23:31.854783 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T10:23:31.854825 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T10:23:31.854874 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T10:23:31.854918 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T10:23:31.854964 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T10:23:31.855005 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T10:23:31.855045 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T10:23:31.888889 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T10:23:31.889028 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T10:23:31.892535 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T10:23:31.894999 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T10:23:31.897095 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T10:23:31.899071 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T10:23:31.900988 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T10:23:31.902889 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 855 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T10:23:31.904844 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T10:23:31.906804 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T10:23:31.908858 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T10:23:31.910825 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T10:23:31.912780 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T10:23:31.914647 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T10:23:31.916521 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:23:31.916612 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:23:31.916677 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T10:23:31.919265 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202685000], Memory % [3.38], CPU Time [153110.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:23:31.919519 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79580], State: [ok], Delivered in [0.067594202] seconds [----] I, [2016-09-13T10:23:33.160236 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79579], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.922874513] seconds [----] I, [2016-09-13T10:23:33.160390 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79579], Delivering... [----] I, [2016-09-13T10:23:33.164406 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79579], State: [ok], Delivered in [0.004009632] seconds [----] I, [2016-09-13T10:23:36.312774 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:23:36.892019 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79581], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.590308244] seconds [----] I, [2016-09-13T10:23:36.892136 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79581], Delivering... [----] I, [2016-09-13T10:23:36.896288 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:23:16 UTC], Process Info: Memory Usage [286867456], Memory Size [627494912], Proportional Set Size: [206076000], Memory % [3.5], CPU Time [243948.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T10:23:36.896605 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:23:22 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347779000], Memory % [5.04], CPU Time [105892.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T10:23:36.896924 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:23:28 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163149000], Memory % [3.1], CPU Time [38557.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T10:23:36.897220 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:23:29 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [213405000], Memory % [3.5], CPU Time [49681.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T10:23:36.897560 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:23:30 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359295000], Memory % [5.28], CPU Time [207202.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T10:23:36.897871 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:23:30 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201169000], Memory % [3.36], CPU Time [154010.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:23:36.898129 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:23:30 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202685000], Memory % [3.38], CPU Time [153118.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:23:36.898453 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:23:31 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169745000], Memory % [3.14], CPU Time [52359.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:23:36.900370 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:23:24 UTC], Process Info: Memory Usage [612089856], Memory Size [1038077952], Proportional Set Size: [450583000], Memory % [7.46], CPU Time [1134.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T10:23:36.902094 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:23:28 UTC], Process Info: Memory Usage [601690112], Memory Size [960634880], Proportional Set Size: [440007000], Memory % [7.34], CPU Time [388.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T10:23:36.902479 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:23:30 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358594000], Memory % [5.27], CPU Time [213079.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T10:23:36.902781 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:23:28 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178472000], Memory % [3.2], CPU Time [52345.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:23:36.903045 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:23:24 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166758000], Memory % [3.16], CPU Time [39456.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T10:23:36.903296 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79581], State: [ok], Delivered in [0.011156032] seconds [----] I, [2016-09-13T10:23:46.341922 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:23:46.481214 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79582], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:23:47.767951 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:23:47.772000 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003664731979370117, :worker_monitor=>1.4273650646209717, :worker_dequeue=>0.008617639541625977, :total_time=>1.4399113655090332} [----] I, [2016-09-13T10:23:48.059145 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79582], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.710373214] seconds [----] I, [2016-09-13T10:23:48.059386 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79582], Delivering... [----] I, [2016-09-13T10:23:48.066319 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036411285400390625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003660440444946289, :pending_vm_jobs=>0.0007851123809814453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0064814090728759766} [----] I, [2016-09-13T10:23:48.066689 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79582], State: [ok], Delivered in [0.007344758] seconds [----] I, [2016-09-13T10:23:52.772451 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:23:52 UTC]... [----] I, [2016-09-13T10:23:52.789078 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:23:52 UTC]...Complete [----] I, [2016-09-13T10:24:01.494438 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:24:01.517087 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79583], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:24:01.532506 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79584], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:24:01.549569 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79585], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:24:01.572280 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79586], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:24:04.501533 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:24:04.505874 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005678653717041016, :worker_monitor=>1.6811723709106445, :worker_dequeue=>0.00988459587097168, :total_time=>1.6970884799957275} [----] I, [2016-09-13T10:24:05.207824 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79583], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.705872396] seconds [----] I, [2016-09-13T10:24:05.208055 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79583], Delivering... [----] I, [2016-09-13T10:24:05.215790 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004038572311401367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004075050354003906, :pending_vm_jobs=>0.0009033679962158203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007222652435302734} [----] I, [2016-09-13T10:24:05.216221 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79583], State: [ok], Delivered in [0.008164704] seconds [----] I, [2016-09-13T10:24:05.277069 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79584], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.754463307] seconds [----] I, [2016-09-13T10:24:05.277277 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79584], Delivering... [----] I, [2016-09-13T10:24:05.373230 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79584], State: [ok], Delivered in [0.095927793] seconds [----] I, [2016-09-13T10:24:06.304880 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79585], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.76529196] seconds [----] I, [2016-09-13T10:24:06.305114 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79585], Delivering... [----] I, [2016-09-13T10:24:06.314599 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79585], State: [ok], Delivered in [0.009469333] seconds [----] I, [2016-09-13T10:24:06.318390 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79586], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.759067995] seconds [----] I, [2016-09-13T10:24:06.318657 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79586], Delivering... [----] I, [2016-09-13T10:24:06.324410 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79586], State: [ok], Delivered in [0.005718313] seconds [----] I, [2016-09-13T10:24:16.581315 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:24:16.710182 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79587], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:24:21.108180 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:24:21.112133 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0032546520233154297, :worker_monitor=>1.5612602233886719, :worker_dequeue=>0.009183168411254883, :total_time=>1.5740103721618652} [----] I, [2016-09-13T10:24:21.436710 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79587], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.850418801] seconds [----] I, [2016-09-13T10:24:21.437008 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79587], Delivering... [----] I, [2016-09-13T10:24:21.448279 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005861997604370117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005899667739868164, :pending_vm_jobs=>0.0014731884002685547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010683536529541016} [----] I, [2016-09-13T10:24:21.448774 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79587], State: [ok], Delivered in [0.01179093] seconds [----] I, [2016-09-13T10:24:26.112611 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:24:26 UTC]... [----] I, [2016-09-13T10:24:26.138684 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:24:26 UTC]...Complete [----] I, [2016-09-13T10:24:31.720061 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:24:31.739347 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79588], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:24:31.756409 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79589], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:24:38.291825 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:24:38.296893 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038251876831054688, :worker_monitor=>2.0084822177886963, :worker_dequeue=>0.010960817337036133, :total_time=>2.023560047149658} [----] I, [2016-09-13T10:24:38.516511 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79588], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.790628242] seconds [----] I, [2016-09-13T10:24:38.516713 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79588], Delivering... [----] I, [2016-09-13T10:24:38.523814 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003690481185913086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003714323043823242, :pending_vm_jobs=>0.0009217262268066406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006725788116455078} [----] I, [2016-09-13T10:24:38.524216 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79588], State: [ok], Delivered in [0.007512266] seconds [----] I, [2016-09-13T10:24:39.459890 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79589], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.716227486] seconds [----] I, [2016-09-13T10:24:39.460160 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79589], Delivering... [----] I, [2016-09-13T10:24:39.467538 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79589], State: [ok], Delivered in [0.007313536] seconds [----] I, [2016-09-13T10:24:46.767465 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:24:46.796491 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79590], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:24:48.327885 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:24:48.547050 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79590], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.774392574] seconds [----] I, [2016-09-13T10:24:48.547259 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79590], Delivering... [----] I, [2016-09-13T10:24:48.554874 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0039937496185302734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0040302276611328125, :pending_vm_jobs=>0.0009682178497314453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007109880447387695} [----] I, [2016-09-13T10:24:48.555335 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79590], State: [ok], Delivered in [0.008040797] seconds [----] I, [2016-09-13T10:24:54.639841 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037078857421875, :worker_monitor=>1.2973239421844482, :worker_dequeue=>0.006668567657470703, :total_time=>1.3079609870910645} [----] I, [2016-09-13T10:24:59.640359 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:24:59 UTC]... [----] I, [2016-09-13T10:24:59.665028 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:24:59 UTC]...Complete [----] I, [2016-09-13T10:25:01.806966 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:25:01.824995 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79591], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:25:01.847940 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79592], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:25:01.887689 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79593], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:25:01.916640 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79594], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:25:04.697727 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:25:04.779743 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79591], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.965831263] seconds [----] I, [2016-09-13T10:25:04.779950 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79591], Delivering... [----] I, [2016-09-13T10:25:04.786933 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036597251892089844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003725767135620117, :pending_vm_jobs=>0.0008835792541503906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006562709808349609} [----] I, [2016-09-13T10:25:04.787250 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79591], State: [ok], Delivered in [0.007305457] seconds [----] I, [2016-09-13T10:25:04.842548 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79592], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.013491777] seconds [----] I, [2016-09-13T10:25:04.842759 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79592], Delivering... [----] I, [2016-09-13T10:25:04.922384 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79592], State: [ok], Delivered in [0.079576257] seconds [----] I, [2016-09-13T10:25:06.619510 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79593], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.759297078] seconds [----] I, [2016-09-13T10:25:06.619750 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79593], Delivering... [----] I, [2016-09-13T10:25:06.623346 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79593], State: [ok], Delivered in [0.003574369] seconds [----] I, [2016-09-13T10:25:06.705332 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79594], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.808628682] seconds [----] I, [2016-09-13T10:25:06.705609 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79594], Delivering... [----] I, [2016-09-13T10:25:06.711383 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79594], State: [ok], Delivered in [0.005761363] seconds [----] I, [2016-09-13T10:25:11.506458 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033118724822998047, :worker_monitor=>1.792748212814331, :worker_dequeue=>0.007775306701660156, :total_time=>1.804131269454956} [----] I, [2016-09-13T10:25:16.930736 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:25:16.961166 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79595], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:25:21.536452 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T10:25:21.542790 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:25:21.733884 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79595], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.797301015] seconds [----] I, [2016-09-13T10:25:21.734057 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79595], Delivering... [----] I, [2016-09-13T10:25:21.739356 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002845287322998047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028760433197021484, :pending_vm_jobs=>0.0006277561187744141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0049669742584228516} [----] I, [2016-09-13T10:25:21.739654 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79595], State: [ok], Delivered in [0.005614691] seconds [----] I, [2016-09-13T10:25:27.883846 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004070758819580078, :server_monitor=>0.1129751205444336, :worker_monitor=>1.2087929248809814, :worker_dequeue=>0.009841442108154297, :total_time=>1.3360445499420166} [----] I, [2016-09-13T10:25:31.976112 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:25:32.008491 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79596], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:25:32.042778 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79597], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:25:32.884408 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:25:32 UTC]... [----] I, [2016-09-13T10:25:32.906027 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:25:32 UTC]...Complete [----] I, [2016-09-13T10:25:32.919341 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:25:33.037030 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79596], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.052489576] seconds [----] I, [2016-09-13T10:25:33.037192 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79596], Delivering... [----] I, [2016-09-13T10:25:33.042948 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029282569885253906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029833316802978516, :pending_vm_jobs=>0.0007114410400390625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005395174026489258} [----] I, [2016-09-13T10:25:33.043258 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79596], State: [ok], Delivered in [0.006059865] seconds [----] I, [2016-09-13T10:25:33.784979 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79597], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.770735215] seconds [----] I, [2016-09-13T10:25:33.785096 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79597], Delivering... [----] I, [2016-09-13T10:25:33.788442 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79597], State: [ok], Delivered in [0.003331298] seconds [----] I, [2016-09-13T10:25:43.859972 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:25:43.860106 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:25:43.895539 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [103], PID: [17555], GUID: [1dd6952c-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:25:43.895691 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [103], PID: [17555], GUID: [1dd6952c-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:25:43.917746 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:25:43.917876 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:25:43.934119 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:25:43.934249 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:25:43.962694 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:25:43.962824 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:25:44.003181 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:25:44.003340 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:25:44.048607 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:25:44.048756 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:25:44.071507 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:25:44.071766 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:25:44.094092 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:25:44.094231 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:25:44.111089 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:25:44.111225 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:25:44.134217 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:25:44.134471 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:25:44.156395 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:25:44.156601 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:25:44.179335 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:25:44.179533 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:25:44.187661 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002686023712158203, :worker_monitor=>1.2409043312072754, :worker_dequeue=>0.0061130523681640625, :total_time=>1.2499058246612549} [----] I, [2016-09-13T10:25:44.885348 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T10:25:44.885482 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T10:25:44.885544 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T10:25:45.022980 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:25:45.023952 #17546:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T10:25:45.024030 #17546:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:25:45.024082 #17546:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:25:45.024129 #17546:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:25:45.024173 #17546:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T10:25:45.024212 #17546:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T10:25:45.024256 #17546:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:25:45.024311 #17546:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T10:25:45.024360 #17546:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:25:45.024405 #17546:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:25:45.024482 #17546:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T10:25:45.024534 #17546:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:25:45.024580 #17546:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T10:25:45.024625 #17546:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T10:25:45.024684 #17546:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T10:25:45.024733 #17546:34713c] INFO -- : --- [----] I, [2016-09-13T10:25:45.025256 #17546:34713c] INFO -- : :guid: 1d7be00a-79b6-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:25:45.025337 #17546:34713c] INFO -- : :ems_id: 17 [----] I, [2016-09-13T10:25:45.025538 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T10:25:45.825071 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:25:45.825184 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:25:45.825234 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:25:45.919932 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:25:45.920388 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:25:45.920453 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:25:45.920484 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:25:45.920506 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:25:45.920526 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T10:25:45.920544 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T10:25:45.920564 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:25:45.920584 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T10:25:45.920602 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:25:45.920620 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:25:45.920638 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:25:45.920656 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:25:45.920673 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T10:25:45.920690 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T10:25:45.920707 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T10:25:45.920722 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T10:25:45.920887 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:25:45.920994 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:25:46.427147 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:25:46.427250 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:25:46.427308 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:25:46.533324 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:25:46.533773 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T10:25:46.533820 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:25:46.533847 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:25:46.533868 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:25:46.533889 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T10:25:46.533909 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:25:46.533928 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:25:46.533946 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T10:25:46.533964 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:25:46.533982 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:25:46.534000 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:25:46.534018 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:25:46.534037 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T10:25:46.534054 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T10:25:46.534207 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:25:46.534374 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:25:46.987308 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:25:46.987453 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:25:46.987529 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:25:47.059568 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:25:47.059803 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:25:47.059887 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:25:47.130456 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:25:47.130634 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:25:47.130723 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:25:47.132844 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:25:47.133635 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:25:47.133705 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:25:47.133756 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:25:47.133790 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:25:47.133821 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T10:25:47.133858 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T10:25:47.133886 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:25:47.133914 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T10:25:47.133942 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:25:47.133968 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:25:47.133994 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:25:47.134023 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:25:47.134052 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T10:25:47.134079 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T10:25:47.134112 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T10:25:47.134137 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T10:25:47.134399 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:25:47.134571 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:25:47.216545 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:25:47.219378 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T10:25:47.219573 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:25:47.219674 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:25:47.219763 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:25:47.219850 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T10:25:47.219933 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T10:25:47.220015 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:25:47.220096 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T10:25:47.220175 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:25:47.220251 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:25:47.220339 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:25:47.220442 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:25:47.220535 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T10:25:47.220615 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T10:25:47.220692 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T10:25:47.220768 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T10:25:47.220849 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T10:25:47.220931 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T10:25:47.221016 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T10:25:47.221099 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T10:25:47.221176 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T10:25:47.221254 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T10:25:47.221376 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T10:25:47.221503 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T10:25:47.221580 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T10:25:47.221652 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T10:25:47.221727 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T10:25:47.221807 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T10:25:47.221889 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T10:25:47.221973 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T10:25:47.222055 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T10:25:47.222136 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T10:25:47.222213 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T10:25:47.222288 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T10:25:47.222393 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T10:25:47.222515 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T10:25:47.222594 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T10:25:47.222661 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T10:25:47.222724 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T10:25:47.223362 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:25:47.223677 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:25:47.223812 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:25:47.281452 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:25:47.282172 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:25:47.282224 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:25:47.282266 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:25:47.282326 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:25:47.282369 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T10:25:47.282405 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:25:47.282479 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:25:47.282520 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T10:25:47.282557 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:25:47.282591 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:25:47.282634 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:25:47.282667 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:25:47.282700 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T10:25:47.282733 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T10:25:47.282768 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T10:25:47.282809 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T10:25:47.283036 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:25:47.283185 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:25:47.288056 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79598], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:25:48.660154 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T10:25:48.660318 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T10:25:48.660407 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T10:25:48.799662 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:25:48.800489 #17555:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T10:25:48.800571 #17555:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:25:48.800616 #17555:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:25:48.800653 #17555:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:25:48.800693 #17555:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T10:25:48.800726 #17555:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:25:48.800761 #17555:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:25:48.800794 #17555:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T10:25:48.800827 #17555:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:25:48.800858 #17555:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:25:48.800890 #17555:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:25:48.800922 #17555:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:25:48.800954 #17555:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T10:25:48.800986 #17555:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T10:25:48.801024 #17555:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T10:25:48.801061 #17555:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T10:25:48.801091 #17555:34713c] INFO -- : --- [----] I, [2016-09-13T10:25:48.801506 #17555:34713c] INFO -- : :guid: 1dd6952c-79b6-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:25:48.801578 #17555:34713c] INFO -- : :ems_id: 17 [----] I, [2016-09-13T10:25:48.801699 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T10:25:48.837680 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:25:48.837804 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:25:48.837880 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:25:48.844643 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:25:48.844779 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:25:48.844850 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:25:48.986407 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:25:48.987218 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:25:48.987317 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:25:48.987369 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:25:48.987406 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:25:48.987479 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T10:25:48.987518 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T10:25:48.987551 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:25:48.987584 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T10:25:48.987614 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:25:48.987644 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:25:48.987675 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:25:48.987704 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:25:48.987732 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T10:25:48.987769 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T10:25:48.987797 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T10:25:48.987824 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T10:25:48.988083 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:25:48.988251 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:25:49.001864 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:25:49.003059 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T10:25:49.003141 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:25:49.003187 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:25:49.003224 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:25:49.003259 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T10:25:49.003292 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:25:49.003348 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:25:49.003397 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T10:25:49.003470 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:25:49.003512 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:25:49.003545 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:25:49.003577 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:25:49.003610 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T10:25:49.003641 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T10:25:49.003905 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:25:49.004188 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:25:49.201724 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:25:49.236740 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79598], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.001803602] seconds [----] I, [2016-09-13T10:25:49.236985 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79598], Delivering... [----] I, [2016-09-13T10:25:49.247504 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005458354949951172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005490303039550781, :pending_vm_jobs=>0.001275777816772461, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009907960891723633} [----] I, [2016-09-13T10:25:49.247966 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79598], State: [ok], Delivered in [0.010962348] seconds [----] I, [2016-09-13T10:25:51.287676 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:25:51.287836 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:25:51.287947 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:25:51.442838 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:25:51.443715 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:25:51.443799 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:25:51.443843 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:25:51.443883 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:25:51.443918 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T10:25:51.443953 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:25:51.443985 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:25:51.444016 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T10:25:51.444052 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:25:51.444098 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:25:51.444134 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:25:51.444167 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:25:51.444199 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T10:25:51.444231 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T10:25:51.444261 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T10:25:51.444292 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T10:25:51.444641 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:25:51.444797 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:25:52.778159 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:25:52.778363 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:25:52.778499 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:25:52.966822 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:25:52.967852 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:25:52.967983 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:25:52.968048 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:25:52.968091 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:25:52.968129 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T10:25:52.968164 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T10:25:52.968197 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:25:52.968231 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T10:25:52.968266 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:25:52.968321 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:25:52.968363 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:25:52.968397 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:25:52.968473 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T10:25:52.968515 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T10:25:52.968555 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T10:25:52.968587 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T10:25:52.968927 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:25:52.969086 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:25:53.173071 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:25:53.173267 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:25:53.173372 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:25:53.327065 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:25:53.328026 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T10:25:53.328110 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:25:53.328156 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:25:53.328194 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:25:53.328230 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T10:25:53.328264 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T10:25:53.328318 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:25:53.328363 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T10:25:53.328399 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:25:53.328472 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:25:53.328515 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:25:53.328549 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:25:53.328582 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T10:25:53.328614 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T10:25:53.328647 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T10:25:53.328677 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T10:25:53.328968 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:25:53.329137 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:25:54.034911 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:25:54.035056 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:25:54.035621 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:25:54.202539 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:25:54.203294 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T10:25:54.203391 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:25:54.203478 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:25:54.203527 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:25:54.203564 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T10:25:54.203599 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:25:54.203633 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:25:54.203666 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T10:25:54.203699 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:25:54.203749 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:25:54.203786 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:25:54.203818 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:25:54.203851 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T10:25:54.203881 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T10:25:54.204149 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:25:54.204477 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:26:00.681500 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003466367721557617, :worker_monitor=>1.4480962753295898, :worker_dequeue=>0.006974220275878906, :total_time=>1.4588241577148438} [----] I, [2016-09-13T10:26:02.308791 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:26:02.340885 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79599], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:26:02.369005 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79600], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:26:02.386087 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79601], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:26:02.409027 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79602], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:26:05.681944 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:26:05 UTC]... [----] I, [2016-09-13T10:26:05.711731 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:26:05 UTC]...Complete [----] I, [2016-09-13T10:26:05.718729 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:26:06.414765 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79599], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.095219124] seconds [----] I, [2016-09-13T10:26:06.414947 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79599], Delivering... [----] I, [2016-09-13T10:26:06.420488 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030825138092041016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003101348876953125, :pending_vm_jobs=>0.0006158351898193359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005189418792724609} [----] I, [2016-09-13T10:26:06.420784 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79599], State: [ok], Delivered in [0.005849744] seconds [----] I, [2016-09-13T10:26:06.472116 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79600], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.124520038] seconds [----] I, [2016-09-13T10:26:06.472313 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79600], Delivering... [----] I, [2016-09-13T10:26:06.552215 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79600], State: [ok], Delivered in [0.079858621] seconds [----] I, [2016-09-13T10:26:07.009837 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79601], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.633051447] seconds [----] I, [2016-09-13T10:26:07.010015 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79601], Delivering... [----] I, [2016-09-13T10:26:07.012896 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79601], State: [ok], Delivered in [0.002875928] seconds [----] I, [2016-09-13T10:26:07.083644 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79602], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.68920379] seconds [----] I, [2016-09-13T10:26:07.083845 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79602], Delivering... [----] I, [2016-09-13T10:26:07.088339 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79602], State: [ok], Delivered in [0.004486861] seconds [----] I, [2016-09-13T10:26:17.029236 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005320072174072266, :worker_monitor=>1.2819416522979736, :worker_dequeue=>0.005576372146606445, :total_time=>1.2931394577026367} [----] I, [2016-09-13T10:26:17.421871 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:26:17.444344 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79603], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:26:22.040511 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:26:22.113126 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79603], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.681641781] seconds [----] I, [2016-09-13T10:26:22.113397 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79603], Delivering... [----] I, [2016-09-13T10:26:22.123078 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005533456802368164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00559234619140625, :pending_vm_jobs=>0.0011060237884521484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0090789794921875} [----] I, [2016-09-13T10:26:22.123584 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79603], State: [ok], Delivered in [0.010183052] seconds [----] I, [2016-09-13T10:26:32.456578 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:26:32.472531 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79604], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:26:32.485377 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79605], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:26:33.590687 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:26:33.592634 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00582575798034668, :worker_monitor=>1.413895845413208, :worker_dequeue=>0.004376888275146484, :total_time=>1.4243865013122559} [----] I, [2016-09-13T10:26:33.707628 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79604], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.245769074] seconds [----] I, [2016-09-13T10:26:33.707871 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79604], Delivering... [----] I, [2016-09-13T10:26:33.718396 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005406379699707031, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0054361820220947266, :pending_vm_jobs=>0.0012638568878173828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009726762771606445} [----] I, [2016-09-13T10:26:33.718906 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79604], State: [ok], Delivered in [0.011028371] seconds [----] I, [2016-09-13T10:26:34.198839 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79605], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.723252578] seconds [----] I, [2016-09-13T10:26:34.199023 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79605], Delivering... [----] I, [2016-09-13T10:26:34.204136 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79605], State: [ok], Delivered in [0.005105697] seconds [----] I, [2016-09-13T10:26:38.592984 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:26:38 UTC]... [----] I, [2016-09-13T10:26:38.611116 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:26:38 UTC]...Complete [----] I, [2016-09-13T10:26:47.497508 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:26:47.518710 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79606], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:26:50.016308 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:26:50.020725 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038154125213623047, :worker_monitor=>1.3658173084259033, :worker_dequeue=>0.008142709732055664, :total_time=>1.3780851364135742} [----] I, [2016-09-13T10:26:50.891171 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79606], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.384803508] seconds [----] I, [2016-09-13T10:26:50.891524 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79606], Delivering... [----] I, [2016-09-13T10:26:50.902877 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005739450454711914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005775928497314453, :pending_vm_jobs=>0.0014927387237548828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.01073312759399414} [----] I, [2016-09-13T10:26:50.903503 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79606], State: [ok], Delivered in [0.011953406] seconds [----] I, [2016-09-13T10:27:02.527026 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:27:02.553214 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79607], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:27:02.570335 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79608], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:27:02.587486 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79609], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:27:02.617074 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79610], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:27:06.224945 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:27:06.229245 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004093647003173828, :worker_monitor=>1.1758432388305664, :worker_dequeue=>0.00942373275756836, :total_time=>1.1896421909332275} [----] I, [2016-09-13T10:27:07.016590 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79607], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.485472895] seconds [----] I, [2016-09-13T10:27:07.016796 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79607], Delivering... [----] I, [2016-09-13T10:27:07.023436 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034177303314208984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003441333770751953, :pending_vm_jobs=>0.0007715225219726562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006186485290527344} [----] I, [2016-09-13T10:27:07.023785 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79607], State: [ok], Delivered in [0.006989228] seconds [----] I, [2016-09-13T10:27:07.033861 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79608], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.478024748] seconds [----] I, [2016-09-13T10:27:07.034037 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79608], Delivering... [----] I, [2016-09-13T10:27:07.119390 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79608], State: [ok], Delivered in [0.085289283] seconds [----] I, [2016-09-13T10:27:07.285206 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79609], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.711572894] seconds [----] I, [2016-09-13T10:27:07.285480 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79609], Delivering... [----] I, [2016-09-13T10:27:07.289082 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79609], State: [ok], Delivered in [0.003626896] seconds [----] I, [2016-09-13T10:27:07.325059 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79610], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.732835305] seconds [----] I, [2016-09-13T10:27:07.325234 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79610], Delivering... [----] I, [2016-09-13T10:27:07.330641 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79610], State: [ok], Delivered in [0.005378299] seconds [----] I, [2016-09-13T10:27:11.229794 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:27:11 UTC]... [----] I, [2016-09-13T10:27:11.250173 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:27:11 UTC]...Complete [----] I, [2016-09-13T10:27:17.628122 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:27:17.645491 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79611], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:27:22.689469 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:27:22.694748 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004225492477416992, :worker_monitor=>1.3948419094085693, :worker_dequeue=>0.011506319046020508, :total_time=>1.410904884338379} [----] I, [2016-09-13T10:27:23.212203 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79611], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.578247278] seconds [----] I, [2016-09-13T10:27:23.212395 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79611], Delivering... [----] I, [2016-09-13T10:27:23.218774 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032460689544677734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032644271850585938, :pending_vm_jobs=>0.0008234977722167969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005998849868774414} [----] I, [2016-09-13T10:27:23.219106 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79611], State: [ok], Delivered in [0.006701965] seconds [----] I, [2016-09-13T10:27:32.656520 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:27:32.692688 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79612], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:27:32.720765 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79613], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:27:32.841017 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:27:33.316444 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79612], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.654923726] seconds [----] I, [2016-09-13T10:27:33.316645 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79612], Delivering... [----] I, [2016-09-13T10:27:33.322826 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003301858901977539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033206939697265625, :pending_vm_jobs=>0.0007603168487548828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005848884582519531} [----] I, [2016-09-13T10:27:33.323211 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79612], State: [ok], Delivered in [0.006542103] seconds [----] I, [2016-09-13T10:27:34.383746 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79613], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.687445368] seconds [----] I, [2016-09-13T10:27:34.383998 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79613], Delivering... [----] I, [2016-09-13T10:27:34.390368 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79613], State: [ok], Delivered in [0.006344514] seconds [----] I, [2016-09-13T10:27:39.096542 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0026330947875976562, :worker_monitor=>1.2415781021118164, :worker_dequeue=>0.007941961288452148, :total_time=>1.2523488998413086} [----] I, [2016-09-13T10:27:44.097110 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:27:44 UTC]... [----] I, [2016-09-13T10:27:44.120612 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:27:44 UTC]...Complete [----] I, [2016-09-13T10:27:47.731201 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:27:47.749385 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79614], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:27:49.147084 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:27:49.469599 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79614], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.732523412] seconds [----] I, [2016-09-13T10:27:49.469791 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79614], Delivering... [----] I, [2016-09-13T10:27:49.476168 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032796859741210938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003300189971923828, :pending_vm_jobs=>0.0007700920104980469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059680938720703125} [----] I, [2016-09-13T10:27:49.476536 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79614], State: [ok], Delivered in [0.006749533] seconds [----] I, [2016-09-13T10:27:55.458516 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003881692886352539, :worker_monitor=>1.2921371459960938, :worker_dequeue=>0.009521961212158203, :total_time=>1.3058123588562012} [----] I, [2016-09-13T10:28:02.761305 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:28:02.790717 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79615], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:28:02.809489 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79616], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:28:02.824719 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79617], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:28:02.842067 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79618], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:28:05.475947 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:28:05.574105 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79615], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.806910574] seconds [----] I, [2016-09-13T10:28:05.574365 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79615], Delivering... [----] I, [2016-09-13T10:28:05.582412 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004143714904785156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004172563552856445, :pending_vm_jobs=>0.0008502006530761719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007471799850463867} [----] I, [2016-09-13T10:28:05.583047 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79615], State: [ok], Delivered in [0.008687629] seconds [----] I, [2016-09-13T10:28:05.591340 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79616], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.796318852] seconds [----] I, [2016-09-13T10:28:05.591570 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79616], Delivering... [----] I, [2016-09-13T10:28:05.653849 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79616], State: [ok], Delivered in [0.062256866] seconds [----] I, [2016-09-13T10:28:07.511189 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79617], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.695434985] seconds [----] I, [2016-09-13T10:28:07.511406 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79617], Delivering... [----] I, [2016-09-13T10:28:07.514846 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79617], State: [ok], Delivered in [0.003434554] seconds [----] I, [2016-09-13T10:28:07.556004 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79618], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.723488682] seconds [----] I, [2016-09-13T10:28:07.556207 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79618], Delivering... [----] I, [2016-09-13T10:28:07.561176 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79618], State: [ok], Delivered in [0.004968809] seconds [----] I, [2016-09-13T10:28:11.838353 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004109621047973633, :worker_monitor=>1.3433473110198975, :worker_dequeue=>0.010586261749267578, :total_time=>1.358389139175415} [----] I, [2016-09-13T10:28:16.839110 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:28:16 UTC]... [----] I, [2016-09-13T10:28:16.858333 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:28:16 UTC]...Complete [----] I, [2016-09-13T10:28:17.853073 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:28:17.887536 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79619], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:28:21.892196 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:28:22.596105 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79619], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.73723457] seconds [----] I, [2016-09-13T10:28:22.596282 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79619], Delivering... [----] I, [2016-09-13T10:28:22.600631 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024416446685791016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024535655975341797, :pending_vm_jobs=>0.0005042552947998047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00400853157043457} [----] I, [2016-09-13T10:28:22.600949 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79619], State: [ok], Delivered in [0.004665138] seconds [----] I, [2016-09-13T10:28:28.307760 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003949165344238281, :worker_monitor=>1.393786907196045, :worker_dequeue=>0.011435508728027344, :total_time=>1.409614086151123} [----] I, [2016-09-13T10:28:32.897487 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T10:28:32.921859 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79620], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:28:32.950160 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79621], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:28:32.961711 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79622], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:28:32.978649 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79623], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:28:33.420065 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:28:33.796796 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79620], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.89581152] seconds [----] I, [2016-09-13T10:28:33.796939 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79620], Delivering... [----] I, [2016-09-13T10:28:33.801788 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025701522827148438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025870800018310547, :pending_vm_jobs=>0.0005850791931152344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004575014114379883} [----] I, [2016-09-13T10:28:33.802088 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79620], State: [ok], Delivered in [0.005138146] seconds [----] I, [2016-09-13T10:28:33.836336 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79621], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.911009867] seconds [----] I, [2016-09-13T10:28:33.836558 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79621], Delivering... [----] I, [2016-09-13T10:28:33.837815 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T10:28:33.838046 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4572168192 [----] I, [2016-09-13T10:28:33.838152 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4338798592 [----] I, [2016-09-13T10:28:33.838236 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 233369600 [----] I, [2016-09-13T10:28:33.838331 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T10:28:33.838453 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4282101760 [----] I, [2016-09-13T10:28:33.838556 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T10:28:33.838639 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T10:28:33.838726 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 555720704 [----] I, [2016-09-13T10:28:33.838804 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T10:28:33.838880 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6766837760 [----] I, [2016-09-13T10:28:33.838955 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T10:28:33.839038 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T10:28:33.839120 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T10:28:33.839226 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T10:28:33.839329 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T10:28:33.839448 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T10:28:33.839549 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T10:28:33.839639 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T10:28:33.839729 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T10:28:33.839825 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T10:28:33.839911 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 271872000 [----] I, [2016-09-13T10:28:33.839976 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 54800384 [----] I, [2016-09-13T10:28:33.840030 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217071616 [----] I, [2016-09-13T10:28:33.840079 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6127616 [----] I, [2016-09-13T10:28:33.840134 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141873152 [----] I, [2016-09-13T10:28:33.840185 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3384553472 [----] I, [2016-09-13T10:28:33.840236 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3055951872 [----] I, [2016-09-13T10:28:33.840285 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T10:28:33.840369 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T10:28:33.840443 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T10:28:33.840514 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36532224 [----] I, [2016-09-13T10:28:33.840568 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 102281216 [----] I, [2016-09-13T10:28:33.840621 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 53702656 [----] I, [2016-09-13T10:28:33.840670 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111497216 [----] I, [2016-09-13T10:28:33.840723 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 155983872 [----] I, [2016-09-13T10:28:33.840775 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T10:28:33.840830 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T10:28:33.840880 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T10:28:33.840939 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T10:28:33.840994 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T10:28:33.841045 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T10:28:33.841091 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T10:28:33.841143 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T10:28:33.841190 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T10:28:33.853516 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79622], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.900023031] seconds [----] I, [2016-09-13T10:28:33.853728 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79622], Delivering... [----] I, [2016-09-13T10:28:33.861749 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:28:27 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201169000], Memory % [3.36], CPU Time [154097.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:28:33.862246 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:28:27 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202685000], Memory % [3.38], CPU Time [153197.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:28:33.862816 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:28:17 UTC], Process Info: Memory Usage [286867456], Memory Size [627494912], Proportional Set Size: [206076000], Memory % [3.5], CPU Time [244080.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T10:28:33.863332 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:28:27 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163159000], Memory % [3.1], CPU Time [38618.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T10:28:33.863822 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:28:23 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347780000], Memory % [5.04], CPU Time [105958.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T10:28:33.864242 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:28:18 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [213406000], Memory % [3.5], CPU Time [49764.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T10:28:33.864858 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:28:25 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359295000], Memory % [5.28], CPU Time [207246.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T10:28:33.865359 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:28:26 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169745000], Memory % [3.14], CPU Time [52420.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:28:33.868411 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:28:25 UTC], Process Info: Memory Usage [612401152], Memory Size [1015009280], Proportional Set Size: [450889000], Memory % [7.47], CPU Time [1159.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T10:28:33.870525 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:28:18 UTC], Process Info: Memory Usage [602210304], Memory Size [977416192], Proportional Set Size: [440701000], Memory % [7.34], CPU Time [413.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T10:28:33.871018 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:28:25 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358594000], Memory % [5.27], CPU Time [213123.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T10:28:33.871523 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:28:26 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178486000], Memory % [3.2], CPU Time [52400.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:28:33.872001 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:28:25 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166760000], Memory % [3.16], CPU Time [39505.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T10:28:33.872319 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79622], State: [ok], Delivered in [0.018566886] seconds [----] I, [2016-09-13T10:28:33.879987 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T10:28:33.880146 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T10:28:33.884312 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T10:28:33.886703 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T10:28:33.888920 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T10:28:33.891095 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T10:28:33.893275 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T10:28:33.896569 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 854 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T10:28:33.900327 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T10:28:33.902904 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T10:28:33.906065 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T10:28:33.908528 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 245 MB 769 MB 25% 1048576 19947 1028629 2% /tmp [----] I, [2016-09-13T10:28:33.910751 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T10:28:33.912948 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T10:28:33.915228 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:28:33.915344 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:28:33.915448 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T10:28:33.918770 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201169000], Memory % [3.36], CPU Time [154089.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:28:33.919160 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79621], State: [ok], Delivered in [0.082585138] seconds [----] I, [2016-09-13T10:28:34.653628 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79623], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.687500006] seconds [----] I, [2016-09-13T10:28:34.653844 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79623], Delivering... [----] I, [2016-09-13T10:28:34.659079 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79623], State: [ok], Delivered in [0.005216159] seconds [----] I, [2016-09-13T10:28:44.909346 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040705204010009766, :worker_monitor=>1.4558453559875488, :worker_dequeue=>0.007073879241943359, :total_time=>1.4672749042510986} [----] I, [2016-09-13T10:28:47.991412 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:28:48.015227 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79624], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:28:49.909844 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:28:49 UTC]... [----] I, [2016-09-13T10:28:49.936022 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:28:49 UTC]...Complete [----] I, [2016-09-13T10:28:49.949854 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:28:50.037215 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79624], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.038248549] seconds [----] I, [2016-09-13T10:28:50.037406 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79624], Delivering... [----] I, [2016-09-13T10:28:50.043259 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030586719512939453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003076314926147461, :pending_vm_jobs=>0.000759124755859375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005470991134643555} [----] I, [2016-09-13T10:28:50.043628 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79624], State: [ok], Delivered in [0.006201012] seconds [----] I, [2016-09-13T10:29:01.285614 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039234161376953125, :worker_monitor=>1.3071184158325195, :worker_dequeue=>0.0065996646881103516, :total_time=>1.3179373741149902} [----] I, [2016-09-13T10:29:03.027034 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:29:03.060251 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79625], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:29:03.084036 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79626], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:29:03.111695 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79627], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:29:03.133986 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79628], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:29:06.301309 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:29:07.186340 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79625], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.15253969] seconds [----] I, [2016-09-13T10:29:07.186632 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79625], Delivering... [----] I, [2016-09-13T10:29:07.191196 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79626], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.124892274] seconds [----] I, [2016-09-13T10:29:07.191392 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79626], Delivering... [----] I, [2016-09-13T10:29:07.194549 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004384279251098633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004407167434692383, :pending_vm_jobs=>0.0009334087371826172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007415771484375} [----] I, [2016-09-13T10:29:07.194930 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79625], State: [ok], Delivered in [0.008303916] seconds [----] I, [2016-09-13T10:29:07.248407 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79626], State: [ok], Delivered in [0.056988203] seconds [----] I, [2016-09-13T10:29:07.763462 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79627], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.673832888] seconds [----] I, [2016-09-13T10:29:07.763853 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79627], Delivering... [----] I, [2016-09-13T10:29:07.769561 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79627], State: [ok], Delivered in [0.005738259] seconds [----] I, [2016-09-13T10:29:07.785624 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79628], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.663380157] seconds [----] I, [2016-09-13T10:29:07.785811 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79628], Delivering... [----] I, [2016-09-13T10:29:07.789699 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79628], State: [ok], Delivered in [0.003887931] seconds [----] I, [2016-09-13T10:29:17.387792 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038111209869384766, :worker_monitor=>1.0581111907958984, :worker_dequeue=>0.005580902099609375, :total_time=>1.0677380561828613} [----] I, [2016-09-13T10:29:18.144777 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:29:18.162858 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79629], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:29:22.388309 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:29:22 UTC]... [----] I, [2016-09-13T10:29:22.408242 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:29:22 UTC]...Complete [----] I, [2016-09-13T10:29:22.419129 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:29:22.854502 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79629], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.70387841] seconds [----] I, [2016-09-13T10:29:22.854694 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79629], Delivering... [----] I, [2016-09-13T10:29:22.861509 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035202503204345703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003623485565185547, :pending_vm_jobs=>0.000843048095703125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006380796432495117} [----] I, [2016-09-13T10:29:22.861875 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79629], State: [ok], Delivered in [0.007173157] seconds [----] I, [2016-09-13T10:29:33.174376 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:29:33.197060 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79630], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:29:33.208241 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79631], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:29:33.804364 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:29:33.807926 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041043758392333984, :worker_monitor=>1.3633835315704346, :worker_dequeue=>0.007904291152954102, :total_time=>1.3758251667022705} [----] I, [2016-09-13T10:29:34.380185 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79630], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.200978356] seconds [----] I, [2016-09-13T10:29:34.380385 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79630], Delivering... [----] I, [2016-09-13T10:29:34.386903 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033135414123535156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003336668014526367, :pending_vm_jobs=>0.0009133815765380859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0061168670654296875} [----] I, [2016-09-13T10:29:34.387240 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79630], State: [ok], Delivered in [0.006845728] seconds [----] I, [2016-09-13T10:29:34.900264 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79631], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.700461599] seconds [----] I, [2016-09-13T10:29:34.900450 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79631], Delivering... [----] I, [2016-09-13T10:29:34.904141 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79631], State: [ok], Delivered in [0.003686974] seconds [----] I, [2016-09-13T10:29:48.216611 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:29:48.231698 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79632], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:29:50.106948 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:29:50.110544 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036907196044921875, :worker_monitor=>1.1873698234558105, :worker_dequeue=>0.007541656494140625, :total_time=>1.19893479347229} [----] I, [2016-09-13T10:29:50.529875 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79632], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.307492466] seconds [----] I, [2016-09-13T10:29:50.530069 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79632], Delivering... [----] I, [2016-09-13T10:29:50.536720 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034062862396240234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034236907958984375, :pending_vm_jobs=>0.0008821487426757812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062596797943115234} [----] I, [2016-09-13T10:29:50.537079 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79632], State: [ok], Delivered in [0.007007541] seconds [----] I, [2016-09-13T10:29:55.111007 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:29:55 UTC]... [----] I, [2016-09-13T10:29:55.129552 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:29:55 UTC]...Complete [----] I, [2016-09-13T10:30:03.242374 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 8. [----] I, [2016-09-13T10:30:03.262676 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79633], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:30:03.272472 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79634], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:30:03.284022 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79635], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:30:03.307040 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79636], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:30:03.323987 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79637], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:30:03.341163 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79638], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:30:03.358147 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79639], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:30:06.389067 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 7 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:30:06.393409 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004070281982421875, :worker_monitor=>1.2211809158325195, :worker_dequeue=>0.009594440460205078, :total_time=>1.235173225402832} [----] I, [2016-09-13T10:30:06.661776 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79633], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.413637539] seconds [----] I, [2016-09-13T10:30:06.661972 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79633], Delivering... [----] I, [2016-09-13T10:30:06.667548 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79634], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.400630413] seconds [----] I, [2016-09-13T10:30:06.667814 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79634], Delivering... [----] I, [2016-09-13T10:30:06.668583 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003516674041748047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035390853881835938, :pending_vm_jobs=>0.0008435249328613281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006224632263183594} [----] I, [2016-09-13T10:30:06.668941 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79633], State: [ok], Delivered in [0.00696303] seconds [----] I, [2016-09-13T10:30:06.723898 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79634], State: [ok], Delivered in [0.056091222] seconds [----] I, [2016-09-13T10:30:08.005446 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79635], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.727571098] seconds [----] I, [2016-09-13T10:30:08.005657 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79635], Delivering... [----] I, [2016-09-13T10:30:08.008854 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79635], State: [ok], Delivered in [0.003197917] seconds [----] I, [2016-09-13T10:30:08.015573 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79636], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.721417365] seconds [----] I, [2016-09-13T10:30:08.015750 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79636], Delivering... [----] I, [2016-09-13T10:30:08.020241 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79636], State: [ok], Delivered in [0.004484559] seconds [----] I, [2016-09-13T10:30:08.038389 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79637], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.72334999] seconds [----] I, [2016-09-13T10:30:08.038582 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79637], Delivering... [----] I, [2016-09-13T10:30:08.040738 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79637], State: [ok], Delivered in [0.00214895] seconds [----] I, [2016-09-13T10:30:08.044122 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79638], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.712498572] seconds [----] I, [2016-09-13T10:30:08.044299 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79638], Delivering... [----] I, [2016-09-13T10:30:08.056749 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79638], State: [ok], Delivered in [0.012443395] seconds [----] I, [2016-09-13T10:30:08.113818 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79639], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.765063029] seconds [----] I, [2016-09-13T10:30:08.114008 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79639], Delivering... [----] I, [2016-09-13T10:30:08.119987 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79639], State: [ok], Delivered in [0.005963571] seconds [----] I, [2016-09-13T10:30:18.370041 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:30:18.411150 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79640], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:30:22.571073 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:30:22.573784 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005743503570556641, :worker_monitor=>1.1412670612335205, :worker_dequeue=>0.005902290344238281, :total_time=>1.153355598449707} [----] I, [2016-09-13T10:30:22.782947 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79640], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.407088922] seconds [----] I, [2016-09-13T10:30:22.783050 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79640], Delivering... [----] I, [2016-09-13T10:30:22.786640 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0018839836120605469, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0018951892852783203, :pending_vm_jobs=>0.0004620552062988281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003367185592651367} [----] I, [2016-09-13T10:30:22.786829 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79640], State: [ok], Delivered in [0.003774572] seconds [----] I, [2016-09-13T10:30:27.574324 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:30:27 UTC]... [----] I, [2016-09-13T10:30:27.594383 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:30:27 UTC]...Complete [----] I, [2016-09-13T10:30:27.612390 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T10:30:33.422093 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:30:33.468939 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79641], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:30:33.491660 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79642], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:30:38.880754 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:30:38.887378 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038073062896728516, :worker_monitor=>1.2289371490478516, :worker_dequeue=>0.0133514404296875, :total_time=>1.2463748455047607} [----] I, [2016-09-13T10:30:38.937786 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79641], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.509867077] seconds [----] I, [2016-09-13T10:30:38.938012 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79641], Delivering... [----] I, [2016-09-13T10:30:38.947313 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004679679870605469, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004754781723022461, :pending_vm_jobs=>0.0012011528015136719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008803844451904297} [----] I, [2016-09-13T10:30:38.947774 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79641], State: [ok], Delivered in [0.009755224] seconds [----] I, [2016-09-13T10:30:41.212099 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79642], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.739126878] seconds [----] I, [2016-09-13T10:30:41.212303 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79642], Delivering... [----] I, [2016-09-13T10:30:41.216844 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79642], State: [ok], Delivered in [0.004555157] seconds [----] I, [2016-09-13T10:30:48.503374 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 0. [----] I, [2016-09-13T10:30:59.955259 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:30:59 UTC]... [----] I, [2016-09-13T10:30:59.971870 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:30:59 UTC]...Complete [----] I, [2016-09-13T10:31:03.515296 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:31:03.532396 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79643], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:31:03.561255 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79644], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:31:03.583635 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79645], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:31:03.606524 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79646], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:31:04.997342 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:31:05.064461 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79643], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.542902031] seconds [----] I, [2016-09-13T10:31:05.064617 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79643], Delivering... [----] I, [2016-09-13T10:31:05.068961 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002408742904663086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002421140670776367, :pending_vm_jobs=>0.0005660057067871094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004077911376953125} [----] I, [2016-09-13T10:31:05.069205 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79643], State: [ok], Delivered in [0.004591849] seconds [----] I, [2016-09-13T10:31:05.109894 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79644], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.573585136] seconds [----] I, [2016-09-13T10:31:05.110041 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79644], Delivering... [----] I, [2016-09-13T10:31:05.167094 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79644], State: [ok], Delivered in [0.057022425] seconds [----] I, [2016-09-13T10:31:05.275592 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79645], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.709703841] seconds [----] I, [2016-09-13T10:31:05.275736 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79645], Delivering... [----] I, [2016-09-13T10:31:05.280860 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79645], State: [ok], Delivered in [0.005113765] seconds [----] I, [2016-09-13T10:31:05.327015 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79646], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.733936018] seconds [----] I, [2016-09-13T10:31:05.327164 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79646], Delivering... [----] I, [2016-09-13T10:31:05.331089 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79646], State: [ok], Delivered in [0.003919244] seconds [----] I, [2016-09-13T10:31:11.572825 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003936052322387695, :worker_monitor=>1.5586204528808594, :worker_dequeue=>0.008808374404907227, :total_time=>1.5716931819915771} [----] I, [2016-09-13T10:31:18.948716 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:31:19.009313 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79647], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:31:21.595392 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:31:22.245893 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79647], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.28381503] seconds [----] I, [2016-09-13T10:31:22.246162 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79647], Delivering... [----] I, [2016-09-13T10:31:22.253525 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003412485122680664, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034325122833251953, :pending_vm_jobs=>0.0009834766387939453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006644487380981445} [----] I, [2016-09-13T10:31:22.253945 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79647], State: [ok], Delivered in [0.007792944] seconds [----] I, [2016-09-13T10:31:27.642603 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036880970001220703, :worker_monitor=>1.0315017700195312, :worker_dequeue=>0.008998870849609375, :total_time=>1.044475793838501} [----] I, [2016-09-13T10:31:32.643161 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:31:32 UTC]... [----] I, [2016-09-13T10:31:32.659090 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:31:32 UTC]...Complete [----] I, [2016-09-13T10:31:34.021372 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:31:34.036509 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79648], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:31:34.053619 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79649], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:31:37.682762 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:31:38.402359 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79649], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.359835392] seconds [----] I, [2016-09-13T10:31:38.402567 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79649], Delivering... [----] I, [2016-09-13T10:31:38.408963 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032851696014404297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033042430877685547, :pending_vm_jobs=>0.0008182525634765625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006012678146362305} [----] I, [2016-09-13T10:31:38.409365 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79649], State: [ok], Delivered in [0.006789333] seconds [----] I, [2016-09-13T10:31:38.436738 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79648], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.41071445] seconds [----] I, [2016-09-13T10:31:38.436909 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79648], Delivering... [----] I, [2016-09-13T10:31:38.441122 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79648], State: [ok], Delivered in [0.004207793] seconds [----] I, [2016-09-13T10:31:43.802650 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004081249237060547, :worker_monitor=>1.1060969829559326, :worker_dequeue=>0.004686832427978516, :total_time=>1.1152095794677734} [----] I, [2016-09-13T10:31:49.065484 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:31:49.088081 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79650], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:31:53.926900 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:31:54.519624 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79650], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.448299126] seconds [----] I, [2016-09-13T10:31:54.519837 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79650], Delivering... [----] I, [2016-09-13T10:31:54.526508 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036203861236572266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003640890121459961, :pending_vm_jobs=>0.0008008480072021484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006234884262084961} [----] I, [2016-09-13T10:31:54.526875 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79650], State: [ok], Delivered in [0.007025803] seconds [----] I, [2016-09-13T10:32:00.340854 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004164218902587891, :worker_monitor=>1.392935037612915, :worker_dequeue=>0.008871316909790039, :total_time=>1.4062974452972412} [----] I, [2016-09-13T10:32:04.101855 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:32:04.124148 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79651], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:32:04.146392 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79652], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:32:04.163473 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79653], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:32:04.174841 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79654], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:32:05.341462 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:32:05 UTC]... [----] I, [2016-09-13T10:32:05.357903 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:32:05 UTC]...Complete [----] I, [2016-09-13T10:32:05.369312 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:32:05.563688 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79651], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.455022844] seconds [----] I, [2016-09-13T10:32:05.563885 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79651], Delivering... [----] I, [2016-09-13T10:32:05.575151 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79654], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.406277975] seconds [----] I, [2016-09-13T10:32:05.575365 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79654], Delivering... [----] I, [2016-09-13T10:32:05.581940 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034143924713134766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003437042236328125, :pending_vm_jobs=>0.0008087158203125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0061032772064208984} [----] I, [2016-09-13T10:32:05.582309 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79654], State: [ok], Delivered in [0.006925654] seconds [----] I, [2016-09-13T10:32:05.632364 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79652], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.500386791] seconds [----] I, [2016-09-13T10:32:05.632573 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79652], Delivering... [----] I, [2016-09-13T10:32:05.635550 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79652], State: [ok], Delivered in [0.002969106] seconds [----] I, [2016-09-13T10:32:05.638025 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79651], State: [ok], Delivered in [0.074121177] seconds [----] I, [2016-09-13T10:32:05.666796 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79653], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.512267988] seconds [----] I, [2016-09-13T10:32:05.666985 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79653], Delivering... [----] I, [2016-09-13T10:32:05.671756 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79653], State: [ok], Delivered in [0.004754848] seconds [----] I, [2016-09-13T10:32:16.823669 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003919363021850586, :worker_monitor=>1.423184871673584, :worker_dequeue=>0.00924825668334961, :total_time=>1.4366416931152344} [----] I, [2016-09-13T10:32:19.188163 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:32:19.222353 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79655], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:32:21.833519 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:32:21.906738 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79655], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.712501817] seconds [----] I, [2016-09-13T10:32:21.906891 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79655], Delivering... [----] I, [2016-09-13T10:32:21.912409 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029523372650146484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002971649169921875, :pending_vm_jobs=>0.000743865966796875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005215883255004883} [----] I, [2016-09-13T10:32:21.912777 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79655], State: [ok], Delivered in [0.005881325] seconds [----] I, [2016-09-13T10:32:33.313573 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003756284713745117, :worker_monitor=>1.4492835998535156, :worker_dequeue=>0.009065866470336914, :total_time=>1.4624378681182861} [----] I, [2016-09-13T10:32:34.234720 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:32:34.255452 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79656], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:32:34.295711 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79657], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:32:38.314081 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:32:38 UTC]... [----] I, [2016-09-13T10:32:38.335304 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:32:38 UTC]...Complete [----] I, [2016-09-13T10:32:38.346370 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:32:38.775472 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79657], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.514376541] seconds [----] I, [2016-09-13T10:32:38.775640 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79657], Delivering... [----] I, [2016-09-13T10:32:38.781902 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003278970718383789, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003298521041870117, :pending_vm_jobs=>0.0007748603820800781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005898952484130859} [----] I, [2016-09-13T10:32:38.782266 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79657], State: [ok], Delivered in [0.006611681] seconds [----] I, [2016-09-13T10:32:38.788249 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79656], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.549012005] seconds [----] I, [2016-09-13T10:32:38.788457 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79656], Delivering... [----] I, [2016-09-13T10:32:38.792824 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79656], State: [ok], Delivered in [0.004386619] seconds [----] I, [2016-09-13T10:32:49.311458 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:32:49.346884 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79658], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:32:49.679155 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:32:49.682312 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004054069519042969, :worker_monitor=>1.3002650737762451, :worker_dequeue=>0.006898641586303711, :total_time=>1.3115229606628418} [----] I, [2016-09-13T10:32:49.890182 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79658], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.572619614] seconds [----] I, [2016-09-13T10:32:49.890358 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79658], Delivering... [----] I, [2016-09-13T10:32:49.894750 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002384185791015625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002397775650024414, :pending_vm_jobs=>0.0005204677581787109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00406956672668457} [----] I, [2016-09-13T10:32:49.894980 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79658], State: [ok], Delivered in [0.004631214] seconds [----] I, [2016-09-13T10:33:04.356687 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:33:04.378091 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79659], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:33:04.393886 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79660], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:33:04.430229 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79661], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:33:04.453255 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79662], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:33:06.241036 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:33:06.245492 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004186153411865234, :worker_monitor=>1.4115710258483887, :worker_dequeue=>0.012868404388427734, :total_time=>1.429027795791626} [----] I, [2016-09-13T10:33:06.258743 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79659], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.897563504] seconds [----] I, [2016-09-13T10:33:06.258923 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79659], Delivering... [----] I, [2016-09-13T10:33:06.310210 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79659], State: [ok], Delivered in [0.051255417] seconds [----] I, [2016-09-13T10:33:06.332951 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79662], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.896983025] seconds [----] I, [2016-09-13T10:33:06.333120 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79662], Delivering... [----] I, [2016-09-13T10:33:06.339013 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030655860900878906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030851364135742188, :pending_vm_jobs=>0.0007171630859375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005540370941162109} [----] I, [2016-09-13T10:33:06.339384 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79662], State: [ok], Delivered in [0.006249098] seconds [----] I, [2016-09-13T10:33:08.899686 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79660], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.515804133] seconds [----] I, [2016-09-13T10:33:08.899899 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79660], Delivering... [----] I, [2016-09-13T10:33:08.903384 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79660], State: [ok], Delivered in [0.003463454] seconds [----] I, [2016-09-13T10:33:08.922117 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79661], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.520156178] seconds [----] I, [2016-09-13T10:33:08.922388 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79661], Delivering... [----] I, [2016-09-13T10:33:08.927120 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79661], State: [ok], Delivered in [0.004741063] seconds [----] I, [2016-09-13T10:33:11.246007 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:33:11 UTC]... [----] I, [2016-09-13T10:33:11.264396 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:33:11 UTC]...Complete [----] I, [2016-09-13T10:33:19.465500 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:33:19.481550 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79663], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:33:22.790675 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:33:22.793737 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004034757614135742, :worker_monitor=>1.4782629013061523, :worker_dequeue=>0.006796121597290039, :total_time=>1.4893991947174072} [----] I, [2016-09-13T10:33:23.110612 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79663], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.638928528] seconds [----] I, [2016-09-13T10:33:23.110771 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79663], Delivering... [----] I, [2016-09-13T10:33:23.116661 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00296783447265625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002985239028930664, :pending_vm_jobs=>0.0007944107055664062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00554656982421875} [----] I, [2016-09-13T10:33:23.117000 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79663], State: [ok], Delivered in [0.006216336] seconds [----] I, [2016-09-13T10:33:34.492448 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T10:33:34.516209 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79664], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:33:34.527780 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79665], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:33:34.539738 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79666], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:33:34.556031 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79667], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:33:39.073394 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:33:39.077831 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003032684326171875, :worker_monitor=>1.240177869796753, :worker_dequeue=>0.00967717170715332, :total_time=>1.2531192302703857} [----] I, [2016-09-13T10:33:39.270728 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79664], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.77436074] seconds [----] I, [2016-09-13T10:33:39.270898 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79664], Delivering... [----] I, [2016-09-13T10:33:39.271764 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T10:33:39.271947 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4561199104 [----] I, [2016-09-13T10:33:39.272029 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4327632896 [----] I, [2016-09-13T10:33:39.272099 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 233566208 [----] I, [2016-09-13T10:33:39.272170 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T10:33:39.272236 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4270936064 [----] I, [2016-09-13T10:33:39.272321 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T10:33:39.272391 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T10:33:39.272517 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 555913216 [----] I, [2016-09-13T10:33:39.272604 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T10:33:39.272710 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6653480960 [----] I, [2016-09-13T10:33:39.272791 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T10:33:39.272857 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T10:33:39.272921 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T10:33:39.272994 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T10:33:39.273059 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T10:33:39.273120 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T10:33:39.273179 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T10:33:39.273239 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T10:33:39.273321 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T10:33:39.273388 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T10:33:39.273488 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 271872000 [----] I, [2016-09-13T10:33:39.273562 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 54800384 [----] I, [2016-09-13T10:33:39.273626 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217071616 [----] I, [2016-09-13T10:33:39.273688 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T10:33:39.273752 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141873152 [----] I, [2016-09-13T10:33:39.273813 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3419279360 [----] I, [2016-09-13T10:33:39.273875 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3103137792 [----] I, [2016-09-13T10:33:39.273937 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T10:33:39.273997 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T10:33:39.274065 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T10:33:39.274122 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36384768 [----] I, [2016-09-13T10:33:39.274182 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76967936 [----] I, [2016-09-13T10:33:39.274243 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49745920 [----] I, [2016-09-13T10:33:39.274323 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111497216 [----] I, [2016-09-13T10:33:39.274401 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126713856 [----] I, [2016-09-13T10:33:39.274505 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T10:33:39.274579 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T10:33:39.274645 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T10:33:39.274706 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T10:33:39.274768 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T10:33:39.274833 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T10:33:39.274897 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T10:33:39.274963 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T10:33:39.275023 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T10:33:39.310126 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T10:33:39.310334 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T10:33:39.313735 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T10:33:39.316109 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T10:33:39.318955 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T10:33:39.321880 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T10:33:39.324743 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T10:33:39.327540 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 855 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T10:33:39.330359 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T10:33:39.333248 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T10:33:39.336210 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T10:33:39.339022 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T10:33:39.341878 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T10:33:39.344596 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T10:33:39.347117 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:33:39.347247 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:33:39.347366 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T10:33:39.351364 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358594000], Memory % [5.27], CPU Time [154150.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T10:33:39.351723 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79664], State: [ok], Delivered in [0.08080152] seconds [----] I, [2016-09-13T10:33:39.373373 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79665], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.853591207] seconds [----] I, [2016-09-13T10:33:39.373572 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79665], Delivering... [----] I, [2016-09-13T10:33:39.380001 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:33:35 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347780000], Memory % [5.04], CPU Time [105974.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T10:33:39.380611 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:33:38 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202685000], Memory % [3.38], CPU Time [153257.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:33:39.381105 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:33:36 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169745000], Memory % [3.14], CPU Time [52436.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:33:39.381564 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:33:30 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [213406000], Memory % [3.5], CPU Time [49799.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T10:33:39.382021 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:33:34 UTC], Process Info: Memory Usage [286867456], Memory Size [627494912], Proportional Set Size: [206076000], Memory % [3.5], CPU Time [244239.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T10:33:39.382545 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:33:36 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163159000], Memory % [3.1], CPU Time [38628.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T10:33:39.383018 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:33:35 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359295000], Memory % [5.28], CPU Time [207280.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T10:33:39.383521 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:33:38 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201169000], Memory % [3.36], CPU Time [154159.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:33:39.386066 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:33:36 UTC], Process Info: Memory Usage [602046464], Memory Size [933191680], Proportional Set Size: [440777000], Memory % [7.34], CPU Time [1221.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T10:33:39.388043 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:33:29 UTC], Process Info: Memory Usage [601583616], Memory Size [945352704], Proportional Set Size: [439907000], Memory % [7.33], CPU Time [468.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T10:33:39.388563 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:33:35 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358594000], Memory % [5.27], CPU Time [213159.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T10:33:39.389022 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:33:36 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178486000], Memory % [3.2], CPU Time [52415.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:33:39.389485 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:33:37 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166760000], Memory % [3.16], CPU Time [39516.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T10:33:39.389792 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79665], State: [ok], Delivered in [0.016219086] seconds [----] I, [2016-09-13T10:33:39.418999 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79667], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.873508704] seconds [----] I, [2016-09-13T10:33:39.419164 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79667], Delivering... [----] I, [2016-09-13T10:33:39.425103 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003110647201538086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031557083129882812, :pending_vm_jobs=>0.000728607177734375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005608081817626953} [----] I, [2016-09-13T10:33:39.425412 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79667], State: [ok], Delivered in [0.006244011] seconds [----] I, [2016-09-13T10:33:42.013718 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79666], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.481630168] seconds [----] I, [2016-09-13T10:33:42.013867 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79666], Delivering... [----] I, [2016-09-13T10:33:42.017879 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79666], State: [ok], Delivered in [0.003993929] seconds [----] I, [2016-09-13T10:33:44.078460 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:33:44 UTC]... [----] I, [2016-09-13T10:33:44.099355 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:33:44 UTC]...Complete [----] I, [2016-09-13T10:33:49.567658 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:33:49.586159 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79668], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:33:55.426265 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:33:55.430504 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038499832153320312, :worker_monitor=>1.2882885932922363, :worker_dequeue=>0.009003877639770508, :total_time=>1.3014638423919678} [----] I, [2016-09-13T10:33:55.556488 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79668], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.982739046] seconds [----] I, [2016-09-13T10:33:55.556722 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79668], Delivering... [----] I, [2016-09-13T10:33:55.562801 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003148794174194336, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003165721893310547, :pending_vm_jobs=>0.000743865966796875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005704402923583984} [----] I, [2016-09-13T10:33:55.563156 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79668], State: [ok], Delivered in [0.006440368] seconds [----] I, [2016-09-13T10:34:04.600929 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 14. [----] I, [2016-09-13T10:34:04.619228 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79669], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:34:04.630606 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79670], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:34:04.653677 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79671], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:34:04.680038 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79672], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:34:04.705189 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79673], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:34:05.518031 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:34:05.637080 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79669], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.02882655] seconds [----] I, [2016-09-13T10:34:05.637246 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79669], Delivering... [----] I, [2016-09-13T10:34:05.691400 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79669], State: [ok], Delivered in [0.054130814] seconds [----] I, [2016-09-13T10:34:05.705221 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79673], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.01570278] seconds [----] I, [2016-09-13T10:34:05.705499 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79673], Delivering... [----] I, [2016-09-13T10:34:05.711835 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033190250396728516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033392906188964844, :pending_vm_jobs=>0.0007786750793457031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005959272384643555} [----] I, [2016-09-13T10:34:05.712146 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79673], State: [ok], Delivered in [0.006699989] seconds [----] I, [2016-09-13T10:34:06.079783 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79670], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.454836172] seconds [----] I, [2016-09-13T10:34:06.079937 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79670], Delivering... [----] I, [2016-09-13T10:34:06.082515 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79670], State: [ok], Delivered in [0.002580038] seconds [----] I, [2016-09-13T10:34:06.110832 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79671], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.47208426] seconds [----] I, [2016-09-13T10:34:06.111018 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79671], Delivering... [----] I, [2016-09-13T10:34:06.115489 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79671], State: [ok], Delivered in [0.004448301] seconds [----] I, [2016-09-13T10:34:06.116175 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79672], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.445274089] seconds [----] I, [2016-09-13T10:34:06.116320 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79672], Delivering... [----] I, [2016-09-13T10:34:06.139221 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79674], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T10:34:06.139549 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79672], State: [ok], Delivered in [0.023238766] seconds [----] I, [2016-09-13T10:34:11.746116 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T10:34:11.746355 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00318145751953125, :worker_monitor=>1.2070424556732178, :worker_dequeue=>0.01244354248046875, :total_time=>1.2229669094085693} [----] I, [2016-09-13T10:34:16.281077 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [79674], MiqWorker id: [102], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [10.152093476] seconds [----] I, [2016-09-13T10:34:16.281342 #17546:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79674], Delivering... [----] I, [2016-09-13T10:34:16.285459 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T10:34:16.285647 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T10:34:16.285785 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T10:34:16.285978 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T10:34:16.286157 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:16.732720 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:16.746824 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:34:16 UTC]... [----] I, [2016-09-13T10:34:16.771497 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:34:16 UTC]...Complete [----] I, [2016-09-13T10:34:17.040406 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:17.040617 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:17.529581 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:17.837246 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:17.837378 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:18.349764 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:18.683458 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:18.683586 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:19.169766 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:19.489411 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:19.489643 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:19.717716 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:34:19.737257 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79675], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:34:19.955954 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:20.253930 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:20.254076 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:20.698782 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:20.990458 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:20.990638 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:21.465023 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:21.766974 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:21.767192 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:21.799941 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:34:21.840636 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79675], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.117459737] seconds [----] I, [2016-09-13T10:34:21.840846 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79675], Delivering... [----] I, [2016-09-13T10:34:21.847592 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003525972366333008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00354766845703125, :pending_vm_jobs=>0.0008370876312255859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006396055221557617} [----] I, [2016-09-13T10:34:21.847998 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79675], State: [ok], Delivered in [0.007170904] seconds [----] I, [2016-09-13T10:34:22.272658 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:22.581451 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:22.581620 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:23.134404 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:23.431451 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:23.431565 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:23.882880 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:24.201484 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:24.201656 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:24.688676 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:28.146791 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003795623779296875, :worker_monitor=>1.3221957683563232, :worker_dequeue=>0.009051799774169922, :total_time=>1.3354225158691406} [----] I, [2016-09-13T10:34:30.990961 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:30.991091 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:31.454447 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:31.751706 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:31.751876 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:32.259762 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:32.568007 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:32.568175 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:33.043774 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:33.207379 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:33.345044 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:33.490530 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:33.629356 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:33.765744 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:33.924492 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:34.091486 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:34.223066 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:34.365844 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:34.503912 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:34.640283 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:34.749410 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:34:34.765987 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79676], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:34:34.772298 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:34.784605 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79677], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:34:34.911710 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:35.053905 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:35.551440 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:35.728660 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:35.871823 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:36.012258 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:36.161735 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:36.304696 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:36.436850 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:36.571044 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:36.716928 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:36.855310 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:36.997448 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:37.143835 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:37.278313 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:37.416723 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:37.558061 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:37.690030 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:37.827075 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:38.172565 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:34:38.216252 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:38.365651 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:38.499006 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:38.638363 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:38.782586 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:38.918983 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:38.920363 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79677], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.148618645] seconds [----] I, [2016-09-13T10:34:38.920567 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79677], Delivering... [----] I, [2016-09-13T10:34:38.930182 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004984617233276367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005010843276977539, :pending_vm_jobs=>0.0012164115905761719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009191036224365234} [----] I, [2016-09-13T10:34:38.930689 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79677], State: [ok], Delivered in [0.010099229] seconds [----] I, [2016-09-13T10:34:39.057050 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:39.196840 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:39.225209 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79676], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.47123374] seconds [----] I, [2016-09-13T10:34:39.225485 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79676], Delivering... [----] I, [2016-09-13T10:34:39.231110 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79676], State: [ok], Delivered in [0.005637163] seconds [----] I, [2016-09-13T10:34:39.338192 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:39.470899 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:39.613621 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:39.762180 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:39.895163 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:40.033149 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:40.168676 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:40.321151 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:40.460839 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:40.891546 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:41.041285 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:41.180524 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:41.320310 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:41.460570 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:41.594316 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:41.753167 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:44.254690 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037920475006103516, :worker_monitor=>1.064500331878662, :worker_dequeue=>0.008655786514282227, :total_time=>1.0773053169250488} [----] I, [2016-09-13T10:34:48.117309 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:48.253989 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:48.417098 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:48.566076 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:48.706465 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:48.867532 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:49.005516 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:49.160740 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:49.255180 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:34:49 UTC]... [----] I, [2016-09-13T10:34:49.304727 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:49.325920 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:34:49 UTC]...Complete [----] I, [2016-09-13T10:34:49.443704 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:49.796246 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:34:49.823329 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79678], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:34:49.927591 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:50.076553 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:50.209842 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:50.399832 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:50.544836 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:50.685107 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:50.823248 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:50.955154 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:51.095250 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:51.233666 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:51.369286 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:51.501372 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:51.678590 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:51.814498 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:51.954513 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:52.099111 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:52.233781 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:52.699997 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:52.845783 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:52.985468 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:53.125798 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:53.285325 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:53.431583 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:53.569884 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:53.715121 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:53.852524 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:53.990108 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:54.138755 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:54.270600 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:54.346652 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:34:54.409533 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:54.545072 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:54.693102 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:54.837397 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:54.984054 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:55.059086 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79678], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.256433911] seconds [----] I, [2016-09-13T10:34:55.059278 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79678], Delivering... [----] I, [2016-09-13T10:34:55.065608 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034232139587402344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034432411193847656, :pending_vm_jobs=>0.0007643699645996094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005964756011962891} [----] I, [2016-09-13T10:34:55.065942 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79678], State: [ok], Delivered in [0.0066723] seconds [----] I, [2016-09-13T10:34:55.671386 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:55.820106 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:55.965760 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:56.116566 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:56.259541 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:56.404938 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:56.542971 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:56.678063 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:56.822753 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:56.977743 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:57.130078 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:57.265478 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:57.399191 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:57.537140 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:57.685893 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:57.828735 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:57.968906 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:58.521720 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:58.678069 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:34:58.823340 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:00.569392 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003449678421020508, :worker_monitor=>1.2055020332336426, :worker_dequeue=>0.008827686309814453, :total_time=>1.2180840969085693} [----] I, [2016-09-13T10:35:04.834548 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:35:04.851730 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79679], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:35:04.868786 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79680], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:35:04.880249 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79681], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:35:04.891592 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79682], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:35:04.974446 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:05.114364 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:05.255352 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:05.405897 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:05.549186 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:05.681076 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:35:05.701766 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:05.839538 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:05.973760 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:06.112193 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:06.132310 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79679], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.293688175] seconds [----] I, [2016-09-13T10:35:06.132541 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79679], Delivering... [----] I, [2016-09-13T10:35:06.189350 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79679], State: [ok], Delivered in [0.056773275] seconds [----] I, [2016-09-13T10:35:06.212495 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79682], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.327550392] seconds [----] I, [2016-09-13T10:35:06.212679 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79682], Delivering... [----] I, [2016-09-13T10:35:06.218992 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032863616943359375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003305673599243164, :pending_vm_jobs=>0.0007984638214111328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005965709686279297} [----] I, [2016-09-13T10:35:06.219391 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79682], State: [ok], Delivered in [0.006699909] seconds [----] I, [2016-09-13T10:35:06.257228 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:06.303708 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79680], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.447302904] seconds [----] I, [2016-09-13T10:35:06.303931 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79680], Delivering... [----] I, [2016-09-13T10:35:06.307636 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79680], State: [ok], Delivered in [0.003703089] seconds [----] I, [2016-09-13T10:35:06.326630 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79681], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.452949666] seconds [----] I, [2016-09-13T10:35:06.326907 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79681], Delivering... [----] I, [2016-09-13T10:35:06.333671 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79681], State: [ok], Delivered in [0.00675878] seconds [----] I, [2016-09-13T10:35:06.403375 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:06.538091 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:06.673401 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:06.808448 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:07.160582 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:07.317403 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:07.462036 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:07.607010 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:07.749303 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:07.888542 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:08.024581 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:08.166958 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:08.306017 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:08.450603 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:08.591705 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:08.725763 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:08.862992 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:08.999687 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:09.133883 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:09.270988 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:09.404233 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:09.772568 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:09.929341 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:10.062815 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:10.206120 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:10.349612 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:10.493068 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:10.639582 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:10.783165 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:10.920223 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:11.055405 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:11.195974 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:11.331755 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:11.467457 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:11.605797 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:11.817284 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:11.974867 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:12.130771 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:12.673046 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:12.845474 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:13.033577 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:13.195654 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:13.378952 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:13.527733 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:13.668667 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:13.809678 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:13.953528 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:14.089192 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:14.224943 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:14.366773 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:14.507007 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:14.650285 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:14.790571 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:14.925856 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:15.071243 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:15.509479 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:15.682068 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:15.826260 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:16.923351 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003305196762084961, :worker_monitor=>1.2136189937591553, :worker_dequeue=>0.004981517791748047, :total_time=>1.222132921218872} [----] I, [2016-09-13T10:35:19.901633 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:35:19.932176 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79683], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:35:21.923935 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:35:21 UTC]... [----] I, [2016-09-13T10:35:21.954814 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:35:21 UTC]...Complete [----] I, [2016-09-13T10:35:21.966587 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:35:21.979983 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:22.121044 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:22.260846 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:22.360677 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79683], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.454445593] seconds [----] I, [2016-09-13T10:35:22.360844 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79683], Delivering... [----] I, [2016-09-13T10:35:22.366872 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027680397033691406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027840137481689453, :pending_vm_jobs=>0.0007233619689941406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005686283111572266} [----] I, [2016-09-13T10:35:22.367307 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79683], State: [ok], Delivered in [0.006422076] seconds [----] I, [2016-09-13T10:35:22.407708 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:22.548258 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:22.682401 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:22.831289 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:22.975693 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:23.111348 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:23.248666 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:23.388534 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:23.520578 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:23.656537 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:23.801368 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:24.281592 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:24.443687 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:24.597111 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:24.743556 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:24.882698 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:25.021811 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:25.158482 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:25.301889 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:25.437520 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:25.576353 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:25.716329 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:25.856069 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:25.993584 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:26.132191 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:26.271919 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:26.406481 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:26.541815 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:26.964742 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:27.112576 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:27.254641 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:27.399657 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:27.534334 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:27.670535 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:27.815239 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:27.953592 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:28.096129 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:28.239629 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:28.383173 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:28.520169 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:28.653025 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:28.798154 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:28.947372 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:29.084035 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:35:29.223340 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T10:35:29.467317 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T10:35:29.467715 #17546:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T10:35:29.468058 #17546:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T10:35:29.468167 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T10:35:29.468306 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T10:35:29.499929 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T10:35:29.500307 #17546:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [79674], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T10:35:29.500597 #17546:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T10:35:29.500869 #17546:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T10:35:29.501072 #17546:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79674], State: [error], Delivered in [73.219755073] seconds [----] I, [2016-09-13T10:35:31.997409 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T10:35:33.232733 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035903453826904297, :log_active_servers=>0.009348630905151367, :worker_monitor=>1.2251675128936768, :worker_dequeue=>0.009789466857910156, :total_time=>1.2482633590698242} [----] I, [2016-09-13T10:35:34.942144 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:35:34.958321 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79684], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:35:34.986118 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79685], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:35:38.240746 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:35:38.437644 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79685], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.472028713] seconds [----] I, [2016-09-13T10:35:38.437883 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79685], Delivering... [----] I, [2016-09-13T10:35:38.444555 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003569364547729492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003593921661376953, :pending_vm_jobs=>0.0007619857788085938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006222248077392578} [----] I, [2016-09-13T10:35:38.444968 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79685], State: [ok], Delivered in [0.00707498] seconds [----] I, [2016-09-13T10:35:39.404401 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79684], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.459231578] seconds [----] I, [2016-09-13T10:35:39.404598 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79684], Delivering... [----] I, [2016-09-13T10:35:39.409041 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79684], State: [ok], Delivered in [0.004437578] seconds [----] I, [2016-09-13T10:35:49.326527 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0031452178955078125, :worker_monitor=>1.0608155727386475, :worker_dequeue=>0.004786491394042969, :total_time=>1.0690746307373047} [----] I, [2016-09-13T10:35:49.998754 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:35:50.022631 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79686], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:35:54.326964 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:35:54 UTC]... [----] I, [2016-09-13T10:35:54.342306 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:35:54 UTC]...Complete [----] I, [2016-09-13T10:35:54.358915 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:35:54.502914 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79686], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.497294494] seconds [----] I, [2016-09-13T10:35:54.503159 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79686], Delivering... [----] I, [2016-09-13T10:35:54.511964 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004579782485961914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004601716995239258, :pending_vm_jobs=>0.0011534690856933594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008270502090454102} [----] I, [2016-09-13T10:35:54.512448 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79686], State: [ok], Delivered in [0.009258178] seconds [----] I, [2016-09-13T10:36:05.035360 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:36:05.045244 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79687], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:36:05.056560 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79688], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:36:05.067965 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79689], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:36:05.079767 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79690], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:36:05.475110 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:36:05.478930 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038111209869384766, :worker_monitor=>1.0888919830322266, :worker_dequeue=>0.00851130485534668, :total_time=>1.1015548706054688} [----] I, [2016-09-13T10:36:05.675022 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79687], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.635487711] seconds [----] I, [2016-09-13T10:36:05.675208 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79687], Delivering... [----] I, [2016-09-13T10:36:05.679839 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79690], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.607784579] seconds [----] I, [2016-09-13T10:36:05.680037 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79690], Delivering... [----] I, [2016-09-13T10:36:05.686499 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034332275390625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034525394439697266, :pending_vm_jobs=>0.0007882118225097656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060384273529052734} [----] I, [2016-09-13T10:36:05.686906 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79690], State: [ok], Delivered in [0.006869114] seconds [----] I, [2016-09-13T10:36:05.725677 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79687], State: [ok], Delivered in [0.050429696] seconds [----] I, [2016-09-13T10:36:06.525490 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79688], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.474533896] seconds [----] I, [2016-09-13T10:36:06.525629 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79688], Delivering... [----] I, [2016-09-13T10:36:06.527612 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79688], State: [ok], Delivered in [0.001981157] seconds [----] I, [2016-09-13T10:36:06.565804 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79689], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.504341064] seconds [----] I, [2016-09-13T10:36:06.566008 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79689], Delivering... [----] I, [2016-09-13T10:36:06.572369 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79689], State: [ok], Delivered in [0.006293889] seconds [----] I, [2016-09-13T10:36:20.091642 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:36:20.114208 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79691], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:36:22.018612 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:36:22.025954 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038504600524902344, :worker_monitor=>1.4017395973205566, :worker_dequeue=>0.015982627868652344, :total_time=>1.4218723773956299} [----] I, [2016-09-13T10:36:22.812402 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79691], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.712257153] seconds [----] I, [2016-09-13T10:36:22.812646 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79691], Delivering... [----] I, [2016-09-13T10:36:22.819361 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033223628997802734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003345489501953125, :pending_vm_jobs=>0.0008890628814697266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00635075569152832} [----] I, [2016-09-13T10:36:22.820028 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79691], State: [ok], Delivered in [0.007399524] seconds [----] I, [2016-09-13T10:36:27.026591 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:36:27 UTC]... [----] I, [2016-09-13T10:36:27.045670 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:36:27 UTC]...Complete [----] I, [2016-09-13T10:36:35.125326 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:36:35.142946 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79692], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:36:35.154251 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79693], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:36:38.234232 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:36:38.236603 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003437042236328125, :worker_monitor=>1.1557648181915283, :worker_dequeue=>0.0052950382232666016, :total_time=>1.1647703647613525} [----] I, [2016-09-13T10:36:38.931518 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79693], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.78367442] seconds [----] I, [2016-09-13T10:36:38.931640 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79693], Delivering... [----] I, [2016-09-13T10:36:38.935519 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021085739135742188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002121448516845703, :pending_vm_jobs=>0.0004642009735107422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0036563873291015625} [----] I, [2016-09-13T10:36:38.935750 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79693], State: [ok], Delivered in [0.004105501] seconds [----] I, [2016-09-13T10:36:39.645933 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79692], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.516511791] seconds [----] I, [2016-09-13T10:36:39.646097 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79692], Delivering... [----] I, [2016-09-13T10:36:39.651310 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79692], State: [ok], Delivered in [0.005166248] seconds [----] I, [2016-09-13T10:36:50.165450 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:36:50.205973 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79694], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:36:54.438843 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:36:54.443762 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002614259719848633, :worker_monitor=>1.1679332256317139, :worker_dequeue=>0.012751340866088867, :total_time=>1.1835613250732422} [----] I, [2016-09-13T10:36:54.726519 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79694], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.553376514] seconds [----] I, [2016-09-13T10:36:54.726730 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79694], Delivering... [----] I, [2016-09-13T10:36:54.733571 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035104751586914062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035452842712402344, :pending_vm_jobs=>0.0009317398071289062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006417512893676758} [----] I, [2016-09-13T10:36:54.733999 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79694], State: [ok], Delivered in [0.007259636] seconds [----] I, [2016-09-13T10:36:59.444538 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:36:59 UTC]... [----] I, [2016-09-13T10:36:59.462897 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:36:59 UTC]...Complete [----] I, [2016-09-13T10:37:05.217172 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:37:05.234667 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79695], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:37:05.257600 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79696], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:37:05.280490 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79697], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:37:05.303103 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79698], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:37:11.043857 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:37:11.047615 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038444995880126953, :worker_monitor=>1.5477955341339111, :worker_dequeue=>0.008308649063110352, :total_time=>1.560232162475586} [----] I, [2016-09-13T10:37:11.129641 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79695], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.908979838] seconds [----] I, [2016-09-13T10:37:11.129772 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79695], Delivering... [----] I, [2016-09-13T10:37:11.146519 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79698], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.858874919] seconds [----] I, [2016-09-13T10:37:11.146662 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79698], Delivering... [----] I, [2016-09-13T10:37:11.151198 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024869441986083984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025026798248291016, :pending_vm_jobs=>0.0005278587341308594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0042345523834228516} [----] I, [2016-09-13T10:37:11.151496 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79698], State: [ok], Delivered in [0.004817224] seconds [----] I, [2016-09-13T10:37:11.163635 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79695], State: [ok], Delivered in [0.033845628] seconds [----] I, [2016-09-13T10:37:12.810117 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79696], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.571160213] seconds [----] I, [2016-09-13T10:37:12.810379 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79696], Delivering... [----] I, [2016-09-13T10:37:12.819164 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79696], State: [ok], Delivered in [0.008784935] seconds [----] I, [2016-09-13T10:37:12.872895 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79697], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.609145619] seconds [----] I, [2016-09-13T10:37:12.873069 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79697], Delivering... [----] I, [2016-09-13T10:37:12.877713 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79697], State: [ok], Delivered in [0.004628155] seconds [----] I, [2016-09-13T10:37:20.311486 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:37:20.331539 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79699], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:37:21.215982 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:37:21.238183 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79699], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.920494598] seconds [----] I, [2016-09-13T10:37:21.238322 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79699], Delivering... [----] I, [2016-09-13T10:37:21.242351 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021719932556152344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021867752075195312, :pending_vm_jobs=>0.00045990943908691406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0037734508514404297} [----] I, [2016-09-13T10:37:21.242619 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79699], State: [ok], Delivered in [0.004293388] seconds [----] I, [2016-09-13T10:37:27.335290 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005468130111694336, :worker_monitor=>1.103226661682129, :worker_dequeue=>0.004547595977783203, :total_time=>1.1135587692260742} [----] I, [2016-09-13T10:37:32.335839 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:37:32 UTC]... [----] I, [2016-09-13T10:37:32.358470 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:37:32 UTC]...Complete [----] I, [2016-09-13T10:37:35.346107 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:37:35.364070 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79700], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:37:35.381201 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79701], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:37:37.381080 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:37:37.433149 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79701], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.062750087] seconds [----] I, [2016-09-13T10:37:37.433469 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79701], Delivering... [----] I, [2016-09-13T10:37:37.443392 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0051212310791015625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005151510238647461, :pending_vm_jobs=>0.0013341903686523438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009433507919311523} [----] I, [2016-09-13T10:37:37.443806 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79701], State: [ok], Delivered in [0.010386978] seconds [----] I, [2016-09-13T10:37:37.472800 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79700], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.122093017] seconds [----] I, [2016-09-13T10:37:37.472978 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79700], Delivering... [----] I, [2016-09-13T10:37:37.477070 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79700], State: [ok], Delivered in [0.004082751] seconds [----] I, [2016-09-13T10:37:43.639131 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004011869430541992, :worker_monitor=>1.2409961223602295, :worker_dequeue=>0.008827447891235352, :total_time=>1.2541022300720215} [----] I, [2016-09-13T10:37:50.393886 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:37:50.427447 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79702], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:37:53.661449 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:37:53.878513 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79702], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.478661901] seconds [----] I, [2016-09-13T10:37:53.878651 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79702], Delivering... [----] I, [2016-09-13T10:37:53.883167 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002424955368041992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024416446685791016, :pending_vm_jobs=>0.0005543231964111328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004239320755004883} [----] I, [2016-09-13T10:37:53.883488 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79702], State: [ok], Delivered in [0.004831135] seconds [----] I, [2016-09-13T10:37:59.979119 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003780364990234375, :worker_monitor=>1.3004257678985596, :worker_dequeue=>0.008783340454101562, :total_time=>1.3133423328399658} [----] I, [2016-09-13T10:38:04.979777 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:38:04 UTC]... [----] I, [2016-09-13T10:38:05.001094 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:38:04 UTC]...Complete [----] I, [2016-09-13T10:38:05.439946 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:38:05.458802 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79703], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:38:05.470756 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79704], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:38:05.486966 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79705], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:38:05.498375 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79706], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:38:10.021881 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:38:10.201508 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79703], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.757005226] seconds [----] I, [2016-09-13T10:38:10.201719 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79703], Delivering... [----] I, [2016-09-13T10:38:10.287522 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79703], State: [ok], Delivered in [0.085752936] seconds [----] I, [2016-09-13T10:38:10.309687 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79706], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.817707557] seconds [----] I, [2016-09-13T10:38:10.309785 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79706], Delivering... [----] I, [2016-09-13T10:38:10.313386 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0018925666809082031, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0019049644470214844, :pending_vm_jobs=>0.00043082237243652344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003372669219970703} [----] I, [2016-09-13T10:38:10.313590 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79706], State: [ok], Delivered in [0.003796958] seconds [----] I, [2016-09-13T10:38:10.338588 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79704], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.874388744] seconds [----] I, [2016-09-13T10:38:10.338726 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79704], Delivering... [----] I, [2016-09-13T10:38:10.340933 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79704], State: [ok], Delivered in [0.002210092] seconds [----] I, [2016-09-13T10:38:10.361409 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79705], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.883075743] seconds [----] I, [2016-09-13T10:38:10.361570 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79705], Delivering... [----] I, [2016-09-13T10:38:10.364666 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79705], State: [ok], Delivered in [0.003095028] seconds [----] I, [2016-09-13T10:38:16.204676 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003633260726928711, :worker_monitor=>1.169072151184082, :worker_dequeue=>0.006907939910888672, :total_time=>1.179889440536499} [----] I, [2016-09-13T10:38:20.509240 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:38:20.550304 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79707], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:38:21.315576 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:38:22.041788 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79707], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.526881543] seconds [----] I, [2016-09-13T10:38:22.041978 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79707], Delivering... [----] I, [2016-09-13T10:38:22.049466 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003709077835083008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003856658935546875, :pending_vm_jobs=>0.0009489059448242188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0069811344146728516} [----] I, [2016-09-13T10:38:22.049895 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79707], State: [ok], Delivered in [0.007901109] seconds [----] I, [2016-09-13T10:38:32.403760 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005879402160644531, :worker_monitor=>1.0564770698547363, :worker_dequeue=>0.0050048828125, :total_time=>1.0677144527435303} [----] I, [2016-09-13T10:38:35.561780 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T10:38:35.580853 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79708], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:38:35.597057 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79709], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:38:35.617088 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79710], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:38:35.628150 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79711], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:38:37.404181 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:38:37 UTC]... [----] I, [2016-09-13T10:38:37.428157 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:38:37 UTC]...Complete [----] I, [2016-09-13T10:38:37.438971 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:38:37.645735 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79708], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.079292418] seconds [----] I, [2016-09-13T10:38:37.645935 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79708], Delivering... [----] I, [2016-09-13T10:38:37.647624 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T10:38:37.647855 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4575551488 [----] I, [2016-09-13T10:38:37.647970 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4341706752 [----] I, [2016-09-13T10:38:37.648060 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 233844736 [----] I, [2016-09-13T10:38:37.648148 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 918552576 [----] I, [2016-09-13T10:38:37.648238 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4285009920 [----] I, [2016-09-13T10:38:37.648352 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T10:38:37.648467 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T10:38:37.648582 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 556195840 [----] I, [2016-09-13T10:38:37.648672 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T10:38:37.648757 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6806720512 [----] I, [2016-09-13T10:38:37.648837 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T10:38:37.648924 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T10:38:37.649000 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T10:38:37.649082 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T10:38:37.649161 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T10:38:37.649268 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T10:38:37.649359 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T10:38:37.649469 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T10:38:37.649574 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T10:38:37.649656 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T10:38:37.649734 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 271876096 [----] I, [2016-09-13T10:38:37.649808 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 54800384 [----] I, [2016-09-13T10:38:37.649885 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217075712 [----] I, [2016-09-13T10:38:37.649965 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6111232 [----] I, [2016-09-13T10:38:37.650042 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141873152 [----] I, [2016-09-13T10:38:37.650117 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3405467648 [----] I, [2016-09-13T10:38:37.650186 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3089043456 [----] I, [2016-09-13T10:38:37.650279 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T10:38:37.650363 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T10:38:37.650469 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T10:38:37.650572 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36610048 [----] I, [2016-09-13T10:38:37.650664 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76967936 [----] I, [2016-09-13T10:38:37.650763 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49766400 [----] I, [2016-09-13T10:38:37.650864 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111497216 [----] I, [2016-09-13T10:38:37.650960 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126734336 [----] I, [2016-09-13T10:38:37.651048 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T10:38:37.651139 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T10:38:37.651222 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T10:38:37.651319 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T10:38:37.651410 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T10:38:37.651548 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T10:38:37.651643 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T10:38:37.651723 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T10:38:37.651811 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T10:38:37.706075 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T10:38:37.706316 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T10:38:37.710664 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T10:38:37.713823 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T10:38:37.717512 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T10:38:37.721187 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T10:38:37.724958 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T10:38:37.728736 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 854 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T10:38:37.732501 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T10:38:37.736180 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T10:38:37.739658 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T10:38:37.743733 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T10:38:37.747162 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T10:38:37.750686 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T10:38:37.753909 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:38:37.754085 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:38:37.754211 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T10:38:37.758994 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358594000], Memory % [5.27], CPU Time [213211.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T10:38:37.759394 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79708], State: [ok], Delivered in [0.11345493] seconds [----] I, [2016-09-13T10:38:37.795546 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79709], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.210274139] seconds [----] I, [2016-09-13T10:38:37.795740 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79709], Delivering... [----] I, [2016-09-13T10:38:37.803641 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:38:20 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208116000], Memory % [3.52], CPU Time [244351.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T10:38:37.804164 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:38:23 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347781000], Memory % [5.04], CPU Time [105987.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T10:38:37.804714 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:38:30 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [213406000], Memory % [3.5], CPU Time [49833.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T10:38:37.805286 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:38:31 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163160000], Memory % [3.1], CPU Time [38637.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T10:38:37.805894 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:38:32 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202685000], Memory % [3.38], CPU Time [153367.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:38:37.806529 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:38:31 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359295000], Memory % [5.28], CPU Time [207356.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T10:38:37.807069 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:38:32 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201169000], Memory % [3.36], CPU Time [154246.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:38:37.807684 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:38:30 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169746000], Memory % [3.14], CPU Time [52449.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:38:37.810690 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:38:29 UTC], Process Info: Memory Usage [613097472], Memory Size [1071751168], Proportional Set Size: [451736000], Memory % [7.47], CPU Time [1358.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T10:38:37.812914 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:38:29 UTC], Process Info: Memory Usage [601812992], Memory Size [960032768], Proportional Set Size: [440266000], Memory % [7.34], CPU Time [479.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T10:38:37.813584 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:38:31 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358594000], Memory % [5.27], CPU Time [213221.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T10:38:37.814299 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:38:30 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178487000], Memory % [3.2], CPU Time [52429.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:38:37.814893 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:38:25 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166761000], Memory % [3.16], CPU Time [39525.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T10:38:37.815254 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79709], State: [ok], Delivered in [0.019509253] seconds [----] I, [2016-09-13T10:38:37.839932 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79711], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.217228959] seconds [----] I, [2016-09-13T10:38:37.840114 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79711], Delivering... [----] I, [2016-09-13T10:38:37.846717 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033113956451416016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033333301544189453, :pending_vm_jobs=>0.0008704662322998047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062029361724853516} [----] I, [2016-09-13T10:38:37.847068 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79711], State: [ok], Delivered in [0.006949624] seconds [----] I, [2016-09-13T10:38:37.874390 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79710], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.273240772] seconds [----] I, [2016-09-13T10:38:37.874606 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79710], Delivering... [----] I, [2016-09-13T10:38:37.879499 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79710], State: [ok], Delivered in [0.004887104] seconds [----] I, [2016-09-13T10:38:48.757148 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005498647689819336, :worker_monitor=>1.2879364490509033, :worker_dequeue=>0.006506443023681641, :total_time=>1.3003990650177002} [----] I, [2016-09-13T10:38:50.639533 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:38:50.658488 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79712], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:38:53.763440 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:38:54.274554 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79712], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.629055787] seconds [----] I, [2016-09-13T10:38:54.274768 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79712], Delivering... [----] I, [2016-09-13T10:38:54.281977 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038022994995117188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038547515869140625, :pending_vm_jobs=>0.0009224414825439453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006792306900024414} [----] I, [2016-09-13T10:38:54.282476 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79712], State: [ok], Delivered in [0.007659336] seconds [----] I, [2016-09-13T10:39:04.829535 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0052394866943359375, :worker_monitor=>1.0390729904174805, :worker_dequeue=>0.0052547454833984375, :total_time=>1.0498530864715576} [----] I, [2016-09-13T10:39:05.669836 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:39:05.687003 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79713], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:39:05.702795 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79714], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:39:05.720003 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79715], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:39:05.731317 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79716], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:39:09.830054 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:39:09 UTC]... [----] I, [2016-09-13T10:39:09.851543 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:39:09 UTC]...Complete [----] I, [2016-09-13T10:39:09.864607 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:39:10.366159 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79713], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.691774945] seconds [----] I, [2016-09-13T10:39:10.366400 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79713], Delivering... [----] I, [2016-09-13T10:39:10.411802 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79716], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.686055687] seconds [----] I, [2016-09-13T10:39:10.412001 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79716], Delivering... [----] I, [2016-09-13T10:39:10.419910 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004041433334350586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00407719612121582, :pending_vm_jobs=>0.0010530948638916016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00748133659362793} [----] I, [2016-09-13T10:39:10.420324 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79716], State: [ok], Delivered in [0.008299794] seconds [----] I, [2016-09-13T10:39:10.434516 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79713], State: [ok], Delivered in [0.068072989] seconds [----] I, [2016-09-13T10:39:10.543203 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79714], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.85064267] seconds [----] I, [2016-09-13T10:39:10.543538 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79714], Delivering... [----] I, [2016-09-13T10:39:10.547179 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79714], State: [ok], Delivered in [0.003646759] seconds [----] I, [2016-09-13T10:39:10.572274 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79715], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.861530354] seconds [----] I, [2016-09-13T10:39:10.572630 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79715], Delivering... [----] I, [2016-09-13T10:39:10.579121 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79715], State: [ok], Delivered in [0.006507053] seconds [----] I, [2016-09-13T10:39:20.752215 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:39:20.777533 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79717], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:39:21.144806 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:39:21.147607 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00384521484375, :worker_monitor=>1.2548818588256836, :worker_dequeue=>0.006067752838134766, :total_time=>1.265054702758789} [----] I, [2016-09-13T10:39:21.511557 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79717], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.753396113] seconds [----] I, [2016-09-13T10:39:21.511685 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79717], Delivering... [----] I, [2016-09-13T10:39:21.516183 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023026466369628906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023403167724609375, :pending_vm_jobs=>0.0005631446838378906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004190921783447266} [----] I, [2016-09-13T10:39:21.516406 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79717], State: [ok], Delivered in [0.004719785] seconds [----] I, [2016-09-13T10:39:35.790360 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:39:35.809145 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79718], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:39:35.820182 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79719], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:39:37.623903 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:39:37.628474 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004911899566650391, :worker_monitor=>1.3776295185089111, :worker_dequeue=>0.010274410247802734, :total_time=>1.3932080268859863} [----] I, [2016-09-13T10:39:37.683787 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79719], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.868602928] seconds [----] I, [2016-09-13T10:39:37.683973 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79719], Delivering... [----] I, [2016-09-13T10:39:37.691175 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037343502044677734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037565231323242188, :pending_vm_jobs=>0.0009443759918212891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006751537322998047} [----] I, [2016-09-13T10:39:37.691528 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79719], State: [ok], Delivered in [0.007552392] seconds [----] I, [2016-09-13T10:39:37.735001 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79718], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.940071222] seconds [----] I, [2016-09-13T10:39:37.735267 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79718], Delivering... [----] I, [2016-09-13T10:39:37.740520 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79718], State: [ok], Delivered in [0.005283447] seconds [----] I, [2016-09-13T10:39:42.629033 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:39:42 UTC]... [----] I, [2016-09-13T10:39:42.649058 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:39:42 UTC]...Complete [----] I, [2016-09-13T10:39:50.834939 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:39:50.849152 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79720], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:39:54.187034 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:39:54.190365 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003774404525756836, :worker_monitor=>1.498283863067627, :worker_dequeue=>0.007214069366455078, :total_time=>1.5094902515411377} [----] I, [2016-09-13T10:39:54.712874 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79720], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.872076392] seconds [----] I, [2016-09-13T10:39:54.713198 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79720], Delivering... [----] I, [2016-09-13T10:39:54.724411 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005728960037231445, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005816221237182617, :pending_vm_jobs=>0.0014200210571289062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010511398315429688} [----] I, [2016-09-13T10:39:54.724942 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79720], State: [ok], Delivered in [0.011747864] seconds [----] I, [2016-09-13T10:40:05.861848 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 8. [----] I, [2016-09-13T10:40:05.871988 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79721], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:40:05.883396 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79722], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:40:05.894806 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79723], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:40:05.906362 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79724], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:40:05.929395 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79725], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:40:05.940845 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79726], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:40:05.952339 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79727], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:40:10.448745 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 7 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:40:10.451265 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004075050354003906, :worker_monitor=>1.2232930660247803, :worker_dequeue=>0.005647897720336914, :total_time=>1.2333414554595947} [----] I, [2016-09-13T10:40:10.844334 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79724], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.947040292] seconds [----] I, [2016-09-13T10:40:10.844578 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79724], Delivering... [----] I, [2016-09-13T10:40:10.889886 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79727], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.945613965] seconds [----] I, [2016-09-13T10:40:10.890076 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79727], Delivering... [----] I, [2016-09-13T10:40:10.895802 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79721], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.028447193] seconds [----] I, [2016-09-13T10:40:10.896033 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79721], Delivering... [----] I, [2016-09-13T10:40:10.896475 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031745433807373047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003196239471435547, :pending_vm_jobs=>0.0007915496826171875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005953550338745117} [----] I, [2016-09-13T10:40:10.896781 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79727], State: [ok], Delivered in [0.006709919] seconds [----] I, [2016-09-13T10:40:10.899098 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79721], State: [ok], Delivered in [0.003062457] seconds [----] I, [2016-09-13T10:40:10.912645 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79724], State: [ok], Delivered in [0.068033727] seconds [----] I, [2016-09-13T10:40:10.924114 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79722], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.048859652] seconds [----] I, [2016-09-13T10:40:10.924324 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79722], Delivering... [----] I, [2016-09-13T10:40:10.935210 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79722], State: [ok], Delivered in [0.010893588] seconds [----] I, [2016-09-13T10:40:10.970312 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79723], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.083687603] seconds [----] I, [2016-09-13T10:40:10.970537 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79723], Delivering... [----] I, [2016-09-13T10:40:10.975020 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79723], State: [ok], Delivered in [0.004478195] seconds [----] I, [2016-09-13T10:40:10.998409 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79725], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.088719923] seconds [----] I, [2016-09-13T10:40:10.998663 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79725], Delivering... [----] I, [2016-09-13T10:40:11.002011 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79725], State: [ok], Delivered in [0.003346279] seconds [----] I, [2016-09-13T10:40:11.027094 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79726], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.092751751] seconds [----] I, [2016-09-13T10:40:11.027288 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79726], Delivering... [----] I, [2016-09-13T10:40:11.032127 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79726], State: [ok], Delivered in [0.0048372] seconds [----] I, [2016-09-13T10:40:15.451754 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:40:15 UTC]... [----] I, [2016-09-13T10:40:15.472587 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:40:15 UTC]...Complete [----] I, [2016-09-13T10:40:20.960109 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:40:20.975801 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79728], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:40:26.579712 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:40:26.581931 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004141092300415039, :worker_monitor=>1.0654537677764893, :worker_dequeue=>0.004825115203857422, :total_time=>1.0746846199035645} [----] I, [2016-09-13T10:40:27.004277 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79728], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.0386432] seconds [----] I, [2016-09-13T10:40:27.004491 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79728], Delivering... [----] I, [2016-09-13T10:40:27.010966 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003252267837524414, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032739639282226562, :pending_vm_jobs=>0.0008161067962646484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060346126556396484} [----] I, [2016-09-13T10:40:27.011314 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79728], State: [ok], Delivered in [0.006828771] seconds [----] I, [2016-09-13T10:40:35.987346 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:40:35.998284 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79729], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:40:36.009691 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79730], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:40:36.727841 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T10:40:36.733140 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:40:37.061451 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79730], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.05920355] seconds [----] I, [2016-09-13T10:40:37.061598 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79730], Delivering... [----] I, [2016-09-13T10:40:37.066956 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002936124801635742, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002950429916381836, :pending_vm_jobs=>0.0006530284881591797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005077362060546875} [----] I, [2016-09-13T10:40:37.067222 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79730], State: [ok], Delivered in [0.005624428] seconds [----] I, [2016-09-13T10:40:38.118895 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79729], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.127882812] seconds [----] I, [2016-09-13T10:40:38.119079 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79729], Delivering... [----] I, [2016-09-13T10:40:38.123957 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79729], State: [ok], Delivered in [0.004865823] seconds [----] I, [2016-09-13T10:40:43.001361 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004474639892578125, :worker_monitor=>1.2538959980010986, :worker_dequeue=>0.004865407943725586, :total_time=>1.2636101245880127} [----] I, [2016-09-13T10:40:48.001864 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:40:48 UTC]... [----] I, [2016-09-13T10:40:48.023540 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:40:48 UTC]...Complete [----] I, [2016-09-13T10:40:51.021823 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:40:51.042191 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79731], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:40:53.043337 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:40:53.201132 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79731], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.170325405] seconds [----] I, [2016-09-13T10:40:53.201381 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79731], Delivering... [----] I, [2016-09-13T10:40:53.208372 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036585330963134766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037114620208740234, :pending_vm_jobs=>0.0008292198181152344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006514787673950195} [----] I, [2016-09-13T10:40:53.208758 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79731], State: [ok], Delivered in [0.007380122] seconds [----] I, [2016-09-13T10:40:59.615374 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003949642181396484, :worker_monitor=>1.5524625778198242, :worker_dequeue=>0.010661840438842773, :total_time=>1.5673549175262451} [----] I, [2016-09-13T10:41:06.059602 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:41:06.075396 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79732], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:41:06.109701 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79733], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:41:06.144162 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79734], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:41:06.168731 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79735], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:41:09.637235 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:41:10.332654 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79732], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.268707266] seconds [----] I, [2016-09-13T10:41:10.332859 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79732], Delivering... [----] I, [2016-09-13T10:41:10.355451 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79735], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.205111163] seconds [----] I, [2016-09-13T10:41:10.355655 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79735], Delivering... [----] I, [2016-09-13T10:41:10.362634 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003535032272338867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035600662231445312, :pending_vm_jobs=>0.0008976459503173828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065975189208984375} [----] I, [2016-09-13T10:41:10.362999 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79735], State: [ok], Delivered in [0.007339543] seconds [----] I, [2016-09-13T10:41:10.401996 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79732], State: [ok], Delivered in [0.069114761] seconds [----] I, [2016-09-13T10:41:11.241123 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79733], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.160067149] seconds [----] I, [2016-09-13T10:41:11.241367 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79733], Delivering... [----] I, [2016-09-13T10:41:11.244542 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79733], State: [ok], Delivered in [0.00318038] seconds [----] I, [2016-09-13T10:41:11.304161 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79734], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.186759277] seconds [----] I, [2016-09-13T10:41:11.304345 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79734], Delivering... [----] I, [2016-09-13T10:41:11.308578 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79734], State: [ok], Delivered in [0.004230368] seconds [----] I, [2016-09-13T10:41:16.070198 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039730072021484375, :worker_monitor=>1.4142940044403076, :worker_dequeue=>0.008434057235717773, :total_time=>1.4270069599151611} [----] I, [2016-09-13T10:41:21.070788 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:41:21 UTC]... [----] I, [2016-09-13T10:41:21.096937 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:41:21 UTC]...Complete [----] I, [2016-09-13T10:41:21.185124 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:41:21.206904 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79736], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:41:26.130670 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:41:26.321935 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79736], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.127903404] seconds [----] I, [2016-09-13T10:41:26.322196 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79736], Delivering... [----] I, [2016-09-13T10:41:26.331769 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004971981048583984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005002498626708984, :pending_vm_jobs=>0.0012347698211669922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008933067321777344} [----] I, [2016-09-13T10:41:26.332283 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79736], State: [ok], Delivered in [0.010070953] seconds [----] I, [2016-09-13T10:41:32.586870 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0046672821044921875, :worker_monitor=>1.436694622039795, :worker_dequeue=>0.010622262954711914, :total_time=>1.4523706436157227} [----] I, [2016-09-13T10:41:36.230916 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:41:36.247932 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79737], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:41:36.269942 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79738], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:41:37.684861 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:41:38.405387 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79738], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.152931511] seconds [----] I, [2016-09-13T10:41:38.405539 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79738], Delivering... [----] I, [2016-09-13T10:41:38.410312 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025565624237060547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025730133056640625, :pending_vm_jobs=>0.0005950927734375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0044727325439453125} [----] I, [2016-09-13T10:41:38.410581 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79738], State: [ok], Delivered in [0.005038345] seconds [----] I, [2016-09-13T10:41:38.411493 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79737], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.17536948] seconds [----] I, [2016-09-13T10:41:38.411680 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79737], Delivering... [----] I, [2016-09-13T10:41:38.417242 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79737], State: [ok], Delivered in [0.005571137] seconds [----] I, [2016-09-13T10:41:48.905093 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004018545150756836, :worker_monitor=>1.18442964553833, :worker_dequeue=>0.004869937896728516, :total_time=>1.1936392784118652} [----] I, [2016-09-13T10:41:51.283019 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:41:51.298815 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79739], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:41:53.905645 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:41:53 UTC]... [----] I, [2016-09-13T10:41:53.927169 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:41:53 UTC]...Complete [----] I, [2016-09-13T10:41:53.936064 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:41:54.670763 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79739], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.381590407] seconds [----] I, [2016-09-13T10:41:54.671068 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79739], Delivering... [----] I, [2016-09-13T10:41:54.678336 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003626585006713867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036520957946777344, :pending_vm_jobs=>0.0008797645568847656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006668567657470703} [----] I, [2016-09-13T10:41:54.678753 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79739], State: [ok], Delivered in [0.007715237] seconds [----] I, [2016-09-13T10:42:05.503229 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00405120849609375, :worker_monitor=>1.5380408763885498, :worker_dequeue=>0.007582902908325195, :total_time=>1.549983263015747} [----] I, [2016-09-13T10:42:06.313272 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:42:06.334333 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79740], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:42:06.344394 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79741], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:42:06.361804 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79742], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:42:06.378893 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79743], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:42:10.512125 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:42:10.796335 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79740], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.475750934] seconds [----] I, [2016-09-13T10:42:10.796559 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79740], Delivering... [----] I, [2016-09-13T10:42:10.858981 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79743], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.488399927] seconds [----] I, [2016-09-13T10:42:10.859144 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79743], Delivering... [----] I, [2016-09-13T10:42:10.865018 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029304027557373047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002953052520751953, :pending_vm_jobs=>0.0007104873657226562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055637359619140625} [----] I, [2016-09-13T10:42:10.865380 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79743], State: [ok], Delivered in [0.006227262] seconds [----] I, [2016-09-13T10:42:10.903212 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79740], State: [ok], Delivered in [0.106601835] seconds [----] I, [2016-09-13T10:42:11.550362 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79741], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.210645772] seconds [----] I, [2016-09-13T10:42:11.550520 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79741], Delivering... [----] I, [2016-09-13T10:42:11.552812 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79741], State: [ok], Delivered in [0.002295646] seconds [----] I, [2016-09-13T10:42:11.562006 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79742], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.210147252] seconds [----] I, [2016-09-13T10:42:11.562141 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79742], Delivering... [----] I, [2016-09-13T10:42:11.565669 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79742], State: [ok], Delivered in [0.003506635] seconds [----] I, [2016-09-13T10:42:21.393895 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:42:21.419149 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79744], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:42:21.676341 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:42:21.678978 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003904104232788086, :worker_monitor=>1.1229748725891113, :worker_dequeue=>0.005832672119140625, :total_time=>1.1329724788665771} [----] I, [2016-09-13T10:42:21.973453 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79744], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.573192326] seconds [----] I, [2016-09-13T10:42:21.973720 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79744], Delivering... [----] I, [2016-09-13T10:42:21.983519 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00492405891418457, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004961252212524414, :pending_vm_jobs=>0.0013010501861572266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009272098541259766} [----] I, [2016-09-13T10:42:21.983992 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79744], State: [ok], Delivered in [0.010292395] seconds [----] I, [2016-09-13T10:42:26.679530 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:42:26 UTC]... [----] I, [2016-09-13T10:42:26.699228 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:42:26 UTC]...Complete [----] I, [2016-09-13T10:42:36.430702 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:42:36.447711 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79745], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:42:36.470711 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79746], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:42:38.221623 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:42:38.226013 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0060307979583740234, :worker_monitor=>1.4860460758209229, :worker_dequeue=>0.00980234146118164, :total_time=>1.5022423267364502} [----] I, [2016-09-13T10:42:38.649115 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79746], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.196006958] seconds [----] I, [2016-09-13T10:42:38.649343 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79746], Delivering... [----] I, [2016-09-13T10:42:38.656540 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003682851791381836, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037839412689208984, :pending_vm_jobs=>0.0009255409240722656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006712436676025391} [----] I, [2016-09-13T10:42:38.656915 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79746], State: [ok], Delivered in [0.007592762] seconds [----] I, [2016-09-13T10:42:38.666492 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79745], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.231195968] seconds [----] I, [2016-09-13T10:42:38.666669 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79745], Delivering... [----] I, [2016-09-13T10:42:38.671743 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79745], State: [ok], Delivered in [0.00505636] seconds [----] I, [2016-09-13T10:42:51.484489 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:42:51.499480 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79747], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:42:54.456487 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:42:54.459797 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038836002349853516, :worker_monitor=>1.111121654510498, :worker_dequeue=>0.007328987121582031, :total_time=>1.1226537227630615} [----] I, [2016-09-13T10:42:55.187901 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79747], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.697509506] seconds [----] I, [2016-09-13T10:42:55.188121 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79747], Delivering... [----] I, [2016-09-13T10:42:55.195317 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003719329833984375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003744363784790039, :pending_vm_jobs=>0.0009467601776123047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00673365592956543} [----] I, [2016-09-13T10:42:55.195676 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79747], State: [ok], Delivered in [0.007557724] seconds [----] I, [2016-09-13T10:42:59.460206 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:42:59 UTC]... [----] I, [2016-09-13T10:42:59.472501 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:42:59 UTC]...Complete [----] I, [2016-09-13T10:43:06.513031 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:43:06.530235 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79748], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:43:06.547621 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79749], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:43:06.558517 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79750], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:43:06.571852 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79751], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:43:10.838344 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:43:10.842581 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004237174987792969, :worker_monitor=>1.3331964015960693, :worker_dequeue=>0.009666681289672852, :total_time=>1.347548007965088} [----] I, [2016-09-13T10:43:11.303383 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79748], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.786467357] seconds [----] I, [2016-09-13T10:43:11.303700 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79748], Delivering... [----] I, [2016-09-13T10:43:11.337945 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79751], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.774833574] seconds [----] I, [2016-09-13T10:43:11.338196 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79751], Delivering... [----] I, [2016-09-13T10:43:11.342737 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023398399353027344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002409219741821289, :pending_vm_jobs=>0.0004851818084716797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0040552616119384766} [----] I, [2016-09-13T10:43:11.342972 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79751], State: [ok], Delivered in [0.004816076] seconds [----] I, [2016-09-13T10:43:11.417317 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79748], State: [ok], Delivered in [0.113624492] seconds [----] I, [2016-09-13T10:43:11.817652 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79749], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.282745662] seconds [----] I, [2016-09-13T10:43:11.817841 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79749], Delivering... [----] I, [2016-09-13T10:43:11.823608 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79750], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.26940183] seconds [----] I, [2016-09-13T10:43:11.823869 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79750], Delivering... [----] I, [2016-09-13T10:43:11.824907 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79749], State: [ok], Delivered in [0.007051147] seconds [----] I, [2016-09-13T10:43:11.833175 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79750], State: [ok], Delivered in [0.009283896] seconds [----] I, [2016-09-13T10:43:21.582731 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:43:21.611594 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79752], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:43:27.385200 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:43:27.388129 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039215087890625, :worker_monitor=>1.5053462982177734, :worker_dequeue=>0.007067441940307617, :total_time=>1.51662015914917} [----] I, [2016-09-13T10:43:27.480842 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79752], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.892315315] seconds [----] I, [2016-09-13T10:43:27.481027 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79752], Delivering... [----] I, [2016-09-13T10:43:27.488520 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003846406936645508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003870725631713867, :pending_vm_jobs=>0.0009064674377441406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007070779800415039} [----] I, [2016-09-13T10:43:27.488920 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79752], State: [ok], Delivered in [0.007874167] seconds [----] I, [2016-09-13T10:43:32.388755 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:43:32 UTC]... [----] I, [2016-09-13T10:43:32.411810 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:43:32 UTC]...Complete [----] I, [2016-09-13T10:43:36.620461 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T10:43:36.635009 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79753], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:43:36.657909 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79754], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:43:36.674829 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79755], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:43:36.691948 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79756], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:43:37.435932 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:43:37.583525 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79753], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.958431296] seconds [----] I, [2016-09-13T10:43:37.583710 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79753], Delivering... [----] I, [2016-09-13T10:43:37.584741 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T10:43:37.584922 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4576546816 [----] I, [2016-09-13T10:43:37.585001 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4342521856 [----] I, [2016-09-13T10:43:37.585069 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 234024960 [----] I, [2016-09-13T10:43:37.585134 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 918552576 [----] I, [2016-09-13T10:43:37.585197 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4285825024 [----] I, [2016-09-13T10:43:37.585277 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T10:43:37.585346 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T10:43:37.585409 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 556388352 [----] I, [2016-09-13T10:43:37.585516 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T10:43:37.585580 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6822625280 [----] I, [2016-09-13T10:43:37.585642 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T10:43:37.585705 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T10:43:37.585765 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T10:43:37.585830 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T10:43:37.585890 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T10:43:37.585952 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T10:43:37.586010 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T10:43:37.586069 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T10:43:37.586143 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T10:43:37.586209 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T10:43:37.586292 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 271888384 [----] I, [2016-09-13T10:43:37.586360 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 54800384 [----] I, [2016-09-13T10:43:37.586443 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217088000 [----] I, [2016-09-13T10:43:37.586522 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6111232 [----] I, [2016-09-13T10:43:37.586583 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141873152 [----] I, [2016-09-13T10:43:37.586651 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3404779520 [----] I, [2016-09-13T10:43:37.586707 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3088162816 [----] I, [2016-09-13T10:43:37.586769 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T10:43:37.586831 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T10:43:37.586891 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T10:43:37.586951 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36638720 [----] I, [2016-09-13T10:43:37.587011 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76967936 [----] I, [2016-09-13T10:43:37.587072 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49721344 [----] I, [2016-09-13T10:43:37.587131 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111497216 [----] I, [2016-09-13T10:43:37.587187 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126689280 [----] I, [2016-09-13T10:43:37.587259 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T10:43:37.587329 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T10:43:37.587394 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T10:43:37.587495 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T10:43:37.587565 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T10:43:37.587628 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T10:43:37.587686 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T10:43:37.587742 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T10:43:37.587853 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T10:43:37.623502 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79756], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.942963558] seconds [----] I, [2016-09-13T10:43:37.623674 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79756], Delivering... [----] I, [2016-09-13T10:43:37.628867 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T10:43:37.629158 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T10:43:37.632410 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004143953323364258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0041713714599609375, :pending_vm_jobs=>0.001264333724975586, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00832676887512207} [----] I, [2016-09-13T10:43:37.632823 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79756], State: [ok], Delivered in [0.00913215] seconds [----] I, [2016-09-13T10:43:37.636054 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T10:43:37.641264 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T10:43:37.647541 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T10:43:37.653782 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T10:43:37.659941 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T10:43:37.663564 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 854 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T10:43:37.666532 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T10:43:37.669575 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T10:43:37.672751 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T10:43:37.675878 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T10:43:37.678824 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T10:43:37.681724 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T10:43:37.684472 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:43:37.684626 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:43:37.684729 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T10:43:37.689157 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201169000], Memory % [3.36], CPU Time [154302.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:43:37.689541 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79753], State: [ok], Delivered in [0.105811375] seconds [----] I, [2016-09-13T10:43:38.926388 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79755], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.264122824] seconds [----] I, [2016-09-13T10:43:38.926579 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79755], Delivering... [----] I, [2016-09-13T10:43:38.931094 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79755], State: [ok], Delivered in [0.004508445] seconds [----] I, [2016-09-13T10:43:44.003163 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:43:44.007411 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00577855110168457, :worker_monitor=>1.5529279708862305, :worker_dequeue=>0.009322881698608398, :total_time=>1.5684187412261963} [----] I, [2016-09-13T10:43:44.715373 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79754], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.076079703] seconds [----] I, [2016-09-13T10:43:44.715556 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79754], Delivering... [----] I, [2016-09-13T10:43:44.722258 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:43:42 UTC], Process Info: Memory Usage [287387648], Memory Size [602968064], Proportional Set Size: [213406000], Memory % [3.5], CPU Time [49905.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T10:43:44.722786 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:43:43 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169746000], Memory % [3.14], CPU Time [52496.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:43:44.723262 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:43:36 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208116000], Memory % [3.52], CPU Time [244473.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T10:43:44.723744 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:43:41 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359295000], Memory % [5.28], CPU Time [207397.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T10:43:44.724226 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:43:41 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163160000], Memory % [3.1], CPU Time [38664.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T10:43:44.724727 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:43:43 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201169000], Memory % [3.36], CPU Time [154313.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:43:44.725142 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:43:43 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202685000], Memory % [3.38], CPU Time [153439.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:43:44.725568 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:43:35 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347781000], Memory % [5.04], CPU Time [106035.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T10:43:44.728126 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:43:40 UTC], Process Info: Memory Usage [613097472], Memory Size [1071751168], Proportional Set Size: [451736000], Memory % [7.47], CPU Time [1368.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T10:43:44.729998 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:43:39 UTC], Process Info: Memory Usage [602185728], Memory Size [976642048], Proportional Set Size: [440646000], Memory % [7.34], CPU Time [490.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T10:43:44.730512 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:43:41 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358594000], Memory % [5.27], CPU Time [213262.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T10:43:44.730964 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:43:41 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178487000], Memory % [3.2], CPU Time [52480.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:43:44.731379 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:43:37 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166761000], Memory % [3.16], CPU Time [39563.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T10:43:44.731712 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79754], State: [ok], Delivered in [0.016148013] seconds [----] I, [2016-09-13T10:43:51.703564 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:43:51.720607 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79757], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:43:54.137607 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:43:54.841082 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79757], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.131960615] seconds [----] I, [2016-09-13T10:43:54.841294 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79757], Delivering... [----] I, [2016-09-13T10:43:54.848230 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003694772720336914, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003719329833984375, :pending_vm_jobs=>0.0008416175842285156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006520271301269531} [----] I, [2016-09-13T10:43:54.848630 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79757], State: [ok], Delivered in [0.007333181] seconds [----] I, [2016-09-13T10:44:00.630981 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039026737213134766, :worker_monitor=>1.4720489978790283, :worker_dequeue=>0.009781599044799805, :total_time=>1.4860897064208984} [----] I, [2016-09-13T10:44:05.631541 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:44:05 UTC]... [----] I, [2016-09-13T10:44:05.652107 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:44:05 UTC]...Complete [----] I, [2016-09-13T10:44:06.732268 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:44:06.749540 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79758], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:44:06.766291 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79759], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:44:06.796337 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79760], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:44:06.823817 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79761], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:44:10.676546 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:44:10.961458 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79758], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.224460006] seconds [----] I, [2016-09-13T10:44:10.961666 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79758], Delivering... [----] I, [2016-09-13T10:44:11.024729 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79758], State: [ok], Delivered in [0.063009677] seconds [----] I, [2016-09-13T10:44:11.041825 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79761], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.239291271] seconds [----] I, [2016-09-13T10:44:11.042006 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79761], Delivering... [----] I, [2016-09-13T10:44:11.048538 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033729076385498047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003396272659301758, :pending_vm_jobs=>0.0008935928344726562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006166696548461914} [----] I, [2016-09-13T10:44:11.048921 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79761], State: [ok], Delivered in [0.00690312] seconds [----] I, [2016-09-13T10:44:12.018527 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79759], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.263293018] seconds [----] I, [2016-09-13T10:44:12.018673 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79759], Delivering... [----] I, [2016-09-13T10:44:12.025678 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79759], State: [ok], Delivered in [0.006970212] seconds [----] I, [2016-09-13T10:44:12.070609 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79760], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.297815658] seconds [----] I, [2016-09-13T10:44:12.070808 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79760], Delivering... [----] I, [2016-09-13T10:44:12.076087 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79760], State: [ok], Delivered in [0.005271065] seconds [----] I, [2016-09-13T10:44:16.792798 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030193328857421875, :worker_monitor=>1.10231614112854, :worker_dequeue=>0.005735158920288086, :total_time=>1.1113297939300537} [----] I, [2016-09-13T10:44:21.836442 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:44:21.860083 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79762], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:44:26.822186 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:44:27.127447 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79762], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.285444425] seconds [----] I, [2016-09-13T10:44:27.127593 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79762], Delivering... [----] I, [2016-09-13T10:44:27.131722 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002301931381225586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023241043090820312, :pending_vm_jobs=>0.0004956722259521484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003873586654663086} [----] I, [2016-09-13T10:44:27.131953 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79762], State: [ok], Delivered in [0.004358283] seconds [----] I, [2016-09-13T10:44:33.495845 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040416717529296875, :worker_monitor=>1.6557748317718506, :worker_dequeue=>0.009511232376098633, :total_time=>1.6697044372558594} [----] I, [2016-09-13T10:44:36.872138 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:44:36.893567 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79763], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:44:36.916412 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79764], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:44:38.496445 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:44:38 UTC]... [----] I, [2016-09-13T10:44:38.515976 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:44:38 UTC]...Complete [----] I, [2016-09-13T10:44:38.526019 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:44:39.179465 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79764], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.279851604] seconds [----] I, [2016-09-13T10:44:39.179680 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79764], Delivering... [----] I, [2016-09-13T10:44:39.186856 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003748655319213867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037980079650878906, :pending_vm_jobs=>0.0008981227874755859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006753683090209961} [----] I, [2016-09-13T10:44:39.187301 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79764], State: [ok], Delivered in [0.007616953] seconds [----] I, [2016-09-13T10:44:39.202019 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79763], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.324778252] seconds [----] I, [2016-09-13T10:44:39.202147 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79763], Delivering... [----] I, [2016-09-13T10:44:39.205405 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79763], State: [ok], Delivered in [0.00325659] seconds [----] I, [2016-09-13T10:44:49.940525 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004892587661743164, :worker_monitor=>1.3822178840637207, :worker_dequeue=>0.005167245864868164, :total_time=>1.3925371170043945} [----] I, [2016-09-13T10:44:51.929884 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:44:51.949542 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79765], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:44:55.083503 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:44:55.372882 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79765], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.437112883] seconds [----] I, [2016-09-13T10:44:55.373037 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79765], Delivering... [----] I, [2016-09-13T10:44:55.377396 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002401590347290039, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024137496948242188, :pending_vm_jobs=>0.0005204677581787109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004076957702636719} [----] I, [2016-09-13T10:44:55.377702 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79765], State: [ok], Delivered in [0.00466237] seconds [----] I, [2016-09-13T10:45:06.389683 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004199028015136719, :worker_monitor=>1.2708117961883545, :worker_dequeue=>0.009069442749023438, :total_time=>1.2844419479370117} [----] I, [2016-09-13T10:45:06.964190 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:45:06.984971 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79766], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:45:07.000593 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79767], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:45:07.023583 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79768], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:45:07.042438 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79769], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:45:11.390182 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:45:11 UTC]... [----] I, [2016-09-13T10:45:11.436657 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:45:11 UTC]...Complete [----] I, [2016-09-13T10:45:11.446986 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:45:11.500194 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79766], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.531057064] seconds [----] I, [2016-09-13T10:45:11.500405 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79766], Delivering... [----] I, [2016-09-13T10:45:11.516867 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79769], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.487830356] seconds [----] I, [2016-09-13T10:45:11.517021 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79769], Delivering... [----] I, [2016-09-13T10:45:11.521715 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024461746215820312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024619102478027344, :pending_vm_jobs=>0.0005779266357421875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004410266876220703} [----] I, [2016-09-13T10:45:11.522011 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79769], State: [ok], Delivered in [0.004995849] seconds [----] I, [2016-09-13T10:45:11.550803 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79766], State: [ok], Delivered in [0.050381868] seconds [----] I, [2016-09-13T10:45:12.339792 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79768], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.331103409] seconds [----] I, [2016-09-13T10:45:12.339947 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79768], Delivering... [----] I, [2016-09-13T10:45:12.343725 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79768], State: [ok], Delivered in [0.00376193] seconds [----] I, [2016-09-13T10:45:12.345830 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79767], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.35505223] seconds [----] I, [2016-09-13T10:45:12.346024 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79767], Delivering... [----] I, [2016-09-13T10:45:12.349659 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79767], State: [ok], Delivered in [0.003628263] seconds [----] I, [2016-09-13T10:45:22.070486 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:45:22.088201 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79770], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:45:22.845304 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:45:22.853353 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038881301879882812, :worker_monitor=>1.363816261291504, :worker_dequeue=>0.017030000686645508, :total_time=>1.3851771354675293} [----] I, [2016-09-13T10:45:23.620075 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79770], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.543330403] seconds [----] I, [2016-09-13T10:45:23.620273 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79770], Delivering... [----] I, [2016-09-13T10:45:23.626248 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032470226287841797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032646656036376953, :pending_vm_jobs=>0.00078582763671875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005630016326904297} [----] I, [2016-09-13T10:45:23.626560 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79770], State: [ok], Delivered in [0.006323945] seconds [----] I, [2016-09-13T10:45:37.102734 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:45:37.122491 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79771], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:45:37.133814 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79772], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:45:37.905036 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T10:45:39.349156 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:45:39.353842 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005909442901611328, :log_active_servers=>0.021668434143066406, :worker_monitor=>1.4377360343933105, :worker_dequeue=>0.010515451431274414, :total_time=>1.4763290882110596} [----] I, [2016-09-13T10:45:39.425725 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79772], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.299564128] seconds [----] I, [2016-09-13T10:45:39.425911 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79772], Delivering... [----] I, [2016-09-13T10:45:39.432183 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033211708068847656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033419132232666016, :pending_vm_jobs=>0.0008034706115722656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059168338775634766} [----] I, [2016-09-13T10:45:39.432530 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79772], State: [ok], Delivered in [0.006609645] seconds [----] I, [2016-09-13T10:45:39.437192 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79771], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.32742028] seconds [----] I, [2016-09-13T10:45:39.437408 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79771], Delivering... [----] I, [2016-09-13T10:45:39.442022 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79771], State: [ok], Delivered in [0.004615116] seconds [----] I, [2016-09-13T10:45:44.354323 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:45:44 UTC]... [----] I, [2016-09-13T10:45:44.374074 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:45:44 UTC]...Complete [----] I, [2016-09-13T10:45:52.142554 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:45:52.179370 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79773], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:45:55.660493 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:45:55.667801 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0031766891479492188, :worker_monitor=>1.2562508583068848, :worker_dequeue=>0.015625715255737305, :total_time=>1.2754788398742676} [----] I, [2016-09-13T10:45:55.882956 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79773], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.731269773] seconds [----] I, [2016-09-13T10:45:55.883255 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79773], Delivering... [----] I, [2016-09-13T10:45:55.892340 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00492095947265625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004946708679199219, :pending_vm_jobs=>0.0011966228485107422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008515596389770508} [----] I, [2016-09-13T10:45:55.892837 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79773], State: [ok], Delivered in [0.0095999] seconds [----] I, [2016-09-13T10:46:07.197070 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:46:07.213814 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79774], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:46:07.230922 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79775], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:46:07.247852 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79776], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:46:07.265060 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79777], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:46:11.890272 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:46:11.899976 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041730403900146484, :worker_monitor=>1.0553655624389648, :worker_dequeue=>0.014889955520629883, :total_time=>1.0747368335723877} [----] I, [2016-09-13T10:46:11.916662 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79774], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.715067682] seconds [----] I, [2016-09-13T10:46:11.916855 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79774], Delivering... [----] I, [2016-09-13T10:46:11.968680 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79774], State: [ok], Delivered in [0.051800612] seconds [----] I, [2016-09-13T10:46:12.002276 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79777], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.746769061] seconds [----] I, [2016-09-13T10:46:12.002486 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79777], Delivering... [----] I, [2016-09-13T10:46:12.008582 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030875205993652344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031087398529052734, :pending_vm_jobs=>0.0008475780487060547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005759716033935547} [----] I, [2016-09-13T10:46:12.008887 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79777], State: [ok], Delivered in [0.006399935] seconds [----] I, [2016-09-13T10:46:12.585508 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79775], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.365785789] seconds [----] I, [2016-09-13T10:46:12.585686 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79775], Delivering... [----] I, [2016-09-13T10:46:12.588587 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79775], State: [ok], Delivered in [0.002886837] seconds [----] I, [2016-09-13T10:46:12.591868 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79776], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.350025628] seconds [----] I, [2016-09-13T10:46:12.592064 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79776], Delivering... [----] I, [2016-09-13T10:46:12.596720 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79776], State: [ok], Delivered in [0.004646815] seconds [----] I, [2016-09-13T10:46:16.900745 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:46:16 UTC]... [----] I, [2016-09-13T10:46:16.917753 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:46:16 UTC]...Complete [----] I, [2016-09-13T10:46:22.714248 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:46:22.774982 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79778], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:46:28.394299 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:46:28.398770 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003658294677734375, :worker_monitor=>1.438049077987671, :worker_dequeue=>0.00938272476196289, :total_time=>1.451406478881836} [----] I, [2016-09-13T10:46:29.123744 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79778], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.367498684] seconds [----] I, [2016-09-13T10:46:29.123909 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79778], Delivering... [----] I, [2016-09-13T10:46:29.129947 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003061532974243164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003079652786254883, :pending_vm_jobs=>0.0007901191711425781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005705356597900391} [----] I, [2016-09-13T10:46:29.130330 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79778], State: [ok], Delivered in [0.006404694] seconds [----] I, [2016-09-13T10:46:37.786798 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:46:37.803561 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79779], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:46:37.826468 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79780], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:46:38.412259 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:46:39.192581 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79780], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.385028964] seconds [----] I, [2016-09-13T10:46:39.192761 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79780], Delivering... [----] I, [2016-09-13T10:46:39.198994 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032308101654052734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003251314163208008, :pending_vm_jobs=>0.0007576942443847656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058879852294921875} [----] I, [2016-09-13T10:46:39.199380 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79780], State: [ok], Delivered in [0.006609507] seconds [----] I, [2016-09-13T10:46:39.672566 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79779], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.882565018] seconds [----] I, [2016-09-13T10:46:39.672767 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79779], Delivering... [----] I, [2016-09-13T10:46:39.677520 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79779], State: [ok], Delivered in [0.004745254] seconds [----] I, [2016-09-13T10:46:44.572114 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004022359848022461, :worker_monitor=>1.1425409317016602, :worker_dequeue=>0.010616064071655273, :total_time=>1.1574761867523193} [----] I, [2016-09-13T10:46:49.572705 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:46:49 UTC]... [----] I, [2016-09-13T10:46:49.586586 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:46:49 UTC]...Complete [----] I, [2016-09-13T10:46:52.836009 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:46:52.860991 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79781], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:46:54.612621 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:46:54.723654 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79781], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.881461324] seconds [----] I, [2016-09-13T10:46:54.723807 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79781], Delivering... [----] I, [2016-09-13T10:46:54.729365 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027360916137695312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027549266815185547, :pending_vm_jobs=>0.0008194446563720703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005262851715087891} [----] I, [2016-09-13T10:46:54.729723 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79781], State: [ok], Delivered in [0.005907378] seconds [----] I, [2016-09-13T10:47:00.788464 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038499832153320312, :worker_monitor=>1.157149076461792, :worker_dequeue=>0.009572744369506836, :total_time=>1.1708800792694092} [----] I, [2016-09-13T10:47:07.874054 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:47:07.895370 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79782], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:47:07.947055 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79783], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:47:07.975632 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79784], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:47:08.015839 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79785], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:47:11.009321 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:47:11.375925 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79782], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.496953112] seconds [----] I, [2016-09-13T10:47:11.376053 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79782], Delivering... [----] I, [2016-09-13T10:47:11.410123 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79782], State: [ok], Delivered in [0.034047928] seconds [----] I, [2016-09-13T10:47:11.455339 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79785], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.473506194] seconds [----] I, [2016-09-13T10:47:11.455468 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79785], Delivering... [----] I, [2016-09-13T10:47:11.459608 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0019674301147460938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0019795894622802734, :pending_vm_jobs=>0.0004482269287109375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038788318634033203} [----] I, [2016-09-13T10:47:11.459941 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79785], State: [ok], Delivered in [0.004455594] seconds [----] I, [2016-09-13T10:47:12.793527 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79783], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.893671009] seconds [----] I, [2016-09-13T10:47:12.793506 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79784], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.837643233] seconds [----] I, [2016-09-13T10:47:12.793690 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79784], Delivering... [----] I, [2016-09-13T10:47:12.793691 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79783], Delivering... [----] I, [2016-09-13T10:47:12.796606 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79783], State: [ok], Delivered in [0.002902324] seconds [----] I, [2016-09-13T10:47:12.798290 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79784], State: [ok], Delivered in [0.004569615] seconds [----] I, [2016-09-13T10:47:17.361761 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004412174224853516, :worker_monitor=>1.3373196125030518, :worker_dequeue=>0.006052970886230469, :total_time=>1.3480916023254395} [----] I, [2016-09-13T10:47:22.363528 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:47:22 UTC]... [----] I, [2016-09-13T10:47:22.393622 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:47:22 UTC]...Complete [----] I, [2016-09-13T10:47:23.029979 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:47:23.062605 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79786], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:47:27.429713 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:47:27.566363 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79786], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.529853873] seconds [----] I, [2016-09-13T10:47:27.566612 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79786], Delivering... [----] I, [2016-09-13T10:47:27.578486 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.008645296096801758, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.008666276931762695, :pending_vm_jobs=>0.0008018016815185547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.011400461196899414} [----] I, [2016-09-13T10:47:27.578901 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79786], State: [ok], Delivered in [0.012269414] seconds [----] I, [2016-09-13T10:47:33.782097 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035734176635742188, :worker_monitor=>1.3348710536956787, :worker_dequeue=>0.008755683898925781, :total_time=>1.3474981784820557} [----] I, [2016-09-13T10:47:38.079446 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:47:38.096144 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79787], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:47:38.119392 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79788], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:47:38.789912 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:47:39.658131 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79788], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.555844804] seconds [----] I, [2016-09-13T10:47:39.658333 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79788], Delivering... [----] I, [2016-09-13T10:47:39.664025 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003034353256225586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003056764602661133, :pending_vm_jobs=>0.0006971359252929688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00535273551940918} [----] I, [2016-09-13T10:47:39.664362 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79788], State: [ok], Delivered in [0.006037509] seconds [----] I, [2016-09-13T10:47:39.897556 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79787], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.813481866] seconds [----] I, [2016-09-13T10:47:39.897755 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79787], Delivering... [----] I, [2016-09-13T10:47:39.902210 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79787], State: [ok], Delivered in [0.004450977] seconds [----] I, [2016-09-13T10:47:50.046628 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003940105438232422, :worker_monitor=>1.2270185947418213, :worker_dequeue=>0.013679027557373047, :total_time=>1.2449400424957275} [----] I, [2016-09-13T10:47:53.136118 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:47:53.159902 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79789], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:47:55.047333 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:47:55 UTC]... [----] I, [2016-09-13T10:47:55.069446 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:47:55 UTC]...Complete [----] I, [2016-09-13T10:47:55.075839 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:47:55.812046 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79789], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.671001597] seconds [----] I, [2016-09-13T10:47:55.812218 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79789], Delivering... [----] I, [2016-09-13T10:47:55.819932 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038573741912841797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00388336181640625, :pending_vm_jobs=>0.0009756088256835938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007277250289916992} [----] I, [2016-09-13T10:47:55.820342 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79789], State: [ok], Delivered in [0.008102598] seconds [----] I, [2016-09-13T10:48:06.451841 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003728628158569336, :worker_monitor=>1.3431901931762695, :worker_dequeue=>0.01302957534790039, :total_time=>1.3603124618530273} [----] I, [2016-09-13T10:48:08.170437 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:48:08.190997 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79790], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:48:08.227213 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79791], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:48:08.255891 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79792], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:48:08.278687 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79793], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:48:11.570514 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:48:11.879013 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79790], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.701868759] seconds [----] I, [2016-09-13T10:48:11.879261 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79790], Delivering... [----] I, [2016-09-13T10:48:11.936042 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79793], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.673951262] seconds [----] I, [2016-09-13T10:48:11.936218 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79793], Delivering... [----] I, [2016-09-13T10:48:11.942900 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034706592559814453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034918785095214844, :pending_vm_jobs=>0.0008599758148193359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006277561187744141} [----] I, [2016-09-13T10:48:11.943283 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79793], State: [ok], Delivered in [0.00703235] seconds [----] I, [2016-09-13T10:48:11.958798 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79790], State: [ok], Delivered in [0.079541516] seconds [----] I, [2016-09-13T10:48:13.010993 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79791], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.815263811] seconds [----] I, [2016-09-13T10:48:13.011140 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79791], Delivering... [----] I, [2016-09-13T10:48:13.013408 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79791], State: [ok], Delivered in [0.002260344] seconds [----] I, [2016-09-13T10:48:13.015494 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79792], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.781420025] seconds [----] I, [2016-09-13T10:48:13.015634 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79792], Delivering... [----] I, [2016-09-13T10:48:13.019079 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79792], State: [ok], Delivered in [0.003437116] seconds [----] I, [2016-09-13T10:48:22.662718 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0047397613525390625, :worker_monitor=>1.0604369640350342, :worker_dequeue=>0.0054018497467041016, :total_time=>1.070970058441162} [----] I, [2016-09-13T10:48:23.292442 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:48:23.314354 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79794], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:48:27.663376 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:48:27 UTC]... [----] I, [2016-09-13T10:48:27.724694 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:48:27 UTC]...Complete [----] I, [2016-09-13T10:48:27.737253 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:48:28.116383 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79794], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.817518955] seconds [----] I, [2016-09-13T10:48:28.116628 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79794], Delivering... [----] I, [2016-09-13T10:48:28.123944 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003805875778198242, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003827810287475586, :pending_vm_jobs=>0.0010051727294921875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00687408447265625} [----] I, [2016-09-13T10:48:28.124377 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79794], State: [ok], Delivered in [0.007742215] seconds [----] I, [2016-09-13T10:48:38.327516 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T10:48:38.347563 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79795], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:48:38.358823 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79796], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:48:38.370248 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79797], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:48:38.381688 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79798], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:48:38.961207 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:48:38.965828 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004341602325439453, :worker_monitor=>1.1945910453796387, :worker_dequeue=>0.009942770004272461, :total_time=>1.2091894149780273} [----] I, [2016-09-13T10:48:39.193339 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79795], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.860548003] seconds [----] I, [2016-09-13T10:48:39.193542 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79795], Delivering... [----] I, [2016-09-13T10:48:39.194687 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T10:48:39.194886 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4565348352 [----] I, [2016-09-13T10:48:39.194975 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4331126784 [----] I, [2016-09-13T10:48:39.195049 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 234221568 [----] I, [2016-09-13T10:48:39.195124 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 918552576 [----] I, [2016-09-13T10:48:39.195192 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4274429952 [----] I, [2016-09-13T10:48:39.195285 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T10:48:39.195357 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T10:48:39.195450 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 556576768 [----] I, [2016-09-13T10:48:39.195539 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T10:48:39.195619 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6654607360 [----] I, [2016-09-13T10:48:39.195686 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T10:48:39.195750 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T10:48:39.195827 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T10:48:39.195896 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T10:48:39.195966 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T10:48:39.196031 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T10:48:39.196099 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T10:48:39.196161 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T10:48:39.196252 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T10:48:39.196330 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T10:48:39.196405 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 271880192 [----] I, [2016-09-13T10:48:39.196515 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 54800384 [----] I, [2016-09-13T10:48:39.196586 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217079808 [----] I, [2016-09-13T10:48:39.196651 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6094848 [----] I, [2016-09-13T10:48:39.196718 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141873152 [----] I, [2016-09-13T10:48:39.196787 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3416539136 [----] I, [2016-09-13T10:48:39.196850 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3099734016 [----] I, [2016-09-13T10:48:39.196919 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T10:48:39.196987 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T10:48:39.197050 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T10:48:39.197112 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36384768 [----] I, [2016-09-13T10:48:39.197177 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76967936 [----] I, [2016-09-13T10:48:39.197254 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49623040 [----] I, [2016-09-13T10:48:39.197328 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111497216 [----] I, [2016-09-13T10:48:39.197395 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126590976 [----] I, [2016-09-13T10:48:39.197496 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T10:48:39.197569 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T10:48:39.197647 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T10:48:39.197714 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T10:48:39.197781 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T10:48:39.197846 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T10:48:39.197908 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T10:48:39.197968 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T10:48:39.198034 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T10:48:39.205705 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79796], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.85392192] seconds [----] I, [2016-09-13T10:48:39.205906 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79796], Delivering... [----] I, [2016-09-13T10:48:39.213389 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:48:38 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [153496.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:48:39.213959 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:48:38 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [244637.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T10:48:39.214403 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:48:35 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347859000], Memory % [5.04], CPU Time [106059.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T10:48:39.214912 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:48:38 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [154374.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:48:39.215378 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:48:31 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213440000], Memory % [3.51], CPU Time [49924.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T10:48:39.215938 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:48:35 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163160000], Memory % [3.1], CPU Time [38673.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T10:48:39.216491 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:48:37 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359296000], Memory % [5.28], CPU Time [207426.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T10:48:39.216988 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:48:38 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169747000], Memory % [3.14], CPU Time [52511.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:48:39.219966 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:48:30 UTC], Process Info: Memory Usage [601649152], Memory Size [946872320], Proportional Set Size: [440107000], Memory % [7.33], CPU Time [544.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T10:48:39.220522 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:48:37 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358595000], Memory % [5.27], CPU Time [213293.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T10:48:39.221008 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:48:38 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178488000], Memory % [3.2], CPU Time [52497.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:48:39.221479 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:48:38 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166762000], Memory % [3.16], CPU Time [39573.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T10:48:39.223763 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:48:31 UTC], Process Info: Memory Usage [602013696], Memory Size [932499456], Proportional Set Size: [440915000], Memory % [7.34], CPU Time [1421.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T10:48:39.224085 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79796], State: [ok], Delivered in [0.018181561] seconds [----] I, [2016-09-13T10:48:39.235843 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T10:48:39.236033 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T10:48:39.239728 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T10:48:39.242408 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T10:48:39.247563 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T10:48:39.251470 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T10:48:39.254634 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T10:48:39.256357 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79798], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.880312169] seconds [----] I, [2016-09-13T10:48:39.256624 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79798], Delivering... [----] I, [2016-09-13T10:48:39.257709 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 855 MB 1.16 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T10:48:39.260983 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T10:48:39.263078 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033562183380126953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003379344940185547, :pending_vm_jobs=>0.0007879734039306641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006000041961669922} [----] I, [2016-09-13T10:48:39.263465 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79798], State: [ok], Delivered in [0.006832329] seconds [----] I, [2016-09-13T10:48:39.264079 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T10:48:39.267185 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T10:48:39.270213 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T10:48:39.273270 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T10:48:39.276496 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T10:48:39.279332 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1, "smartstate"=>1}} [----] I, [2016-09-13T10:48:39.279540 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:48:39.279666 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T10:48:39.284009 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [154366.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:48:39.284386 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79795], State: [ok], Delivered in [0.090819065] seconds [----] I, [2016-09-13T10:48:40.138133 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79797], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.77516418] seconds [----] I, [2016-09-13T10:48:40.138459 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79797], Delivering... [----] I, [2016-09-13T10:48:40.144956 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79797], State: [ok], Delivered in [0.006547356] seconds [----] I, [2016-09-13T10:48:53.397541 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:48:53.444355 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79799], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:48:55.247124 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:48:55.251574 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041506290435791016, :worker_monitor=>1.2429664134979248, :worker_dequeue=>0.009714603424072266, :total_time=>1.2571995258331299} [----] I, [2016-09-13T10:48:55.427511 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79799], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.023444882] seconds [----] I, [2016-09-13T10:48:55.427731 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79799], Delivering... [----] I, [2016-09-13T10:48:55.434341 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034232139587402344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003442525863647461, :pending_vm_jobs=>0.0008020401000976562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006201505661010742} [----] I, [2016-09-13T10:48:55.434716 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79799], State: [ok], Delivered in [0.007004118] seconds [----] I, [2016-09-13T10:49:00.252110 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:49:00 UTC]... [----] I, [2016-09-13T10:49:00.279853 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:49:00 UTC]...Complete [----] I, [2016-09-13T10:49:08.456145 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 14. [----] I, [2016-09-13T10:49:08.497605 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79800], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:49:08.513045 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79801], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:49:08.530989 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79802], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:49:08.570899 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79803], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:49:08.587155 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79804], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:49:11.372814 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:49:11.377119 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003905057907104492, :worker_monitor=>1.0529348850250244, :worker_dequeue=>0.009235620498657227, :total_time=>1.0663714408874512} [----] I, [2016-09-13T10:49:11.507448 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79800], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.047454869] seconds [----] I, [2016-09-13T10:49:11.507632 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79800], Delivering... [----] I, [2016-09-13T10:49:11.558699 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79800], State: [ok], Delivered in [0.051046328] seconds [----] I, [2016-09-13T10:49:11.564576 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79804], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.982845619] seconds [----] I, [2016-09-13T10:49:11.564757 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79804], Delivering... [----] I, [2016-09-13T10:49:11.570650 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030059814453125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003023386001586914, :pending_vm_jobs=>0.0007693767547607422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055789947509765625} [----] I, [2016-09-13T10:49:11.570969 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79804], State: [ok], Delivered in [0.006220477] seconds [----] I, [2016-09-13T10:49:13.274887 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79801], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.772552275] seconds [----] I, [2016-09-13T10:49:13.275125 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79801], Delivering... [----] I, [2016-09-13T10:49:13.279165 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79802], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.759802529] seconds [----] I, [2016-09-13T10:49:13.279411 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79802], Delivering... [----] I, [2016-09-13T10:49:13.283395 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79801], State: [ok], Delivered in [0.008262821] seconds [----] I, [2016-09-13T10:49:13.285006 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79802], State: [ok], Delivered in [0.005594817] seconds [----] I, [2016-09-13T10:49:13.307530 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79803], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.75937199] seconds [----] I, [2016-09-13T10:49:13.307732 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79803], Delivering... [----] I, [2016-09-13T10:49:13.336349 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79805], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T10:49:13.336833 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79803], State: [ok], Delivered in [0.029086739] seconds [----] I, [2016-09-13T10:49:16.467907 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T10:49:21.207322 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [79805], MiqWorker id: [102], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [7.882807999] seconds [----] I, [2016-09-13T10:49:21.207619 #17546:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79805], Delivering... [----] I, [2016-09-13T10:49:21.212072 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T10:49:21.212304 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T10:49:21.212498 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T10:49:21.212732 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T10:49:21.212943 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:21.662890 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:22.026733 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:22.026976 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:22.779161 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:23.207485 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:23.207753 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:23.599464 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:49:23.640475 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79806], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:49:23.659899 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79807], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:49:23.772219 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:24.235972 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:24.236158 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:24.713104 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:25.134368 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:25.134584 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:25.935667 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:26.241646 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:26.241770 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:26.755387 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:27.070482 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:27.070672 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:27.571816 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:49:27.576132 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004108905792236328, :worker_monitor=>1.077110767364502, :worker_dequeue=>0.009270429611206055, :total_time=>1.0908570289611816} [----] I, [2016-09-13T10:49:27.584028 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:27.721068 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79806], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.115546727] seconds [----] I, [2016-09-13T10:49:27.721283 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79806], Delivering... [----] I, [2016-09-13T10:49:27.727558 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032923221588134766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003310680389404297, :pending_vm_jobs=>0.0007965564727783203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00591588020324707} [----] I, [2016-09-13T10:49:27.727867 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79806], State: [ok], Delivered in [0.006612274] seconds [----] I, [2016-09-13T10:49:27.903132 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:27.903290 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:28.349580 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79807], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.704692655] seconds [----] I, [2016-09-13T10:49:28.349828 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79807], Delivering... [----] I, [2016-09-13T10:49:28.432619 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:28.435033 #2928:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 14:49:27 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_17' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 14:49:27.574127') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2927,,2016-09-13 14:49:26 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2936,2016-09-13 14:49:28 UTC,2016-09-13 14:49:28 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2946,,2016-09-13 14:49:25 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3, 2955,,2016-09-13 14:49:27 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 14:49:27 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 14:49:26 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2986,,2016-09-13 14:49:26 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2997,,2016-09-13 14:49:23 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 14:49:08.593815')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,4, 3011,,2016-09-13 14:25:48 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1419, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,520323, 3030,,2016-09-13 14:45:26 UTC,"SELECT ""miq_servers"".* FROM ""miq_servers"" WHERE ""miq_servers"".""guid"" = $1 LIMIT $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,242, 3054,,2016-09-13 14:45:26 UTC,"SELECT ""miq_groups"".""description"" FROM ""miq_groups"" INNER JOIN ""miq_groups_users"" ON ""miq_groups"".""id"" = ""miq_groups_users"".""miq_group_id"" WHERE ""miq_groups_users"".""user_id"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,242, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,520321, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,520321, 3160,,2016-09-13 14:45:26 UTC,"SELECT ""zones"".* FROM ""zones"" WHERE ""zones"".""id"" = $1 LIMIT $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,241, 17554,,2016-09-13 14:49:21 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,7, 17563,,2016-09-13 14:25:48 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1419, 27056,,2016-09-13 14:45:28 UTC,"SELECT ""tenants"".* FROM ""tenants"" WHERE (""tenants"".""id"" BETWEEN $1 AND $2) AND ""tenants"".""ancestry"" IS NULL ORDER BY ""tenants"".""id"" ASC LIMIT $3",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,239, 28888,,2016-09-13 14:45:30 UTC,SELECT 1,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,238, ACTIVITY_STATS_CSV [----] I, [2016-09-13T10:49:28.435451 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79807], State: [ok], Delivered in [0.085618077] seconds [----] I, [2016-09-13T10:49:28.748213 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:28.748477 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:29.253649 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:29.551078 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:29.551290 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:30.040491 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:30.368381 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:30.368595 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:32.576826 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:49:32 UTC]... [----] I, [2016-09-13T10:49:32.594956 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:49:32 UTC]...Complete [----] I, [2016-09-13T10:49:36.983991 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:37.352260 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:37.352469 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:37.980061 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:38.358118 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:38.358314 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:38.672755 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:49:38.686534 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79808], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:49:38.715345 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79809], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:49:38.887333 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:39.212931 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:39.213108 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:39.700749 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:39.872246 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:40.008445 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:40.146396 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:40.276559 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:40.414051 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:40.556122 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:40.694138 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:40.851904 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:40.989983 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:41.125088 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:41.260788 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:41.396799 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:41.545657 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:41.691586 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:42.136517 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:42.304712 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:42.478806 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:42.617555 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:42.763836 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:42.908364 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:43.060956 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:43.202130 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:43.347483 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:43.493676 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:43.630680 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:43.802286 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:49:43.805619 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004128217697143555, :worker_monitor=>1.1717677116394043, :worker_dequeue=>0.006866455078125, :total_time=>1.1830289363861084} [----] I, [2016-09-13T10:49:43.852493 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79809], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.160642326] seconds [----] I, [2016-09-13T10:49:43.852632 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79809], Delivering... [----] I, [2016-09-13T10:49:43.856959 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023581981658935547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002372264862060547, :pending_vm_jobs=>0.0005292892456054688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004082441329956055} [----] I, [2016-09-13T10:49:43.857239 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79809], State: [ok], Delivered in [0.004581641] seconds [----] I, [2016-09-13T10:49:43.917916 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:44.077029 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:44.235349 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:44.377656 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:44.512541 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:44.651847 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:45.502028 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:45.666094 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:45.806615 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:45.944662 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:46.086165 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:46.251869 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:46.409840 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:46.458083 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79808], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.780715968] seconds [----] I, [2016-09-13T10:49:46.458278 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79808], Delivering... [----] I, [2016-09-13T10:49:46.462684 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79808], State: [ok], Delivered in [0.004420174] seconds [----] I, [2016-09-13T10:49:46.550689 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:46.694897 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:46.860909 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:47.008904 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:47.155448 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:47.303818 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:47.459807 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:47.602325 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:47.741509 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:47.885136 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:53.727500 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:49:53.772579 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79810], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:49:53.828287 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:49:53.858203 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79810], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.125131952] seconds [----] I, [2016-09-13T10:49:53.858410 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79810], Delivering... [----] I, [2016-09-13T10:49:53.864605 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003101825714111328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003121614456176758, :pending_vm_jobs=>0.0008072853088378906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005754947662353516} [----] I, [2016-09-13T10:49:53.864954 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79810], State: [ok], Delivered in [0.006545296] seconds [----] I, [2016-09-13T10:49:54.541313 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:54.710558 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:54.911500 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:55.054813 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:55.204279 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:55.400502 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:55.574911 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:55.713544 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:55.857003 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:55.990776 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:56.142352 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:56.279066 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:56.423707 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:56.569086 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:56.705884 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:56.847621 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:56.989736 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:57.394638 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:57.546013 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:57.711872 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:57.855605 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:57.990832 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:58.135088 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:58.275571 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:58.433295 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:58.579553 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:58.713383 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:58.865698 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:58.998280 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:59.150993 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:59.296638 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:59.451904 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:59.588832 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:49:59.726148 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:00.098474 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0042667388916015625, :worker_monitor=>1.2454931735992432, :worker_dequeue=>0.009258031845092773, :total_time=>1.2594776153564453} [----] I, [2016-09-13T10:50:00.276296 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:00.427449 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:00.573205 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:00.748497 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:00.932937 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:01.067811 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:01.205549 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:01.340884 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:01.474566 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:01.619914 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:01.753657 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:01.892409 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:02.094800 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:02.262839 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:02.410736 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:02.553984 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:02.691184 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:03.484804 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:03.641119 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:03.783898 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:03.926962 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:04.066836 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:04.216104 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:04.359528 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:04.507661 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:04.645263 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:04.857304 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:05.099001 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:50:05 UTC]... [----] I, [2016-09-13T10:50:05.126599 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:50:05 UTC]...Complete [----] I, [2016-09-13T10:50:08.786016 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 9. [----] I, [2016-09-13T10:50:08.829988 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79811], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:50:08.846694 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79812], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:50:08.863743 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79813], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:50:08.875288 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79814], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:50:08.886655 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79815], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:50:08.899169 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79816], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:50:08.915146 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79817], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:50:08.932483 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79818], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:50:08.949626 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79819], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:50:10.153797 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 9 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:50:10.590386 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79816], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.699137926] seconds [----] I, [2016-09-13T10:50:10.590720 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79816], Delivering... [----] I, [2016-09-13T10:50:10.607566 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79819], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.666881457] seconds [----] I, [2016-09-13T10:50:10.607811 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79819], Delivering... [----] I, [2016-09-13T10:50:10.615327 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0040967464447021484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004124164581298828, :pending_vm_jobs=>0.0008630752563476562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007040739059448242} [----] I, [2016-09-13T10:50:10.615757 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79819], State: [ok], Delivered in [0.007940061] seconds [----] I, [2016-09-13T10:50:10.665620 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79811], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.874279455] seconds [----] I, [2016-09-13T10:50:10.665827 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79811], Delivering... [----] I, [2016-09-13T10:50:10.681531 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79816], State: [ok], Delivered in [0.090764799] seconds [----] I, [2016-09-13T10:50:10.699269 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79820], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 14:50:10 UTC] [----] I, [2016-09-13T10:50:10.727621 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79821], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 14:50:10 UTC] [----] I, [2016-09-13T10:50:10.728056 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79811], State: [ok], Delivered in [0.062208957] seconds [----] I, [2016-09-13T10:50:10.744345 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79812], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.909405954] seconds [----] I, [2016-09-13T10:50:10.744587 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79812], Delivering... [----] I, [2016-09-13T10:50:10.796258 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79822], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 14:50:10 UTC] [----] I, [2016-09-13T10:50:10.841846 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79813], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.989100784] seconds [----] I, [2016-09-13T10:50:10.842065 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79813], Delivering... [----] I, [2016-09-13T10:50:10.844757 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79813], State: [ok], Delivered in [0.002681737] seconds [----] I, [2016-09-13T10:50:10.853194 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79823], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 14:50:10 UTC] [----] I, [2016-09-13T10:50:10.853645 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79812], State: [ok], Delivered in [0.109057048] seconds [----] I, [2016-09-13T10:50:10.898696 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79814], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.029006447] seconds [----] I, [2016-09-13T10:50:10.898921 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79814], Delivering... [----] I, [2016-09-13T10:50:10.909546 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79814], State: [ok], Delivered in [0.010597603] seconds [----] I, [2016-09-13T10:50:10.927473 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79815], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.045904817] seconds [----] I, [2016-09-13T10:50:10.927682 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79815], Delivering... [----] I, [2016-09-13T10:50:10.933836 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79815], State: [ok], Delivered in [0.006135516] seconds [----] I, [2016-09-13T10:50:10.972976 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79817], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.067720542] seconds [----] I, [2016-09-13T10:50:10.973176 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79817], Delivering... [----] I, [2016-09-13T10:50:10.977029 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79817], State: [ok], Delivered in [0.003821098] seconds [----] I, [2016-09-13T10:50:10.984476 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79818], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.060073903] seconds [----] I, [2016-09-13T10:50:10.984692 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79818], Delivering... [----] I, [2016-09-13T10:50:10.990721 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79818], State: [ok], Delivered in [0.006005746] seconds [----] I, [2016-09-13T10:50:11.076297 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:11.222619 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:11.359720 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:11.496807 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:11.634275 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:11.770955 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:11.915058 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:12.507447 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:12.677488 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:12.816086 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:12.959029 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:13.098534 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:13.233339 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:13.374197 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:13.518170 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:13.660727 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:13.829495 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:14.023934 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:14.165618 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:14.336993 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:14.493775 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:14.666104 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:14.835635 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:14.978317 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:15.448635 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:15.623248 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:15.770194 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:15.910666 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:16.050544 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:16.185601 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:16.323266 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:16.460512 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:16.600460 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:16.817292 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:16.923906 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:50:16.929245 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005218982696533203, :worker_monitor=>1.7528164386749268, :worker_dequeue=>0.011670112609863281, :total_time=>1.7700834274291992} [----] I, [2016-09-13T10:50:16.958984 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:17.035839 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79820], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 14:50:10 UTC], Dequeued in: [6.362067922] seconds [----] I, [2016-09-13T10:50:17.036025 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79820], Delivering... [----] I, [2016-09-13T10:50:17.036465 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 14:50:10 UTC]... [----] I, [2016-09-13T10:50:17.039335 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T10:50:17.042819 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 14:50:10 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T10:50:17.043292 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79820], State: [ok], Delivered in [0.007237277] seconds [----] I, [2016-09-13T10:50:17.057132 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79821], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 14:50:10 UTC], Dequeued in: [6.350489857] seconds [----] I, [2016-09-13T10:50:17.057350 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79821], Delivering... [----] I, [2016-09-13T10:50:17.057703 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 14:50:10 UTC]... [----] I, [2016-09-13T10:50:17.060705 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T10:50:17.063047 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 14:50:10 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T10:50:17.063406 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79821], State: [ok], Delivered in [0.006044104] seconds [----] I, [2016-09-13T10:50:17.093948 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79822], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 14:50:10 UTC], Dequeued in: [6.34198569] seconds [----] I, [2016-09-13T10:50:17.094131 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79822], Delivering... [----] I, [2016-09-13T10:50:17.094480 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 14:50:10 UTC]... [----] I, [2016-09-13T10:50:17.097177 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T10:50:17.097315 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:17.102280 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79823], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 14:50:10 UTC], Dequeued in: [6.299209948] seconds [----] I, [2016-09-13T10:50:17.102513 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79823], Delivering... [----] I, [2016-09-13T10:50:17.102816 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 14:50:10 UTC]... [----] I, [2016-09-13T10:50:17.105282 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T10:50:17.174946 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 14:50:10 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T10:50:17.175362 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79822], State: [ok], Delivered in [0.081218032] seconds [----] I, [2016-09-13T10:50:17.213200 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 14:50:10 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T10:50:17.213631 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79823], State: [ok], Delivered in [0.111109396] seconds [----] I, [2016-09-13T10:50:17.234302 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:17.373719 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:17.512176 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:17.661760 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:17.796501 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:18.281786 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:18.450404 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:18.584392 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:18.717334 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:18.851614 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:18.999565 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:19.145053 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:19.294906 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:19.437901 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:19.607678 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:19.764113 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:19.907064 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:20.043389 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:20.180722 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:20.345582 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:20.486054 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:20.646612 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:21.605827 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:21.855185 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:23.962435 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:50:24.007502 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79824], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:50:27.124215 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:50:27.158852 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79824], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.190130668] seconds [----] I, [2016-09-13T10:50:27.159035 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79824], Delivering... [----] I, [2016-09-13T10:50:27.165577 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003294706344604492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033168792724609375, :pending_vm_jobs=>0.0009038448333740234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00615382194519043} [----] I, [2016-09-13T10:50:27.165959 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79824], State: [ok], Delivered in [0.006914484] seconds [----] I, [2016-09-13T10:50:28.010743 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:28.158959 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:28.304137 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:28.444152 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:28.578691 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:28.775291 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:28.924984 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:29.067794 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:29.203832 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:29.345351 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:29.484749 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:29.631286 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:29.821274 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:29.972908 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:30.117295 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:30.774409 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:30.934985 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:31.076704 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:31.220290 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:31.356410 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:31.495188 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:31.658466 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:31.868115 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:32.005195 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:32.155599 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:32.296065 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:32.435198 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:32.578934 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:32.717612 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:32.854992 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:32.992763 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:33.175320 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:33.360325 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003143310546875, :worker_monitor=>1.2209718227386475, :worker_dequeue=>0.006398677825927734, :total_time=>1.2307522296905518} [----] I, [2016-09-13T10:50:33.633145 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:33.836196 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:33.997827 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:34.162547 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:34.310303 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:34.524567 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:34.679239 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:35.028773 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:35.167596 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:35.308545 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:35.447868 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:35.583877 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:35.734566 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:35.923735 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:36.062606 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:36.201407 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:36.351909 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:37.004199 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:37.178005 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:37.323675 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:37.485616 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:37.625077 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:37.758478 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:37.908763 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:38.056621 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:38.197776 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:38.360806 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:50:38 UTC]... [----] I, [2016-09-13T10:50:38.384051 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:50:38 UTC]...Complete [----] I, [2016-09-13T10:50:38.407178 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T10:50:38.413079 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:38.575131 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:38.726601 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:38.866825 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:39.019679 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:50:39.035266 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79825], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:50:39.046515 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79826], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:50:43.429239 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:50:44.292468 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79826], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.252964659] seconds [----] I, [2016-09-13T10:50:44.292607 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79826], Delivering... [----] I, [2016-09-13T10:50:44.296617 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002100706100463867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021140575408935547, :pending_vm_jobs=>0.0004994869232177734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003759145736694336} [----] I, [2016-09-13T10:50:44.296850 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79826], State: [ok], Delivered in [0.004242906] seconds [----] I, [2016-09-13T10:50:44.338123 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79825], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.314555043] seconds [----] I, [2016-09-13T10:50:44.338288 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79825], Delivering... [----] I, [2016-09-13T10:50:44.341842 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79825], State: [ok], Delivered in [0.003550103] seconds [----] I, [2016-09-13T10:50:45.039328 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:45.196664 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:45.370881 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T10:50:45.511455 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T10:50:45.710068 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T10:50:45.710505 #17546:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T10:50:45.710864 #17546:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T10:50:45.710967 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T10:50:45.711118 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T10:50:45.738614 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T10:50:45.739004 #17546:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [79805], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T10:50:45.739295 #17546:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T10:50:45.739582 #17546:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T10:50:45.739784 #17546:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79805], State: [error], Delivered in [84.532189569] seconds [----] I, [2016-09-13T10:50:49.830688 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004446983337402344, :worker_monitor=>1.3827013969421387, :worker_dequeue=>0.00904989242553711, :total_time=>1.3965034484863281} [----] I, [2016-09-13T10:50:54.060588 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:50:54.092986 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79827], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:50:54.841339 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:50:55.425058 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79827], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.348202705] seconds [----] I, [2016-09-13T10:50:55.425317 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79827], Delivering... [----] I, [2016-09-13T10:50:55.432406 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003858327865600586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038797855377197266, :pending_vm_jobs=>0.0008177757263183594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0066225528717041016} [----] I, [2016-09-13T10:50:55.432834 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79827], State: [ok], Delivered in [0.00751646] seconds [----] I, [2016-09-13T10:51:05.913205 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0053675174713134766, :worker_monitor=>1.040306806564331, :worker_dequeue=>0.006560564041137695, :total_time=>1.052764654159546} [----] I, [2016-09-13T10:51:09.105674 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:51:09.127448 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79828], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:51:09.138667 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79829], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:51:09.155910 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79830], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:51:09.167208 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79831], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:51:10.913760 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:51:10 UTC]... [----] I, [2016-09-13T10:51:10.933137 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:51:10 UTC]...Complete [----] I, [2016-09-13T10:51:10.944716 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:51:11.482157 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79828], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.371536771] seconds [----] I, [2016-09-13T10:51:11.482446 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79828], Delivering... [----] I, [2016-09-13T10:51:11.499502 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79831], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.337789322] seconds [----] I, [2016-09-13T10:51:11.499800 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79831], Delivering... [----] I, [2016-09-13T10:51:11.509921 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005564451217651367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005611419677734375, :pending_vm_jobs=>0.0012078285217285156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009564876556396484} [----] I, [2016-09-13T10:51:11.510373 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79831], State: [ok], Delivered in [0.010576702] seconds [----] I, [2016-09-13T10:51:11.539146 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79829], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.406413076] seconds [----] I, [2016-09-13T10:51:11.539351 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79829], Delivering... [----] I, [2016-09-13T10:51:11.542700 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79829], State: [ok], Delivered in [0.003317195] seconds [----] I, [2016-09-13T10:51:11.544606 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79828], State: [ok], Delivered in [0.062172446] seconds [----] I, [2016-09-13T10:51:11.567741 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79830], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.421333299] seconds [----] I, [2016-09-13T10:51:11.568490 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79830], Delivering... [----] I, [2016-09-13T10:51:11.573495 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79830], State: [ok], Delivered in [0.004997406] seconds [----] I, [2016-09-13T10:51:22.533597 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004778623580932617, :worker_monitor=>1.5566966533660889, :worker_dequeue=>0.008839845657348633, :total_time=>1.570652961730957} [----] I, [2016-09-13T10:51:24.181104 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:51:24.201757 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79832], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:51:27.653005 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:51:28.596302 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79832], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.409243524] seconds [----] I, [2016-09-13T10:51:28.596520 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79832], Delivering... [----] I, [2016-09-13T10:51:28.602814 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033817291259765625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003400087356567383, :pending_vm_jobs=>0.0007801055908203125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005927085876464844} [----] I, [2016-09-13T10:51:28.603150 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79832], State: [ok], Delivered in [0.006632361] seconds [----] I, [2016-09-13T10:51:38.778300 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005437374114990234, :worker_monitor=>1.0877511501312256, :worker_dequeue=>0.007912158966064453, :total_time=>1.1014375686645508} [----] I, [2016-09-13T10:51:39.211777 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:51:39.224617 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79833], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:51:39.235971 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79834], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:51:43.778838 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:51:43 UTC]... [----] I, [2016-09-13T10:51:43.825544 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:51:43 UTC]...Complete [----] I, [2016-09-13T10:51:43.836895 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:51:44.654750 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79834], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.426254759] seconds [----] I, [2016-09-13T10:51:44.654944 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79834], Delivering... [----] I, [2016-09-13T10:51:44.661510 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003494739532470703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035126209259033203, :pending_vm_jobs=>0.0008032321929931641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0061490535736083984} [----] I, [2016-09-13T10:51:44.661880 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79834], State: [ok], Delivered in [0.006923868] seconds [----] I, [2016-09-13T10:51:44.676934 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79833], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.461718436] seconds [----] I, [2016-09-13T10:51:44.677107 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79833], Delivering... [----] I, [2016-09-13T10:51:44.681544 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79833], State: [ok], Delivered in [0.004424747] seconds [----] I, [2016-09-13T10:51:54.246130 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:51:54.277387 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79835], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:51:55.216013 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:51:55.223936 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004034519195556641, :worker_monitor=>1.3503084182739258, :worker_dequeue=>0.012630701065063477, :total_time=>1.3673205375671387} [----] I, [2016-09-13T10:51:55.814561 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79835], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.560771775] seconds [----] I, [2016-09-13T10:51:55.814791 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79835], Delivering... [----] I, [2016-09-13T10:51:55.821691 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003678560256958008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003704071044921875, :pending_vm_jobs=>0.0009236335754394531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065021514892578125} [----] I, [2016-09-13T10:51:55.822067 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79835], State: [ok], Delivered in [0.00728851] seconds [----] I, [2016-09-13T10:52:09.288274 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:52:09.305777 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79836], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:52:09.316994 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79837], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:52:09.334155 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79838], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:52:09.357363 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79839], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:52:11.433671 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:52:11.437983 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00404810905456543, :worker_monitor=>1.1724357604980469, :worker_dequeue=>0.009397506713867188, :total_time=>1.1861908435821533} [----] I, [2016-09-13T10:52:11.774453 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79836], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.481549875] seconds [----] I, [2016-09-13T10:52:11.774646 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79836], Delivering... [----] I, [2016-09-13T10:52:11.780370 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79839], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.440654788] seconds [----] I, [2016-09-13T10:52:11.780616 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79839], Delivering... [----] I, [2016-09-13T10:52:11.787243 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035054683685302734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003552675247192383, :pending_vm_jobs=>0.0008144378662109375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006218671798706055} [----] I, [2016-09-13T10:52:11.787616 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79839], State: [ok], Delivered in [0.007018694] seconds [----] I, [2016-09-13T10:52:11.826101 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79837], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.514167179] seconds [----] I, [2016-09-13T10:52:11.826296 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79837], Delivering... [----] I, [2016-09-13T10:52:11.829230 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79837], State: [ok], Delivered in [0.002908392] seconds [----] I, [2016-09-13T10:52:11.848738 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79836], State: [ok], Delivered in [0.074066411] seconds [----] I, [2016-09-13T10:52:11.883098 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79838], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.558264047] seconds [----] I, [2016-09-13T10:52:11.883300 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79838], Delivering... [----] I, [2016-09-13T10:52:11.887997 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79838], State: [ok], Delivered in [0.00468441] seconds [----] I, [2016-09-13T10:52:16.438592 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:52:16 UTC]... [----] I, [2016-09-13T10:52:16.465956 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:52:16 UTC]...Complete [----] I, [2016-09-13T10:52:24.369698 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:52:24.403394 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79840], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:52:28.010956 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:52:28.015314 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00466465950012207, :worker_monitor=>1.5049242973327637, :worker_dequeue=>0.009282112121582031, :total_time=>1.5191848278045654} [----] I, [2016-09-13T10:52:28.477524 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79840], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.101189564] seconds [----] I, [2016-09-13T10:52:28.477666 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79840], Delivering... [----] I, [2016-09-13T10:52:28.482160 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025076866149902344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002523660659790039, :pending_vm_jobs=>0.0005095005035400391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004227161407470703} [----] I, [2016-09-13T10:52:28.482432 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79840], State: [ok], Delivered in [0.004744938] seconds [----] I, [2016-09-13T10:52:39.416014 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:52:39.433014 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79841], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:52:39.448005 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79842], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:52:44.286515 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:52:44.291290 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0034186840057373047, :worker_monitor=>1.0931005477905273, :worker_dequeue=>0.010245323181152344, :total_time=>1.107102870941162} [----] I, [2016-09-13T10:52:44.603584 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79842], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.16611111] seconds [----] I, [2016-09-13T10:52:44.603835 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79842], Delivering... [----] I, [2016-09-13T10:52:44.611096 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0039920806884765625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004015922546386719, :pending_vm_jobs=>0.0009531974792480469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0067980289459228516} [----] I, [2016-09-13T10:52:44.611511 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79842], State: [ok], Delivered in [0.00765942] seconds [----] I, [2016-09-13T10:52:45.339636 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79841], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.919953458] seconds [----] I, [2016-09-13T10:52:45.339765 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79841], Delivering... [----] I, [2016-09-13T10:52:45.342957 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79841], State: [ok], Delivered in [0.003187378] seconds [----] I, [2016-09-13T10:52:49.291930 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:52:49 UTC]... [----] I, [2016-09-13T10:52:49.316683 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:52:49 UTC]...Complete [----] I, [2016-09-13T10:52:54.457673 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:52:54.484460 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79843], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:53:00.742470 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:53:00.750797 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003179311752319336, :worker_monitor=>1.3787436485290527, :worker_dequeue=>0.021390438079833984, :total_time=>1.403630256652832} [----] I, [2016-09-13T10:53:00.770388 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79843], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.305924996] seconds [----] I, [2016-09-13T10:53:00.770670 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79843], Delivering... [----] I, [2016-09-13T10:53:00.779039 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004397392272949219, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004464626312255859, :pending_vm_jobs=>0.0010602474212646484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007877588272094727} [----] I, [2016-09-13T10:53:00.779540 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79843], State: [ok], Delivered in [0.008864217] seconds [----] I, [2016-09-13T10:53:09.497781 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:53:09.519371 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79844], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:53:09.541269 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79845], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:53:09.564020 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79846], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:53:09.580892 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79847], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:53:10.770244 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:53:10.872293 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79844], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.36869303] seconds [----] I, [2016-09-13T10:53:10.872516 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79844], Delivering... [----] I, [2016-09-13T10:53:10.946583 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79844], State: [ok], Delivered in [0.074049031] seconds [----] I, [2016-09-13T10:53:10.986675 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79847], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.416026114] seconds [----] I, [2016-09-13T10:53:10.986837 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79847], Delivering... [----] I, [2016-09-13T10:53:10.993265 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003176450729370117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003196239471435547, :pending_vm_jobs=>0.0008513927459716797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060117244720458984} [----] I, [2016-09-13T10:53:10.993611 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79847], State: [ok], Delivered in [0.006763159] seconds [----] I, [2016-09-13T10:53:12.472826 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79845], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.947070552] seconds [----] I, [2016-09-13T10:53:12.473063 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79845], Delivering... [----] I, [2016-09-13T10:53:12.476874 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79845], State: [ok], Delivered in [0.003804635] seconds [----] I, [2016-09-13T10:53:12.496572 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79846], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.946184671] seconds [----] I, [2016-09-13T10:53:12.496791 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79846], Delivering... [----] I, [2016-09-13T10:53:12.502010 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79846], State: [ok], Delivered in [0.005205638] seconds [----] I, [2016-09-13T10:53:17.059033 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004091739654541016, :worker_monitor=>1.2698843479156494, :worker_dequeue=>0.008856534957885742, :total_time=>1.2830874919891357} [----] I, [2016-09-13T10:53:22.059648 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:53:22 UTC]... [----] I, [2016-09-13T10:53:22.091079 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:53:22 UTC]...Complete [----] I, [2016-09-13T10:53:24.593679 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:53:24.611342 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79848], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:53:27.114855 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:53:27.543291 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79848], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.943635534] seconds [----] I, [2016-09-13T10:53:27.543536 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79848], Delivering... [----] I, [2016-09-13T10:53:27.551133 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003934621810913086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0039615631103515625, :pending_vm_jobs=>0.001028299331665039, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007135868072509766} [----] I, [2016-09-13T10:53:27.551568 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79848], State: [ok], Delivered in [0.00803173] seconds [----] I, [2016-09-13T10:53:33.320386 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004419565200805664, :worker_monitor=>1.1821403503417969, :worker_dequeue=>0.013165473937988281, :total_time=>1.2000272274017334} [----] I, [2016-09-13T10:53:39.625580 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T10:53:39.645734 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79849], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:53:39.662871 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79850], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:53:39.673981 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79851], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:53:39.685501 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79852], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:53:43.436576 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:53:43.971992 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79849], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.339248282] seconds [----] I, [2016-09-13T10:53:43.972239 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79849], Delivering... [----] I, [2016-09-13T10:53:43.973841 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T10:53:43.974099 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4589572096 [----] I, [2016-09-13T10:53:43.974236 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4355059712 [----] I, [2016-09-13T10:53:43.974342 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 234512384 [----] I, [2016-09-13T10:53:43.974460 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 931135488 [----] I, [2016-09-13T10:53:43.974570 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4298350592 [----] I, [2016-09-13T10:53:43.974656 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T10:53:43.974739 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T10:53:43.974823 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 556908544 [----] I, [2016-09-13T10:53:43.974915 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T10:53:43.975000 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6811815936 [----] I, [2016-09-13T10:53:43.975085 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T10:53:43.975168 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T10:53:43.975293 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T10:53:43.975460 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T10:53:43.975572 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T10:53:43.975659 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T10:53:43.975738 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T10:53:43.975815 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T10:53:43.975895 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T10:53:43.975970 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T10:53:43.976055 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 271900672 [----] I, [2016-09-13T10:53:43.976139 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 54812672 [----] I, [2016-09-13T10:53:43.976238 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217088000 [----] I, [2016-09-13T10:53:43.976334 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T10:53:43.976412 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142520320 [----] I, [2016-09-13T10:53:43.976527 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3391324160 [----] I, [2016-09-13T10:53:43.976614 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3074220032 [----] I, [2016-09-13T10:53:43.976699 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T10:53:43.976783 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T10:53:43.976864 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T10:53:43.976943 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36900864 [----] I, [2016-09-13T10:53:43.977026 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76967936 [----] I, [2016-09-13T10:53:43.977105 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49950720 [----] I, [2016-09-13T10:53:43.977176 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111529984 [----] I, [2016-09-13T10:53:43.977276 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126918656 [----] I, [2016-09-13T10:53:43.977353 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T10:53:43.977456 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T10:53:43.977554 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T10:53:43.977665 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T10:53:43.977757 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T10:53:43.977837 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T10:53:43.977913 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T10:53:43.977989 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T10:53:43.978067 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T10:53:44.033073 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T10:53:44.033321 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T10:53:44.037593 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T10:53:44.040802 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T10:53:44.044553 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T10:53:44.048279 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T10:53:44.052168 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T10:53:44.056021 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 856 MB 1.15 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T10:53:44.059723 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T10:53:44.063264 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T10:53:44.066781 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.8 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T10:53:44.070250 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T10:53:44.073843 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T10:53:44.078096 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T10:53:44.081561 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:53:44.081766 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:53:44.081897 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T10:53:44.087150 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358593000], Memory % [5.27], CPU Time [153590.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T10:53:44.087597 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79849], State: [ok], Delivered in [0.115373086] seconds [----] I, [2016-09-13T10:53:44.154819 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79850], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.502538803] seconds [----] I, [2016-09-13T10:53:44.155091 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79850], Delivering... [----] I, [2016-09-13T10:53:44.163933 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:53:31 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213440000], Memory % [3.51], CPU Time [49932.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T10:53:44.164701 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:53:30 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169747000], Memory % [3.14], CPU Time [52527.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:53:44.165366 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:53:30 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163160000], Memory % [3.1], CPU Time [38683.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T10:53:44.166012 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:53:30 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359294000], Memory % [5.28], CPU Time [207521.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T10:53:44.166690 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:53:33 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [153599.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:53:44.167472 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:53:24 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [244761.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T10:53:44.168078 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:53:32 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [154466.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:53:44.168640 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:53:24 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347858000], Memory % [5.04], CPU Time [106073.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T10:53:44.169201 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:53:30 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178488000], Memory % [3.2], CPU Time [52512.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:53:44.169738 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:53:26 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166762000], Memory % [3.16], CPU Time [39583.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T10:53:44.173329 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:53:26 UTC], Process Info: Memory Usage [624246784], Memory Size [1071255552], Proportional Set Size: [462703000], Memory % [7.61], CPU Time [1566.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T10:53:44.175829 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:53:30 UTC], Process Info: Memory Usage [601862144], Memory Size [960503808], Proportional Set Size: [440391000], Memory % [7.34], CPU Time [555.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T10:53:44.176493 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:53:30 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358593000], Memory % [5.27], CPU Time [213389.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T10:53:44.176886 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79850], State: [ok], Delivered in [0.021823618] seconds [----] I, [2016-09-13T10:53:44.211487 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79852], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.531942722] seconds [----] I, [2016-09-13T10:53:44.211702 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79852], Delivering... [----] I, [2016-09-13T10:53:44.221799 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005479335784912109, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0055506229400634766, :pending_vm_jobs=>0.0014524459838867188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00966024398803711} [----] I, [2016-09-13T10:53:44.222187 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79852], State: [ok], Delivered in [0.010474507] seconds [----] I, [2016-09-13T10:53:45.605897 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79851], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.938613521] seconds [----] I, [2016-09-13T10:53:45.606098 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79851], Delivering... [----] I, [2016-09-13T10:53:45.611351 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79851], State: [ok], Delivered in [0.005240477] seconds [----] I, [2016-09-13T10:53:49.760472 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00407719612121582, :worker_monitor=>1.3066890239715576, :worker_dequeue=>0.009157896041870117, :total_time=>1.320373773574829} [----] I, [2016-09-13T10:53:54.697559 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:53:54.714113 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79853], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:53:54.761039 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:53:54 UTC]... [----] I, [2016-09-13T10:53:54.777996 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:53:54 UTC]...Complete [----] I, [2016-09-13T10:53:54.788403 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:53:55.354662 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79853], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.651404033] seconds [----] I, [2016-09-13T10:53:55.354861 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79853], Delivering... [----] I, [2016-09-13T10:53:55.366268 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003571748733520508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003637552261352539, :pending_vm_jobs=>0.0008459091186523438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010972261428833008} [----] I, [2016-09-13T10:53:55.366606 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79853], State: [ok], Delivered in [0.011743709] seconds [----] I, [2016-09-13T10:54:06.126304 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004593849182128906, :worker_monitor=>1.3074216842651367, :worker_dequeue=>0.009335041046142578, :total_time=>1.3217284679412842} [----] I, [2016-09-13T10:54:09.725350 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:54:09.742966 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79854], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:54:09.758887 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79855], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:54:09.777134 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79856], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:54:09.787441 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79857], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:54:11.135958 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:54:11.502306 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79854], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.772089303] seconds [----] I, [2016-09-13T10:54:11.502558 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79854], Delivering... [----] I, [2016-09-13T10:54:11.507866 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79857], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.725550569] seconds [----] I, [2016-09-13T10:54:11.508062 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79857], Delivering... [----] I, [2016-09-13T10:54:11.515597 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037937164306640625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003899097442626953, :pending_vm_jobs=>0.00096893310546875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007120847702026367} [----] I, [2016-09-13T10:54:11.516000 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79857], State: [ok], Delivered in [0.007937464] seconds [----] I, [2016-09-13T10:54:11.577012 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79854], State: [ok], Delivered in [0.074414461] seconds [----] I, [2016-09-13T10:54:12.703322 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79855], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.954914792] seconds [----] I, [2016-09-13T10:54:12.703622 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79855], Delivering... [----] I, [2016-09-13T10:54:12.712437 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79855], State: [ok], Delivered in [0.00879854] seconds [----] I, [2016-09-13T10:54:12.719681 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79856], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.953051409] seconds [----] I, [2016-09-13T10:54:12.719901 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79856], Delivering... [----] I, [2016-09-13T10:54:12.725657 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79856], State: [ok], Delivered in [0.005749385] seconds [----] I, [2016-09-13T10:54:22.303200 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004342794418334961, :worker_monitor=>1.138256311416626, :worker_dequeue=>0.005396604537963867, :total_time=>1.148341178894043} [----] I, [2016-09-13T10:54:24.800072 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:54:24.823154 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79858], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:54:27.303758 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:54:27 UTC]... [----] I, [2016-09-13T10:54:27.342106 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:54:27 UTC]...Complete [----] I, [2016-09-13T10:54:27.353574 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:54:27.656685 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79858], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.849840454] seconds [----] I, [2016-09-13T10:54:27.656888 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79858], Delivering... [----] I, [2016-09-13T10:54:27.663997 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036809444427490234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037233829498291016, :pending_vm_jobs=>0.0009098052978515625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0066945552825927734} [----] I, [2016-09-13T10:54:27.664402 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79858], State: [ok], Delivered in [0.007508298] seconds [----] I, [2016-09-13T10:54:38.579657 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004470348358154297, :worker_monitor=>1.19350266456604, :worker_dequeue=>0.0071146488189697266, :total_time=>1.2054345607757568} [----] I, [2016-09-13T10:54:39.835406 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:54:39.850572 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79859], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:54:39.890811 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79860], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:54:43.696307 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:54:43.789372 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79860], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.933176097] seconds [----] I, [2016-09-13T10:54:43.789581 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79860], Delivering... [----] I, [2016-09-13T10:54:43.794841 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028612613677978516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002880573272705078, :pending_vm_jobs=>0.0006213188171386719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004935264587402344} [----] I, [2016-09-13T10:54:43.795153 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79860], State: [ok], Delivered in [0.005581675] seconds [----] I, [2016-09-13T10:54:45.880144 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79859], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.040354701] seconds [----] I, [2016-09-13T10:54:45.880365 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79859], Delivering... [----] I, [2016-09-13T10:54:45.886118 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79859], State: [ok], Delivered in [0.005733684] seconds [----] I, [2016-09-13T10:54:54.900977 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:54:54.925185 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79861], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:54:55.078507 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:54:55.083176 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003976106643676758, :worker_monitor=>1.351259708404541, :worker_dequeue=>0.008970260620117188, :total_time=>1.364499807357788} [----] I, [2016-09-13T10:54:55.902944 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79861], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.997596531] seconds [----] I, [2016-09-13T10:54:55.903165 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79861], Delivering... [----] I, [2016-09-13T10:54:55.910231 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036382675170898438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036635398864746094, :pending_vm_jobs=>0.0008194446563720703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006539106369018555} [----] I, [2016-09-13T10:54:55.910607 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79861], State: [ok], Delivered in [0.007447658] seconds [----] I, [2016-09-13T10:55:00.083795 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:55:00 UTC]... [----] I, [2016-09-13T10:55:00.103879 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:55:00 UTC]...Complete [----] I, [2016-09-13T10:55:09.933625 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:55:09.948251 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79862], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:55:09.959639 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79863], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:55:09.976882 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79864], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:55:09.988283 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79865], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:55:11.271115 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:55:11.275908 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00376129150390625, :worker_monitor=>1.1267266273498535, :worker_dequeue=>0.010406017303466797, :total_time=>1.14121675491333} [----] I, [2016-09-13T10:55:12.011628 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79862], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.073627193] seconds [----] I, [2016-09-13T10:55:12.011865 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79862], Delivering... [----] I, [2016-09-13T10:55:12.040136 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79865], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.057932472] seconds [----] I, [2016-09-13T10:55:12.040386 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79865], Delivering... [----] I, [2016-09-13T10:55:12.047980 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038595199584960938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003885030746459961, :pending_vm_jobs=>0.0009686946868896484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007138967514038086} [----] I, [2016-09-13T10:55:12.048394 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79865], State: [ok], Delivered in [0.008007108] seconds [----] I, [2016-09-13T10:55:12.075186 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79862], State: [ok], Delivered in [0.063290313] seconds [----] I, [2016-09-13T10:55:12.954510 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79863], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.001159537] seconds [----] I, [2016-09-13T10:55:12.954766 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79863], Delivering... [----] I, [2016-09-13T10:55:12.963770 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79863], State: [ok], Delivered in [0.009009555] seconds [----] I, [2016-09-13T10:55:12.989770 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79864], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.020789187] seconds [----] I, [2016-09-13T10:55:12.989975 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79864], Delivering... [----] I, [2016-09-13T10:55:12.995803 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79864], State: [ok], Delivered in [0.005822457] seconds [----] I, [2016-09-13T10:55:24.999462 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:55:25.017030 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79866], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:55:27.661263 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:55:27.666028 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004886150360107422, :worker_monitor=>1.3367223739624023, :worker_dequeue=>0.010003328323364258, :total_time=>1.3519532680511475} [----] I, [2016-09-13T10:55:28.035620 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79866], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.031336603] seconds [----] I, [2016-09-13T10:55:28.035853 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79866], Delivering... [----] I, [2016-09-13T10:55:28.043543 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00399327278137207, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004023313522338867, :pending_vm_jobs=>0.0009357929229736328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007113218307495117} [----] I, [2016-09-13T10:55:28.043945 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79866], State: [ok], Delivered in [0.008091132] seconds [----] I, [2016-09-13T10:55:32.666473 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:55:32 UTC]... [----] I, [2016-09-13T10:55:32.680674 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:55:32 UTC]...Complete [----] I, [2016-09-13T10:55:40.026249 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:55:40.041514 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79867], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:55:40.058248 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79868], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:55:42.715704 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T10:55:43.897261 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:55:43.899792 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0047397613525390625, :log_active_servers=>0.012173891067504883, :worker_monitor=>1.1782503128051758, :worker_dequeue=>0.0055201053619384766, :total_time=>1.2010252475738525} [----] I, [2016-09-13T10:55:44.304370 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79868], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.256323543] seconds [----] I, [2016-09-13T10:55:44.304536 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79868], Delivering... [----] I, [2016-09-13T10:55:44.309359 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025894641876220703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026090145111083984, :pending_vm_jobs=>0.000598907470703125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004532814025878906} [----] I, [2016-09-13T10:55:44.309641 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79868], State: [ok], Delivered in [0.005093643] seconds [----] I, [2016-09-13T10:55:46.110166 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79867], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.079939366] seconds [----] I, [2016-09-13T10:55:46.110456 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79867], Delivering... [----] I, [2016-09-13T10:55:46.115824 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79867], State: [ok], Delivered in [0.005393708] seconds [----] I, [2016-09-13T10:55:55.072742 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:55:55.099778 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79869], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:55:59.973239 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:55:59.973372 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:56:00.013188 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [103], PID: [17555], GUID: [1dd6952c-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:56:00.013332 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [103], PID: [17555], GUID: [1dd6952c-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:56:00.059007 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:56:00.059164 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:56:00.094656 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:56:00.094882 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:56:00.133476 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:56:00.133678 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:56:00.161830 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:56:00.162062 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:56:00.184863 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:56:00.185149 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:56:00.218963 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:56:00.219230 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:56:00.259790 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:56:00.260100 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:56:00.281999 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:56:00.282242 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:56:00.316198 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:56:00.316445 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:56:00.374667 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:56:00.374944 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:56:00.407570 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T10:56:00.407762 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T10:56:00.415983 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:56:00.420398 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006169557571411133, :worker_monitor=>1.3338916301727295, :worker_dequeue=>0.009578466415405273, :total_time=>1.3500614166259766} [----] I, [2016-09-13T10:56:00.470268 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79869], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.385511051] seconds [----] I, [2016-09-13T10:56:00.470489 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79869], Delivering... [----] I, [2016-09-13T10:56:00.476194 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031561851501464844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003177642822265625, :pending_vm_jobs=>0.0006723403930664062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005368947982788086} [----] I, [2016-09-13T10:56:00.476499 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79869], State: [ok], Delivered in [0.006019143] seconds [----] I, [2016-09-13T10:56:00.520497 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T10:56:00.520655 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T10:56:00.520737 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T10:56:00.669538 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:56:00.670511 #17555:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T10:56:00.670600 #17555:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:56:00.670647 #17555:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:56:00.670686 #17555:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:56:00.670731 #17555:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T10:56:00.670795 #17555:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:56:00.670862 #17555:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:56:00.670910 #17555:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T10:56:00.670945 #17555:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:56:00.670979 #17555:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:56:00.671012 #17555:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:56:00.671045 #17555:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:56:00.671078 #17555:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T10:56:00.671111 #17555:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T10:56:00.671144 #17555:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T10:56:00.671176 #17555:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T10:56:00.671226 #17555:34713c] INFO -- : --- [----] I, [2016-09-13T10:56:00.671665 #17555:34713c] INFO -- : :guid: 1dd6952c-79b6-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:56:00.671743 #17555:34713c] INFO -- : :ems_id: 17 [----] I, [2016-09-13T10:56:00.671879 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T10:56:02.571578 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:56:02.571747 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:56:02.571843 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:56:02.798015 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:56:02.798855 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T10:56:02.798940 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:56:02.798986 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:56:02.799025 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:56:02.799062 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T10:56:02.799096 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:56:02.799130 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:56:02.799163 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T10:56:02.799196 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:56:02.799277 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:56:02.799327 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:56:02.799362 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:56:02.799395 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T10:56:02.799463 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T10:56:02.799748 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:56:02.800019 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:56:03.420854 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:56:03.421034 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:56:03.421120 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:56:03.567700 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:56:03.568456 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:56:03.568528 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:56:03.568565 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:56:03.568598 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:56:03.568627 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T10:56:03.568656 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:56:03.568684 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:56:03.568727 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T10:56:03.568759 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:56:03.568786 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:56:03.568813 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:56:03.568839 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:56:03.568866 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T10:56:03.568892 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T10:56:03.568917 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T10:56:03.568944 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T10:56:03.569185 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:56:03.569335 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:56:04.238712 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:56:04.238865 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:56:04.238957 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:56:04.351979 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:56:04.352591 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:56:04.352642 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:56:04.352668 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:56:04.352691 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:56:04.352714 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T10:56:04.352734 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T10:56:04.352755 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:56:04.352777 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T10:56:04.352798 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:56:04.352818 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:56:04.352839 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:56:04.352859 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:56:04.352879 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T10:56:04.352900 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T10:56:04.352920 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T10:56:04.352940 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T10:56:04.353115 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:56:04.353233 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:56:05.420846 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:56:05 UTC]... [----] I, [2016-09-13T10:56:05.446942 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:56:05 UTC]...Complete [----] I, [2016-09-13T10:56:06.234784 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T10:56:06.234966 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T10:56:06.235064 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T10:56:06.404481 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:56:06.405465 #17546:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T10:56:06.405558 #17546:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:56:06.405604 #17546:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:56:06.405644 #17546:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:56:06.405682 #17546:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T10:56:06.405719 #17546:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T10:56:06.405757 #17546:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:56:06.405793 #17546:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T10:56:06.405833 #17546:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:56:06.405869 #17546:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:56:06.405903 #17546:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T10:56:06.405939 #17546:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:56:06.405975 #17546:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T10:56:06.406007 #17546:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T10:56:06.406041 #17546:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T10:56:06.406072 #17546:34713c] INFO -- : --- [----] I, [2016-09-13T10:56:06.406640 #17546:34713c] INFO -- : :guid: 1d7be00a-79b6-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:56:06.406726 #17546:34713c] INFO -- : :ems_id: 17 [----] I, [2016-09-13T10:56:06.406904 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T10:56:07.189003 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:56:07.189266 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:56:07.189482 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:56:07.401321 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:56:07.402087 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:56:07.402144 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:56:07.402181 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:56:07.402226 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:56:07.402256 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T10:56:07.402287 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T10:56:07.402313 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:56:07.402338 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T10:56:07.402362 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:56:07.402386 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:56:07.402411 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:56:07.402472 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:56:07.402501 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T10:56:07.402532 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T10:56:07.402558 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T10:56:07.402581 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T10:56:07.402820 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:56:07.402975 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:56:07.549926 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:56:07.550198 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:56:07.550382 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:56:07.656242 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:56:07.656500 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:56:07.656582 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:56:07.779288 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:56:07.779797 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:56:07.779845 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:56:07.779872 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:56:07.779893 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:56:07.779912 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T10:56:07.779934 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:56:07.779955 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:56:07.779975 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T10:56:07.779995 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:56:07.780026 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:56:07.780046 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:56:07.780066 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:56:07.780083 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T10:56:07.780102 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T10:56:07.780120 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T10:56:07.780138 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T10:56:07.780323 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:56:07.780440 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:56:07.807887 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:56:07.808893 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T10:56:07.808995 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:56:07.809071 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:56:07.809140 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:56:07.809215 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T10:56:07.809281 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:56:07.809339 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:56:07.809396 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T10:56:07.809489 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:56:07.809553 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:56:07.809611 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:56:07.809666 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:56:07.809724 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T10:56:07.809780 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T10:56:07.810158 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:56:07.810533 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:56:09.852083 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:56:09.852241 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:56:09.852320 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:56:09.923703 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:56:09.923873 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:56:09.923973 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:56:09.990187 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:56:09.991006 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T10:56:09.991087 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:56:09.991130 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:56:09.991164 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:56:09.991197 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T10:56:09.991263 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T10:56:09.991317 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:56:09.991352 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T10:56:09.991385 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:56:09.991443 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:56:09.991495 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:56:09.991531 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:56:09.991563 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T10:56:09.991593 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T10:56:09.991623 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T10:56:09.991653 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T10:56:09.991932 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:56:09.992080 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:56:10.102834 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:56:10.103752 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:56:10.103838 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:56:10.103886 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:56:10.103923 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:56:10.103960 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T10:56:10.103994 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T10:56:10.104030 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:56:10.104064 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T10:56:10.104097 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:56:10.104131 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:56:10.104162 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:56:10.104195 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:56:10.104251 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T10:56:10.104288 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T10:56:10.104322 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T10:56:10.104352 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T10:56:10.104694 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:56:10.104883 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:56:10.113536 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:56:10.113729 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:56:10.113807 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:56:10.172186 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:56:10.172368 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:56:10.172498 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:56:10.242845 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:56:10.244183 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T10:56:10.244285 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:56:10.244332 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:56:10.244368 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:56:10.244402 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T10:56:10.244476 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T10:56:10.244519 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:56:10.244555 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T10:56:10.244588 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:56:10.244620 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:56:10.244651 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:56:10.244682 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:56:10.244714 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T10:56:10.244746 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T10:56:10.244778 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T10:56:10.244810 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T10:56:10.244842 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T10:56:10.244874 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T10:56:10.244906 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T10:56:10.244940 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T10:56:10.244972 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T10:56:10.245003 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T10:56:10.245036 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T10:56:10.245067 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T10:56:10.245113 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T10:56:10.245149 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T10:56:10.245182 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T10:56:10.245232 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T10:56:10.245269 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T10:56:10.245301 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T10:56:10.245332 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T10:56:10.245364 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T10:56:10.245394 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T10:56:10.245457 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T10:56:10.245502 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T10:56:10.245535 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T10:56:10.245566 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T10:56:10.245598 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T10:56:10.245630 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T10:56:10.245896 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:56:10.246035 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:56:10.246109 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:56:10.258528 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79870], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:56:10.271091 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79871], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:56:10.287008 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79872], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:56:10.308860 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79873], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:56:10.348933 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:56:10.349826 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T10:56:10.349912 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:56:10.349957 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:56:10.350011 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:56:10.350053 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T10:56:10.350090 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T10:56:10.350128 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:56:10.350169 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T10:56:10.350220 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:56:10.350267 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:56:10.350302 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:56:10.350339 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:56:10.350373 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T10:56:10.350404 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T10:56:10.350484 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T10:56:10.350531 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T10:56:10.350850 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:56:10.351029 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:56:10.468857 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:56:10.636470 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79870], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.385911134] seconds [----] I, [2016-09-13T10:56:10.636683 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79870], Delivering... [----] I, [2016-09-13T10:56:10.691823 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79870], State: [ok], Delivered in [0.05511224] seconds [----] I, [2016-09-13T10:56:10.737758 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79873], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.445471277] seconds [----] I, [2016-09-13T10:56:10.737927 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79873], Delivering... [----] I, [2016-09-13T10:56:10.744236 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032041072845458984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033206939697265625, :pending_vm_jobs=>0.0007300376892089844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005943775177001953} [----] I, [2016-09-13T10:56:10.744572 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79873], State: [ok], Delivered in [0.006622533] seconds [----] I, [2016-09-13T10:56:12.134042 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T10:56:12.134191 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T10:56:12.134285 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T10:56:12.283521 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T10:56:12.284189 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T10:56:12.284269 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T10:56:12.284308 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T10:56:12.284339 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T10:56:12.284368 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T10:56:12.284397 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T10:56:12.284461 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T10:56:12.284501 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T10:56:12.284531 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T10:56:12.284559 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T10:56:12.284587 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T10:56:12.284615 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T10:56:12.284642 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T10:56:12.284668 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T10:56:12.284898 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T10:56:12.285134 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T10:56:13.383462 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79871], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.119568081] seconds [----] I, [2016-09-13T10:56:13.383610 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79871], Delivering... [----] I, [2016-09-13T10:56:13.385927 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79871], State: [ok], Delivered in [0.002300561] seconds [----] I, [2016-09-13T10:56:13.440563 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79872], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.161560828] seconds [----] I, [2016-09-13T10:56:13.440698 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79872], Delivering... [----] I, [2016-09-13T10:56:13.443975 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79872], State: [ok], Delivered in [0.003265573] seconds [----] I, [2016-09-13T10:56:16.779568 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002889871597290039, :worker_monitor=>1.2943782806396484, :worker_dequeue=>0.008912801742553711, :total_time=>1.3064343929290771} [----] I, [2016-09-13T10:56:25.320771 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:56:25.338852 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79874], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:56:26.802547 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:56:26.882481 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79874], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.55584223] seconds [----] I, [2016-09-13T10:56:26.882794 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79874], Delivering... [----] I, [2016-09-13T10:56:26.894238 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0058689117431640625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0059239864349365234, :pending_vm_jobs=>0.0015060901641845703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010855436325073242} [----] I, [2016-09-13T10:56:26.894871 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79874], State: [ok], Delivered in [0.012068801] seconds [----] I, [2016-09-13T10:56:33.072613 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037126541137695312, :worker_monitor=>1.2566862106323242, :worker_dequeue=>0.005482196807861328, :total_time=>1.2662084102630615} [----] I, [2016-09-13T10:56:38.073097 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:56:38 UTC]... [----] I, [2016-09-13T10:56:38.101454 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:56:38 UTC]...Complete [----] I, [2016-09-13T10:56:40.348655 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:56:40.367623 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79875], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:56:40.378920 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79876], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:56:43.141957 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:56:43.493666 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79876], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.121691564] seconds [----] I, [2016-09-13T10:56:43.493871 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79876], Delivering... [----] I, [2016-09-13T10:56:43.500216 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033922195434570312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003412008285522461, :pending_vm_jobs=>0.0007660388946533203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005968809127807617} [----] I, [2016-09-13T10:56:43.500582 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79876], State: [ok], Delivered in [0.006728198] seconds [----] I, [2016-09-13T10:56:43.539782 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79875], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.185824154] seconds [----] I, [2016-09-13T10:56:43.539991 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79875], Delivering... [----] I, [2016-09-13T10:56:43.544650 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79875], State: [ok], Delivered in [0.00466619] seconds [----] I, [2016-09-13T10:56:49.606622 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004082918167114258, :worker_monitor=>1.4454538822174072, :worker_dequeue=>0.009998559951782227, :total_time=>1.4598982334136963} [----] I, [2016-09-13T10:56:55.388071 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:56:55.414972 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79877], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:56:59.746440 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:57:00.100286 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79877], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.70679931] seconds [----] I, [2016-09-13T10:57:00.100569 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79877], Delivering... [----] I, [2016-09-13T10:57:00.107259 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003559589385986328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003580331802368164, :pending_vm_jobs=>0.0008172988891601562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006241559982299805} [----] I, [2016-09-13T10:57:00.107617 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79877], State: [ok], Delivered in [0.007069266] seconds [----] I, [2016-09-13T10:57:06.073766 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002392292022705078, :worker_monitor=>1.3152391910552979, :worker_dequeue=>0.004809379577636719, :total_time=>1.3226277828216553} [----] I, [2016-09-13T10:57:10.433372 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:57:10.449953 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79878], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:57:10.466078 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79879], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:57:10.488853 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79880], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:57:10.506409 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79881], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:57:11.074392 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:57:11 UTC]... [----] I, [2016-09-13T10:57:11.100369 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:57:11 UTC]...Complete [----] I, [2016-09-13T10:57:11.115287 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:57:11.197926 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79878], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.759799153] seconds [----] I, [2016-09-13T10:57:11.198165 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79878], Delivering... [----] I, [2016-09-13T10:57:11.220274 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79881], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.725717452] seconds [----] I, [2016-09-13T10:57:11.220470 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79881], Delivering... [----] I, [2016-09-13T10:57:11.226632 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031540393829345703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031757354736328125, :pending_vm_jobs=>0.00081634521484375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058138370513916016} [----] I, [2016-09-13T10:57:11.226950 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79881], State: [ok], Delivered in [0.006497322] seconds [----] I, [2016-09-13T10:57:11.265677 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79878], State: [ok], Delivered in [0.067489099] seconds [----] I, [2016-09-13T10:57:13.644702 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79879], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.189027849] seconds [----] I, [2016-09-13T10:57:13.644938 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79879], Delivering... [----] I, [2016-09-13T10:57:13.648540 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79879], State: [ok], Delivered in [0.003598734] seconds [----] I, [2016-09-13T10:57:13.665930 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79880], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.191282303] seconds [----] I, [2016-09-13T10:57:13.666228 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79880], Delivering... [----] I, [2016-09-13T10:57:13.672833 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79880], State: [ok], Delivered in [0.006614241] seconds [----] I, [2016-09-13T10:57:22.663450 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004724979400634766, :worker_monitor=>1.5005638599395752, :worker_dequeue=>0.011739730834960938, :total_time=>1.5173711776733398} [----] I, [2016-09-13T10:57:25.518449 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:57:25.551897 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79882], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:57:27.673271 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:57:28.380702 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79882], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.856241046] seconds [----] I, [2016-09-13T10:57:28.380911 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79882], Delivering... [----] I, [2016-09-13T10:57:28.388408 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003979921340942383, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004002571105957031, :pending_vm_jobs=>0.0009262561798095703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007104635238647461} [----] I, [2016-09-13T10:57:28.388919 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79882], State: [ok], Delivered in [0.007981092] seconds [----] I, [2016-09-13T10:57:39.789575 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005339860916137695, :worker_monitor=>2.076538562774658, :worker_dequeue=>0.011536598205566406, :total_time=>2.0937986373901367} [----] I, [2016-09-13T10:57:40.564740 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:57:40.586436 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79883], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:57:40.637633 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79884], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:57:44.790110 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:57:44 UTC]... [----] I, [2016-09-13T10:57:44.808812 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:57:44 UTC]...Complete [----] I, [2016-09-13T10:57:44.816131 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:57:45.534891 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79884], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.942380503] seconds [----] I, [2016-09-13T10:57:45.535039 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79884], Delivering... [----] I, [2016-09-13T10:57:45.539399 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023949146270751953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024099349975585938, :pending_vm_jobs=>0.0005068778991699219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004084587097167969} [----] I, [2016-09-13T10:57:45.539675 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79884], State: [ok], Delivered in [0.004629475] seconds [----] I, [2016-09-13T10:57:46.763685 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79883], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.193920002] seconds [----] I, [2016-09-13T10:57:46.763893 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79883], Delivering... [----] I, [2016-09-13T10:57:46.769504 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79883], State: [ok], Delivered in [0.00555958] seconds [----] I, [2016-09-13T10:57:55.649759 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:57:55.670191 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79885], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:57:56.832367 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:57:56.836538 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0051310062408447266, :server_monitor=>0.17289996147155762, :worker_monitor=>1.814516544342041, :worker_dequeue=>0.008658409118652344, :total_time=>2.0017013549804688} [----] I, [2016-09-13T10:57:57.681984 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79885], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.027194599] seconds [----] I, [2016-09-13T10:57:57.682181 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79885], Delivering... [----] I, [2016-09-13T10:57:57.688637 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003288745880126953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003312349319458008, :pending_vm_jobs=>0.0008189678192138672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005928993225097656} [----] I, [2016-09-13T10:57:57.688989 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79885], State: [ok], Delivered in [0.006804437] seconds [----] I, [2016-09-13T10:58:10.679478 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:58:10.692929 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79886], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:58:10.705906 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79887], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:58:10.717393 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79888], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:58:10.729046 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79889], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:58:12.784935 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:58:13.809170 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79886], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.126015409] seconds [----] I, [2016-09-13T10:58:13.809312 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79886], Delivering... [----] I, [2016-09-13T10:58:13.855276 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79889], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.133544499] seconds [----] I, [2016-09-13T10:58:13.855437 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79889], Delivering... [----] I, [2016-09-13T10:58:13.859128 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020389556884765625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002051115036010742, :pending_vm_jobs=>0.0004277229309082031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0034742355346679688} [----] I, [2016-09-13T10:58:13.859331 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79889], State: [ok], Delivered in [0.00391336] seconds [----] I, [2016-09-13T10:58:13.877762 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79886], State: [ok], Delivered in [0.068412033] seconds [----] I, [2016-09-13T10:58:13.935146 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79887], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.23772893] seconds [----] I, [2016-09-13T10:58:13.935297 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79887], Delivering... [----] I, [2016-09-13T10:58:13.935537 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79888], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.223402729] seconds [----] I, [2016-09-13T10:58:13.935807 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79888], Delivering... [----] I, [2016-09-13T10:58:13.937408 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79887], State: [ok], Delivered in [0.002112208] seconds [----] I, [2016-09-13T10:58:13.941810 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79888], State: [ok], Delivered in [0.006010478] seconds [----] I, [2016-09-13T10:58:17.791697 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:58:17 UTC]... [----] I, [2016-09-13T10:58:17.860951 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:58:17 UTC]...Complete [----] I, [2016-09-13T10:58:25.742683 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:58:25.765106 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79890], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:58:29.645566 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:58:29.650240 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004261970520019531, :worker_monitor=>1.739027500152588, :worker_dequeue=>0.013213634490966797, :total_time=>1.7569386959075928} [----] I, [2016-09-13T10:58:30.003852 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79890], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.255016884] seconds [----] I, [2016-09-13T10:58:30.003988 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79890], Delivering... [----] I, [2016-09-13T10:58:30.008276 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022263526916503906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022416114807128906, :pending_vm_jobs=>0.0005128383636474609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003998994827270508} [----] I, [2016-09-13T10:58:30.008564 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79890], State: [ok], Delivered in [0.004568394] seconds [----] I, [2016-09-13T10:58:40.778013 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T10:58:40.792305 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79891], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:58:40.803845 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79892], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:58:40.821084 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79893], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:58:40.843989 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79894], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:58:45.850560 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:58:45.854111 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004074573516845703, :worker_monitor=>1.1606354713439941, :worker_dequeue=>0.010298013687133789, :total_time=>1.175302267074585} [----] I, [2016-09-13T10:58:46.131216 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79891], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.34905537] seconds [----] I, [2016-09-13T10:58:46.131386 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79891], Delivering... [----] I, [2016-09-13T10:58:46.132374 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T10:58:46.132568 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4589785088 [----] I, [2016-09-13T10:58:46.132641 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4355043328 [----] I, [2016-09-13T10:58:46.132707 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 234741760 [----] I, [2016-09-13T10:58:46.132772 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 931135488 [----] I, [2016-09-13T10:58:46.132838 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4298371072 [----] I, [2016-09-13T10:58:46.132904 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T10:58:46.132970 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T10:58:46.133034 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 557101056 [----] I, [2016-09-13T10:58:46.133096 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T10:58:46.133158 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6825549824 [----] I, [2016-09-13T10:58:46.133229 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T10:58:46.133296 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T10:58:46.133363 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T10:58:46.133462 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T10:58:46.133538 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T10:58:46.133615 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T10:58:46.133687 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T10:58:46.133751 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T10:58:46.133813 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T10:58:46.133877 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T10:58:46.133943 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 271884288 [----] I, [2016-09-13T10:58:46.134010 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 54800384 [----] I, [2016-09-13T10:58:46.134075 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217083904 [----] I, [2016-09-13T10:58:46.134134 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6144000 [----] I, [2016-09-13T10:58:46.134206 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 141881344 [----] I, [2016-09-13T10:58:46.134277 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3391848448 [----] I, [2016-09-13T10:58:46.134337 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3074523136 [----] I, [2016-09-13T10:58:46.134399 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T10:58:46.134486 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T10:58:46.134549 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T10:58:46.134606 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36646912 [----] I, [2016-09-13T10:58:46.134664 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76963840 [----] I, [2016-09-13T10:58:46.134723 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49750016 [----] I, [2016-09-13T10:58:46.134783 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111497216 [----] I, [2016-09-13T10:58:46.134843 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126713856 [----] I, [2016-09-13T10:58:46.134903 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T10:58:46.134964 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T10:58:46.135027 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T10:58:46.135098 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T10:58:46.135161 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T10:58:46.135235 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T10:58:46.135295 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T10:58:46.135356 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T10:58:46.135433 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T10:58:46.147263 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79892], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.351695895] seconds [----] I, [2016-09-13T10:58:46.147494 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79892], Delivering... [----] I, [2016-09-13T10:58:46.155066 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:58:43 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213440000], Memory % [3.51], CPU Time [49986.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T10:58:46.155700 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:58:43 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169749000], Memory % [3.14], CPU Time [52592.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:58:46.156188 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:58:40 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [244897.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T10:58:46.156753 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:58:44 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359296000], Memory % [5.28], CPU Time [207575.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T10:58:46.157177 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:58:36 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347859000], Memory % [5.04], CPU Time [106144.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T10:58:46.157731 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:58:43 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163161000], Memory % [3.1], CPU Time [38729.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T10:58:46.158261 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:58:45 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [154566.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:58:46.158717 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:58:45 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [153684.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:58:46.161794 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:58:36 UTC], Process Info: Memory Usage [624312320], Memory Size [1071255552], Proportional Set Size: [462809000], Memory % [7.61], CPU Time [1593.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T10:58:46.164228 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:58:40 UTC], Process Info: Memory Usage [602583040], Memory Size [978796544], Proportional Set Size: [441180000], Memory % [7.35], CPU Time [583.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T10:58:46.164783 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:58:44 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358595000], Memory % [5.27], CPU Time [213434.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T10:58:46.165277 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:58:43 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178488000], Memory % [3.2], CPU Time [52572.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T10:58:46.165843 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 14:58:38 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166762000], Memory % [3.16], CPU Time [39645.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T10:58:46.166164 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79892], State: [ok], Delivered in [0.018675126] seconds [----] I, [2016-09-13T10:58:46.176545 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T10:58:46.176743 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T10:58:46.180232 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T10:58:46.182850 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T10:58:46.185882 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T10:58:46.188823 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T10:58:46.191728 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T10:58:46.194686 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 856 MB 1.15 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T10:58:46.197723 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T10:58:46.201742 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T10:58:46.204301 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79894], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.378826616] seconds [----] I, [2016-09-13T10:58:46.204615 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79894], Delivering... [----] I, [2016-09-13T10:58:46.206919 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T10:58:46.211180 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003359556198120117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003378152847290039, :pending_vm_jobs=>0.0008521080017089844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0061337947845458984} [----] I, [2016-09-13T10:58:46.211576 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79894], State: [ok], Delivered in [0.00699117] seconds [----] I, [2016-09-13T10:58:46.211897 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T10:58:46.215013 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T10:58:46.217966 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T10:58:46.220661 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1, "smartstate"=>1}} [----] I, [2016-09-13T10:58:46.220808 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T10:58:46.220905 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T10:58:46.225131 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [153678.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T10:58:46.225539 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79891], State: [ok], Delivered in [0.09413464] seconds [----] I, [2016-09-13T10:58:47.030504 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79893], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.223543194] seconds [----] I, [2016-09-13T10:58:47.030641 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79893], Delivering... [----] I, [2016-09-13T10:58:47.034056 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79893], State: [ok], Delivered in [0.003393588] seconds [----] I, [2016-09-13T10:58:50.854619 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:58:50 UTC]... [----] I, [2016-09-13T10:58:50.881613 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:58:50 UTC]...Complete [----] I, [2016-09-13T10:58:55.855478 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:58:55.870142 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79895], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:58:55.958625 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:58:56.076281 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79895], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.215983492] seconds [----] I, [2016-09-13T10:58:56.076487 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79895], Delivering... [----] I, [2016-09-13T10:58:56.082112 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030908584594726562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003106355667114258, :pending_vm_jobs=>0.0006711483001708984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005276203155517578} [----] I, [2016-09-13T10:58:56.082446 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79895], State: [ok], Delivered in [0.005972108] seconds [----] I, [2016-09-13T10:59:02.306529 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0066792964935302734, :worker_monitor=>1.3333144187927246, :worker_dequeue=>0.005345821380615234, :total_time=>1.3456237316131592} [----] I, [2016-09-13T10:59:10.882272 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T10:59:10.913095 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79896], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:59:11.002498 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79897], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:59:11.025141 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79898], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:59:11.139552 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79899], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:59:12.331452 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:59:12.506884 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79896], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.618137394] seconds [----] I, [2016-09-13T10:59:12.507099 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79896], Delivering... [----] I, [2016-09-13T10:59:12.539768 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79899], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.509287284] seconds [----] I, [2016-09-13T10:59:12.539963 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79899], Delivering... [----] I, [2016-09-13T10:59:12.545639 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002986907958984375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003095388412475586, :pending_vm_jobs=>0.0006453990936279297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005256175994873047} [----] I, [2016-09-13T10:59:12.545951 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79899], State: [ok], Delivered in [0.005981266] seconds [----] I, [2016-09-13T10:59:12.613833 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79896], State: [ok], Delivered in [0.106723332] seconds [----] I, [2016-09-13T10:59:14.157153 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79897], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.236331161] seconds [----] I, [2016-09-13T10:59:14.157514 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79897], Delivering... [----] I, [2016-09-13T10:59:14.162382 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79897], State: [ok], Delivered in [0.004892341] seconds [----] I, [2016-09-13T10:59:14.191523 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79898], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.181510792] seconds [----] I, [2016-09-13T10:59:14.191771 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79898], Delivering... [----] I, [2016-09-13T10:59:14.197562 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79898], State: [ok], Delivered in [0.005792278] seconds [----] I, [2016-09-13T10:59:18.785218 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00528264045715332, :worker_monitor=>1.4327847957611084, :worker_dequeue=>0.010234355926513672, :total_time=>1.448660135269165} [----] I, [2016-09-13T10:59:23.785759 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:59:23 UTC]... [----] I, [2016-09-13T10:59:23.802074 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:59:23 UTC]...Complete [----] I, [2016-09-13T10:59:26.150447 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:59:26.173868 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79900], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:59:28.831873 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:59:29.231097 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79900], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.074601965] seconds [----] I, [2016-09-13T10:59:29.231273 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79900], Delivering... [----] I, [2016-09-13T10:59:29.236736 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002811908721923828, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028285980224609375, :pending_vm_jobs=>0.0006320476531982422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005068778991699219} [----] I, [2016-09-13T10:59:29.237108 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79900], State: [ok], Delivered in [0.005807942] seconds [----] I, [2016-09-13T10:59:35.488921 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0044269561767578125, :worker_monitor=>1.6403965950012207, :worker_dequeue=>0.004774332046508789, :total_time=>1.6499104499816895} [----] I, [2016-09-13T10:59:41.186571 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T10:59:41.202731 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79901], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:59:41.225258 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79902], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:59:45.516985 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:59:45.922853 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79902], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.713725012] seconds [----] I, [2016-09-13T10:59:45.923038 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79902], Delivering... [----] I, [2016-09-13T10:59:45.930090 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003662109375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003680706024169922, :pending_vm_jobs=>0.0009217262268066406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006683349609375} [----] I, [2016-09-13T10:59:45.930499 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79902], State: [ok], Delivered in [0.007442862] seconds [----] I, [2016-09-13T10:59:47.334136 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79901], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.142170044] seconds [----] I, [2016-09-13T10:59:47.334353 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79901], Delivering... [----] I, [2016-09-13T10:59:47.339300 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79901], State: [ok], Delivered in [0.004938518] seconds [----] I, [2016-09-13T10:59:51.736644 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006205320358276367, :worker_monitor=>1.2024381160736084, :worker_dequeue=>0.0060214996337890625, :total_time=>1.215019702911377} [----] I, [2016-09-13T10:59:56.237869 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T10:59:56.265756 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79903], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T10:59:56.737207 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:59:56 UTC]... [----] I, [2016-09-13T10:59:56.756393 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 14:59:56 UTC]...Complete [----] I, [2016-09-13T10:59:56.854038 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T10:59:57.019679 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79903], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.775307869] seconds [----] I, [2016-09-13T10:59:57.019876 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79903], Delivering... [----] I, [2016-09-13T10:59:57.025730 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030553340911865234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030853748321533203, :pending_vm_jobs=>0.0007703304290771484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005515098571777344} [----] I, [2016-09-13T10:59:57.026079 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79903], State: [ok], Delivered in [0.006202615] seconds [----] I, [2016-09-13T11:00:08.597237 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004754543304443359, :worker_monitor=>1.7091810703277588, :worker_dequeue=>0.008489131927490234, :total_time=>1.7228412628173828} [----] I, [2016-09-13T11:00:11.279053 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T11:00:11.281332 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget] [----] I, [2016-09-13T11:00:11.306409 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79904], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473782400] [----] I, [2016-09-13T11:00:11.306720 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T11:00:11.309006 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget] [----] I, [2016-09-13T11:00:11.334856 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79905], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473782400] [----] I, [2016-09-13T11:00:11.335278 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T11:00:11.420478 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79906], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:00:11.442918 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79907], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:00:11.465489 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79908], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:00:11.488879 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79909], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:00:11.512906 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79910], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:00:11.539757 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79911], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:00:11.556900 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79912], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:00:13.609076 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 9 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:00:14.168309 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79909], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.697773091] seconds [----] I, [2016-09-13T11:00:14.168522 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79909], Delivering... [----] I, [2016-09-13T11:00:14.225274 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79909], State: [ok], Delivered in [0.056700964] seconds [----] I, [2016-09-13T11:00:14.259834 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79912], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.713671364] seconds [----] I, [2016-09-13T11:00:14.260010 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79912], Delivering... [----] I, [2016-09-13T11:00:14.266144 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003257274627685547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032770633697509766, :pending_vm_jobs=>0.0007290840148925781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005760908126831055} [----] I, [2016-09-13T11:00:14.266497 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79912], State: [ok], Delivered in [0.00648487] seconds [----] I, [2016-09-13T11:00:14.439516 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79906], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.095193333] seconds [----] I, [2016-09-13T11:00:14.439815 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79906], Delivering... [----] I, [2016-09-13T11:00:14.443230 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79906], State: [ok], Delivered in [0.003407103] seconds [----] I, [2016-09-13T11:00:14.494212 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79907], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.067132581] seconds [----] I, [2016-09-13T11:00:14.494460 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79907], Delivering... [----] I, [2016-09-13T11:00:14.499523 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79908], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.048479941] seconds [----] I, [2016-09-13T11:00:14.499659 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79908], Delivering... [----] I, [2016-09-13T11:00:14.504055 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79908], State: [ok], Delivered in [0.004388884] seconds [----] I, [2016-09-13T11:00:14.505232 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79907], State: [ok], Delivered in [0.010774053] seconds [----] I, [2016-09-13T11:00:14.528300 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79910], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.030116127] seconds [----] I, [2016-09-13T11:00:14.528530 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79910], Delivering... [----] I, [2016-09-13T11:00:14.531735 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79910], State: [ok], Delivered in [0.003194519] seconds [----] I, [2016-09-13T11:00:14.539807 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79911], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.013578623] seconds [----] I, [2016-09-13T11:00:14.539976 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79911], Delivering... [----] I, [2016-09-13T11:00:14.544921 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79911], State: [ok], Delivered in [0.004935167] seconds [----] I, [2016-09-13T11:00:14.562705 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79904], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473782400], Dequeued in: [3.279746317] seconds [----] I, [2016-09-13T11:00:14.562861 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79904], Delivering... [----] I, [2016-09-13T11:00:14.570654 #2937:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered Hosts] invoking action: [generate_widget] for target: [rss_newest_hosts] [----] I, [2016-09-13T11:00:14.570780 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79905], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473782400], Dequeued in: [3.259481195] seconds [----] I, [2016-09-13T11:00:14.570956 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79905], Delivering... [----] I, [2016-09-13T11:00:14.580741 #2928:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered VMs] invoking action: [generate_widget] for target: [rss_newest_vms] [----] I, [2016-09-13T11:00:14.598803 #2937:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [223], Name: [Generate Widget: 'EVM: Recently Discovered Hosts'] for: [1] groups [----] I, [2016-09-13T11:00:14.620033 #2937:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered Hosts] ID: [18] Queueing Content Generation [----] I, [2016-09-13T11:00:14.625737 #2928:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [224], Name: [Generate Widget: 'EVM: Recently Discovered VMs'] for: [1] groups [----] I, [2016-09-13T11:00:14.637669 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79913], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T11:00:14.637895 #2937:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered Hosts] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered Hosts] [----] I, [2016-09-13T11:00:14.642808 #2928:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered VMs] ID: [19] Queueing Content Generation [----] I, [2016-09-13T11:00:14.656691 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79904], State: [ok], Delivered in [0.093802083] seconds [----] I, [2016-09-13T11:00:14.662703 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79914], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T11:00:14.662924 #2928:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered VMs] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered VMs] [----] I, [2016-09-13T11:00:14.679569 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79905], State: [ok], Delivered in [0.108579896] seconds [----] I, [2016-09-13T11:00:18.622746 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=reporting, wcount=2, priority=200 [----] I, [2016-09-13T11:00:19.817638 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [79913], MiqWorker id: [18], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [5.189512813] seconds [----] I, [2016-09-13T11:00:19.817850 #2978:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79913], Delivering... [----] I, [2016-09-13T11:00:19.840820 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T11:00:19.879438 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T11:00:19.879882 #2978:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79913], State: [ok], Delivered in [0.062035601] seconds [----] I, [2016-09-13T11:00:19.882391 #2978:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [79913], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T11:00:19.882600 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [18], MiqTask ID: [223], Status: [ok] [----] I, [2016-09-13T11:00:19.887914 #2978:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [223] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T11:00:19.942770 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [79914], MiqWorker id: [18], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [5.292337303] seconds [----] I, [2016-09-13T11:00:19.942941 #2978:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79914], Delivering... [----] I, [2016-09-13T11:00:19.954115 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T11:00:19.976561 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T11:00:19.976953 #2978:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79914], State: [ok], Delivered in [0.034004847] seconds [----] I, [2016-09-13T11:00:19.979370 #2978:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [79914], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T11:00:19.979576 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [19], MiqTask ID: [224], Status: [ok] [----] I, [2016-09-13T11:00:19.984764 #2978:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [224] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T11:00:24.871347 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0042877197265625, :worker_monitor=>1.2312443256378174, :worker_dequeue=>0.01053762435913086, :total_time=>1.2464654445648193} [----] I, [2016-09-13T11:00:26.573186 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:00:26.622871 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79915], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:00:26.632523 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered Hosts] with id: [18] [----] I, [2016-09-13T11:00:26.632727 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_18 [----] I, [2016-09-13T11:00:26.636857 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T11:00:26.637383 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 16:00:00 UTC [----] I, [2016-09-13T11:00:26.639441 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered Hosts] schedule updated to run at 2016-09-13 16:00:00 UTC with interval 3600 [----] I, [2016-09-13T11:00:26.639931 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered VMs] with id: [19] [----] I, [2016-09-13T11:00:26.640085 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_19 [----] I, [2016-09-13T11:00:26.643530 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T11:00:26.643997 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 16:00:00 UTC [----] I, [2016-09-13T11:00:26.646050 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered VMs] schedule updated to run at 2016-09-13 16:00:00 UTC with interval 3600 [----] I, [2016-09-13T11:00:29.871950 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:00:29 UTC]... [----] I, [2016-09-13T11:00:29.891004 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:00:29 UTC]...Complete [----] I, [2016-09-13T11:00:29.901465 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:00:30.362142 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79915], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.779899882] seconds [----] I, [2016-09-13T11:00:30.362400 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79915], Delivering... [----] I, [2016-09-13T11:00:30.369675 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003706216812133789, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037314891815185547, :pending_vm_jobs=>0.0009634494781494141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006788969039916992} [----] I, [2016-09-13T11:00:30.370106 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79915], State: [ok], Delivered in [0.007703624] seconds [----] I, [2016-09-13T11:00:41.157334 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003841400146484375, :worker_monitor=>1.2270338535308838, :worker_dequeue=>0.00655364990234375, :total_time=>1.237720012664795} [----] I, [2016-09-13T11:00:41.651821 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:00:41.668768 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79916], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:00:41.680799 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79917], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:00:46.172138 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T11:00:46.177138 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:00:46.491608 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79917], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.817075004] seconds [----] I, [2016-09-13T11:00:46.491781 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79917], Delivering... [----] I, [2016-09-13T11:00:46.497901 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032033920288085938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032224655151367188, :pending_vm_jobs=>0.0007710456848144531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005790233612060547} [----] I, [2016-09-13T11:00:46.498259 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79917], State: [ok], Delivered in [0.006470784] seconds [----] I, [2016-09-13T11:00:47.754456 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79916], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.097864824] seconds [----] I, [2016-09-13T11:00:47.754651 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79916], Delivering... [----] I, [2016-09-13T11:00:47.759122 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79916], State: [ok], Delivered in [0.004464553] seconds [----] I, [2016-09-13T11:00:56.714450 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:00:56.760308 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79918], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:00:57.534222 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:00:57.538462 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004530429840087891, :worker_monitor=>1.3242149353027344, :worker_dequeue=>0.009361982345581055, :total_time=>1.3384318351745605} [----] I, [2016-09-13T11:00:57.583397 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79918], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.86234123] seconds [----] I, [2016-09-13T11:00:57.583618 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79918], Delivering... [----] I, [2016-09-13T11:00:57.590160 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003413677215576172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003433704376220703, :pending_vm_jobs=>0.0008444786071777344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006183147430419922} [----] I, [2016-09-13T11:00:57.590580 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79918], State: [ok], Delivered in [0.006954684] seconds [----] I, [2016-09-13T11:01:02.538973 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:01:02 UTC]... [----] I, [2016-09-13T11:01:02.554223 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:01:02 UTC]...Complete [----] I, [2016-09-13T11:01:11.773844 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T11:01:11.823262 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79919], id: [], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:01:11.869131 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79920], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:01:11.903092 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79921], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:01:11.921954 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79922], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:01:11.943174 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79923], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:01:14.022606 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:01:14.025036 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003809213638305664, :worker_monitor=>1.2902822494506836, :worker_dequeue=>0.005455493927001953, :total_time=>1.29982590675354} [----] I, [2016-09-13T11:01:14.743642 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79920], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.916700648] seconds [----] I, [2016-09-13T11:01:14.743879 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79920], Delivering... [----] I, [2016-09-13T11:01:14.800787 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79923], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.873483192] seconds [----] I, [2016-09-13T11:01:14.801058 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79923], Delivering... [----] I, [2016-09-13T11:01:14.808115 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037288665771484375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037610530853271484, :pending_vm_jobs=>0.0008265972137451172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006502628326416016} [----] I, [2016-09-13T11:01:14.808542 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79923], State: [ok], Delivered in [0.007504737] seconds [----] I, [2016-09-13T11:01:14.811946 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79920], State: [ok], Delivered in [0.068062367] seconds [----] I, [2016-09-13T11:01:14.875013 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79919], MiqWorker id: [13], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.082333414] seconds [----] I, [2016-09-13T11:01:14.875183 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79919], Delivering... [----] I, [2016-09-13T11:01:14.914571 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79921], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.040635555] seconds [----] I, [2016-09-13T11:01:14.914824 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79921], Delivering... [----] I, [2016-09-13T11:01:14.927347 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79921], State: [ok], Delivered in [0.012479189] seconds [----] I, [2016-09-13T11:01:15.051964 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79922], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.143772707] seconds [----] I, [2016-09-13T11:01:15.052150 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79922], Delivering... [----] I, [2016-09-13T11:01:15.056985 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79922], State: [ok], Delivered in [0.004821309] seconds [----] I, [2016-09-13T11:01:27.241830 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:01:27.295714 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79924], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:01:31.264899 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:01:31.271936 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003502368927001953, :worker_monitor=>2.203800916671753, :worker_dequeue=>0.01502680778503418, :total_time=>2.2226598262786865} [----] I, [2016-09-13T11:01:31.957975 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79924], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.708559738] seconds [----] I, [2016-09-13T11:01:31.958182 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79924], Delivering... [----] I, [2016-09-13T11:01:31.967259 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004396915435791016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004426240921020508, :pending_vm_jobs=>0.0012230873107910156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008537769317626953} [----] I, [2016-09-13T11:01:31.967868 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79924], State: [ok], Delivered in [0.009638608] seconds [----] I, [2016-09-13T11:01:36.272489 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:01:36 UTC]... [----] I, [2016-09-13T11:01:36.312821 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:01:36 UTC]...Complete [----] I, [2016-09-13T11:01:42.307292 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:01:42.367390 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79925], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:01:42.384858 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79926], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:01:49.147761 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:01:49.151485 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00330352783203125, :worker_monitor=>2.7930948734283447, :worker_dequeue=>0.014577627182006836, :total_time=>2.811244249343872} [----] I, [2016-09-13T11:01:50.122934 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79926], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.751199793] seconds [----] I, [2016-09-13T11:01:50.123289 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79926], Delivering... [----] I, [2016-09-13T11:01:50.136870 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005333900451660156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0053730010986328125, :pending_vm_jobs=>0.0017232894897460938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.012971639633178711} [----] I, [2016-09-13T11:01:50.138018 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79926], State: [ok], Delivered in [0.014737199] seconds [----] I, [2016-09-13T11:01:51.207083 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79925], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.896762079] seconds [----] I, [2016-09-13T11:01:51.207279 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79925], Delivering... [----] I, [2016-09-13T11:01:51.211383 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79925], State: [ok], Delivered in [0.004090919] seconds [----] I, [2016-09-13T11:01:57.401003 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:01:57.429232 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79927], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:01:59.178454 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:01:59.330208 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79927], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.923261795] seconds [----] I, [2016-09-13T11:01:59.330359 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79927], Delivering... [----] I, [2016-09-13T11:01:59.335470 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002683877944946289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026972293853759766, :pending_vm_jobs=>0.0005445480346679688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004753828048706055} [----] I, [2016-09-13T11:01:59.335789 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79927], State: [ok], Delivered in [0.005413828] seconds [----] I, [2016-09-13T11:02:06.637886 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005761861801147461, :server_monitor=>0.21026182174682617, :worker_monitor=>2.227719783782959, :worker_dequeue=>0.011278390884399414, :total_time=>2.456002950668335} [----] I, [2016-09-13T11:02:11.638572 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:02:11 UTC]... [----] I, [2016-09-13T11:02:11.680641 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:02:11 UTC]...Complete [----] I, [2016-09-13T11:02:12.444176 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:02:12.483039 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79928], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:02:12.551610 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79929], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:02:12.597307 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79930], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:02:12.642834 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79931], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:02:16.698132 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:02:17.362682 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79928], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.914668965] seconds [----] I, [2016-09-13T11:02:17.362812 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79928], Delivering... [----] I, [2016-09-13T11:02:17.436780 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79928], State: [ok], Delivered in [0.073909967] seconds [----] I, [2016-09-13T11:02:17.484329 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79931], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.87987267] seconds [----] I, [2016-09-13T11:02:17.484527 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79931], Delivering... [----] I, [2016-09-13T11:02:17.490542 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029342174530029297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003072500228881836, :pending_vm_jobs=>0.0008370876312255859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005682229995727539} [----] I, [2016-09-13T11:02:17.490931 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79931], State: [ok], Delivered in [0.006398841] seconds [----] I, [2016-09-13T11:02:18.380083 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79929], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.890829221] seconds [----] I, [2016-09-13T11:02:18.380299 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79929], Delivering... [----] I, [2016-09-13T11:02:18.383977 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79929], State: [ok], Delivered in [0.00366081] seconds [----] I, [2016-09-13T11:02:18.494800 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79930], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.934871748] seconds [----] I, [2016-09-13T11:02:18.495001 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79930], Delivering... [----] I, [2016-09-13T11:02:18.500461 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79930], State: [ok], Delivered in [0.005405955] seconds [----] I, [2016-09-13T11:02:23.954497 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004826545715332031, :worker_monitor=>2.2339465618133545, :worker_dequeue=>0.013978719711303711, :total_time=>2.2532007694244385} [----] I, [2016-09-13T11:02:27.651136 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:02:27.767565 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79932], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:02:28.961281 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:02:29.589518 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79932], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.933557538] seconds [----] I, [2016-09-13T11:02:29.589808 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79932], Delivering... [----] I, [2016-09-13T11:02:29.602296 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005089282989501953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005242824554443359, :pending_vm_jobs=>0.0013234615325927734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.011956453323364258} [----] I, [2016-09-13T11:02:29.602997 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79932], State: [ok], Delivered in [0.013171992] seconds [----] I, [2016-09-13T11:02:41.128986 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003984689712524414, :worker_monitor=>2.136735200881958, :worker_dequeue=>0.010195493698120117, :total_time=>2.151235580444336} [----] I, [2016-09-13T11:02:42.777159 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:02:42.799137 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79933], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:02:42.862008 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79934], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:02:46.129586 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:02:46 UTC]... [----] I, [2016-09-13T11:02:46.157439 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:02:46 UTC]...Complete [----] I, [2016-09-13T11:02:46.169801 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:02:46.739765 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79934], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.93485815] seconds [----] I, [2016-09-13T11:02:46.740030 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79934], Delivering... [----] I, [2016-09-13T11:02:46.750465 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005023002624511719, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005057334899902344, :pending_vm_jobs=>0.0014145374298095703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009767532348632812} [----] I, [2016-09-13T11:02:46.751146 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79934], State: [ok], Delivered in [0.011100264] seconds [----] I, [2016-09-13T11:02:48.770231 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79933], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.990155649] seconds [----] I, [2016-09-13T11:02:48.770369 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79933], Delivering... [----] I, [2016-09-13T11:02:48.773645 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79933], State: [ok], Delivered in [0.003258986] seconds [----] I, [2016-09-13T11:02:57.871661 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:02:57.896481 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79935], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:02:58.812975 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:02:58.818052 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004968166351318359, :worker_monitor=>2.5995991230010986, :worker_dequeue=>0.011605978012084961, :total_time=>2.6166067123413086} [----] I, [2016-09-13T11:02:58.898774 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79935], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.021470655] seconds [----] I, [2016-09-13T11:02:58.898998 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79935], Delivering... [----] I, [2016-09-13T11:02:58.908150 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038962364196777344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003920316696166992, :pending_vm_jobs=>0.0012943744659423828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00863337516784668} [----] I, [2016-09-13T11:02:58.908846 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79935], State: [ok], Delivered in [0.009807979] seconds [----] I, [2016-09-13T11:03:00.886390 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79919], State: [ok], Delivered in [106.011158508] seconds [----] I, [2016-09-13T11:03:12.910728 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:03:12.946649 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79936], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:03:12.969837 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79937], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:03:13.009730 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79938], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:03:13.032452 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79939], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:03:15.469144 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:03:15.473768 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004505157470703125, :worker_monitor=>1.460266351699829, :worker_dequeue=>0.010097265243530273, :total_time=>1.4751324653625488} [----] I, [2016-09-13T11:03:15.917833 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79936], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.002823243] seconds [----] I, [2016-09-13T11:03:15.918062 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79936], Delivering... [----] I, [2016-09-13T11:03:15.992084 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79936], State: [ok], Delivered in [0.07400225] seconds [----] I, [2016-09-13T11:03:16.012704 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79939], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.998890461] seconds [----] I, [2016-09-13T11:03:16.013054 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79939], Delivering... [----] I, [2016-09-13T11:03:16.020885 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004209995269775391, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004253387451171875, :pending_vm_jobs=>0.0007967948913574219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00732874870300293} [----] I, [2016-09-13T11:03:16.021294 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79939], State: [ok], Delivered in [0.008229356] seconds [----] I, [2016-09-13T11:03:16.075899 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79937], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.12394423] seconds [----] I, [2016-09-13T11:03:16.076220 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79937], Delivering... [----] I, [2016-09-13T11:03:16.081100 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79937], State: [ok], Delivered in [0.004888863] seconds [----] I, [2016-09-13T11:03:16.095136 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79938], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.117164457] seconds [----] I, [2016-09-13T11:03:16.095444 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79938], Delivering... [----] I, [2016-09-13T11:03:16.103558 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79938], State: [ok], Delivered in [0.007793995] seconds [----] I, [2016-09-13T11:03:20.474316 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:03:20 UTC]... [----] I, [2016-09-13T11:03:20.609940 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:03:20 UTC]...Complete [----] I, [2016-09-13T11:03:28.044487 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:03:28.069742 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79940], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:03:31.673233 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:03:31.675524 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0045588016510009766, :worker_monitor=>1.026233196258545, :worker_dequeue=>0.00494074821472168, :total_time=>1.0361640453338623} [----] I, [2016-09-13T11:03:32.166579 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79940], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.114409133] seconds [----] I, [2016-09-13T11:03:32.166736 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79940], Delivering... [----] I, [2016-09-13T11:03:32.171720 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002783060073852539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027985572814941406, :pending_vm_jobs=>0.0005762577056884766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004706859588623047} [----] I, [2016-09-13T11:03:32.172029 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79940], State: [ok], Delivered in [0.005289362] seconds [----] I, [2016-09-13T11:03:43.081218 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T11:03:43.097643 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79941], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:03:43.115221 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79942], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:03:43.126367 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79943], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:03:43.137782 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79944], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:03:48.078976 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:03:48.081663 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004148006439208984, :worker_monitor=>1.3723258972167969, :worker_dequeue=>0.005866527557373047, :total_time=>1.3826215267181396} [----] I, [2016-09-13T11:03:48.342841 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79942], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.242407072] seconds [----] I, [2016-09-13T11:03:48.343006 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79942], Delivering... [----] I, [2016-09-13T11:03:48.348827 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:03:47 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [154636.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:03:48.349269 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:03:43 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [245056.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T11:03:48.349630 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:03:36 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347859000], Memory % [5.04], CPU Time [106162.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T11:03:48.349985 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:03:47 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [153749.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:03:48.350298 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:03:44 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213440000], Memory % [3.51], CPU Time [49995.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T11:03:48.350739 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:03:47 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163161000], Memory % [3.1], CPU Time [38739.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T11:03:48.351139 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:03:46 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359296000], Memory % [5.28], CPU Time [207627.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T11:03:48.351560 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:03:47 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169749000], Memory % [3.14], CPU Time [52622.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:03:48.354019 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:03:47 UTC], Process Info: Memory Usage [603860992], Memory Size [934510592], Proportional Set Size: [442837000], Memory % [7.36], CPU Time [1663.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T11:03:48.354440 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79941], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.269858149] seconds [----] I, [2016-09-13T11:03:48.354650 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79941], Delivering... [----] I, [2016-09-13T11:03:48.355742 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T11:03:48.355944 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:03:41 UTC], Process Info: Memory Usage [601784320], Memory Size [945504256], Proportional Set Size: [440364000], Memory % [7.34], CPU Time [649.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T11:03:48.356007 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4568715264 [----] I, [2016-09-13T11:03:48.356142 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4333772800 [----] I, [2016-09-13T11:03:48.356291 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 234942464 [----] I, [2016-09-13T11:03:48.356373 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:03:46 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358595000], Memory % [5.27], CPU Time [214990.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T11:03:48.356410 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 918552576 [----] I, [2016-09-13T11:03:48.356553 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4277084160 [----] I, [2016-09-13T11:03:48.356666 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T11:03:48.356786 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T11:03:48.356807 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:03:47 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178488000], Memory % [3.2], CPU Time [52588.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:03:48.356907 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 557719552 [----] I, [2016-09-13T11:03:48.357017 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T11:03:48.357126 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6655488000 [----] I, [2016-09-13T11:03:48.357257 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T11:03:48.357326 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:03:39 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166762000], Memory % [3.16], CPU Time [39656.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T11:03:48.357376 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T11:03:48.357549 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T11:03:48.357671 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 172032 [----] I, [2016-09-13T11:03:48.357731 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79942], State: [ok], Delivered in [0.014706384] seconds [----] I, [2016-09-13T11:03:48.357785 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T11:03:48.357901 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T11:03:48.358018 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T11:03:48.358132 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T11:03:48.358266 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T11:03:48.358388 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T11:03:48.358547 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272302080 [----] I, [2016-09-13T11:03:48.358670 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55005184 [----] I, [2016-09-13T11:03:48.358786 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217296896 [----] I, [2016-09-13T11:03:48.358910 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6144000 [----] I, [2016-09-13T11:03:48.359024 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142090240 [----] I, [2016-09-13T11:03:48.359139 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3413549056 [----] I, [2016-09-13T11:03:48.359281 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3095810048 [----] I, [2016-09-13T11:03:48.359400 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T11:03:48.359605 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T11:03:48.359722 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T11:03:48.359831 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36388864 [----] I, [2016-09-13T11:03:48.359944 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76963840 [----] I, [2016-09-13T11:03:48.360061 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49508352 [----] I, [2016-09-13T11:03:48.360172 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111702016 [----] I, [2016-09-13T11:03:48.360309 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126472192 [----] I, [2016-09-13T11:03:48.360447 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T11:03:48.360577 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T11:03:48.360697 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T11:03:48.360812 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T11:03:48.360925 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T11:03:48.361038 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T11:03:48.361155 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T11:03:48.361298 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T11:03:48.361444 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T11:03:48.399878 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79944], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.267730418] seconds [----] I, [2016-09-13T11:03:48.400025 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79944], Delivering... [----] I, [2016-09-13T11:03:48.405213 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026900768280029297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002707958221435547, :pending_vm_jobs=>0.0006566047668457031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0048770904541015625} [----] I, [2016-09-13T11:03:48.405513 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79944], State: [ok], Delivered in [0.005480789] seconds [----] I, [2016-09-13T11:03:48.410055 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T11:03:48.410294 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T11:03:48.415197 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T11:03:48.418966 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T11:03:48.423467 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T11:03:48.428002 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T11:03:48.432602 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T11:03:48.437109 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 856 MB 1.15 GB 42% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T11:03:48.441708 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T11:03:48.446392 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T11:03:48.450819 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.8 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T11:03:48.455311 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T11:03:48.459915 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 183 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T11:03:48.464240 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T11:03:48.467735 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:03:48.467942 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:03:48.468075 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T11:03:48.473408 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359296000], Memory % [5.28], CPU Time [207618.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T11:03:48.473863 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79941], State: [ok], Delivered in [0.119201986] seconds [----] I, [2016-09-13T11:03:49.245642 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79943], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.126153425] seconds [----] I, [2016-09-13T11:03:49.245805 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79943], Delivering... [----] I, [2016-09-13T11:03:49.250016 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79943], State: [ok], Delivered in [0.004180442] seconds [----] I, [2016-09-13T11:03:53.082121 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:03:53 UTC]... [----] I, [2016-09-13T11:03:53.103052 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:03:53 UTC]...Complete [----] I, [2016-09-13T11:03:58.149913 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:03:58.171483 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79945], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:04:04.581576 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:04:04.583935 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039288997650146484, :worker_monitor=>1.437211036682129, :worker_dequeue=>0.005506038665771484, :total_time=>1.446908712387085} [----] I, [2016-09-13T11:04:04.619378 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79945], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.463658354] seconds [----] I, [2016-09-13T11:04:04.619536 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79945], Delivering... [----] I, [2016-09-13T11:04:04.624531 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003259420394897461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032722949981689453, :pending_vm_jobs=>0.0004665851593017578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004747152328491211} [----] I, [2016-09-13T11:04:04.624804 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79945], State: [ok], Delivered in [0.00526583] seconds [----] I, [2016-09-13T11:04:13.188047 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 14. [----] I, [2016-09-13T11:04:13.207867 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79946], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:04:13.219375 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79947], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:04:13.231022 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79948], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:04:13.248079 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79949], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:04:13.260611 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79950], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:04:14.708729 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:04:15.642885 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79947], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.428244201] seconds [----] I, [2016-09-13T11:04:15.643081 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79947], Delivering... [----] I, [2016-09-13T11:04:15.694044 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79947], State: [ok], Delivered in [0.050936117] seconds [----] I, [2016-09-13T11:04:15.705786 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79950], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.452413858] seconds [----] I, [2016-09-13T11:04:15.705975 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79950], Delivering... [----] I, [2016-09-13T11:04:15.712170 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033342838287353516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003462076187133789, :pending_vm_jobs=>0.0007085800170898438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005849599838256836} [----] I, [2016-09-13T11:04:15.712541 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79950], State: [ok], Delivered in [0.006549276] seconds [----] I, [2016-09-13T11:04:16.328905 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79946], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.125589408] seconds [----] I, [2016-09-13T11:04:16.329222 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79946], Delivering... [----] I, [2016-09-13T11:04:16.408904 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79951], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T11:04:16.409352 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79946], State: [ok], Delivered in [0.080160823] seconds [----] I, [2016-09-13T11:04:16.437238 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79948], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.212075608] seconds [----] I, [2016-09-13T11:04:16.437462 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79948], Delivering... [----] I, [2016-09-13T11:04:16.440618 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79948], State: [ok], Delivered in [0.003183713] seconds [----] I, [2016-09-13T11:04:16.448563 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79949], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.210039649] seconds [----] I, [2016-09-13T11:04:16.448845 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79949], Delivering... [----] I, [2016-09-13T11:04:16.454044 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79949], State: [ok], Delivered in [0.005189257] seconds [----] I, [2016-09-13T11:04:21.225396 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T11:04:21.225666 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003763437271118164, :worker_monitor=>1.496793508529663, :worker_dequeue=>0.011563301086425781, :total_time=>1.5124225616455078} [----] I, [2016-09-13T11:04:26.226275 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:04:26 UTC]... [----] I, [2016-09-13T11:04:26.249127 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:04:26 UTC]...Complete [----] I, [2016-09-13T11:04:26.271954 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T11:04:27.724319 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [79951], MiqWorker id: [102], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [11.374144725] seconds [----] I, [2016-09-13T11:04:27.724598 #17546:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79951], Delivering... [----] I, [2016-09-13T11:04:27.728760 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T11:04:27.728948 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T11:04:27.729120 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T11:04:27.729355 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T11:04:27.729598 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:28.176871 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:28.272101 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:04:28.294923 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79952], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:04:28.503112 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:28.503398 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:28.990716 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:29.281368 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:29.281561 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:29.757941 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:30.057677 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:30.057857 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:30.557320 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:30.854918 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:30.855063 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:31.281522 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:04:31.329966 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:31.494770 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79952], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.216656302] seconds [----] I, [2016-09-13T11:04:31.494886 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79952], Delivering... [----] I, [2016-09-13T11:04:31.498627 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.001934051513671875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020084381103515625, :pending_vm_jobs=>0.0004875659942626953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0035064220428466797} [----] I, [2016-09-13T11:04:31.498853 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79952], State: [ok], Delivered in [0.003954131] seconds [----] I, [2016-09-13T11:04:31.621903 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:31.622137 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:32.158039 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:32.449576 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:32.449705 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:32.922694 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:33.244628 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:33.244785 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:33.713387 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:34.043735 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:34.043907 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:34.502815 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:34.799000 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:34.799148 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:35.269730 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:35.567893 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:35.568025 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:37.450194 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030813217163085938, :worker_monitor=>1.153538465499878, :worker_dequeue=>0.007115364074707031, :total_time=>1.1640472412109375} [----] I, [2016-09-13T11:04:42.062707 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:42.359261 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:42.359484 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:42.831471 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:43.132112 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:43.132317 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:43.306222 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:04:43.323796 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79953], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:04:43.352484 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79954], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:04:43.634921 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:43.939033 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:43.939221 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:44.459342 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:44.617873 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:44.751567 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:44.888447 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:45.035259 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:45.176220 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:45.315869 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:45.454400 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:45.593567 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:45.729645 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:45.871503 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:46.008050 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:46.151450 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:46.284964 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:46.414856 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:46.863523 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:47.026055 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:47.179247 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:47.315485 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:47.454792 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:47.479057 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:04:47.591723 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:47.741032 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:47.901826 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:47.957972 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79954], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.629270849] seconds [----] I, [2016-09-13T11:04:47.958141 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79954], Delivering... [----] I, [2016-09-13T11:04:47.964527 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032033920288085938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003222942352294922, :pending_vm_jobs=>0.0007688999176025391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00595402717590332} [----] I, [2016-09-13T11:04:47.964823 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79954], State: [ok], Delivered in [0.006675154] seconds [----] I, [2016-09-13T11:04:48.045134 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:48.184597 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:48.359051 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:48.535287 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:48.679767 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:48.829309 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:48.965100 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:49.100968 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:49.239110 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:49.552577 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79953], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.242398989] seconds [----] I, [2016-09-13T11:04:49.552775 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79953], Delivering... [----] I, [2016-09-13T11:04:49.557515 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79953], State: [ok], Delivered in [0.004725694] seconds [----] I, [2016-09-13T11:04:49.896538 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:50.051947 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:50.313368 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:50.455755 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:50.609771 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:50.746571 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:50.900167 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:51.050622 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:51.207138 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:51.350599 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:51.492017 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:51.631030 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:51.776978 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:51.915050 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:52.064118 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:52.207447 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:52.349627 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:52.796158 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:53.814560 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003966808319091797, :worker_monitor=>1.3150379657745361, :worker_dequeue=>0.011209964752197266, :total_time=>1.3306055068969727} [----] I, [2016-09-13T11:04:58.362994 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:04:58.378322 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79955], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:04:58.815128 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:04:58 UTC]... [----] I, [2016-09-13T11:04:58.864249 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:04:58 UTC]...Complete [----] I, [2016-09-13T11:04:58.875135 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:04:58.964010 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:59.064642 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79955], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.696839635] seconds [----] I, [2016-09-13T11:04:59.064837 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79955], Delivering... [----] I, [2016-09-13T11:04:59.071248 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034706592559814453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003489971160888672, :pending_vm_jobs=>0.0007381439208984375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006020069122314453} [----] I, [2016-09-13T11:04:59.071718 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79955], State: [ok], Delivered in [0.006875652] seconds [----] I, [2016-09-13T11:04:59.106077 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:59.246983 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:59.395496 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:59.565510 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:59.698586 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:59.839675 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:04:59.980197 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:00.120676 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:00.270769 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:00.432395 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:00.572473 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:00.713073 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:00.871664 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:01.012457 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:01.162553 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:01.732971 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:01.885141 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:02.027941 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:02.170015 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:02.305057 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:02.449718 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:02.598644 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:02.734353 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:02.870192 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:03.009232 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:03.151493 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:03.286491 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:03.420288 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:03.563316 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:03.701153 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:03.840357 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:03.995011 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:04.383790 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:04.595552 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:04.734921 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:04.877019 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:05.010122 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:05.144988 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:05.284482 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:05.430274 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:05.569139 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:05.707360 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:05.845489 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:05.979922 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:06.122012 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:06.260778 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:06.401620 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:06.546377 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:06.684563 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:07.140076 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:07.311332 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:07.455476 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:07.596721 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:07.760574 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:07.910356 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:08.049412 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:08.195132 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:08.348070 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:08.484124 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:08.631272 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:08.770196 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:08.906534 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:09.048243 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:09.186497 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:09.325794 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:09.467843 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:09.892610 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:10.206863 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0043375492095947266, :worker_monitor=>1.3062126636505127, :worker_dequeue=>0.005914211273193359, :total_time=>1.3167893886566162} [----] I, [2016-09-13T11:05:13.388593 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:05:13.407710 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79956], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:05:13.419837 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79957], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:05:13.487532 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79958], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:05:13.510582 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79959], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:05:15.297306 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:05:16.093611 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:16.169574 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79956], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.775063159] seconds [----] I, [2016-09-13T11:05:16.169772 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79956], Delivering... [----] I, [2016-09-13T11:05:16.207837 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79959], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.715642749] seconds [----] I, [2016-09-13T11:05:16.208012 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79959], Delivering... [----] I, [2016-09-13T11:05:16.214325 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003231525421142578, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003253936767578125, :pending_vm_jobs=>0.0007607936859130859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005936145782470703} [----] I, [2016-09-13T11:05:16.214729 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79959], State: [ok], Delivered in [0.006707355] seconds [----] I, [2016-09-13T11:05:16.236399 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79956], State: [ok], Delivered in [0.066577462] seconds [----] I, [2016-09-13T11:05:16.242030 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:16.388066 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:16.530835 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:16.649257 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79957], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.235984728] seconds [----] I, [2016-09-13T11:05:16.649500 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79957], Delivering... [----] I, [2016-09-13T11:05:16.653513 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79957], State: [ok], Delivered in [0.003997231] seconds [----] I, [2016-09-13T11:05:16.665374 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79958], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.238788711] seconds [----] I, [2016-09-13T11:05:16.665642 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79958], Delivering... [----] I, [2016-09-13T11:05:16.671584 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79958], State: [ok], Delivered in [0.005706623] seconds [----] I, [2016-09-13T11:05:16.676884 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:16.817657 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:16.952483 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:17.108584 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:17.272774 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:17.425289 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:17.573573 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:17.711772 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:17.869901 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:18.009876 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:18.153322 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:18.302039 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:18.688774 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:18.846166 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:18.985355 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:19.120748 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:19.265067 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:19.414674 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:19.563551 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:19.703273 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:19.848102 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:19.992888 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:20.136543 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:20.280993 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:20.423971 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:20.568410 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:20.706691 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:20.846089 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:20.983545 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:21.429061 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:21.589473 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:21.745025 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:21.887293 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:22.023479 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:22.160758 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:22.310441 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:22.444867 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:22.584727 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:22.737488 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:22.887558 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:23.028119 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:23.166399 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:23.309041 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:23.450369 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:23.587401 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:23.730766 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:24.195076 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:24.398996 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:24.544094 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:24.683616 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:24.836130 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:24.982910 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:25.134989 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:25.315839 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:25.488663 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:25.628680 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:25.766256 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:25.912964 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:26.052566 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:26.195365 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:26.345589 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:26.511365 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:26.637399 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0023992061614990234, :worker_monitor=>1.317145586013794, :worker_dequeue=>0.006291866302490234, :total_time=>1.3260343074798584} [----] I, [2016-09-13T11:05:26.651705 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:27.067990 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:28.522209 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:05:28.539303 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79960], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:05:31.638059 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:05:31 UTC]... [----] I, [2016-09-13T11:05:31.664879 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:05:31 UTC]...Complete [----] I, [2016-09-13T11:05:31.676918 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:05:31.728588 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79960], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.199597306] seconds [----] I, [2016-09-13T11:05:31.728827 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79960], Delivering... [----] I, [2016-09-13T11:05:31.737968 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004660367965698242, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004685878753662109, :pending_vm_jobs=>0.0011692047119140625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008677959442138672} [----] I, [2016-09-13T11:05:31.738462 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79960], State: [ok], Delivered in [0.009601237] seconds [----] I, [2016-09-13T11:05:33.281160 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:33.420045 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:33.558873 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:33.695475 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:33.839352 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:33.978402 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:34.120897 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:34.260913 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:34.403828 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:34.551341 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:34.688665 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:34.828887 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:34.973744 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:35.112780 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:35.264887 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:35.408708 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:35.854308 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:36.020240 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:36.170030 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:36.307530 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:36.449654 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:36.589455 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:36.730580 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:36.869726 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:37.018345 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:37.164339 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:37.299720 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:37.442892 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:37.580243 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:37.722278 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:37.864226 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:38.013576 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:38.160252 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:38.655435 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:38.829343 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:38.979133 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:39.122382 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:39.265169 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:40.406674 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:40.547583 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:40.685832 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:40.838357 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:40.978957 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:41.118677 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:41.262826 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:41.406507 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:41.544996 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:41.681892 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:41.818972 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:05:41.960844 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T11:05:42.156199 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T11:05:42.156728 #17546:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T11:05:42.157226 #17546:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T11:05:42.157383 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T11:05:42.157591 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T11:05:42.173629 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T11:05:42.174082 #17546:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [79951], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T11:05:42.174446 #17546:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T11:05:42.174781 #17546:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T11:05:42.175028 #17546:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79951], State: [error], Delivered in [74.45044169] seconds [----] I, [2016-09-13T11:05:43.301684 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004549980163574219, :worker_monitor=>1.596851110458374, :worker_dequeue=>0.006103992462158203, :total_time=>1.6078073978424072} [----] I, [2016-09-13T11:05:43.550817 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:05:43.567730 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79961], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:05:43.578789 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79962], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:05:48.320050 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T11:05:48.328036 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:05:48.453629 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79962], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.881374105] seconds [----] I, [2016-09-13T11:05:48.453812 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79962], Delivering... [----] I, [2016-09-13T11:05:48.459963 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031642913818359375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031855106353759766, :pending_vm_jobs=>0.0008091926574707031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005814790725708008} [----] I, [2016-09-13T11:05:48.460378 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79962], State: [ok], Delivered in [0.006557564] seconds [----] I, [2016-09-13T11:05:49.808382 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79961], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.25449865] seconds [----] I, [2016-09-13T11:05:49.808639 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79961], Delivering... [----] I, [2016-09-13T11:05:49.813626 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79961], State: [ok], Delivered in [0.004992303] seconds [----] I, [2016-09-13T11:05:58.587301 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:05:58.612793 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79963], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:05:59.457840 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:05:59.460440 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003900289535522461, :worker_monitor=>1.101759910583496, :worker_dequeue=>0.0054645538330078125, :total_time=>1.111386775970459} [----] I, [2016-09-13T11:05:59.533268 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79963], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.935499154] seconds [----] I, [2016-09-13T11:05:59.533395 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79963], Delivering... [----] I, [2016-09-13T11:05:59.536992 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0019736289978027344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.001984834671020508, :pending_vm_jobs=>0.0003905296325683594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003330707550048828} [----] I, [2016-09-13T11:05:59.537263 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79963], State: [ok], Delivered in [0.00387065] seconds [----] I, [2016-09-13T11:06:04.460973 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:06:04 UTC]... [----] I, [2016-09-13T11:06:04.477581 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:06:04 UTC]...Complete [----] I, [2016-09-13T11:06:13.623288 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:06:13.641596 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79964], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:06:13.658649 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79965], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:06:13.681636 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79966], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:06:13.698912 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79967], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:06:15.870467 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:06:15.873223 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004325389862060547, :worker_monitor=>1.3562169075012207, :worker_dequeue=>0.006373882293701172, :total_time=>1.3672022819519043} [----] I, [2016-09-13T11:06:16.664155 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79964], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.032745521] seconds [----] I, [2016-09-13T11:06:16.664309 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79964], Delivering... [----] I, [2016-09-13T11:06:16.671179 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79967], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.982307438] seconds [----] I, [2016-09-13T11:06:16.671354 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79967], Delivering... [----] I, [2016-09-13T11:06:16.676896 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003006458282470703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030236244201660156, :pending_vm_jobs=>0.0006473064422607422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0051975250244140625} [----] I, [2016-09-13T11:06:16.677272 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79967], State: [ok], Delivered in [0.005906023] seconds [----] I, [2016-09-13T11:06:16.704388 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79964], State: [ok], Delivered in [0.040026493] seconds [----] I, [2016-09-13T11:06:16.909794 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79965], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.260737501] seconds [----] I, [2016-09-13T11:06:16.909934 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79965], Delivering... [----] I, [2016-09-13T11:06:16.915870 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79965], State: [ok], Delivered in [0.005903171] seconds [----] I, [2016-09-13T11:06:16.921407 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79966], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.251399604] seconds [----] I, [2016-09-13T11:06:16.921568 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79966], Delivering... [----] I, [2016-09-13T11:06:16.925666 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79966], State: [ok], Delivered in [0.004077351] seconds [----] I, [2016-09-13T11:06:28.715407 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:06:28.738041 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79968], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:06:32.434726 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:06:32.437494 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005926370620727539, :worker_monitor=>1.4190316200256348, :worker_dequeue=>0.012276411056518555, :total_time=>1.437791347503662} [----] I, [2016-09-13T11:06:32.789636 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79968], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.064743948] seconds [----] I, [2016-09-13T11:06:32.789817 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79968], Delivering... [----] I, [2016-09-13T11:06:32.795734 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003209829330444336, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003284931182861328, :pending_vm_jobs=>0.000720977783203125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005600690841674805} [----] I, [2016-09-13T11:06:32.796028 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79968], State: [ok], Delivered in [0.006209281] seconds [----] I, [2016-09-13T11:06:37.437969 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:06:37 UTC]... [----] I, [2016-09-13T11:06:37.457767 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:06:37 UTC]...Complete [----] I, [2016-09-13T11:06:43.753823 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:06:43.790390 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79969], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:06:43.818839 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79970], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:06:49.055199 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:06:49.065625 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004418611526489258, :worker_monitor=>1.556976556777954, :worker_dequeue=>0.018062353134155273, :total_time=>1.5797827243804932} [----] I, [2016-09-13T11:06:49.963539 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79970], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.166011026] seconds [----] I, [2016-09-13T11:06:49.963800 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79970], Delivering... [----] I, [2016-09-13T11:06:49.993803 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.02643108367919922, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.026456117630004883, :pending_vm_jobs=>0.0009586811065673828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.02955174446105957} [----] I, [2016-09-13T11:06:50.000042 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79970], State: [ok], Delivered in [0.036225933] seconds [----] I, [2016-09-13T11:06:50.054671 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79969], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.296225413] seconds [----] I, [2016-09-13T11:06:50.054901 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79969], Delivering... [----] I, [2016-09-13T11:06:50.060599 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79969], State: [ok], Delivered in [0.005684105] seconds [----] I, [2016-09-13T11:06:58.831944 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:06:58.860598 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79971], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:06:59.091090 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:07:00.026364 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79971], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.184858919] seconds [----] I, [2016-09-13T11:07:00.026619 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79971], Delivering... [----] I, [2016-09-13T11:07:00.033607 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036497116088867188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036716461181640625, :pending_vm_jobs=>0.0008785724639892578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065729618072509766} [----] I, [2016-09-13T11:07:00.033963 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79971], State: [ok], Delivered in [0.007344442] seconds [----] I, [2016-09-13T11:07:05.522905 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005948066711425781, :worker_monitor=>1.4138538837432861, :worker_dequeue=>0.008707046508789062, :total_time=>1.428910493850708} [----] I, [2016-09-13T11:07:10.523478 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:07:10 UTC]... [----] I, [2016-09-13T11:07:10.550717 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:07:10 UTC]...Complete [----] I, [2016-09-13T11:07:13.879649 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:07:13.905372 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79972], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:07:13.928197 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79973], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:07:13.962568 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79974], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:07:13.991088 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79975], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:07:15.573016 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:07:16.162381 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79973], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.248684521] seconds [----] I, [2016-09-13T11:07:16.162577 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79973], Delivering... [----] I, [2016-09-13T11:07:16.168003 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79975], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.199839987] seconds [----] I, [2016-09-13T11:07:16.168120 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79975], Delivering... [----] I, [2016-09-13T11:07:16.171602 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0018687248229980469, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0018928050994873047, :pending_vm_jobs=>0.00046539306640625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0032570362091064453} [----] I, [2016-09-13T11:07:16.171797 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79975], State: [ok], Delivered in [0.003671972] seconds [----] I, [2016-09-13T11:07:16.196464 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79973], State: [ok], Delivered in [0.033856861] seconds [----] I, [2016-09-13T11:07:17.142255 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79972], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.254132293] seconds [----] I, [2016-09-13T11:07:17.142565 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79972], Delivering... [----] I, [2016-09-13T11:07:17.147537 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79972], State: [ok], Delivered in [0.004963984] seconds [----] I, [2016-09-13T11:07:17.179667 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79974], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.247365778] seconds [----] I, [2016-09-13T11:07:17.179842 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79974], Delivering... [----] I, [2016-09-13T11:07:17.184036 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79974], State: [ok], Delivered in [0.004180764] seconds [----] I, [2016-09-13T11:07:22.177562 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005518674850463867, :worker_monitor=>1.5892422199249268, :worker_dequeue=>0.0068492889404296875, :total_time=>1.6019914150238037} [----] I, [2016-09-13T11:07:29.003365 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:07:29.025691 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79976], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:07:32.285740 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:07:32.625494 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79976], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.615914652] seconds [----] I, [2016-09-13T11:07:32.625672 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79976], Delivering... [----] I, [2016-09-13T11:07:32.631969 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032508373260498047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003270387649536133, :pending_vm_jobs=>0.0007479190826416016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00594329833984375} [----] I, [2016-09-13T11:07:32.632398 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79976], State: [ok], Delivered in [0.006712503] seconds [----] I, [2016-09-13T11:07:38.789405 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005244731903076172, :worker_monitor=>1.4721095561981201, :worker_dequeue=>0.020977020263671875, :total_time=>1.498722791671753} [----] I, [2016-09-13T11:07:43.790251 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:07:43 UTC]... [----] I, [2016-09-13T11:07:43.808393 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:07:43 UTC]...Complete [----] I, [2016-09-13T11:07:44.037782 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:07:44.054127 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79977], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:07:44.077021 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79978], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:07:48.837568 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:07:48.866337 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79978], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.806819211] seconds [----] I, [2016-09-13T11:07:48.866481 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79978], Delivering... [----] I, [2016-09-13T11:07:48.870340 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021944046020507812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022079944610595703, :pending_vm_jobs=>0.00044918060302734375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0036211013793945312} [----] I, [2016-09-13T11:07:48.870580 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79978], State: [ok], Delivered in [0.004095451] seconds [----] I, [2016-09-13T11:07:50.718239 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79977], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.675792019] seconds [----] I, [2016-09-13T11:07:50.718480 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79977], Delivering... [----] I, [2016-09-13T11:07:50.723225 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79977], State: [ok], Delivered in [0.004763517] seconds [----] I, [2016-09-13T11:07:55.056310 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030155181884765625, :worker_monitor=>1.1988542079925537, :worker_dequeue=>0.013755559921264648, :total_time=>1.2159054279327393} [----] I, [2016-09-13T11:07:59.088622 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:07:59.123512 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79979], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:08:00.066738 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:08:00.963483 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79979], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.868982742] seconds [----] I, [2016-09-13T11:08:00.963611 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79979], Delivering... [----] I, [2016-09-13T11:08:00.967645 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022079944610595703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002222776412963867, :pending_vm_jobs=>0.0004901885986328125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003781557083129883} [----] I, [2016-09-13T11:08:00.967854 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79979], State: [ok], Delivered in [0.004245175] seconds [----] I, [2016-09-13T11:08:11.461765 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004171609878540039, :worker_monitor=>1.364112138748169, :worker_dequeue=>0.007413625717163086, :total_time=>1.3760228157043457} [----] I, [2016-09-13T11:08:14.134206 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:08:14.153928 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79980], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:08:14.176500 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79981], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:08:14.193554 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79982], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:08:14.210850 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79983], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:08:16.462264 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:08:16 UTC]... [----] I, [2016-09-13T11:08:16.479145 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:08:16 UTC]...Complete [----] I, [2016-09-13T11:08:16.488406 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:08:17.092921 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79980], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.954040638] seconds [----] I, [2016-09-13T11:08:17.093177 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79980], Delivering... [----] I, [2016-09-13T11:08:17.119832 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79983], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.920619261] seconds [----] I, [2016-09-13T11:08:17.120009 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79983], Delivering... [----] I, [2016-09-13T11:08:17.126259 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033571720123291016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034003257751464844, :pending_vm_jobs=>0.00079345703125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058634281158447266} [----] I, [2016-09-13T11:08:17.126608 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79983], State: [ok], Delivered in [0.006590099] seconds [----] I, [2016-09-13T11:08:17.165317 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79980], State: [ok], Delivered in [0.072131803] seconds [----] I, [2016-09-13T11:08:17.794213 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79981], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.631745671] seconds [----] I, [2016-09-13T11:08:17.794402 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79981], Delivering... [----] I, [2016-09-13T11:08:17.797629 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79981], State: [ok], Delivered in [0.00321279] seconds [----] I, [2016-09-13T11:08:17.805728 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79982], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.624035342] seconds [----] I, [2016-09-13T11:08:17.806009 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79982], Delivering... [----] I, [2016-09-13T11:08:17.813970 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79982], State: [ok], Delivered in [0.007961713] seconds [----] I, [2016-09-13T11:08:27.773942 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003483295440673828, :worker_monitor=>1.253218412399292, :worker_dequeue=>0.010116338729858398, :total_time=>1.2671566009521484} [----] I, [2016-09-13T11:08:29.225196 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:08:29.245351 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79984], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:08:32.965158 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:08:33.274070 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79984], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.042344677] seconds [----] I, [2016-09-13T11:08:33.274302 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79984], Delivering... [----] I, [2016-09-13T11:08:33.282235 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004045248031616211, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004079103469848633, :pending_vm_jobs=>0.0010755062103271484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007445335388183594} [----] I, [2016-09-13T11:08:33.282745 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79984], State: [ok], Delivered in [0.008434973] seconds [----] I, [2016-09-13T11:08:44.137684 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025773048400878906, :worker_monitor=>1.1360795497894287, :worker_dequeue=>0.009250402450561523, :total_time=>1.1481292247772217} [----] I, [2016-09-13T11:08:44.262910 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T11:08:44.308321 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79985], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:08:44.325324 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79986], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:08:44.342466 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79987], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:08:44.359627 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79988], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:08:49.138239 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:08:49 UTC]... [----] I, [2016-09-13T11:08:49.170973 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:08:49 UTC]...Complete [----] I, [2016-09-13T11:08:49.185683 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:08:49.428655 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79985], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.158930467] seconds [----] I, [2016-09-13T11:08:49.428861 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79985], Delivering... [----] I, [2016-09-13T11:08:49.430132 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T11:08:49.430363 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4580421632 [----] I, [2016-09-13T11:08:49.430520 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4345016320 [----] I, [2016-09-13T11:08:49.430618 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 235405312 [----] I, [2016-09-13T11:08:49.430699 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 918552576 [----] I, [2016-09-13T11:08:49.430774 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4288319488 [----] I, [2016-09-13T11:08:49.430849 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T11:08:49.430923 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T11:08:49.430990 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 557977600 [----] I, [2016-09-13T11:08:49.431064 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T11:08:49.431141 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6807687168 [----] I, [2016-09-13T11:08:49.431230 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T11:08:49.431309 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T11:08:49.431386 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T11:08:49.431554 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T11:08:49.431646 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T11:08:49.431724 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T11:08:49.431798 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T11:08:49.431865 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T11:08:49.431937 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T11:08:49.432009 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T11:08:49.432077 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272097280 [----] I, [2016-09-13T11:08:49.432146 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55005184 [----] I, [2016-09-13T11:08:49.432256 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217092096 [----] I, [2016-09-13T11:08:49.432332 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6127616 [----] I, [2016-09-13T11:08:49.432438 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142090240 [----] I, [2016-09-13T11:08:49.432561 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3402498048 [----] I, [2016-09-13T11:08:49.432639 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3084500992 [----] I, [2016-09-13T11:08:49.432710 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T11:08:49.432786 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T11:08:49.432859 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T11:08:49.432929 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36614144 [----] I, [2016-09-13T11:08:49.432999 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76959744 [----] I, [2016-09-13T11:08:49.433065 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49713152 [----] I, [2016-09-13T11:08:49.433134 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111702016 [----] I, [2016-09-13T11:08:49.433229 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126672896 [----] I, [2016-09-13T11:08:49.433297 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T11:08:49.433399 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T11:08:49.433521 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T11:08:49.433601 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T11:08:49.433676 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T11:08:49.433749 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T11:08:49.433815 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T11:08:49.433884 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T11:08:49.433950 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T11:08:49.464494 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T11:08:49.464739 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T11:08:49.468930 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T11:08:49.472038 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T11:08:49.476908 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T11:08:49.481734 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T11:08:49.485229 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T11:08:49.488720 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 856 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T11:08:49.492246 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T11:08:49.495823 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T11:08:49.499288 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T11:08:49.502331 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79988], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.151888828] seconds [----] I, [2016-09-13T11:08:49.502457 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79988], Delivering... [----] I, [2016-09-13T11:08:49.502719 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T11:08:49.506174 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T11:08:49.506500 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002148151397705078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021636486053466797, :pending_vm_jobs=>0.0005068778991699219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0037987232208251953} [----] I, [2016-09-13T11:08:49.506756 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79988], State: [ok], Delivered in [0.004305932] seconds [----] I, [2016-09-13T11:08:49.510096 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T11:08:49.513286 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1, "smartstate"=>1}} [----] I, [2016-09-13T11:08:49.513505 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:08:49.513644 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T11:08:49.518228 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [153854.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:08:49.518628 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79985], State: [ok], Delivered in [0.089749861] seconds [----] I, [2016-09-13T11:08:50.988523 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79987], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.657446253] seconds [----] I, [2016-09-13T11:08:50.988752 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79987], Delivering... [----] I, [2016-09-13T11:08:50.993436 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79987], State: [ok], Delivered in [0.004667648] seconds [----] I, [2016-09-13T11:08:54.202979 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:08:54.605613 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79986], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [10.291363587] seconds [----] I, [2016-09-13T11:08:54.605824 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [79986], Delivering... [----] I, [2016-09-13T11:08:54.618693 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:08:37 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347859000], Memory % [5.04], CPU Time [106178.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T11:08:54.619676 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:08:32 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213440000], Memory % [3.51], CPU Time [50002.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T11:08:54.620872 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:08:43 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [153863.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:08:54.621961 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:08:42 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169749000], Memory % [3.14], CPU Time [52637.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:08:54.622993 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:08:41 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163161000], Memory % [3.1], CPU Time [38749.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T11:08:54.624033 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:08:41 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359296000], Memory % [5.28], CPU Time [207698.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T11:08:54.625015 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:08:43 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [154741.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:08:54.626041 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:08:29 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [245178.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T11:08:54.631313 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:08:42 UTC], Process Info: Memory Usage [614723584], Memory Size [1071505408], Proportional Set Size: [453507000], Memory % [7.49], CPU Time [1807.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T11:08:54.635261 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:08:41 UTC], Process Info: Memory Usage [602021888], Memory Size [960708608], Proportional Set Size: [440658000], Memory % [7.34], CPU Time [661.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T11:08:54.636285 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:08:41 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358595000], Memory % [5.27], CPU Time [215073.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T11:08:54.637301 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:08:42 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178488000], Memory % [3.2], CPU Time [52603.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:08:54.638243 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:08:39 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166762000], Memory % [3.16], CPU Time [39666.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T11:08:54.638738 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [79986], State: [ok], Delivered in [0.032878477] seconds [----] I, [2016-09-13T11:08:59.373735 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:08:59.382340 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79989], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:09:00.470551 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:09:00.475524 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005040645599365234, :worker_monitor=>1.2519898414611816, :worker_dequeue=>0.010119438171386719, :total_time=>1.2676222324371338} [----] I, [2016-09-13T11:09:00.639898 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79989], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.262317747] seconds [----] I, [2016-09-13T11:09:00.640113 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79989], Delivering... [----] I, [2016-09-13T11:09:00.647369 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037093162536621094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003734588623046875, :pending_vm_jobs=>0.0008361339569091797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006777048110961914} [----] I, [2016-09-13T11:09:00.647746 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79989], State: [ok], Delivered in [0.007635635] seconds [----] I, [2016-09-13T11:09:14.391456 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:09:14.417317 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79990], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:09:14.434671 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79991], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:09:14.462780 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79992], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:09:14.473876 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79993], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:09:16.486691 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:09:16.794577 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79990], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.39768626] seconds [----] I, [2016-09-13T11:09:16.794811 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79990], Delivering... [----] I, [2016-09-13T11:09:16.800263 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79993], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.331957833] seconds [----] I, [2016-09-13T11:09:16.800479 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79993], Delivering... [----] I, [2016-09-13T11:09:16.807245 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035254955291748047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035538673400878906, :pending_vm_jobs=>0.0008215904235839844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063440799713134766} [----] I, [2016-09-13T11:09:16.807598 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79993], State: [ok], Delivered in [0.007143395] seconds [----] I, [2016-09-13T11:09:16.868581 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79990], State: [ok], Delivered in [0.073718319] seconds [----] I, [2016-09-13T11:09:18.091617 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79991], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.668125506] seconds [----] I, [2016-09-13T11:09:18.091865 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79991], Delivering... [----] I, [2016-09-13T11:09:18.095304 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79991], State: [ok], Delivered in [0.003423976] seconds [----] I, [2016-09-13T11:09:18.103614 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79992], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.661073733] seconds [----] I, [2016-09-13T11:09:18.103835 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79992], Delivering... [----] I, [2016-09-13T11:09:18.110901 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79992], State: [ok], Delivered in [0.007044922] seconds [----] I, [2016-09-13T11:09:21.493408 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:09:21 UTC]... [----] I, [2016-09-13T11:09:21.520022 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:09:21 UTC]...Complete [----] I, [2016-09-13T11:09:29.485293 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:09:29.507824 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79994], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:09:32.715342 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:09:32.717947 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0068132877349853516, :worker_monitor=>1.1557433605194092, :worker_dequeue=>0.0057981014251708984, :total_time=>1.1687753200531006} [----] I, [2016-09-13T11:09:32.924779 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79994], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.434175388] seconds [----] I, [2016-09-13T11:09:32.924909 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79994], Delivering... [----] I, [2016-09-13T11:09:32.928920 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021219253540039062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00213623046875, :pending_vm_jobs=>0.0005123615264892578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0037593841552734375} [----] I, [2016-09-13T11:09:32.929194 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79994], State: [ok], Delivered in [0.004284566] seconds [----] I, [2016-09-13T11:09:44.518776 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:09:44.530730 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79995], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:09:44.547718 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79996], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:09:49.388974 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:09:49.393509 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041768550872802734, :worker_monitor=>1.5314171314239502, :worker_dequeue=>0.009700775146484375, :total_time=>1.5456113815307617} [----] I, [2016-09-13T11:09:50.083857 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79996], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.545638557] seconds [----] I, [2016-09-13T11:09:50.084084 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79996], Delivering... [----] I, [2016-09-13T11:09:50.092804 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004407405853271484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004435062408447266, :pending_vm_jobs=>0.0010716915130615234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008180379867553711} [----] I, [2016-09-13T11:09:50.093250 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79996], State: [ok], Delivered in [0.009160877] seconds [----] I, [2016-09-13T11:09:51.238113 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79995], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.714747674] seconds [----] I, [2016-09-13T11:09:51.238359 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79995], Delivering... [----] I, [2016-09-13T11:09:51.244063 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79995], State: [ok], Delivered in [0.005698864] seconds [----] I, [2016-09-13T11:09:54.394070 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:09:54 UTC]... [----] I, [2016-09-13T11:09:54.414881 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:09:54 UTC]...Complete [----] I, [2016-09-13T11:09:59.559592 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:09:59.580686 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79997], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:10:05.648440 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:10:05.650998 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004800558090209961, :worker_monitor=>1.1968994140625, :worker_dequeue=>0.005556583404541016, :total_time=>1.2076258659362793} [----] I, [2016-09-13T11:10:06.238281 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [79997], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.672389486] seconds [----] I, [2016-09-13T11:10:06.238522 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [79997], Delivering... [----] I, [2016-09-13T11:10:06.245873 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037093162536621094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038099288940429688, :pending_vm_jobs=>0.0008797645568847656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006836652755737305} [----] I, [2016-09-13T11:10:06.246256 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [79997], State: [ok], Delivered in [0.007733248] seconds [----] I, [2016-09-13T11:10:14.592450 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 8. [----] I, [2016-09-13T11:10:14.609500 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79998], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:10:14.620750 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [79999], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:10:14.632207 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80000], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:10:14.644737 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80001], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:10:14.654980 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80002], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:10:14.666556 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80003], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:10:14.677904 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80004], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:10:15.674177 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 7 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:10:16.308903 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80001], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.672892223] seconds [----] I, [2016-09-13T11:10:16.309077 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80001], Delivering... [----] I, [2016-09-13T11:10:16.323727 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80004], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.652137809] seconds [----] I, [2016-09-13T11:10:16.323862 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80004], Delivering... [----] I, [2016-09-13T11:10:16.328179 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002332448959350586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023488998413085938, :pending_vm_jobs=>0.0005316734313964844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004039764404296875} [----] I, [2016-09-13T11:10:16.328485 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80004], State: [ok], Delivered in [0.004612612] seconds [----] I, [2016-09-13T11:10:16.375380 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80001], State: [ok], Delivered in [0.066268061] seconds [----] I, [2016-09-13T11:10:18.307265 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79998], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.708945249] seconds [----] I, [2016-09-13T11:10:18.307599 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79998], Delivering... [----] I, [2016-09-13T11:10:18.310605 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79998], State: [ok], Delivered in [0.00304191] seconds [----] I, [2016-09-13T11:10:18.318301 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [79999], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.703139893] seconds [----] I, [2016-09-13T11:10:18.318535 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [79999], Delivering... [----] I, [2016-09-13T11:10:18.336906 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [79999], State: [ok], Delivered in [0.018346348] seconds [----] I, [2016-09-13T11:10:18.346982 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80000], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.720942747] seconds [----] I, [2016-09-13T11:10:18.347191 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80000], Delivering... [----] I, [2016-09-13T11:10:18.354928 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80000], State: [ok], Delivered in [0.00770601] seconds [----] I, [2016-09-13T11:10:18.375649 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80002], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.725735527] seconds [----] I, [2016-09-13T11:10:18.375854 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80002], Delivering... [----] I, [2016-09-13T11:10:18.379758 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80002], State: [ok], Delivered in [0.003893738] seconds [----] I, [2016-09-13T11:10:18.404003 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80003], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.74164525] seconds [----] I, [2016-09-13T11:10:18.404213 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80003], Delivering... [----] I, [2016-09-13T11:10:18.410136 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80003], State: [ok], Delivered in [0.005927932] seconds [----] I, [2016-09-13T11:10:21.825844 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004007101058959961, :worker_monitor=>1.1354973316192627, :worker_dequeue=>0.007306337356567383, :total_time=>1.147233486175537} [----] I, [2016-09-13T11:10:26.826474 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:10:26 UTC]... [----] I, [2016-09-13T11:10:26.845923 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:10:26 UTC]...Complete [----] I, [2016-09-13T11:10:29.689347 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:10:29.707187 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80005], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:10:31.868545 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:10:32.461308 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80005], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.766038381] seconds [----] I, [2016-09-13T11:10:32.461527 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80005], Delivering... [----] I, [2016-09-13T11:10:32.468216 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034134387969970703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034339427947998047, :pending_vm_jobs=>0.0007877349853515625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006192922592163086} [----] I, [2016-09-13T11:10:32.468553 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80005], State: [ok], Delivered in [0.007021094] seconds [----] I, [2016-09-13T11:10:38.059967 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004317045211791992, :worker_monitor=>1.1753222942352295, :worker_dequeue=>0.007650136947631836, :total_time=>1.1876075267791748} [----] I, [2016-09-13T11:10:44.722936 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:10:44.769895 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80006], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:10:44.781062 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80007], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:10:48.191664 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:10:48.501372 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80007], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.726247867] seconds [----] I, [2016-09-13T11:10:48.501567 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80007], Delivering... [----] I, [2016-09-13T11:10:48.507153 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00299835205078125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030786991119384766, :pending_vm_jobs=>0.0006964206695556641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005227804183959961} [----] I, [2016-09-13T11:10:48.507237 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80006], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.778097868] seconds [----] I, [2016-09-13T11:10:48.507470 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80006], Delivering... [----] I, [2016-09-13T11:10:48.507521 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80007], State: [ok], Delivered in [0.005936542] seconds [----] I, [2016-09-13T11:10:48.513081 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80006], State: [ok], Delivered in [0.005636916] seconds [----] I, [2016-09-13T11:10:53.212353 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T11:10:54.582744 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004446506500244141, :log_active_servers=>0.011384248733520508, :worker_monitor=>1.3602373600006104, :worker_dequeue=>0.00977635383605957, :total_time=>1.386188268661499} [----] I, [2016-09-13T11:10:59.583379 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:10:59 UTC]... [----] I, [2016-09-13T11:10:59.604230 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:10:59 UTC]...Complete [----] I, [2016-09-13T11:10:59.792835 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:10:59.817852 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80008], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:11:04.634553 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:11:04.714343 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80008], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.915482113] seconds [----] I, [2016-09-13T11:11:04.714593 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80008], Delivering... [----] I, [2016-09-13T11:11:04.722030 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038232803344726562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003880739212036133, :pending_vm_jobs=>0.0009355545043945312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006981611251831055} [----] I, [2016-09-13T11:11:04.722496 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80008], State: [ok], Delivered in [0.00786679] seconds [----] I, [2016-09-13T11:11:11.345241 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004190206527709961, :worker_monitor=>1.6906781196594238, :worker_dequeue=>0.010246992111206055, :total_time=>1.7054438591003418} [----] I, [2016-09-13T11:11:14.830692 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:11:14.856401 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80009], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:11:14.885957 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80010], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:11:14.907920 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80011], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:11:14.924994 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80012], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:11:16.355855 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:11:16.795126 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80009], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.956230355] seconds [----] I, [2016-09-13T11:11:16.795358 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80009], Delivering... [----] I, [2016-09-13T11:11:16.833871 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80012], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.920300822] seconds [----] I, [2016-09-13T11:11:16.834074 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80012], Delivering... [----] I, [2016-09-13T11:11:16.841588 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003844738006591797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038712024688720703, :pending_vm_jobs=>0.0009181499481201172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0070209503173828125} [----] I, [2016-09-13T11:11:16.841976 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80012], State: [ok], Delivered in [0.007892302] seconds [----] I, [2016-09-13T11:11:16.850787 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80009], State: [ok], Delivered in [0.055421565] seconds [----] I, [2016-09-13T11:11:18.616546 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80010], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.753952161] seconds [----] I, [2016-09-13T11:11:18.616778 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80010], Delivering... [----] I, [2016-09-13T11:11:18.625774 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80010], State: [ok], Delivered in [0.008986178] seconds [----] I, [2016-09-13T11:11:18.628488 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80011], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.734386155] seconds [----] I, [2016-09-13T11:11:18.628694 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80011], Delivering... [----] I, [2016-09-13T11:11:18.634245 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80011], State: [ok], Delivered in [0.005562185] seconds [----] I, [2016-09-13T11:11:27.801546 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004340171813964844, :worker_monitor=>1.413409948348999, :worker_dequeue=>0.009313344955444336, :total_time=>1.4273991584777832} [----] I, [2016-09-13T11:11:29.941967 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:11:29.976780 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80013], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:11:32.802085 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:11:32 UTC]... [----] I, [2016-09-13T11:11:32.821921 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:11:32 UTC]...Complete [----] I, [2016-09-13T11:11:32.832627 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:11:32.988494 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80013], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.037210349] seconds [----] I, [2016-09-13T11:11:32.988684 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80013], Delivering... [----] I, [2016-09-13T11:11:32.995486 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035648345947265625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035858154296875, :pending_vm_jobs=>0.0007812976837158203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006406307220458984} [----] I, [2016-09-13T11:11:32.995864 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80013], State: [ok], Delivered in [0.007163265] seconds [----] I, [2016-09-13T11:11:44.060964 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004068613052368164, :worker_monitor=>1.191237211227417, :worker_dequeue=>0.012927055358886719, :total_time=>1.2086138725280762} [----] I, [2016-09-13T11:11:44.988258 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:11:44.999124 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80014], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:11:45.010521 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80015], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:11:49.164953 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:11:50.125236 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80015], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.123167944] seconds [----] I, [2016-09-13T11:11:50.125454 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80015], Delivering... [----] I, [2016-09-13T11:11:50.131698 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032091140747070312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00322723388671875, :pending_vm_jobs=>0.0008108615875244141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058743953704833984} [----] I, [2016-09-13T11:11:50.132029 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80015], State: [ok], Delivered in [0.006603925] seconds [----] I, [2016-09-13T11:11:51.759410 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80014], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.768272828] seconds [----] I, [2016-09-13T11:11:51.759660 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80014], Delivering... [----] I, [2016-09-13T11:11:51.765457 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80014], State: [ok], Delivered in [0.00576731] seconds [----] I, [2016-09-13T11:12:00.018532 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:12:00.033576 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80016], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:12:00.492721 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:12:00.497689 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003931999206542969, :worker_monitor=>1.2973413467407227, :worker_dequeue=>0.009967803955078125, :total_time=>1.3115646839141846} [----] I, [2016-09-13T11:12:00.788088 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80016], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.763776689] seconds [----] I, [2016-09-13T11:12:00.788317 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80016], Delivering... [----] I, [2016-09-13T11:12:00.795472 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003770589828491211, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003793001174926758, :pending_vm_jobs=>0.0008411407470703125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006644248962402344} [----] I, [2016-09-13T11:12:00.795837 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80016], State: [ok], Delivered in [0.007520733] seconds [----] I, [2016-09-13T11:12:05.498306 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:12:05 UTC]... [----] I, [2016-09-13T11:12:05.513363 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:12:05 UTC]...Complete [----] I, [2016-09-13T11:12:15.044929 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:12:15.090935 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80017], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:12:15.101964 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80018], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:12:15.119167 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80019], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:12:15.148014 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80020], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:12:16.661170 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:12:16.663676 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004076719284057617, :worker_monitor=>1.1113123893737793, :worker_dequeue=>0.00548243522644043, :total_time=>1.1212208271026611} [----] I, [2016-09-13T11:12:17.278554 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80017], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.228994899] seconds [----] I, [2016-09-13T11:12:17.278738 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80017], Delivering... [----] I, [2016-09-13T11:12:17.325030 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80020], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.200928102] seconds [----] I, [2016-09-13T11:12:17.325206 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80020], Delivering... [----] I, [2016-09-13T11:12:17.331480 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030574798583984375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003076314926147461, :pending_vm_jobs=>0.0007739067077636719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005825996398925781} [----] I, [2016-09-13T11:12:17.331903 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80020], State: [ok], Delivered in [0.006689064] seconds [----] I, [2016-09-13T11:12:17.336377 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80017], State: [ok], Delivered in [0.057619838] seconds [----] I, [2016-09-13T11:12:18.850954 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80018], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.754430571] seconds [----] I, [2016-09-13T11:12:18.851140 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80018], Delivering... [----] I, [2016-09-13T11:12:18.854460 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80018], State: [ok], Delivered in [0.003293291] seconds [----] I, [2016-09-13T11:12:18.861699 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80019], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.752560383] seconds [----] I, [2016-09-13T11:12:18.861870 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80019], Delivering... [----] I, [2016-09-13T11:12:18.867213 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80019], State: [ok], Delivered in [0.005319985] seconds [----] I, [2016-09-13T11:12:30.157936 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:12:30.176317 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80021], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:12:32.756350 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:12:32.760962 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003701448440551758, :worker_monitor=>1.0568652153015137, :worker_dequeue=>0.009949207305908203, :total_time=>1.0708096027374268} [----] I, [2016-09-13T11:12:33.478976 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80021], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.317100615] seconds [----] I, [2016-09-13T11:12:33.479111 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80021], Delivering... [----] I, [2016-09-13T11:12:33.483094 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002256631851196289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022711753845214844, :pending_vm_jobs=>0.0004551410675048828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003736734390258789} [----] I, [2016-09-13T11:12:33.483408 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80021], State: [ok], Delivered in [0.004291258] seconds [----] I, [2016-09-13T11:12:37.761404 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:12:37 UTC]... [----] I, [2016-09-13T11:12:37.769871 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:12:37 UTC]...Complete [----] I, [2016-09-13T11:12:45.185192 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:12:45.198826 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80022], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:12:45.210294 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80023], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:12:48.966093 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:12:48.970488 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004057168960571289, :worker_monitor=>1.1572866439819336, :worker_dequeue=>0.009632349014282227, :total_time=>1.1712791919708252} [----] I, [2016-09-13T11:12:49.589791 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80023], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.38517642] seconds [----] I, [2016-09-13T11:12:49.589979 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80023], Delivering... [----] I, [2016-09-13T11:12:49.596892 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003460407257080078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034835338592529297, :pending_vm_jobs=>0.0008897781372070312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006520509719848633} [----] I, [2016-09-13T11:12:49.597584 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80023], State: [ok], Delivered in [0.007587346] seconds [----] I, [2016-09-13T11:12:52.024122 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80022], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.834087619] seconds [----] I, [2016-09-13T11:12:52.024477 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80022], Delivering... [----] I, [2016-09-13T11:12:52.030838 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80022], State: [ok], Delivered in [0.006401991] seconds [----] I, [2016-09-13T11:13:00.223527 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:13:00.264005 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80024], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:13:05.225481 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:13:05.229893 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033118724822998047, :worker_monitor=>1.1354823112487793, :worker_dequeue=>0.009398460388183594, :total_time=>1.148514986038208} [----] I, [2016-09-13T11:13:05.795804 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80024], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.564074985] seconds [----] I, [2016-09-13T11:13:05.796019 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80024], Delivering... [----] I, [2016-09-13T11:13:05.802999 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036864280700683594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037081241607666016, :pending_vm_jobs=>0.0008883476257324219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065343379974365234} [----] I, [2016-09-13T11:13:05.803365 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80024], State: [ok], Delivered in [0.00734888] seconds [----] I, [2016-09-13T11:13:10.230355 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:13:10 UTC]... [----] I, [2016-09-13T11:13:10.247938 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:13:10 UTC]...Complete [----] I, [2016-09-13T11:13:15.278595 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:13:15.292363 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80025], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:13:15.317068 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80026], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:13:15.343999 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80027], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:13:15.356996 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80028], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:13:21.519464 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:13:21.523939 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004428863525390625, :worker_monitor=>1.2274246215820312, :worker_dequeue=>0.00981760025024414, :total_time=>1.242030143737793} [----] I, [2016-09-13T11:13:21.849611 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80025], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.565865687] seconds [----] I, [2016-09-13T11:13:21.849836 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80025], Delivering... [----] I, [2016-09-13T11:13:21.905866 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80025], State: [ok], Delivered in [0.056016246] seconds [----] I, [2016-09-13T11:13:21.928716 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80028], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.57943374] seconds [----] I, [2016-09-13T11:13:21.928897 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80028], Delivering... [----] I, [2016-09-13T11:13:21.934917 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003027200698852539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003046751022338867, :pending_vm_jobs=>0.0007948875427246094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005676984786987305} [----] I, [2016-09-13T11:13:21.935270 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80028], State: [ok], Delivered in [0.006374203] seconds [----] I, [2016-09-13T11:13:22.054637 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80026], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.757416862] seconds [----] I, [2016-09-13T11:13:22.054856 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80026], Delivering... [----] I, [2016-09-13T11:13:22.058614 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80026], State: [ok], Delivered in [0.003753013] seconds [----] I, [2016-09-13T11:13:22.082807 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80027], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.758562821] seconds [----] I, [2016-09-13T11:13:22.082907 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80027], Delivering... [----] I, [2016-09-13T11:13:22.086093 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80027], State: [ok], Delivered in [0.003185842] seconds [----] I, [2016-09-13T11:13:30.368017 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:13:30.380439 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80029], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:13:31.547009 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:13:31.980302 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80029], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.606477712] seconds [----] I, [2016-09-13T11:13:31.980521 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80029], Delivering... [----] I, [2016-09-13T11:13:31.986793 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032815933227539062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033011436462402344, :pending_vm_jobs=>0.0007984638214111328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005908012390136719} [----] I, [2016-09-13T11:13:31.987135 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80029], State: [ok], Delivered in [0.006597274] seconds [----] I, [2016-09-13T11:13:37.767272 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038874149322509766, :worker_monitor=>1.2020471096038818, :worker_dequeue=>0.009093761444091797, :total_time=>1.215376615524292} [----] I, [2016-09-13T11:13:42.767997 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:13:42 UTC]... [----] I, [2016-09-13T11:13:42.795765 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:13:42 UTC]...Complete [----] I, [2016-09-13T11:13:45.392736 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T11:13:45.405874 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80030], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:13:45.423169 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80031], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:13:45.434029 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80032], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:13:45.446460 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80033], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:13:47.821462 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:13:48.120290 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80030], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.723617866] seconds [----] I, [2016-09-13T11:13:48.120530 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80030], Delivering... [----] I, [2016-09-13T11:13:48.121525 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T11:13:48.121731 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4580990976 [----] I, [2016-09-13T11:13:48.121844 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4345401344 [----] I, [2016-09-13T11:13:48.121925 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 235589632 [----] I, [2016-09-13T11:13:48.122002 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 918552576 [----] I, [2016-09-13T11:13:48.122069 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4288704512 [----] I, [2016-09-13T11:13:48.122139 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T11:13:48.122237 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T11:13:48.122313 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 558161920 [----] I, [2016-09-13T11:13:48.122380 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T11:13:48.122489 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6823428096 [----] I, [2016-09-13T11:13:48.122569 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T11:13:48.122639 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T11:13:48.122710 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T11:13:48.122779 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 12288 [----] I, [2016-09-13T11:13:48.122848 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T11:13:48.122919 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T11:13:48.122990 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T11:13:48.123060 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T11:13:48.123127 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T11:13:48.123218 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T11:13:48.123285 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272097280 [----] I, [2016-09-13T11:13:48.123358 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55005184 [----] I, [2016-09-13T11:13:48.123451 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217092096 [----] I, [2016-09-13T11:13:48.123538 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6111232 [----] I, [2016-09-13T11:13:48.123610 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142090240 [----] I, [2016-09-13T11:13:48.123680 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3401555968 [----] I, [2016-09-13T11:13:48.123775 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3083374592 [----] I, [2016-09-13T11:13:48.123854 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T11:13:48.123924 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T11:13:48.123992 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T11:13:48.124058 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36646912 [----] I, [2016-09-13T11:13:48.124120 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76959744 [----] I, [2016-09-13T11:13:48.124206 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49741824 [----] I, [2016-09-13T11:13:48.124275 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111702016 [----] I, [2016-09-13T11:13:48.124337 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126701568 [----] I, [2016-09-13T11:13:48.124401 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T11:13:48.124513 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T11:13:48.124586 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T11:13:48.124648 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T11:13:48.124712 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T11:13:48.124777 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T11:13:48.124839 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T11:13:48.124902 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T11:13:48.124963 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T11:13:48.125706 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80031], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.716461809] seconds [----] I, [2016-09-13T11:13:48.125834 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80031], Delivering... [----] I, [2016-09-13T11:13:48.132828 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:13:37 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347859000], Memory % [5.04], CPU Time [106233.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T11:13:48.133496 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:13:37 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [154812.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:13:48.134187 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:13:37 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169749000], Memory % [3.14], CPU Time [52684.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:13:48.134789 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:13:32 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213440000], Memory % [3.51], CPU Time [50041.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T11:13:48.135533 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:13:30 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [245299.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T11:13:48.136213 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:13:36 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163161000], Memory % [3.1], CPU Time [38785.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T11:13:48.136940 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:13:37 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359296000], Memory % [5.28], CPU Time [207729.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T11:13:48.137642 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:13:37 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [153934.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:13:48.141669 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:13:33 UTC], Process Info: Memory Usage [614723584], Memory Size [1071505408], Proportional Set Size: [453507000], Memory % [7.49], CPU Time [1817.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T11:13:48.144778 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:13:31 UTC], Process Info: Memory Usage [602341376], Memory Size [975413248], Proportional Set Size: [440970000], Memory % [7.34], CPU Time [672.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T11:13:48.145580 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:13:37 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358595000], Memory % [5.27], CPU Time [215107.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T11:13:48.146355 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:13:37 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178488000], Memory % [3.2], CPU Time [52645.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:13:48.147057 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:13:27 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166762000], Memory % [3.16], CPU Time [39702.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T11:13:48.147550 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80031], State: [ok], Delivered in [0.021677098] seconds [----] I, [2016-09-13T11:13:48.171653 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T11:13:48.171845 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T11:13:48.175484 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T11:13:48.177213 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80033], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.738740415] seconds [----] I, [2016-09-13T11:13:48.177382 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80033], Delivering... [----] I, [2016-09-13T11:13:48.178020 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T11:13:48.181117 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T11:13:48.183705 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032732486724853516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032930374145507812, :pending_vm_jobs=>0.0008695125579833984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005959510803222656} [----] I, [2016-09-13T11:13:48.184035 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80033], State: [ok], Delivered in [0.006649184] seconds [----] I, [2016-09-13T11:13:48.184227 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T11:13:48.187305 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T11:13:48.190305 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 856 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T11:13:48.193376 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T11:13:48.196379 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T11:13:48.199455 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T11:13:48.202410 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T11:13:48.205383 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T11:13:48.208345 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T11:13:48.211006 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:13:48.211162 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:13:48.211269 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T11:13:48.215482 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [154804.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:13:48.215843 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80030], State: [ok], Delivered in [0.095324889] seconds [----] I, [2016-09-13T11:13:49.183297 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80032], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.756650619] seconds [----] I, [2016-09-13T11:13:49.183534 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80032], Delivering... [----] I, [2016-09-13T11:13:49.188737 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80032], State: [ok], Delivered in [0.005188059] seconds [----] I, [2016-09-13T11:13:54.181204 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004743337631225586, :worker_monitor=>1.3373100757598877, :worker_dequeue=>0.012411832809448242, :total_time=>1.354837417602539} [----] I, [2016-09-13T11:14:00.457671 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:14:00.474623 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80034], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:14:04.326636 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:14:04.360072 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80034], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.896247611] seconds [----] I, [2016-09-13T11:14:04.360228 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80034], Delivering... [----] I, [2016-09-13T11:14:04.364347 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021262168884277344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002141714096069336, :pending_vm_jobs=>0.0005030632019042969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038373470306396484} [----] I, [2016-09-13T11:14:04.364637 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80034], State: [ok], Delivered in [0.004413901] seconds [----] I, [2016-09-13T11:14:10.704016 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004090309143066406, :worker_monitor=>1.358795404434204, :worker_dequeue=>0.009198427200317383, :total_time=>1.3724417686462402} [----] I, [2016-09-13T11:14:15.487066 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:14:15.503215 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80035], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:14:15.514361 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80036], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:14:15.531559 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80037], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:14:15.542922 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80038], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:14:15.704610 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:14:15 UTC]... [----] I, [2016-09-13T11:14:15.726758 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:14:15 UTC]...Complete [----] I, [2016-09-13T11:14:15.737703 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:14:16.268976 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80035], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.777359623] seconds [----] I, [2016-09-13T11:14:16.269191 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80035], Delivering... [----] I, [2016-09-13T11:14:16.320476 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80038], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.783848286] seconds [----] I, [2016-09-13T11:14:16.320681 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80038], Delivering... [----] I, [2016-09-13T11:14:16.329282 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004892587661743164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004914760589599609, :pending_vm_jobs=>0.000949859619140625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008124113082885742} [----] I, [2016-09-13T11:14:16.329646 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80038], State: [ok], Delivered in [0.00895981] seconds [----] I, [2016-09-13T11:14:16.333520 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80035], State: [ok], Delivered in [0.064329329] seconds [----] I, [2016-09-13T11:14:16.354727 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80036], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.845972228] seconds [----] I, [2016-09-13T11:14:16.354898 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80036], Delivering... [----] I, [2016-09-13T11:14:16.358336 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80036], State: [ok], Delivered in [0.003407793] seconds [----] I, [2016-09-13T11:14:16.360543 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80037], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.83879156] seconds [----] I, [2016-09-13T11:14:16.360733 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80037], Delivering... [----] I, [2016-09-13T11:14:16.365444 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80037], State: [ok], Delivered in [0.004663426] seconds [----] I, [2016-09-13T11:14:26.973954 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004379749298095703, :worker_monitor=>1.2076725959777832, :worker_dequeue=>0.006214618682861328, :total_time=>1.2185876369476318} [----] I, [2016-09-13T11:14:30.555200 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:14:30.577845 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80039], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:14:31.980228 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:14:32.583469 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80039], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.021321282] seconds [----] I, [2016-09-13T11:14:32.583649 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80039], Delivering... [----] I, [2016-09-13T11:14:32.587395 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021028518676757812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021185874938964844, :pending_vm_jobs=>0.0004341602325439453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0034940242767333984} [----] I, [2016-09-13T11:14:32.587631 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80039], State: [ok], Delivered in [0.003999828] seconds [----] I, [2016-09-13T11:14:43.443876 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00418853759765625, :worker_monitor=>1.4391634464263916, :worker_dequeue=>0.009386539459228516, :total_time=>1.453047752380371} [----] I, [2016-09-13T11:14:45.591742 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:14:45.617915 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80040], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:14:45.629088 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80041], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:14:48.444531 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:14:48 UTC]... [----] I, [2016-09-13T11:14:48.469503 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:14:48 UTC]...Complete [----] I, [2016-09-13T11:14:48.482550 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:14:48.651995 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80041], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.027989207] seconds [----] I, [2016-09-13T11:14:48.652199 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80041], Delivering... [----] I, [2016-09-13T11:14:48.658741 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003291606903076172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033147335052490234, :pending_vm_jobs=>0.0008833408355712891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006129264831542969} [----] I, [2016-09-13T11:14:48.659125 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80041], State: [ok], Delivered in [0.00694022] seconds [----] I, [2016-09-13T11:14:49.457842 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80040], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.861097267] seconds [----] I, [2016-09-13T11:14:49.458020 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80040], Delivering... [----] I, [2016-09-13T11:14:49.462943 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80040], State: [ok], Delivered in [0.004918527] seconds [----] I, [2016-09-13T11:15:00.122058 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004719257354736328, :worker_monitor=>1.6089982986450195, :worker_dequeue=>0.0052759647369384766, :total_time=>1.6192665100097656} [----] I, [2016-09-13T11:15:00.641465 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:15:00.663670 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80042], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:15:05.240347 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:15:05.812208 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80042], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.164666516] seconds [----] I, [2016-09-13T11:15:05.812405 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80042], Delivering... [----] I, [2016-09-13T11:15:05.818910 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033414363861083984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033597946166992188, :pending_vm_jobs=>0.0008361339569091797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006065845489501953} [----] I, [2016-09-13T11:15:05.819291 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80042], State: [ok], Delivered in [0.006888557] seconds [----] I, [2016-09-13T11:15:15.692464 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:15:15.716067 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80043], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:15:15.732033 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80044], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:15:15.749257 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80045], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:15:15.772366 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80046], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:15:16.447815 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:15:16.452790 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00393366813659668, :worker_monitor=>1.1804122924804688, :worker_dequeue=>0.010452985763549805, :total_time=>1.195105791091919} [----] I, [2016-09-13T11:15:16.558878 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80043], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.861190186] seconds [----] I, [2016-09-13T11:15:16.559084 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80043], Delivering... [----] I, [2016-09-13T11:15:16.571129 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80046], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.815645579] seconds [----] I, [2016-09-13T11:15:16.571379 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80046], Delivering... [----] I, [2016-09-13T11:15:16.578491 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036864280700683594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003790140151977539, :pending_vm_jobs=>0.0008511543273925781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0066051483154296875} [----] I, [2016-09-13T11:15:16.578899 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80046], State: [ok], Delivered in [0.00754194] seconds [----] I, [2016-09-13T11:15:16.615589 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80043], State: [ok], Delivered in [0.056462195] seconds [----] I, [2016-09-13T11:15:16.627181 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80044], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.904841375] seconds [----] I, [2016-09-13T11:15:16.627388 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80044], Delivering... [----] I, [2016-09-13T11:15:16.630795 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80044], State: [ok], Delivered in [0.003413634] seconds [----] I, [2016-09-13T11:15:16.644686 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80045], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.90384223] seconds [----] I, [2016-09-13T11:15:16.644897 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80045], Delivering... [----] I, [2016-09-13T11:15:16.649736 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80045], State: [ok], Delivered in [0.004844422] seconds [----] I, [2016-09-13T11:15:21.453373 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:15:21 UTC]... [----] I, [2016-09-13T11:15:21.472821 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:15:21 UTC]...Complete [----] I, [2016-09-13T11:15:30.786594 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:15:30.804567 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80047], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:15:32.840784 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:15:32.845473 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004160881042480469, :worker_monitor=>1.3289074897766113, :worker_dequeue=>0.009821176528930664, :total_time=>1.3431611061096191} [----] I, [2016-09-13T11:15:32.998940 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80047], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.2056853] seconds [----] I, [2016-09-13T11:15:32.999123 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80047], Delivering... [----] I, [2016-09-13T11:15:33.005988 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003354310989379883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033752918243408203, :pending_vm_jobs=>0.0008785724639892578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006425380706787109} [----] I, [2016-09-13T11:15:33.006343 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80047], State: [ok], Delivered in [0.007209119] seconds [----] I, [2016-09-13T11:15:45.817528 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:15:45.833368 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80048], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:15:45.850336 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80049], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:15:49.022098 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:15:49.025623 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003980398178100586, :worker_monitor=>1.137233018875122, :worker_dequeue=>0.0076062679290771484, :total_time=>1.149235725402832} [----] I, [2016-09-13T11:15:49.136210 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80049], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.296977472] seconds [----] I, [2016-09-13T11:15:49.136385 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80049], Delivering... [----] I, [2016-09-13T11:15:49.142351 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031213760375976562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031414031982421875, :pending_vm_jobs=>0.0007641315460205078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005609035491943359} [----] I, [2016-09-13T11:15:49.142706 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80049], State: [ok], Delivered in [0.006314507] seconds [----] I, [2016-09-13T11:15:49.770763 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80048], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.946981001] seconds [----] I, [2016-09-13T11:15:49.770977 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80048], Delivering... [----] I, [2016-09-13T11:15:49.776886 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80048], State: [ok], Delivered in [0.005901395] seconds [----] I, [2016-09-13T11:15:54.026124 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:15:54 UTC]... [----] I, [2016-09-13T11:15:54.050318 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:15:54 UTC]...Complete [----] I, [2016-09-13T11:15:54.070475 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T11:16:00.862240 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:16:00.884959 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80050], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:16:05.766243 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:16:05.770285 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004116535186767578, :worker_monitor=>1.669341802597046, :worker_dequeue=>0.008692502975463867, :total_time=>1.6824426651000977} [----] I, [2016-09-13T11:16:06.320166 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80050], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.45174405] seconds [----] I, [2016-09-13T11:16:06.320508 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80050], Delivering... [----] I, [2016-09-13T11:16:06.331470 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005577564239501953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005609989166259766, :pending_vm_jobs=>0.0013704299926757812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010308980941772461} [----] I, [2016-09-13T11:16:06.332008 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80050], State: [ok], Delivered in [0.011547278] seconds [----] I, [2016-09-13T11:16:15.896726 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:16:15.919597 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80051], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:16:15.930897 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80052], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:16:15.948252 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80053], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:16:15.959393 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80054], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:16:21.924403 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:16:21.927385 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003500699996948242, :worker_monitor=>1.0526940822601318, :worker_dequeue=>0.006390810012817383, :total_time=>1.0628373622894287} [----] I, [2016-09-13T11:16:22.382815 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80051], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.477476422] seconds [----] I, [2016-09-13T11:16:22.383015 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80051], Delivering... [----] I, [2016-09-13T11:16:22.433816 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80051], State: [ok], Delivered in [0.050785549] seconds [----] I, [2016-09-13T11:16:22.456746 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80054], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.502827654] seconds [----] I, [2016-09-13T11:16:22.456891 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80054], Delivering... [----] I, [2016-09-13T11:16:22.462638 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028667449951171875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028836727142333984, :pending_vm_jobs=>0.0007870197296142578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005426883697509766} [----] I, [2016-09-13T11:16:22.462980 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80054], State: [ok], Delivered in [0.006079414] seconds [----] I, [2016-09-13T11:16:22.835328 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80052], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.9104413] seconds [----] I, [2016-09-13T11:16:22.835621 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80052], Delivering... [----] I, [2016-09-13T11:16:22.845338 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80052], State: [ok], Delivered in [0.009721826] seconds [----] I, [2016-09-13T11:16:22.868337 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80053], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.928988404] seconds [----] I, [2016-09-13T11:16:22.868574 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80053], Delivering... [----] I, [2016-09-13T11:16:22.873612 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80053], State: [ok], Delivered in [0.005051392] seconds [----] I, [2016-09-13T11:16:26.927837 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:16:26 UTC]... [----] I, [2016-09-13T11:16:26.948243 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:16:26 UTC]...Complete [----] I, [2016-09-13T11:16:31.361256 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:16:31.416836 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80055], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:16:31.972093 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:16:32.577488 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80055], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.175983172] seconds [----] I, [2016-09-13T11:16:32.577652 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80055], Delivering... [----] I, [2016-09-13T11:16:32.582326 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002665281295776367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026841163635253906, :pending_vm_jobs=>0.0005383491516113281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0043828487396240234} [----] I, [2016-09-13T11:16:32.582621 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80055], State: [ok], Delivered in [0.004965969] seconds [----] I, [2016-09-13T11:16:38.314519 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006662130355834961, :worker_monitor=>1.3259618282318115, :worker_dequeue=>0.004863739013671875, :total_time=>1.3378629684448242} [----] I, [2016-09-13T11:16:46.429453 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:16:46.457327 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80056], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:16:46.474027 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80057], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:16:48.341012 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:16:48.628516 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80057], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.165068916] seconds [----] I, [2016-09-13T11:16:48.628674 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80057], Delivering... [----] I, [2016-09-13T11:16:48.634361 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002939939498901367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002958536148071289, :pending_vm_jobs=>0.0007371902465820312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005362272262573242} [----] I, [2016-09-13T11:16:48.634698 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80057], State: [ok], Delivered in [0.00602099] seconds [----] I, [2016-09-13T11:16:49.961285 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80056], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.527024836] seconds [----] I, [2016-09-13T11:16:49.961538 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80056], Delivering... [----] I, [2016-09-13T11:16:49.970044 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80056], State: [ok], Delivered in [0.008489477] seconds [----] I, [2016-09-13T11:16:54.440466 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003936052322387695, :worker_monitor=>1.0814330577850342, :worker_dequeue=>0.009056329727172852, :total_time=>1.0948426723480225} [----] I, [2016-09-13T11:16:59.441060 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:16:59 UTC]... [----] I, [2016-09-13T11:16:59.487350 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:16:59 UTC]...Complete [----] I, [2016-09-13T11:17:01.485624 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:17:01.503953 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80058], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:17:04.512314 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:17:04.765779 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80058], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.274364181] seconds [----] I, [2016-09-13T11:17:04.765975 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80058], Delivering... [----] I, [2016-09-13T11:17:04.772111 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031785964965820312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003197193145751953, :pending_vm_jobs=>0.0007672309875488281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005743265151977539} [----] I, [2016-09-13T11:17:04.772476 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80058], State: [ok], Delivered in [0.006482551] seconds [----] I, [2016-09-13T11:17:16.514968 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:17:16.560227 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80059], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:17:16.577195 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80060], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:17:16.594376 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80061], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:17:16.617503 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80062], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:17:20.548829 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:17:20.880234 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80059], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.36014381] seconds [----] I, [2016-09-13T11:17:20.880467 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80059], Delivering... [----] I, [2016-09-13T11:17:20.886198 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80062], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.285462688] seconds [----] I, [2016-09-13T11:17:20.886502 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80062], Delivering... [----] I, [2016-09-13T11:17:20.896910 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005325794219970703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0053577423095703125, :pending_vm_jobs=>0.0014281272888183594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009819746017456055} [----] I, [2016-09-13T11:17:20.897395 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80062], State: [ok], Delivered in [0.010913434] seconds [----] I, [2016-09-13T11:17:20.925789 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80059], State: [ok], Delivered in [0.045339886] seconds [----] I, [2016-09-13T11:17:23.040216 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80060], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.471820214] seconds [----] I, [2016-09-13T11:17:23.040403 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80060], Delivering... [----] I, [2016-09-13T11:17:23.043048 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80060], State: [ok], Delivered in [0.002629567] seconds [----] I, [2016-09-13T11:17:23.114520 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80061], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.528441226] seconds [----] I, [2016-09-13T11:17:23.114665 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80061], Delivering... [----] I, [2016-09-13T11:17:23.118010 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80061], State: [ok], Delivered in [0.00333789] seconds [----] I, [2016-09-13T11:17:31.548767 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:17:31 UTC]... [----] I, [2016-09-13T11:17:31.572688 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:17:31 UTC]...Complete [----] I, [2016-09-13T11:17:31.630209 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:17:31.646124 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80063], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:17:36.592182 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:17:37.017848 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80063], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.381492028] seconds [----] I, [2016-09-13T11:17:37.018108 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80063], Delivering... [----] I, [2016-09-13T11:17:37.028277 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005063772201538086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0050928592681884766, :pending_vm_jobs=>0.0013186931610107422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00953817367553711} [----] I, [2016-09-13T11:17:37.028768 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80063], State: [ok], Delivered in [0.010649539] seconds [----] I, [2016-09-13T11:17:42.777883 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038623809814453125, :worker_monitor=>1.171666145324707, :worker_dequeue=>0.005258798599243164, :total_time=>1.1810691356658936} [----] I, [2016-09-13T11:17:46.660450 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:17:46.679968 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80064], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:17:46.695780 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80065], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:17:47.787280 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:17:48.084519 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80065], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.39847444] seconds [----] I, [2016-09-13T11:17:48.084691 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80065], Delivering... [----] I, [2016-09-13T11:17:48.090909 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031652450561523438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031881332397460938, :pending_vm_jobs=>0.0007927417755126953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005861520767211914} [----] I, [2016-09-13T11:17:48.091272 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80065], State: [ok], Delivered in [0.00656843] seconds [----] I, [2016-09-13T11:17:50.207576 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80064], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.541903906] seconds [----] I, [2016-09-13T11:17:50.207821 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80064], Delivering... [----] I, [2016-09-13T11:17:50.213557 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80064], State: [ok], Delivered in [0.00572748] seconds [----] I, [2016-09-13T11:17:59.036290 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0034515857696533203, :worker_monitor=>1.2182745933532715, :worker_dequeue=>0.008992910385131836, :total_time=>1.2310009002685547} [----] I, [2016-09-13T11:18:01.709619 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T11:18:01.756879 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80066], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:18:01.772949 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80067], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [3600] [----] I, [2016-09-13T11:18:04.036861 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:18:04 UTC]... [----] I, [2016-09-13T11:18:04.081409 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:18:04 UTC]...Complete [----] I, [2016-09-13T11:18:04.093684 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:18:04.224650 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80066], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.505413833] seconds [----] I, [2016-09-13T11:18:04.224859 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80066], Delivering... [----] I, [2016-09-13T11:18:04.231742 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003565549850463867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035860538482666016, :pending_vm_jobs=>0.0008962154388427734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006445407867431641} [----] I, [2016-09-13T11:18:04.232123 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80066], State: [ok], Delivered in [0.007263998] seconds [----] I, [2016-09-13T11:18:05.264388 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80067], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [3600], Dequeued in: [3.501126381] seconds [----] I, [2016-09-13T11:18:05.264550 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80067], Delivering... [----] I, [2016-09-13T11:18:05.276760 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80067], State: [ok], Delivered in [0.012205663] seconds [----] I, [2016-09-13T11:18:15.274628 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003240823745727539, :worker_monitor=>1.1509606838226318, :worker_dequeue=>0.008112430572509766, :total_time=>1.1625988483428955} [----] I, [2016-09-13T11:18:16.788578 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:18:16.803294 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80068], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:18:16.821605 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80069], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:18:16.843568 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80070], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:18:16.877954 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80071], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:18:20.397232 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:18:21.363733 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80068], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.567778628] seconds [----] I, [2016-09-13T11:18:21.363888 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80068], Delivering... [----] I, [2016-09-13T11:18:21.375441 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80071], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.525633673] seconds [----] I, [2016-09-13T11:18:21.375872 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80071], Delivering... [----] I, [2016-09-13T11:18:21.384205 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004273414611816406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004300355911254883, :pending_vm_jobs=>0.0010368824005126953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00781393051147461} [----] I, [2016-09-13T11:18:21.384769 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80071], State: [ok], Delivered in [0.008895746] seconds [----] I, [2016-09-13T11:18:21.414713 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80068], State: [ok], Delivered in [0.050797449] seconds [----] I, [2016-09-13T11:18:23.306625 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80069], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.497406709] seconds [----] I, [2016-09-13T11:18:23.306832 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80069], Delivering... [----] I, [2016-09-13T11:18:23.310253 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80069], State: [ok], Delivered in [0.003396447] seconds [----] I, [2016-09-13T11:18:23.335107 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80070], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.504021972] seconds [----] I, [2016-09-13T11:18:23.335307 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80070], Delivering... [----] I, [2016-09-13T11:18:23.339681 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80070], State: [ok], Delivered in [0.004364063] seconds [----] I, [2016-09-13T11:18:31.605641 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005427360534667969, :worker_monitor=>1.1743602752685547, :worker_dequeue=>0.006030559539794922, :total_time=>1.1862716674804688} [----] I, [2016-09-13T11:18:31.891013 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:18:31.906020 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80072], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:18:36.606177 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:18:36 UTC]... [----] I, [2016-09-13T11:18:36.625960 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:18:36 UTC]...Complete [----] I, [2016-09-13T11:18:36.636752 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:18:37.529409 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80072], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.633294925] seconds [----] I, [2016-09-13T11:18:37.529628 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80072], Delivering... [----] I, [2016-09-13T11:18:37.536105 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034685134887695312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003488779067993164, :pending_vm_jobs=>0.0007975101470947266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006140470504760742} [----] I, [2016-09-13T11:18:37.536551 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80072], State: [ok], Delivered in [0.006894091] seconds [----] I, [2016-09-13T11:18:46.939481 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T11:18:46.958477 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80073], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:18:46.976305 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80074], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:18:46.994194 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80075], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:18:47.015320 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80076], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:18:47.805015 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:18:47.809148 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005576372146606445, :worker_monitor=>1.1379141807556152, :worker_dequeue=>0.008953571319580078, :total_time=>1.1528055667877197} [----] I, [2016-09-13T11:18:48.609255 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80073], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.662375676] seconds [----] I, [2016-09-13T11:18:48.609369 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80073], Delivering... [----] I, [2016-09-13T11:18:48.610065 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T11:18:48.610185 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4569739264 [----] I, [2016-09-13T11:18:48.610254 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4333961216 [----] I, [2016-09-13T11:18:48.610299 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 235778048 [----] I, [2016-09-13T11:18:48.610338 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 918552576 [----] I, [2016-09-13T11:18:48.610375 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4277243904 [----] I, [2016-09-13T11:18:48.610412 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T11:18:48.610479 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T11:18:48.610521 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 558395392 [----] I, [2016-09-13T11:18:48.610560 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T11:18:48.610595 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6658392064 [----] I, [2016-09-13T11:18:48.610632 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T11:18:48.610671 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T11:18:48.610710 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T11:18:48.610745 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T11:18:48.610781 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T11:18:48.610819 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T11:18:48.610857 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T11:18:48.610893 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T11:18:48.610938 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T11:18:48.610977 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T11:18:48.611011 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272117760 [----] I, [2016-09-13T11:18:48.611045 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55017472 [----] I, [2016-09-13T11:18:48.611081 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217100288 [----] I, [2016-09-13T11:18:48.611119 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6127616 [----] I, [2016-09-13T11:18:48.611169 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142745600 [----] I, [2016-09-13T11:18:48.611220 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3412910080 [----] I, [2016-09-13T11:18:48.611255 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3094532096 [----] I, [2016-09-13T11:18:48.611288 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T11:18:48.611323 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T11:18:48.611356 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T11:18:48.611388 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36671488 [----] I, [2016-09-13T11:18:48.611433 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76959744 [----] I, [2016-09-13T11:18:48.611499 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49610752 [----] I, [2016-09-13T11:18:48.611542 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111734784 [----] I, [2016-09-13T11:18:48.611579 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126570496 [----] I, [2016-09-13T11:18:48.611612 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T11:18:48.611648 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T11:18:48.611681 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T11:18:48.611716 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T11:18:48.611749 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T11:18:48.611790 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T11:18:48.611822 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T11:18:48.611854 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T11:18:48.611894 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T11:18:48.641115 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T11:18:48.641253 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T11:18:48.643689 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T11:18:48.645139 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T11:18:48.646816 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T11:18:48.648438 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T11:18:48.650016 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T11:18:48.651648 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 856 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T11:18:48.653208 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T11:18:48.654740 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T11:18:48.656506 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.8 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T11:18:48.656604 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80076], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.656203321] seconds [----] I, [2016-09-13T11:18:48.656813 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80076], Delivering... [----] I, [2016-09-13T11:18:48.658096 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T11:18:48.659774 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T11:18:48.661328 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T11:18:48.662843 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1, "smartstate"=>1}} [----] I, [2016-09-13T11:18:48.662921 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:18:48.662976 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T11:18:48.665227 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [154861.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:18:48.665492 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80073], State: [ok], Delivered in [0.056112375] seconds [----] I, [2016-09-13T11:18:48.666028 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0047795772552490234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004868507385253906, :pending_vm_jobs=>0.0011565685272216797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008764028549194336} [----] I, [2016-09-13T11:18:48.666481 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80076], State: [ok], Delivered in [0.009629873] seconds [----] I, [2016-09-13T11:18:50.460950 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80075], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.480415374] seconds [----] I, [2016-09-13T11:18:50.461151 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80075], Delivering... [----] I, [2016-09-13T11:18:50.465841 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80075], State: [ok], Delivered in [0.004704674] seconds [----] I, [2016-09-13T11:18:52.818481 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:18:53.461228 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80074], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.49660279] seconds [----] I, [2016-09-13T11:18:53.461404 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80074], Delivering... [----] I, [2016-09-13T11:18:53.468486 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:18:47 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169749000], Memory % [3.14], CPU Time [52701.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:18:53.468930 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:18:44 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213440000], Memory % [3.51], CPU Time [50050.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T11:18:53.469380 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:18:46 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [245472.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T11:18:53.469787 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:18:37 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347858000], Memory % [5.04], CPU Time [106248.0], CPU % [0.21], Priority [21] [----] I, [2016-09-13T11:18:53.470246 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:18:46 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163161000], Memory % [3.1], CPU Time [38795.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T11:18:53.470723 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:18:47 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359294000], Memory % [5.28], CPU Time [207771.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T11:18:53.471170 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:18:47 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [154869.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:18:53.471585 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:18:47 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [154002.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:18:53.474152 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:18:43 UTC], Process Info: Memory Usage [602218496], Memory Size [932499456], Proportional Set Size: [441293000], Memory % [7.34], CPU Time [1878.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T11:18:53.475797 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:18:42 UTC], Process Info: Memory Usage [601808896], Memory Size [945299456], Proportional Set Size: [440448000], Memory % [7.34], CPU Time [729.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T11:18:53.476191 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:18:47 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358593000], Memory % [5.27], CPU Time [215140.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T11:18:53.476565 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:18:46 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178488000], Memory % [3.2], CPU Time [52661.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:18:53.476873 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:18:39 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166762000], Memory % [3.16], CPU Time [39712.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T11:18:53.477117 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80074], State: [ok], Delivered in [0.015719852] seconds [----] I, [2016-09-13T11:19:02.031459 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:19:02.043501 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80077], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:19:03.989023 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:19:03.993363 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003990650177001953, :worker_monitor=>1.1427960395812988, :worker_dequeue=>0.009384632110595703, :total_time=>1.156498908996582} [----] I, [2016-09-13T11:19:04.799223 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80077], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.763912083] seconds [----] I, [2016-09-13T11:19:04.799498 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80077], Delivering... [----] I, [2016-09-13T11:19:04.806843 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003913402557373047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003945589065551758, :pending_vm_jobs=>0.0009191036224365234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006891727447509766} [----] I, [2016-09-13T11:19:04.807260 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80077], State: [ok], Delivered in [0.007793648] seconds [----] I, [2016-09-13T11:19:08.993923 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:19:08 UTC]... [----] I, [2016-09-13T11:19:09.015334 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:19:08 UTC]...Complete [----] I, [2016-09-13T11:19:17.050799 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 14. [----] I, [2016-09-13T11:19:17.089735 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80078], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:19:17.118250 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80079], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:19:17.147012 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80080], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:19:17.175655 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80081], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:19:17.192563 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80082], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:19:20.599210 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:19:20.602662 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006937742233276367, :worker_monitor=>1.5376641750335693, :worker_dequeue=>0.0077915191650390625, :total_time=>1.5528345108032227} [----] I, [2016-09-13T11:19:20.906969 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80079], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.809003402] seconds [----] I, [2016-09-13T11:19:20.907173 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80079], Delivering... [----] I, [2016-09-13T11:19:20.963830 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80082], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.781708972] seconds [----] I, [2016-09-13T11:19:20.963950 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80082], Delivering... [----] I, [2016-09-13T11:19:20.967990 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020966529846191406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002110719680786133, :pending_vm_jobs=>0.0005006790161132812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038161277770996094} [----] I, [2016-09-13T11:19:20.968250 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80082], State: [ok], Delivered in [0.00429358] seconds [----] I, [2016-09-13T11:19:20.973732 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80079], State: [ok], Delivered in [0.066546034] seconds [----] I, [2016-09-13T11:19:23.568564 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80080], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.445902632] seconds [----] I, [2016-09-13T11:19:23.568799 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80080], Delivering... [----] I, [2016-09-13T11:19:23.572767 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80080], State: [ok], Delivered in [0.003935103] seconds [----] I, [2016-09-13T11:19:23.585705 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80078], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.523682896] seconds [----] I, [2016-09-13T11:19:23.585924 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80078], Delivering... [----] I, [2016-09-13T11:19:23.625502 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80081], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.470254233] seconds [----] I, [2016-09-13T11:19:23.625665 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80081], Delivering... [----] I, [2016-09-13T11:19:23.629807 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80081], State: [ok], Delivered in [0.004122517] seconds [----] I, [2016-09-13T11:19:23.643062 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80083], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T11:19:23.643554 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80078], State: [ok], Delivered in [0.057608975] seconds [----] I, [2016-09-13T11:19:25.740836 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T11:19:30.765018 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T11:19:32.205797 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:19:32.233484 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80084], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:19:32.255906 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80085], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:19:34.056772 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [80083], MiqWorker id: [102], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [10.452071641] seconds [----] I, [2016-09-13T11:19:34.056995 #17546:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80083], Delivering... [----] I, [2016-09-13T11:19:34.060552 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T11:19:34.060731 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T11:19:34.060854 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T11:19:34.061025 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T11:19:34.061197 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:35.503669 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:35.816344 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:35.816577 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:36.297843 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:36.596788 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:36.596965 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:37.030879 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:19:37.034479 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003757953643798828, :worker_monitor=>1.2542922496795654, :worker_dequeue=>0.010379314422607422, :total_time=>1.2689423561096191} [----] I, [2016-09-13T11:19:37.079474 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80085], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.839350197] seconds [----] I, [2016-09-13T11:19:37.079663 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80085], Delivering... [----] I, [2016-09-13T11:19:37.086652 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034906864166259766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035359859466552734, :pending_vm_jobs=>0.0008327960968017578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006643772125244141} [----] I, [2016-09-13T11:19:37.087026 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80085], State: [ok], Delivered in [0.007348373] seconds [----] I, [2016-09-13T11:19:37.098251 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:37.398157 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:37.398347 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:37.886637 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:38.188152 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:38.188280 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:38.662098 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:38.707959 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80084], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.496854986] seconds [----] I, [2016-09-13T11:19:38.708155 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80084], Delivering... [----] I, [2016-09-13T11:19:38.787789 #2937:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 15:19:37 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_17' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 15:19:37.032905') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2927,,2016-09-13 15:19:37 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2936,,2016-09-13 15:19:38 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2946,2016-09-13 15:19:38 UTC,2016-09-13 15:19:38 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 15:19:38 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 15:19:38 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 15:19:38 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2986,,2016-09-13 15:19:38 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2997,,2016-09-13 15:19:32 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 15:19:17.199752')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,6, 3011,,2016-09-13 14:56:02 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1415, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,522133, 3030,,2016-09-13 14:56:12 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1406, 3054,,2016-09-13 14:56:07 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1410, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,522132, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,522131, 3160,,2016-09-13 14:45:26 UTC,"SELECT ""zones"".* FROM ""zones"" WHERE ""zones"".""id"" = $1 LIMIT $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2052, 17554,,2016-09-13 15:19:34 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,4, 17563,,2016-09-13 14:56:00 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1418, 27056,,2016-09-13 14:45:28 UTC,"SELECT ""tenants"".* FROM ""tenants"" WHERE (""tenants"".""id"" BETWEEN $1 AND $2) AND ""tenants"".""ancestry"" IS NULL ORDER BY ""tenants"".""id"" ASC LIMIT $3",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2050, 28888,,2016-09-13 14:45:30 UTC,SELECT 1,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2048, ACTIVITY_STATS_CSV [----] I, [2016-09-13T11:19:38.788274 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80084], State: [ok], Delivered in [0.080108274] seconds [----] I, [2016-09-13T11:19:38.947319 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:38.947508 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:39.469573 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:39.776545 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:39.776668 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:40.260482 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:40.548039 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:40.548230 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:41.032856 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:41.336469 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:41.336592 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:41.833456 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:42.034901 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:19:42 UTC]... [----] I, [2016-09-13T11:19:42.056161 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:19:42 UTC]...Complete [----] I, [2016-09-13T11:19:42.118619 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:42.118801 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:42.629861 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:42.908777 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:42.908911 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:43.375147 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:43.653567 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:43.653696 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:44.149063 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:44.446673 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:44.446895 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:44.922582 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:45.229393 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:45.229612 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:45.699379 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:45.871301 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:47.269251 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:19:47.279167 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80086], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:19:47.290488 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80087], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:19:52.024588 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:53.160471 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:53.314224 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:53.352560 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:19:53.356492 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004699230194091797, :worker_monitor=>1.2592246532440186, :worker_dequeue=>0.00873875617980957, :total_time=>1.273010492324829} [----] I, [2016-09-13T11:19:53.473320 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:53.629140 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:53.771009 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80087], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.486726134] seconds [----] I, [2016-09-13T11:19:53.771187 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80087], Delivering... [----] I, [2016-09-13T11:19:53.776191 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027663707733154297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002782106399536133, :pending_vm_jobs=>0.0005605220794677734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004648685455322266} [----] I, [2016-09-13T11:19:53.776474 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80087], State: [ok], Delivered in [0.005282691] seconds [----] I, [2016-09-13T11:19:53.804157 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:53.810835 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80086], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.537905636] seconds [----] I, [2016-09-13T11:19:53.810971 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80086], Delivering... [----] I, [2016-09-13T11:19:53.814744 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80086], State: [ok], Delivered in [0.00376511] seconds [----] I, [2016-09-13T11:19:53.943028 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:54.086170 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:54.222374 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:54.374731 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:54.522790 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:54.672462 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:54.832500 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:55.272907 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:55.415978 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:55.556247 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:55.740503 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:55.928376 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:56.062482 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:56.226675 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:56.422015 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:56.573530 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:56.739512 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:56.880727 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:57.040896 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:57.205144 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:57.362053 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:57.514259 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:57.663197 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:57.803283 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:58.259705 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:58.427281 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:58.570787 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:58.724217 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:58.871934 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:59.010519 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:59.146953 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:59.298177 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:59.440973 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:59.581364 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:59.772094 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:19:59.920697 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:00.063160 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:00.209104 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:00.353063 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:00.505170 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:00.643362 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:01.320083 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:01.684279 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:01.823020 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:01.958942 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:02.097488 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:02.238039 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:02.299968 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:20:02.314261 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80088], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:20:02.403617 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:02.544255 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:02.684713 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:02.832236 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:03.385061 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:20:04.262473 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80088], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.95759097] seconds [----] I, [2016-09-13T11:20:04.262662 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80088], Delivering... [----] I, [2016-09-13T11:20:04.268282 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003049135208129883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030646324157714844, :pending_vm_jobs=>0.0006930828094482422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005273580551147461} [----] I, [2016-09-13T11:20:04.268606 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80088], State: [ok], Delivered in [0.005937502] seconds [----] I, [2016-09-13T11:20:08.993076 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:09.131516 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:09.265448 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:09.412525 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:09.547379 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:09.574981 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005299091339111328, :worker_monitor=>1.1729156970977783, :worker_dequeue=>0.004903078079223633, :total_time=>1.1835193634033203} [----] I, [2016-09-13T11:20:09.688622 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:09.831842 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:10.262411 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:10.436213 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:10.594853 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:10.748922 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:10.903683 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:11.044554 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:11.180843 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:11.321795 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:11.461693 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:11.604747 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:11.766733 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:11.909569 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:12.044068 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:12.181642 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:12.320617 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:12.453555 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:12.608563 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:13.110855 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:13.269030 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:13.414982 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:13.554914 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:13.697264 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:13.837147 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:13.979852 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:14.113482 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:14.251653 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:14.391955 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:14.537310 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:14.575491 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:20:14 UTC]... [----] I, [2016-09-13T11:20:14.594821 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:20:14 UTC]...Complete [----] I, [2016-09-13T11:20:14.672391 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:14.813412 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:14.947544 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:15.084625 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:15.229791 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:15.386656 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:15.872597 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:16.025887 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:16.177974 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:16.319954 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:16.464364 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:16.602739 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:16.742213 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:16.877663 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:17.015385 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:17.157395 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:17.302023 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:17.326697 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 8. [----] I, [2016-09-13T11:20:17.342816 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80089], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:20:17.360030 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80090], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:20:17.382628 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80091], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:20:17.399851 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80092], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:20:17.416730 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80093], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:20:17.444476 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:17.451203 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80094], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:20:17.479720 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80095], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:20:17.588366 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:17.726563 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:17.867070 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:18.006455 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:18.150554 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:18.610997 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:18.968001 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:19.137348 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:19.290018 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:19.437305 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:19.586359 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:19.618496 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 7 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:20:19.720497 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:19.882123 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:20.365794 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80092], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.97851821] seconds [----] I, [2016-09-13T11:20:20.366082 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80092], Delivering... [----] I, [2016-09-13T11:20:20.388704 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80095], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.931883697] seconds [----] I, [2016-09-13T11:20:20.388934 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80095], Delivering... [----] I, [2016-09-13T11:20:20.396797 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004167079925537109, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004194736480712891, :pending_vm_jobs=>0.0009045600891113281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007398843765258789} [----] I, [2016-09-13T11:20:20.397328 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80095], State: [ok], Delivered in [0.008378468] seconds [----] I, [2016-09-13T11:20:20.446976 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80092], State: [ok], Delivered in [0.080897452] seconds [----] I, [2016-09-13T11:20:20.902782 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80089], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.57093215] seconds [----] I, [2016-09-13T11:20:20.902981 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80089], Delivering... [----] I, [2016-09-13T11:20:20.904983 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80089], State: [ok], Delivered in [0.002007264] seconds [----] I, [2016-09-13T11:20:20.948577 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80091], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.583986795] seconds [----] I, [2016-09-13T11:20:20.948575 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80090], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.600655763] seconds [----] I, [2016-09-13T11:20:20.948788 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80090], Delivering... [----] I, [2016-09-13T11:20:20.948819 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80091], Delivering... [----] I, [2016-09-13T11:20:20.955165 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80091], State: [ok], Delivered in [0.0063363] seconds [----] I, [2016-09-13T11:20:20.958915 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80090], State: [ok], Delivered in [0.010124635] seconds [----] I, [2016-09-13T11:20:21.005361 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80093], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.600256035] seconds [----] I, [2016-09-13T11:20:21.005526 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80093], Delivering... [----] I, [2016-09-13T11:20:21.007950 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80093], State: [ok], Delivered in [0.002420425] seconds [----] I, [2016-09-13T11:20:21.035455 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80094], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.612935434] seconds [----] I, [2016-09-13T11:20:21.035580 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80094], Delivering... [----] I, [2016-09-13T11:20:21.039384 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80094], State: [ok], Delivered in [0.003780171] seconds [----] I, [2016-09-13T11:20:25.707756 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0027153491973876953, :worker_monitor=>1.0736753940582275, :worker_dequeue=>0.009156465530395508, :total_time=>1.0858194828033447} [----] I, [2016-09-13T11:20:26.037759 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:26.189521 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:26.332871 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:26.472984 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:26.613074 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:26.745755 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:26.881708 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:27.028514 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:27.177198 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:27.655103 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:27.802767 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:27.964510 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:28.102600 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:28.246985 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:28.394222 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:28.534263 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:28.677460 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:28.817645 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:28.958617 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:29.097366 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:29.231869 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:29.376952 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:29.509382 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:29.640733 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:29.799849 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:29.941930 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:30.443963 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:30.612650 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:30.842554 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:30.987220 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:31.125283 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:31.280673 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:31.430759 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:31.602765 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:31.742226 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:31.883504 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:32.029529 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:32.166811 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:32.301103 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:32.439725 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:32.489411 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:20:32.509734 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80096], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:20:32.579529 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:32.713152 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:32.850272 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:33.322067 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:33.477186 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:33.616918 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:33.763478 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:33.937012 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:34.082930 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:34.219316 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:34.358857 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:34.557069 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:34.695384 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:34.843877 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:34.995895 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:35.136719 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:35.290408 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:35.436046 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:35.578170 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:35.719716 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:35.860556 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:20:36.098657 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80096], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.601703117] seconds [----] I, [2016-09-13T11:20:36.098847 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80096], Delivering... [----] I, [2016-09-13T11:20:36.106706 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035974979400634766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036156177520751953, :pending_vm_jobs=>0.0008554458618164062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007425069808959961} [----] I, [2016-09-13T11:20:36.107172 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80096], State: [ok], Delivered in [0.008272922] seconds [----] I, [2016-09-13T11:20:36.239308 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:36.388607 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:36.540008 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:36.689793 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:36.838465 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:42.318478 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005723714828491211, :worker_monitor=>1.4351062774658203, :worker_dequeue=>0.01164555549621582, :total_time=>1.4529192447662354} [----] I, [2016-09-13T11:20:42.993561 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:43.134087 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:43.275856 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:43.407539 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:43.541529 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:43.683803 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:43.822357 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:43.959609 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:44.106620 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:44.277285 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:44.426087 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:44.565986 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:45.197664 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:45.352179 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:45.501958 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:45.640343 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:45.775945 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:45.929760 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:46.078866 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:46.213631 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:46.354103 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:46.504976 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:46.639741 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:46.777818 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:46.912616 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:47.045406 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:47.188400 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:47.319066 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:20:47 UTC]... [----] I, [2016-09-13T11:20:47.321842 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:47.338206 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:20:47 UTC]...Complete [----] I, [2016-09-13T11:20:47.461953 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:47.519557 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:20:47.538733 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80097], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:20:47.555511 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80098], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:20:47.889092 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:48.045688 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:48.193620 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:48.340571 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:48.483407 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:48.630656 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:48.770657 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:48.912516 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:49.045852 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:49.181758 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:49.315687 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:49.451652 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:49.596096 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:49.737838 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:49.890973 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:50.034187 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:20:50.169909 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T11:20:50.376800 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T11:20:50.377197 #17546:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T11:20:50.377539 #17546:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T11:20:50.377656 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T11:20:50.377764 #17546:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T11:20:50.401353 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T11:20:50.401743 #17546:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [80083], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T11:20:50.401979 #17546:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T11:20:50.402251 #17546:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T11:20:50.402462 #17546:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80083], State: [error], Delivered in [76.34544175] seconds [----] I, [2016-09-13T11:20:52.363568 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:20:52.641633 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80098], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.097055756] seconds [----] I, [2016-09-13T11:20:52.641816 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80098], Delivering... [----] I, [2016-09-13T11:20:52.647256 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029044151306152344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002920866012573242, :pending_vm_jobs=>0.0006866455078125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005107879638671875} [----] I, [2016-09-13T11:20:52.647567 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80098], State: [ok], Delivered in [0.005752821] seconds [----] I, [2016-09-13T11:20:54.179500 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80097], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.655201486] seconds [----] I, [2016-09-13T11:20:54.179723 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80097], Delivering... [----] I, [2016-09-13T11:20:54.185024 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80097], State: [ok], Delivered in [0.005296832] seconds [----] I, [2016-09-13T11:20:57.379076 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T11:20:58.921556 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00335693359375, :log_active_servers=>0.00754857063293457, :worker_monitor=>1.5332520008087158, :worker_dequeue=>0.008849382400512695, :total_time=>1.553318738937378} [----] I, [2016-09-13T11:21:02.567674 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:21:02.580007 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80099], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:21:03.931916 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:21:04.790492 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80099], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.216967772] seconds [----] I, [2016-09-13T11:21:04.790709 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80099], Delivering... [----] I, [2016-09-13T11:21:04.797235 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003515481948852539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035376548767089844, :pending_vm_jobs=>0.0007789134979248047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006147146224975586} [----] I, [2016-09-13T11:21:04.797686 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80099], State: [ok], Delivered in [0.006957864] seconds [----] I, [2016-09-13T11:21:15.265926 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003996849060058594, :worker_monitor=>1.2986130714416504, :worker_dequeue=>0.0177459716796875, :total_time=>1.3207054138183594} [----] I, [2016-09-13T11:21:17.591927 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:21:17.613451 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80100], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:21:17.636285 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80101], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:21:17.665208 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80102], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:21:17.687777 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80103], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:21:20.266703 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:21:20 UTC]... [----] I, [2016-09-13T11:21:20.298917 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:21:20 UTC]...Complete [----] I, [2016-09-13T11:21:20.309039 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:21:20.927619 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80100], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.3280499] seconds [----] I, [2016-09-13T11:21:20.927770 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80100], Delivering... [----] I, [2016-09-13T11:21:20.933409 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80103], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.258404432] seconds [----] I, [2016-09-13T11:21:20.933617 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80103], Delivering... [----] I, [2016-09-13T11:21:20.938474 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002883434295654297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002901792526245117, :pending_vm_jobs=>0.0005152225494384766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004536867141723633} [----] I, [2016-09-13T11:21:20.938797 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80103], State: [ok], Delivered in [0.005179899] seconds [----] I, [2016-09-13T11:21:20.973485 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80100], State: [ok], Delivered in [0.045659622] seconds [----] I, [2016-09-13T11:21:21.294040 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80101], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.675235723] seconds [----] I, [2016-09-13T11:21:21.294383 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80101], Delivering... [----] I, [2016-09-13T11:21:21.299521 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80101], State: [ok], Delivered in [0.005090457] seconds [----] I, [2016-09-13T11:21:21.316756 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80102], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.666499114] seconds [----] I, [2016-09-13T11:21:21.316936 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80102], Delivering... [----] I, [2016-09-13T11:21:21.321867 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80102], State: [ok], Delivered in [0.004894788] seconds [----] I, [2016-09-13T11:21:32.002337 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005076169967651367, :worker_monitor=>1.6540887355804443, :worker_dequeue=>0.013361692428588867, :total_time=>1.6729049682617188} [----] I, [2016-09-13T11:21:32.705447 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:21:32.739353 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80104], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:21:37.213966 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:21:38.139388 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80104], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.427377084] seconds [----] I, [2016-09-13T11:21:38.139601 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80104], Delivering... [----] I, [2016-09-13T11:21:38.145840 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033745765686035156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003392457962036133, :pending_vm_jobs=>0.0007381439208984375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005885601043701172} [----] I, [2016-09-13T11:21:38.146241 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80104], State: [ok], Delivered in [0.006636398] seconds [----] I, [2016-09-13T11:21:47.753582 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:21:47.767715 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80105], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:21:47.786113 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80106], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:21:48.598496 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:21:48.602735 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035982131958007812, :worker_monitor=>1.3535449504852295, :worker_dequeue=>0.009037971496582031, :total_time=>1.366431713104248} [----] I, [2016-09-13T11:21:49.220587 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80106], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.448542545] seconds [----] I, [2016-09-13T11:21:49.220739 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80106], Delivering... [----] I, [2016-09-13T11:21:49.225540 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002640247344970703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002656698226928711, :pending_vm_jobs=>0.0005271434783935547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00453948974609375} [----] I, [2016-09-13T11:21:49.225807 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80106], State: [ok], Delivered in [0.00506439] seconds [----] I, [2016-09-13T11:21:51.443751 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80105], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.686564624] seconds [----] I, [2016-09-13T11:21:51.443960 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80105], Delivering... [----] I, [2016-09-13T11:21:51.449166 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80105], State: [ok], Delivered in [0.005159489] seconds [----] I, [2016-09-13T11:21:53.603389 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:21:53 UTC]... [----] I, [2016-09-13T11:21:53.639228 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:21:53 UTC]...Complete [----] I, [2016-09-13T11:22:02.800054 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:22:02.830914 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80107], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:22:04.648001 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:22:05.386379 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80107], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.576909891] seconds [----] I, [2016-09-13T11:22:05.386651 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80107], Delivering... [----] I, [2016-09-13T11:22:05.393324 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003673553466796875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036928653717041016, :pending_vm_jobs=>0.0007636547088623047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062906742095947266} [----] I, [2016-09-13T11:22:05.393805 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80107], State: [ok], Delivered in [0.007164019] seconds [----] I, [2016-09-13T11:22:17.842208 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:22:17.860607 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80108], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:22:17.877519 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80109], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:22:17.894761 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80110], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:22:17.911688 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80111], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:22:20.972325 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:22:20.977724 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004799604415893555, :worker_monitor=>1.2819361686706543, :worker_dequeue=>0.01093435287475586, :total_time=>1.2979705333709717} [----] I, [2016-09-13T11:22:21.483253 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80108], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.637074691] seconds [----] I, [2016-09-13T11:22:21.483476 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80108], Delivering... [----] I, [2016-09-13T11:22:21.535263 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80108], State: [ok], Delivered in [0.051794361] seconds [----] I, [2016-09-13T11:22:21.557917 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80111], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.656713432] seconds [----] I, [2016-09-13T11:22:21.558182 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80111], Delivering... [----] I, [2016-09-13T11:22:21.566998 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005083799362182617, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005120277404785156, :pending_vm_jobs=>0.00118255615234375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008269786834716797} [----] I, [2016-09-13T11:22:21.567390 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80111], State: [ok], Delivered in [0.009243585] seconds [----] I, [2016-09-13T11:22:21.597609 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80109], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.732276094] seconds [----] I, [2016-09-13T11:22:21.597770 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80109], Delivering... [----] I, [2016-09-13T11:22:21.600529 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80109], State: [ok], Delivered in [0.002745664] seconds [----] I, [2016-09-13T11:22:21.643439 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80110], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.759022678] seconds [----] I, [2016-09-13T11:22:21.643632 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80110], Delivering... [----] I, [2016-09-13T11:22:21.647839 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80110], State: [ok], Delivered in [0.004210849] seconds [----] I, [2016-09-13T11:22:25.978692 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:22:25 UTC]... [----] I, [2016-09-13T11:22:26.003483 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:22:25 UTC]...Complete [----] I, [2016-09-13T11:22:32.924470 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:22:32.940401 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80112], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:22:37.340397 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:22:37.343044 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0032889842987060547, :worker_monitor=>1.2919399738311768, :worker_dequeue=>0.00578761100769043, :total_time=>1.3012545108795166} [----] I, [2016-09-13T11:22:38.015096 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80112], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.085205898] seconds [----] I, [2016-09-13T11:22:38.015299 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80112], Delivering... [----] I, [2016-09-13T11:22:38.021934 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003189563751220703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003209352493286133, :pending_vm_jobs=>0.0007536411285400391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062410831451416016} [----] I, [2016-09-13T11:22:38.022316 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80112], State: [ok], Delivered in [0.007006861] seconds [----] I, [2016-09-13T11:22:47.949451 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:22:47.957709 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80113], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:22:47.986261 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80114], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:22:54.056506 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:22:54.064618 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004053354263305664, :worker_monitor=>1.5508129596710205, :worker_dequeue=>0.015157938003540039, :total_time=>1.5703845024108887} [----] I, [2016-09-13T11:22:54.187101 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80114], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.225699455] seconds [----] I, [2016-09-13T11:22:54.187364 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80114], Delivering... [----] I, [2016-09-13T11:22:54.194770 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003752470016479492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038743019104003906, :pending_vm_jobs=>0.0009438991546630859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006930828094482422} [----] I, [2016-09-13T11:22:54.195245 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80114], State: [ok], Delivered in [0.00787315] seconds [----] I, [2016-09-13T11:22:54.963786 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80113], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.011286911] seconds [----] I, [2016-09-13T11:22:54.963969 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80113], Delivering... [----] I, [2016-09-13T11:22:54.967999 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80113], State: [ok], Delivered in [0.004024576] seconds [----] I, [2016-09-13T11:22:59.065268 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:22:59 UTC]... [----] I, [2016-09-13T11:22:59.100731 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:22:59 UTC]...Complete [----] I, [2016-09-13T11:23:02.994785 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:23:03.026668 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80115], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:23:03.049192 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80116], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:23:04.121157 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:23:04.289366 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80115], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.289421906] seconds [----] I, [2016-09-13T11:23:04.289564 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80115], Delivering... [----] I, [2016-09-13T11:23:04.295493 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031828880310058594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032041072845458984, :pending_vm_jobs=>0.0007534027099609375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005558490753173828} [----] I, [2016-09-13T11:23:04.295804 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80115], State: [ok], Delivered in [0.006231278] seconds [----] I, [2016-09-13T11:23:07.037960 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80116], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.006314265] seconds [----] I, [2016-09-13T11:23:07.038145 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80116], Delivering... [----] I, [2016-09-13T11:23:07.038444 #2928:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Starting [----] I, [2016-09-13T11:23:07.048155 #2928:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Complete [----] I, [2016-09-13T11:23:07.048571 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80116], State: [ok], Delivered in [0.01042738] seconds [----] I, [2016-09-13T11:23:10.576037 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005297422409057617, :worker_monitor=>1.432119607925415, :worker_dequeue=>0.012973308563232422, :total_time=>1.450836181640625} [----] I, [2016-09-13T11:23:18.058601 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:23:18.071912 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80117], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:23:18.089520 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80118], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:23:18.118046 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80119], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:23:18.146675 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80120], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:23:20.600107 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:23:21.427077 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80117], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.363666181] seconds [----] I, [2016-09-13T11:23:21.427389 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80117], Delivering... [----] I, [2016-09-13T11:23:21.432270 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80120], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.308360978] seconds [----] I, [2016-09-13T11:23:21.432500 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80120], Delivering... [----] I, [2016-09-13T11:23:21.439733 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035581588745117188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003599405288696289, :pending_vm_jobs=>0.0009074211120605469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006776571273803711} [----] I, [2016-09-13T11:23:21.440082 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80120], State: [ok], Delivered in [0.007611384] seconds [----] I, [2016-09-13T11:23:21.512460 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80117], State: [ok], Delivered in [0.085014166] seconds [----] I, [2016-09-13T11:23:22.101329 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80118], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.023439067] seconds [----] I, [2016-09-13T11:23:22.101600 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80118], Delivering... [----] I, [2016-09-13T11:23:22.105559 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80118], State: [ok], Delivered in [0.003956849] seconds [----] I, [2016-09-13T11:23:22.147704 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80119], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.049907403] seconds [----] I, [2016-09-13T11:23:22.147977 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80119], Delivering... [----] I, [2016-09-13T11:23:22.155706 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80119], State: [ok], Delivered in [0.00773544] seconds [----] I, [2016-09-13T11:23:26.792071 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041351318359375, :worker_monitor=>1.173097848892212, :worker_dequeue=>0.009607315063476562, :total_time=>1.1871633529663086} [----] I, [2016-09-13T11:23:31.792601 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:23:31 UTC]... [----] I, [2016-09-13T11:23:31.818306 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:23:31 UTC]...Complete [----] I, [2016-09-13T11:23:33.161511 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:23:33.212871 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80121], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:23:33.225728 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80122], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:23:33.237071 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80123], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:23:36.883732 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:23:37.180692 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80121], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.010634333] seconds [----] I, [2016-09-13T11:23:37.180965 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80121], Delivering... [----] I, [2016-09-13T11:23:37.189649 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004866123199462891, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0049610137939453125, :pending_vm_jobs=>0.0009899139404296875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008139848709106445} [----] I, [2016-09-13T11:23:37.190047 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80121], State: [ok], Delivered in [0.009097514] seconds [----] I, [2016-09-13T11:23:37.220594 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80122], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.003320441] seconds [----] I, [2016-09-13T11:23:37.220865 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80122], Delivering... [----] I, [2016-09-13T11:23:37.222928 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T11:23:37.223282 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4584595456 [----] I, [2016-09-13T11:23:37.223490 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4348538880 [----] I, [2016-09-13T11:23:37.223662 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 236056576 [----] I, [2016-09-13T11:23:37.223823 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 918552576 [----] I, [2016-09-13T11:23:37.223970 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4291809280 [----] I, [2016-09-13T11:23:37.224148 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T11:23:37.224314 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T11:23:37.224510 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 558702592 [----] I, [2016-09-13T11:23:37.224682 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T11:23:37.224842 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6820843520 [----] I, [2016-09-13T11:23:37.224993 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T11:23:37.225168 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T11:23:37.225328 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T11:23:37.225530 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T11:23:37.225691 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T11:23:37.225837 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T11:23:37.225993 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T11:23:37.226170 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T11:23:37.226344 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T11:23:37.226545 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T11:23:37.226709 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272130048 [----] I, [2016-09-13T11:23:37.226872 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55029760 [----] I, [2016-09-13T11:23:37.227041 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217100288 [----] I, [2016-09-13T11:23:37.227222 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T11:23:37.227380 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142807040 [----] I, [2016-09-13T11:23:37.227571 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3397197824 [----] I, [2016-09-13T11:23:37.227729 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3078541312 [----] I, [2016-09-13T11:23:37.227877 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T11:23:37.228017 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T11:23:37.228187 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T11:23:37.228348 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37478400 [----] I, [2016-09-13T11:23:37.228542 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76959744 [----] I, [2016-09-13T11:23:37.228698 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49831936 [----] I, [2016-09-13T11:23:37.228848 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111767552 [----] I, [2016-09-13T11:23:37.228995 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126791680 [----] I, [2016-09-13T11:23:37.229156 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T11:23:37.229312 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T11:23:37.229510 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T11:23:37.229688 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T11:23:37.229841 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T11:23:37.229991 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T11:23:37.230161 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T11:23:37.230341 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T11:23:37.230556 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T11:23:37.287476 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T11:23:37.287709 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T11:23:37.292232 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T11:23:37.295498 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T11:23:37.299459 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T11:23:37.303231 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T11:23:37.306933 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T11:23:37.310490 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 856 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T11:23:37.314165 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T11:23:37.317749 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T11:23:37.321605 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T11:23:37.325457 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T11:23:37.329014 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T11:23:37.332617 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T11:23:37.335791 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:23:37.335969 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:23:37.336089 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T11:23:37.340951 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [154102.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:23:37.341365 #2937:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80122], State: [ok], Delivered in [0.120510945] seconds [----] I, [2016-09-13T11:23:42.821305 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:23:43.260335 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80123], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [10.030819255] seconds [----] I, [2016-09-13T11:23:43.260483 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80123], Delivering... [----] I, [2016-09-13T11:23:43.267056 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:23:41 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [52716.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:23:43.267646 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:23:33 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [245592.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T11:23:43.268052 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:23:40 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359292000], Memory % [5.28], CPU Time [207852.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T11:23:43.268358 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:23:32 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213439000], Memory % [3.51], CPU Time [50057.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T11:23:43.268659 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:23:37 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347857000], Memory % [5.04], CPU Time [106266.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T11:23:43.268984 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:23:41 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163160000], Memory % [3.1], CPU Time [38805.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T11:23:43.269319 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:23:42 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [154113.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:23:43.269635 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:23:42 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [154970.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:23:43.271606 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:23:42 UTC], Process Info: Memory Usage [602038272], Memory Size [959979520], Proportional Set Size: [440728000], Memory % [7.34], CPU Time [740.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T11:23:43.271944 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:23:40 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358591000], Memory % [5.27], CPU Time [215207.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T11:23:43.272282 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:23:41 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178488000], Memory % [3.2], CPU Time [52676.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:23:43.272586 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:23:39 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166761000], Memory % [3.16], CPU Time [39723.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T11:23:43.274061 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:23:40 UTC], Process Info: Memory Usage [612929536], Memory Size [1070673920], Proportional Set Size: [451831000], Memory % [7.47], CPU Time [2018.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T11:23:43.274309 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80123], State: [ok], Delivered in [0.013823138] seconds [----] I, [2016-09-13T11:23:48.248825 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:23:48.266222 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80124], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:23:48.283187 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80125], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:23:52.941557 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:23:53.695065 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80125], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.423245364] seconds [----] I, [2016-09-13T11:23:53.695282 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80125], Delivering... [----] I, [2016-09-13T11:23:53.702228 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003444194793701172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034875869750976562, :pending_vm_jobs=>0.0009477138519287109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006494283676147461} [----] I, [2016-09-13T11:23:53.702642 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80125], State: [ok], Delivered in [0.007333884] seconds [----] I, [2016-09-13T11:23:55.352010 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80124], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.098360659] seconds [----] I, [2016-09-13T11:23:55.352192 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80124], Delivering... [----] I, [2016-09-13T11:23:55.356162 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80124], State: [ok], Delivered in [0.003962395] seconds [----] I, [2016-09-13T11:23:59.194559 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005829811096191406, :worker_monitor=>1.2359004020690918, :worker_dequeue=>0.006237506866455078, :total_time=>1.2484066486358643} [----] I, [2016-09-13T11:24:03.294693 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:24:03.313027 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80126], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:24:04.195067 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:24:04 UTC]... [----] I, [2016-09-13T11:24:04.216216 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:24:04 UTC]...Complete [----] I, [2016-09-13T11:24:04.227666 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:24:04.404219 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80126], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.103322375] seconds [----] I, [2016-09-13T11:24:04.404555 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80126], Delivering... [----] I, [2016-09-13T11:24:04.416061 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.006082057952880859, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0062177181243896484, :pending_vm_jobs=>0.0014164447784423828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010879755020141602} [----] I, [2016-09-13T11:24:04.416654 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80126], State: [ok], Delivered in [0.012086549] seconds [----] I, [2016-09-13T11:24:15.419320 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005372524261474609, :worker_monitor=>1.158658504486084, :worker_dequeue=>0.007986783981323242, :total_time=>1.1725537776947021} [----] I, [2016-09-13T11:24:18.326878 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:24:18.363344 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80127], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:24:18.403271 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80128], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:24:18.437550 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80129], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:24:18.450612 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80130], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:24:20.429448 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:24:20.897834 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80127], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.565698911] seconds [----] I, [2016-09-13T11:24:20.898040 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80127], Delivering... [----] I, [2016-09-13T11:24:20.914018 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80130], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.471548926] seconds [----] I, [2016-09-13T11:24:20.914242 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80130], Delivering... [----] I, [2016-09-13T11:24:20.921300 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036211013793945312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036475658416748047, :pending_vm_jobs=>0.0008637905120849609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006580829620361328} [----] I, [2016-09-13T11:24:20.921666 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80130], State: [ok], Delivered in [0.007414339] seconds [----] I, [2016-09-13T11:24:20.965277 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80127], State: [ok], Delivered in [0.067213939] seconds [----] I, [2016-09-13T11:24:22.486032 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80128], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.118070814] seconds [----] I, [2016-09-13T11:24:22.486226 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80128], Delivering... [----] I, [2016-09-13T11:24:22.489497 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80128], State: [ok], Delivered in [0.003211676] seconds [----] I, [2016-09-13T11:24:22.493363 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80129], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.083457067] seconds [----] I, [2016-09-13T11:24:22.493600 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80129], Delivering... [----] I, [2016-09-13T11:24:22.501612 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80129], State: [ok], Delivered in [0.008004899] seconds [----] I, [2016-09-13T11:24:31.644460 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005490779876708984, :worker_monitor=>1.1797552108764648, :worker_dequeue=>0.011245965957641602, :total_time=>1.1969692707061768} [----] I, [2016-09-13T11:24:33.461148 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:24:33.485899 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80131], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:24:36.645054 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:24:36 UTC]... [----] I, [2016-09-13T11:24:36.693787 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:24:36 UTC]...Complete [----] I, [2016-09-13T11:24:36.706812 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:24:37.045455 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80131], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.578158656] seconds [----] I, [2016-09-13T11:24:37.045643 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80131], Delivering... [----] I, [2016-09-13T11:24:37.052300 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003345966339111328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003371000289916992, :pending_vm_jobs=>0.0008494853973388672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0062770843505859375} [----] I, [2016-09-13T11:24:37.052691 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80131], State: [ok], Delivered in [0.007042232] seconds [----] I, [2016-09-13T11:24:47.851353 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005482912063598633, :worker_monitor=>1.1064419746398926, :worker_dequeue=>0.010148048400878906, :total_time=>1.1225624084472656} [----] I, [2016-09-13T11:24:48.499708 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:24:48.520868 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80132], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:24:48.536687 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80133], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:24:52.977639 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:24:53.234622 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80133], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.707935537] seconds [----] I, [2016-09-13T11:24:53.234877 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80133], Delivering... [----] I, [2016-09-13T11:24:53.243071 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004441976547241211, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004467487335205078, :pending_vm_jobs=>0.000965118408203125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007668733596801758} [----] I, [2016-09-13T11:24:53.243515 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80133], State: [ok], Delivered in [0.008638489] seconds [----] I, [2016-09-13T11:24:55.634526 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80132], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.130077889] seconds [----] I, [2016-09-13T11:24:55.634796 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80132], Delivering... [----] I, [2016-09-13T11:24:55.640990 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80132], State: [ok], Delivered in [0.006193757] seconds [----] I, [2016-09-13T11:25:03.548238 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:25:03.565502 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80134], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:25:04.373231 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:25:04.375976 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004442691802978516, :worker_monitor=>1.352348804473877, :worker_dequeue=>0.008185863494873047, :total_time=>1.3653833866119385} [----] I, [2016-09-13T11:25:04.388432 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80134], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.834206095] seconds [----] I, [2016-09-13T11:25:04.388589 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80134], Delivering... [----] I, [2016-09-13T11:25:04.392822 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022215843200683594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002238035202026367, :pending_vm_jobs=>0.0005345344543457031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003981828689575195} [----] I, [2016-09-13T11:25:04.393047 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80134], State: [ok], Delivered in [0.004457374] seconds [----] I, [2016-09-13T11:25:09.376631 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:25:09 UTC]... [----] I, [2016-09-13T11:25:09.400367 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:25:09 UTC]...Complete [----] I, [2016-09-13T11:25:18.577506 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:25:18.594598 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80135], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:25:18.618897 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80136], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:25:18.642069 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80137], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:25:18.664845 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80138], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:25:21.383722 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:25:21.398704 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004956722259521484, :worker_monitor=>1.9343247413635254, :worker_dequeue=>0.02429962158203125, :total_time=>1.9639816284179688} [----] I, [2016-09-13T11:25:21.436618 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80135], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.85422826] seconds [----] I, [2016-09-13T11:25:21.436828 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80135], Delivering... [----] I, [2016-09-13T11:25:21.505093 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80135], State: [ok], Delivered in [0.068206184] seconds [----] I, [2016-09-13T11:25:21.550734 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80138], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.902423552] seconds [----] I, [2016-09-13T11:25:21.550944 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80138], Delivering... [----] I, [2016-09-13T11:25:21.559875 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004449605941772461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00447845458984375, :pending_vm_jobs=>0.0009188652038574219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008269071578979492} [----] I, [2016-09-13T11:25:21.560287 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80138], State: [ok], Delivered in [0.009338495] seconds [----] I, [2016-09-13T11:25:22.796777 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80136], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.196399961] seconds [----] I, [2016-09-13T11:25:22.796996 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80136], Delivering... [----] I, [2016-09-13T11:25:22.803516 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80136], State: [ok], Delivered in [0.006503779] seconds [----] I, [2016-09-13T11:25:22.849843 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80137], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.22267313] seconds [----] I, [2016-09-13T11:25:22.850053 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80137], Delivering... [----] I, [2016-09-13T11:25:22.855548 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80137], State: [ok], Delivered in [0.005491725] seconds [----] I, [2016-09-13T11:25:33.677526 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:25:33.700128 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80139], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:25:37.637882 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:25:37.641955 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004296779632568359, :worker_monitor=>1.203739881515503, :worker_dequeue=>0.00858306884765625, :total_time=>1.2169439792633057} [----] I, [2016-09-13T11:25:37.721858 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80139], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.038196604] seconds [----] I, [2016-09-13T11:25:37.722026 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80139], Delivering... [----] I, [2016-09-13T11:25:37.728863 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003463268280029297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003487825393676758, :pending_vm_jobs=>0.0009272098541259766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006440401077270508} [----] I, [2016-09-13T11:25:37.729274 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80139], State: [ok], Delivered in [0.007228691] seconds [----] I, [2016-09-13T11:25:42.644138 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:25:42 UTC]... [----] I, [2016-09-13T11:25:42.658657 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:25:42 UTC]...Complete [----] I, [2016-09-13T11:25:48.710699 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:25:48.727526 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80140], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:25:48.738799 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80141], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:25:54.043630 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:25:54.047715 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004474163055419922, :worker_monitor=>1.336991310119629, :worker_dequeue=>0.008725166320800781, :total_time=>1.3505194187164307} [----] I, [2016-09-13T11:25:54.773791 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80141], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.042194595] seconds [----] I, [2016-09-13T11:25:54.774011 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80141], Delivering... [----] I, [2016-09-13T11:25:54.780883 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034422874450683594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035028457641601562, :pending_vm_jobs=>0.0008947849273681641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006436586380004883} [----] I, [2016-09-13T11:25:54.781246 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80141], State: [ok], Delivered in [0.007245794] seconds [----] I, [2016-09-13T11:25:56.106050 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80140], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.390803133] seconds [----] I, [2016-09-13T11:25:56.106213 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80140], Delivering... [----] I, [2016-09-13T11:25:56.109752 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80140], State: [ok], Delivered in [0.003539564] seconds [----] I, [2016-09-13T11:25:59.168606 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T11:26:03.749513 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:26:03.767590 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80142], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:26:04.187469 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:26:04.876684 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80142], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.120535615] seconds [----] I, [2016-09-13T11:26:04.876897 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80142], Delivering... [----] I, [2016-09-13T11:26:04.883809 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003522157669067383, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036079883575439453, :pending_vm_jobs=>0.0008635520935058594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006514549255371094} [----] I, [2016-09-13T11:26:04.884213 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80142], State: [ok], Delivered in [0.007332888] seconds [----] I, [2016-09-13T11:26:10.288166 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:26:10.288387 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:26:10.304967 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [103], PID: [17555], GUID: [1dd6952c-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:26:10.305093 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [103], PID: [17555], GUID: [1dd6952c-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:26:10.316180 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:26:10.316291 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:26:10.327586 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:26:10.327725 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:26:10.339514 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:26:10.339706 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:26:10.356514 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:26:10.356708 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:26:10.373668 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:26:10.373884 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:26:10.390814 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:26:10.391018 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:26:10.408141 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:26:10.408351 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:26:10.425288 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:26:10.425519 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:26:10.442225 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:26:10.442411 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:26:10.459810 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:26:10.460048 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:26:10.476808 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:26:10.477090 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:26:10.495305 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00460052490234375, :worker_monitor=>1.2834174633026123, :worker_dequeue=>0.014281988143920898, :total_time=>1.3026673793792725} [----] I, [2016-09-13T11:26:10.906571 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T11:26:10.906750 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T11:26:10.906871 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T11:26:10.949865 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:26:10.950018 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:26:10.950125 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:26:11.111015 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:26:11.112517 #17546:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T11:26:11.112651 #17546:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:26:11.112747 #17546:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:26:11.112838 #17546:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:26:11.112916 #17546:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T11:26:11.112996 #17546:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T11:26:11.113087 #17546:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:26:11.113195 #17546:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T11:26:11.113281 #17546:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:26:11.113362 #17546:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:26:11.113479 #17546:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T11:26:11.113575 #17546:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:26:11.113658 #17546:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T11:26:11.113741 #17546:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T11:26:11.113821 #17546:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T11:26:11.113898 #17546:34713c] INFO -- : --- [----] I, [2016-09-13T11:26:11.114749 #17546:34713c] INFO -- : :guid: 1d7be00a-79b6-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:26:11.114874 #17546:34713c] INFO -- : :ems_id: 17 [----] I, [2016-09-13T11:26:11.115170 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T11:26:11.119827 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:26:11.120779 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T11:26:11.120864 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:26:11.120915 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:26:11.120952 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:26:11.120989 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T11:26:11.121026 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T11:26:11.121064 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:26:11.121097 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T11:26:11.121156 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:26:11.121195 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:26:11.121232 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:26:11.121265 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:26:11.121299 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T11:26:11.121332 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T11:26:11.121365 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T11:26:11.121398 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T11:26:11.121735 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:26:11.121927 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:26:12.497685 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T11:26:12.497942 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T11:26:12.498124 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T11:26:12.658458 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:26:12.659983 #17555:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T11:26:12.660123 #17555:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:26:12.660211 #17555:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:26:12.660285 #17555:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:26:12.660354 #17555:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T11:26:12.660453 #17555:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T11:26:12.660564 #17555:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:26:12.660645 #17555:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T11:26:12.660720 #17555:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:26:12.660785 #17555:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:26:12.660851 #17555:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:26:12.660917 #17555:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:26:12.660983 #17555:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T11:26:12.661046 #17555:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T11:26:12.661128 #17555:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T11:26:12.661205 #17555:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T11:26:12.661269 #17555:34713c] INFO -- : --- [----] I, [2016-09-13T11:26:12.661901 #17555:34713c] INFO -- : :guid: 1dd6952c-79b6-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:26:12.662012 #17555:34713c] INFO -- : :ems_id: 17 [----] I, [2016-09-13T11:26:12.662712 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T11:26:13.992343 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:26:13.992499 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:26:13.992569 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:26:14.136208 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:26:14.136901 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T11:26:14.136978 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:26:14.137020 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:26:14.137054 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:26:14.137088 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T11:26:14.137142 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T11:26:14.137180 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:26:14.137213 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T11:26:14.137245 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:26:14.137275 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:26:14.137305 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:26:14.137335 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:26:14.137365 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T11:26:14.137395 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T11:26:14.137687 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:26:14.137939 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:26:14.648459 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:26:14.648648 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:26:14.648746 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:26:14.788456 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:26:14.789206 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T11:26:14.789278 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:26:14.789317 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:26:14.789351 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:26:14.789385 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T11:26:14.789443 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T11:26:14.789500 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:26:14.789537 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T11:26:14.789571 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:26:14.789603 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:26:14.789635 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:26:14.789665 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:26:14.789696 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T11:26:14.789727 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T11:26:14.789758 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T11:26:14.789787 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T11:26:14.790055 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:26:14.790216 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:26:14.963654 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:26:14.963763 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:26:14.963814 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:26:15.049689 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:26:15.050134 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T11:26:15.050176 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:26:15.050200 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:26:15.050222 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:26:15.050243 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T11:26:15.050262 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T11:26:15.050292 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:26:15.050314 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T11:26:15.050334 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:26:15.050352 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:26:15.050370 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:26:15.050388 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:26:15.050407 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T11:26:15.050454 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T11:26:15.050479 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T11:26:15.050496 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T11:26:15.050657 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:26:15.050745 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:26:15.495941 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:26:15 UTC]... [----] I, [2016-09-13T11:26:15.517713 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:26:15 UTC]...Complete [----] I, [2016-09-13T11:26:15.641750 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:26:15.641924 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:26:15.642023 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:26:15.845369 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:26:15.846999 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T11:26:15.847154 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:26:15.847254 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:26:15.847342 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:26:15.847463 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T11:26:15.847568 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T11:26:15.847659 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:26:15.847741 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T11:26:15.847821 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:26:15.847903 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:26:15.847984 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:26:15.848065 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:26:15.848170 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T11:26:15.848252 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T11:26:15.848326 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T11:26:15.848396 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T11:26:15.849001 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:26:15.849261 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:26:16.288763 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:26:16.288901 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:26:16.288972 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:26:16.431925 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:26:16.432667 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T11:26:16.432746 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:26:16.432789 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:26:16.432825 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:26:16.432860 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T11:26:16.432894 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T11:26:16.432929 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:26:16.432962 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T11:26:16.432995 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:26:16.433026 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:26:16.433057 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:26:16.433089 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:26:16.433142 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T11:26:16.433180 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T11:26:16.433465 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:26:16.433716 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:26:17.133904 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:26:17.134075 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:26:17.134187 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:26:17.312011 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:26:17.312838 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T11:26:17.312915 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:26:17.312961 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:26:17.313001 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:26:17.313038 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T11:26:17.313088 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T11:26:17.313145 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:26:17.313181 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T11:26:17.313215 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:26:17.313252 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:26:17.313285 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:26:17.313315 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:26:17.313347 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T11:26:17.313377 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T11:26:17.313409 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T11:26:17.313484 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T11:26:17.313780 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:26:17.313951 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:26:18.778029 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:26:18.778231 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:26:18.778324 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:26:18.909329 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:26:18.910704 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T11:26:18.910790 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:26:18.910834 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:26:18.910871 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:26:18.910905 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T11:26:18.910937 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T11:26:18.910969 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:26:18.911001 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T11:26:18.911034 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:26:18.911065 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:26:18.911096 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:26:18.911151 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:26:18.911187 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T11:26:18.911218 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T11:26:18.911249 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T11:26:18.911281 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T11:26:18.911314 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T11:26:18.911346 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T11:26:18.911379 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T11:26:18.911453 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T11:26:18.911506 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T11:26:18.911541 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T11:26:18.911573 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T11:26:18.911605 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T11:26:18.911637 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T11:26:18.911669 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T11:26:18.911702 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T11:26:18.911734 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T11:26:18.911767 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T11:26:18.911799 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T11:26:18.911831 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T11:26:18.911863 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T11:26:18.911894 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T11:26:18.911925 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T11:26:18.911958 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T11:26:18.911988 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T11:26:18.912020 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T11:26:18.912051 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T11:26:18.912080 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T11:26:18.912366 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:26:18.912548 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:26:18.912632 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:26:18.931195 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80143], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:26:18.942518 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80144], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:26:18.965268 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80145], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:26:18.976641 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80146], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:26:20.164316 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:26:20.164521 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:26:20.164626 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:26:20.339696 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:26:20.340580 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T11:26:20.340672 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:26:20.340717 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:26:20.340754 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:26:20.340789 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T11:26:20.340828 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T11:26:20.340863 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:26:20.340895 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T11:26:20.340928 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:26:20.340967 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:26:20.340999 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:26:20.341030 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:26:20.341064 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T11:26:20.341099 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T11:26:20.341159 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T11:26:20.341194 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T11:26:20.341539 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:26:20.341736 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:26:20.543819 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:26:21.102524 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80143], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.185082346] seconds [----] I, [2016-09-13T11:26:21.102703 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80143], Delivering... [----] I, [2016-09-13T11:26:21.178249 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80143], State: [ok], Delivered in [0.075519322] seconds [----] I, [2016-09-13T11:26:21.199356 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80146], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.228586765] seconds [----] I, [2016-09-13T11:26:21.199494 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80146], Delivering... [----] I, [2016-09-13T11:26:21.203225 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0019185543060302734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0019307136535644531, :pending_vm_jobs=>0.0004544258117675781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003489255905151367} [----] I, [2016-09-13T11:26:21.203461 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80146], State: [ok], Delivered in [0.00395777] seconds [----] I, [2016-09-13T11:26:21.311769 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:26:21.312005 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:26:21.312176 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:26:21.357991 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:26:21.358098 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:26:21.358165 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:26:21.454463 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:26:21.454922 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T11:26:21.454971 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:26:21.454999 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:26:21.455024 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:26:21.455047 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T11:26:21.455069 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T11:26:21.455093 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:26:21.455133 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T11:26:21.455161 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:26:21.455184 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:26:21.455205 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:26:21.455228 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:26:21.455250 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T11:26:21.455270 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T11:26:21.455468 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:26:21.455652 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:26:21.485730 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:26:21.486672 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T11:26:21.486760 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:26:21.486811 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:26:21.486855 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:26:21.486894 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T11:26:21.486931 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T11:26:21.486965 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:26:21.487000 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T11:26:21.487033 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:26:21.487072 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:26:21.487104 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:26:21.487173 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:26:21.487210 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T11:26:21.487247 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T11:26:21.487280 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T11:26:21.487310 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T11:26:21.487651 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:26:21.487819 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:26:23.348582 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80144], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.411823347] seconds [----] I, [2016-09-13T11:26:23.348802 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80144], Delivering... [----] I, [2016-09-13T11:26:23.352074 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80144], State: [ok], Delivered in [0.003263133] seconds [----] I, [2016-09-13T11:26:23.365389 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80145], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.415257347] seconds [----] I, [2016-09-13T11:26:23.365619 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80145], Delivering... [----] I, [2016-09-13T11:26:23.370375 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80145], State: [ok], Delivered in [0.00475355] seconds [----] I, [2016-09-13T11:26:26.812622 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005184173583984375, :worker_monitor=>1.252685785293579, :worker_dequeue=>0.005502462387084961, :total_time=>1.2637569904327393} [----] I, [2016-09-13T11:26:33.989398 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:26:34.006744 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80147], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:26:36.841467 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:26:37.326370 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80147], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.330762914] seconds [----] I, [2016-09-13T11:26:37.326539 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80147], Delivering... [----] I, [2016-09-13T11:26:37.330944 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024781227111816406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024929046630859375, :pending_vm_jobs=>0.0005204677581787109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004138469696044922} [----] I, [2016-09-13T11:26:37.331247 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80147], State: [ok], Delivered in [0.004703] seconds [----] I, [2016-09-13T11:26:42.962522 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004091739654541016, :worker_monitor=>1.102268934249878, :worker_dequeue=>0.009504318237304688, :total_time=>1.1162292957305908} [----] I, [2016-09-13T11:26:47.963190 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:26:47 UTC]... [----] I, [2016-09-13T11:26:47.982832 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:26:47 UTC]...Complete [----] I, [2016-09-13T11:26:49.020121 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:26:49.044808 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80148], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:26:49.061729 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80149], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:26:53.015382 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:26:53.445364 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80149], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.394487203] seconds [----] I, [2016-09-13T11:26:53.445706 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80149], Delivering... [----] I, [2016-09-13T11:26:53.456474 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0057070255279541016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005857944488525391, :pending_vm_jobs=>0.001302957534790039, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010116815567016602} [----] I, [2016-09-13T11:26:53.457087 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80149], State: [ok], Delivered in [0.011382634] seconds [----] I, [2016-09-13T11:26:53.514257 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80148], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.488637925] seconds [----] I, [2016-09-13T11:26:53.514607 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80148], Delivering... [----] I, [2016-09-13T11:26:53.522270 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80148], State: [ok], Delivered in [0.007654363] seconds [----] I, [2016-09-13T11:26:59.342141 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0048596858978271484, :worker_monitor=>1.3046789169311523, :worker_dequeue=>0.008989572525024414, :total_time=>1.3188824653625488} [----] I, [2016-09-13T11:27:04.071963 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:27:04.090398 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80150], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:27:04.459183 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:27:04.542048 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80150], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.466216777] seconds [----] I, [2016-09-13T11:27:04.542248 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80150], Delivering... [----] I, [2016-09-13T11:27:04.547578 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028371810913085938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028543472290039062, :pending_vm_jobs=>0.0006504058837890625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004961490631103516} [----] I, [2016-09-13T11:27:04.547893 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80150], State: [ok], Delivered in [0.005647204] seconds [----] I, [2016-09-13T11:27:15.644199 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002811908721923828, :worker_monitor=>1.1386523246765137, :worker_dequeue=>0.015826940536499023, :total_time=>1.15751314163208} [----] I, [2016-09-13T11:27:19.097802 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:27:19.125732 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80151], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:27:19.147713 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80152], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:27:19.176225 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80153], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:27:19.187526 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80154], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:27:20.644769 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:27:20 UTC]... [----] I, [2016-09-13T11:27:20.671116 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:27:20 UTC]...Complete [----] I, [2016-09-13T11:27:20.686766 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:27:21.708161 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80151], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.607121088] seconds [----] I, [2016-09-13T11:27:21.708356 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80151], Delivering... [----] I, [2016-09-13T11:27:21.713664 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80154], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.533601969] seconds [----] I, [2016-09-13T11:27:21.713878 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80154], Delivering... [----] I, [2016-09-13T11:27:21.721262 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003889799118041992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00393223762512207, :pending_vm_jobs=>0.00087738037109375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006918430328369141} [----] I, [2016-09-13T11:27:21.721781 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80154], State: [ok], Delivered in [0.007875272] seconds [----] I, [2016-09-13T11:27:21.770479 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80151], State: [ok], Delivered in [0.062089119] seconds [----] I, [2016-09-13T11:27:23.588046 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80152], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.45869052] seconds [----] I, [2016-09-13T11:27:23.588286 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80152], Delivering... [----] I, [2016-09-13T11:27:23.591744 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80152], State: [ok], Delivered in [0.003434781] seconds [----] I, [2016-09-13T11:27:23.616590 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80153], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.462329946] seconds [----] I, [2016-09-13T11:27:23.616849 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80153], Delivering... [----] I, [2016-09-13T11:27:23.622465 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80153], State: [ok], Delivered in [0.005610712] seconds [----] I, [2016-09-13T11:27:31.882141 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036115646362304688, :worker_monitor=>1.1693317890167236, :worker_dequeue=>0.006134986877441406, :total_time=>1.1793389320373535} [----] I, [2016-09-13T11:27:34.195995 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:27:34.210514 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80155], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:27:36.896100 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:27:37.839468 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80155], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.638028967] seconds [----] I, [2016-09-13T11:27:37.839624 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80155], Delivering... [----] I, [2016-09-13T11:27:37.844756 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002753734588623047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002770662307739258, :pending_vm_jobs=>0.000606536865234375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0048487186431884766} [----] I, [2016-09-13T11:27:37.845049 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80155], State: [ok], Delivered in [0.005419361] seconds [----] I, [2016-09-13T11:27:48.294039 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00479888916015625, :worker_monitor=>1.3651330471038818, :worker_dequeue=>0.011377573013305664, :total_time=>1.3815891742706299} [----] I, [2016-09-13T11:27:49.222093 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:27:49.239274 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80156], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:27:49.262339 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80157], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:27:53.294639 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:27:53 UTC]... [----] I, [2016-09-13T11:27:53.325194 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:27:53 UTC]...Complete [----] I, [2016-09-13T11:27:53.339040 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:27:53.710047 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80157], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.467134704] seconds [----] I, [2016-09-13T11:27:53.710271 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80157], Delivering... [----] I, [2016-09-13T11:27:53.715441 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027794837951660156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028123855590820312, :pending_vm_jobs=>0.0006108283996582031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004796504974365234} [----] I, [2016-09-13T11:27:53.715724 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80157], State: [ok], Delivered in [0.0054671] seconds [----] I, [2016-09-13T11:27:53.732517 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80156], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.507673137] seconds [----] I, [2016-09-13T11:27:53.732654 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80156], Delivering... [----] I, [2016-09-13T11:27:53.736390 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80156], State: [ok], Delivered in [0.003720705] seconds [----] I, [2016-09-13T11:28:04.317480 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:28:04.338726 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80158], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:28:04.911298 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:28:04.918355 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004590272903442383, :worker_monitor=>1.5444116592407227, :worker_dequeue=>0.016458988189697266, :total_time=>1.5659115314483643} [----] I, [2016-09-13T11:28:05.056536 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80158], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.735307069] seconds [----] I, [2016-09-13T11:28:05.056720 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80158], Delivering... [----] I, [2016-09-13T11:28:05.062642 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030329227447509766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003091096878051758, :pending_vm_jobs=>0.0007679462432861328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005576372146606445} [----] I, [2016-09-13T11:28:05.063194 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80158], State: [ok], Delivered in [0.006471164] seconds [----] I, [2016-09-13T11:28:19.349037 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:28:19.370732 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80159], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:28:19.381782 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80160], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:28:19.416331 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80161], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:28:19.434519 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80162], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:28:21.543979 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:28:21.548553 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035812854766845703, :worker_monitor=>1.4424657821655273, :worker_dequeue=>0.009977102279663086, :total_time=>1.456324577331543} [----] I, [2016-09-13T11:28:22.215512 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80159], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.861676235] seconds [----] I, [2016-09-13T11:28:22.215742 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80159], Delivering... [----] I, [2016-09-13T11:28:22.232800 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80162], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.812609306] seconds [----] I, [2016-09-13T11:28:22.233164 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80162], Delivering... [----] I, [2016-09-13T11:28:22.244472 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005934715270996094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005968570709228516, :pending_vm_jobs=>0.0014088153839111328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010448455810546875} [----] I, [2016-09-13T11:28:22.244983 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80162], State: [ok], Delivered in [0.011842155] seconds [----] I, [2016-09-13T11:28:22.283708 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80159], State: [ok], Delivered in [0.067930689] seconds [----] I, [2016-09-13T11:28:23.833164 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80161], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.443279207] seconds [----] I, [2016-09-13T11:28:23.833330 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80161], Delivering... [----] I, [2016-09-13T11:28:23.838917 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80161], State: [ok], Delivered in [0.005554153] seconds [----] I, [2016-09-13T11:28:23.849291 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80160], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.472898148] seconds [----] I, [2016-09-13T11:28:23.849495 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80160], Delivering... [----] I, [2016-09-13T11:28:23.852627 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80160], State: [ok], Delivered in [0.003124777] seconds [----] I, [2016-09-13T11:28:26.549066 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:28:26 UTC]... [----] I, [2016-09-13T11:28:26.568686 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:28:26 UTC]...Complete [----] I, [2016-09-13T11:28:34.446188 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:28:34.466396 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80163], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:28:34.483445 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80164], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:28:34.500525 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80165], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:28:38.057473 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:28:38.062038 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0034296512603759766, :worker_monitor=>1.4488403797149658, :worker_dequeue=>0.009630203247070312, :total_time=>1.4622256755828857} [----] I, [2016-09-13T11:28:38.369315 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80163], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.916527435] seconds [----] I, [2016-09-13T11:28:38.369472 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80163], Delivering... [----] I, [2016-09-13T11:28:38.373563 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022673606872558594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002280712127685547, :pending_vm_jobs=>0.00052642822265625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038454532623291016} [----] I, [2016-09-13T11:28:38.373828 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80163], State: [ok], Delivered in [0.004361613] seconds [----] I, [2016-09-13T11:28:38.409514 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80164], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.938378978] seconds [----] I, [2016-09-13T11:28:38.409653 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80164], Delivering... [----] I, [2016-09-13T11:28:38.410406 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T11:28:38.410573 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4586188800 [----] I, [2016-09-13T11:28:38.410637 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4349911040 [----] I, [2016-09-13T11:28:38.410689 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 236277760 [----] I, [2016-09-13T11:28:38.410738 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 918552576 [----] I, [2016-09-13T11:28:38.410806 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4293173248 [----] I, [2016-09-13T11:28:38.410879 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T11:28:38.410930 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T11:28:38.410976 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 558931968 [----] I, [2016-09-13T11:28:38.411024 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T11:28:38.411069 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6836199424 [----] I, [2016-09-13T11:28:38.411126 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T11:28:38.411179 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T11:28:38.411226 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T11:28:38.411274 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T11:28:38.411326 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T11:28:38.411371 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T11:28:38.411446 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T11:28:38.411508 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T11:28:38.411558 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T11:28:38.411613 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T11:28:38.411663 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272138240 [----] I, [2016-09-13T11:28:38.411709 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55029760 [----] I, [2016-09-13T11:28:38.411764 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217108480 [----] I, [2016-09-13T11:28:38.411814 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T11:28:38.411865 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142807040 [----] I, [2016-09-13T11:28:38.411913 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3396030464 [----] I, [2016-09-13T11:28:38.411958 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3077144576 [----] I, [2016-09-13T11:28:38.412025 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T11:28:38.412126 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T11:28:38.412197 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T11:28:38.412248 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37507072 [----] I, [2016-09-13T11:28:38.412296 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76959744 [----] I, [2016-09-13T11:28:38.412344 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49917952 [----] I, [2016-09-13T11:28:38.412409 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111767552 [----] I, [2016-09-13T11:28:38.412489 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126877696 [----] I, [2016-09-13T11:28:38.412541 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T11:28:38.412588 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T11:28:38.412641 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T11:28:38.412687 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T11:28:38.412732 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T11:28:38.412776 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T11:28:38.412822 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T11:28:38.412868 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T11:28:38.412913 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T11:28:38.436880 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T11:28:38.437024 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T11:28:38.439179 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T11:28:38.440717 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T11:28:38.442576 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T11:28:38.444394 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T11:28:38.445597 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80165], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.957467971] seconds [----] I, [2016-09-13T11:28:38.445760 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80165], Delivering... [----] I, [2016-09-13T11:28:38.446217 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T11:28:38.448004 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 856 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T11:28:38.449754 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T11:28:38.451494 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T11:28:38.453091 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:28:33 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213439000], Memory % [3.51], CPU Time [50109.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T11:28:38.453198 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T11:28:38.453740 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:28:37 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [52779.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:28:38.454292 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:28:35 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359292000], Memory % [5.28], CPU Time [207895.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T11:28:38.454866 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:28:34 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [245716.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T11:28:38.454936 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T11:28:38.455402 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:28:26 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347857000], Memory % [5.04], CPU Time [106345.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T11:28:38.456257 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:28:36 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163160000], Memory % [3.1], CPU Time [38857.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T11:28:38.456695 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3242 14127958 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T11:28:38.457087 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:28:37 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [154187.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:28:38.457808 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:28:37 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [155050.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:28:38.458390 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T11:28:38.460136 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>2}} [----] I, [2016-09-13T11:28:38.460225 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:28:38.460288 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T11:28:38.462287 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:28:31 UTC], Process Info: Memory Usage [613658624], Memory Size [1070673920], Proportional Set Size: [452547000], Memory % [7.48], CPU Time [2049.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T11:28:38.462913 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [155043.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:28:38.463168 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80164], State: [ok], Delivered in [0.053505329] seconds [----] I, [2016-09-13T11:28:38.464700 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:28:32 UTC], Process Info: Memory Usage [602468352], Memory Size [975269888], Proportional Set Size: [441308000], Memory % [7.34], CPU Time [767.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T11:28:38.465224 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:28:35 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358591000], Memory % [5.27], CPU Time [215260.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T11:28:38.465726 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:28:36 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178488000], Memory % [3.2], CPU Time [52731.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:28:38.466177 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:28:28 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166761000], Memory % [3.16], CPU Time [39779.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T11:28:38.466492 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80165], State: [ok], Delivered in [0.020723048] seconds [----] I, [2016-09-13T11:28:49.511662 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:28:49.535194 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80166], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:28:49.551827 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80167], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:28:54.065883 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:28:54.603641 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80167], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.062421776] seconds [----] I, [2016-09-13T11:28:54.603827 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80167], Delivering... [----] I, [2016-09-13T11:28:54.609244 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002834320068359375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028510093688964844, :pending_vm_jobs=>0.0006911754608154297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005087852478027344} [----] I, [2016-09-13T11:28:54.609548 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80167], State: [ok], Delivered in [0.005726056] seconds [----] I, [2016-09-13T11:28:56.988350 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80166], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.473355235] seconds [----] I, [2016-09-13T11:28:56.988603 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80166], Delivering... [----] I, [2016-09-13T11:28:56.993556 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80166], State: [ok], Delivered in [0.004952611] seconds [----] I, [2016-09-13T11:28:59.068770 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:28:59 UTC]... [----] I, [2016-09-13T11:28:59.089338 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:28:59 UTC]...Complete [----] I, [2016-09-13T11:29:04.559280 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:29:04.575170 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80168], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:29:10.787072 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:29:10.790080 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006111860275268555, :worker_monitor=>1.6560695171356201, :worker_dequeue=>0.006631612777709961, :total_time=>1.6691956520080566} [----] I, [2016-09-13T11:29:11.724817 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80168], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.161674199] seconds [----] I, [2016-09-13T11:29:11.725006 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80168], Delivering... [----] I, [2016-09-13T11:29:11.731318 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003430604934692383, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034530162811279297, :pending_vm_jobs=>0.0008537769317626953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00594329833984375} [----] I, [2016-09-13T11:29:11.731674 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80168], State: [ok], Delivered in [0.006663296] seconds [----] I, [2016-09-13T11:29:19.588221 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:29:19.604038 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80169], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:29:19.615241 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80170], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:29:19.644523 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80171], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:29:19.661196 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80172], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:29:20.938403 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:29:21.050242 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80169], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.456693653] seconds [----] I, [2016-09-13T11:29:21.050510 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80169], Delivering... [----] I, [2016-09-13T11:29:21.102067 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80172], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.45128661] seconds [----] I, [2016-09-13T11:29:21.102380 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80172], Delivering... [----] I, [2016-09-13T11:29:21.109704 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038526058197021484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003877401351928711, :pending_vm_jobs=>0.0008914470672607422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006672859191894531} [----] I, [2016-09-13T11:29:21.110087 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80172], State: [ok], Delivered in [0.007728376] seconds [----] I, [2016-09-13T11:29:21.129776 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80169], State: [ok], Delivered in [0.079215886] seconds [----] I, [2016-09-13T11:29:21.153094 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80170], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.543014591] seconds [----] I, [2016-09-13T11:29:21.153439 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80170], Delivering... [----] I, [2016-09-13T11:29:21.158067 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80170], State: [ok], Delivered in [0.004651071] seconds [----] I, [2016-09-13T11:29:21.173544 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80171], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.54988266] seconds [----] I, [2016-09-13T11:29:21.173818 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80171], Delivering... [----] I, [2016-09-13T11:29:21.180701 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80171], State: [ok], Delivered in [0.006817098] seconds [----] I, [2016-09-13T11:29:31.913701 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:29:31 UTC]... [----] I, [2016-09-13T11:29:31.966246 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:29:31 UTC]...Complete [----] I, [2016-09-13T11:29:34.675592 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:29:34.712739 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80173], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:29:36.989480 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:29:37.880573 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80173], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.195892042] seconds [----] I, [2016-09-13T11:29:37.880708 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80173], Delivering... [----] I, [2016-09-13T11:29:37.885247 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024302005767822266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002445697784423828, :pending_vm_jobs=>0.0005559921264648438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004285573959350586} [----] I, [2016-09-13T11:29:37.885494 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80173], State: [ok], Delivered in [0.004779187] seconds [----] I, [2016-09-13T11:29:43.076472 #2763:34713c] INFO -- : MIQ(MiqServer#validate_worker) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit [----] I, [2016-09-13T11:29:43.088048 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80174], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_uptime_exceeded", {:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T11:29:43.088340 #2763:34713c] INFO -- : MIQ(MiqServer#stop_worker) Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], status [started]... [----] I, [2016-09-13T11:29:43.099734 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80175], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T11:29:43.107931 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] is being requested to exit [----] I, [2016-09-13T11:29:43.359172 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:29:43.364611 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003045797348022461, :worker_monitor=>1.3605461120605469, :worker_dequeue=>0.008555173873901367, :total_time=>1.3723759651184082} [----] I, [2016-09-13T11:29:45.246060 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80174], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_uptime_exceeded", {:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [2.168229289] seconds [----] I, [2016-09-13T11:29:45.246245 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80174], Delivering... [----] I, [2016-09-13T11:29:45.261136 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_uptime_exceeded"> inputs=<{:event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1101, :miq_event_id=>1101, "EventStream::event_stream"=>1101, :event_stream_id=>1101}> [----] I, [2016-09-13T11:29:45.264385 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80175], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_stop", {:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [2.17489074] seconds [----] I, [2016-09-13T11:29:45.264523 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80175], Delivering... [----] I, [2016-09-13T11:29:45.275301 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_stop"> inputs=<{:event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1102, :miq_event_id=>1102, "EventStream::event_stream"=>1102, :event_stream_id=>1102}> [----] I, [2016-09-13T11:29:45.318018 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80176], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1101, :miq_event_id=>1101, "EventStream::event_stream"=>1101, :event_stream_id=>1101}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T11:29:45.318454 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80174], State: [ok], Delivered in [0.072160123] seconds [----] I, [2016-09-13T11:29:45.321709 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80177], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1102, :miq_event_id=>1102, "EventStream::event_stream"=>1102, :event_stream_id=>1102}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T11:29:45.321981 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80175], State: [ok], Delivered in [0.057447091] seconds [----] I, [2016-09-13T11:29:48.373760 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:29:49.024406 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80176], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1101, :miq_event_id=>1101, "EventStream::event_stream"=>1101, :event_stream_id=>1101}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [3.753355818] seconds [----] I, [2016-09-13T11:29:49.024636 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80176], Delivering... [----] I, [2016-09-13T11:29:49.027028 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_uptime_exceeded", :event_details=>"Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] uptime has reached the interval of 7200 seconds, requesting worker to exit", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1101, :miq_event_id=>1101, "EventStream::event_stream"=>1101, :event_stream_id=>1101} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T11:29:49.033908 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1101&MiqEvent%3A%3Amiq_event=1101&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B102%5D%2C%20PID%3A%20%5B17546%5D%2C%20GUID%3A%20%5B1d7be00a-79b6-11e6-87c1-fa163e7d01a3%5D%20uptime%20has%20reached%20the%20interval%20of%207200%20seconds%2C%20requesting%20worker%20to%20exit&event_stream_id=1101&event_type=evm_worker_uptime_exceeded&miq_event_id=1101&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T11:29:49.038558 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80177], MiqWorker id: [16], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1102, :miq_event_id=>1102, "EventStream::event_stream"=>1102, :event_stream_id=>1102}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [3.753442115] seconds [----] I, [2016-09-13T11:29:49.038767 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80177], Delivering... [----] I, [2016-09-13T11:29:49.041033 #2957:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_stop", :event_details=>"Stopping Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], status [started]...", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1102, :miq_event_id=>1102, "EventStream::event_stream"=>1102, :event_stream_id=>1102} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T11:29:49.048009 #2957:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1102&MiqEvent%3A%3Amiq_event=1102&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B102%5D%2C%20PID%3A%20%5B17546%5D%2C%20GUID%3A%20%5B1d7be00a-79b6-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1102&event_type=evm_worker_stop&miq_event_id=1102&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T11:29:49.071169 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1101&MiqEvent%3A%3Amiq_event=1101&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B102%5D%2C%20PID%3A%20%5B17546%5D%2C%20GUID%3A%20%5B1d7be00a-79b6-11e6-87c1-fa163e7d01a3%5D%20uptime%20has%20reached%20the%20interval%20of%207200%20seconds%2C%20requesting%20worker%20to%20exit&event_stream_id=1101&event_type=evm_worker_uptime_exceeded&miq_event_id=1101&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T11:29:49.089717 #2957:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1102&MiqEvent%3A%3Amiq_event=1102&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Stopping%20Worker%20%5BManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker%5D%20with%20ID%3A%20%5B102%5D%2C%20PID%3A%20%5B17546%5D%2C%20GUID%3A%20%5B1d7be00a-79b6-11e6-87c1-fa163e7d01a3%5D%2C%20status%20%5Bstarted%5D...&event_stream_id=1102&event_type=evm_worker_stop&miq_event_id=1102&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T11:29:49.170343 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create] [----] I, [2016-09-13T11:29:49.189890 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T11:29:49.200491 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T11:29:49.220917 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T11:29:49.227987 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T11:29:49.245325 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T11:29:49.250610 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T11:29:49.256612 #2957:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_stop] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T11:29:49.268355 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T11:29:49.276305 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T11:29:49.280981 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 15:29:31", os_priority: 30, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 433213440, memory_size: 732471296, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 359292000, has_active_websocket: true>] [----] I, [2016-09-13T11:29:49.281253 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_uptime_exceeded] [----] I, [2016-09-13T11:29:49.284642 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T11:29:49.291879 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T11:29:49.299322 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_uptime_exceeded] [----] I, [2016-09-13T11:29:49.299738 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_uptime_exceeded] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T11:29:49.310515 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T11:29:49.311039 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_uptime_exceeded#create] [----] I, [2016-09-13T11:29:49.311742 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80176], State: [ok], Delivered in [0.28709921] seconds [----] I, [2016-09-13T11:29:49.315357 #2957:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T11:29:49.326505 #2957:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T11:29:49.332918 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 15:29:31", os_priority: 30, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 433213440, memory_size: 732471296, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 359292000, has_active_websocket: true>] [----] I, [2016-09-13T11:29:49.333293 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_stop] [----] I, [2016-09-13T11:29:49.356491 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_stop] [----] I, [2016-09-13T11:29:49.356757 #2957:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_stop] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T11:29:49.364229 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T11:29:49.364720 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_stop#create] [----] I, [2016-09-13T11:29:49.365336 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80177], State: [ok], Delivered in [0.326575822] seconds [----] I, [2016-09-13T11:29:49.729329 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:29:49.775245 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80178], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:29:49.819553 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80179], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:29:51.486657 #17546:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [102], PID [17546], GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:29:41 UTC], Process Info: Memory Usage [613658624], Memory Size [1070673920], Proportional Set Size: [452578000], Memory % [7.48], CPU Time [2052.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T11:29:51.487177 #17546:34713c] INFO -- : EMS [livingontheedge.hawkular.org] as [jdoe] ID [102] PID [17546] GUID [1d7be00a-79b6-11e6-87c1-fa163e7d01a3] Exit request received. Worker exiting. [----] I, [2016-09-13T11:29:53.386994 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:29:53.436589 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80179], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.65558663] seconds [----] I, [2016-09-13T11:29:53.436750 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80179], Delivering... [----] I, [2016-09-13T11:29:53.441662 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002666950225830078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026826858520507812, :pending_vm_jobs=>0.0005598068237304688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004609584808349609} [----] I, [2016-09-13T11:29:53.441964 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80179], State: [ok], Delivered in [0.005211995] seconds [----] I, [2016-09-13T11:29:54.408487 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80178], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.674350834] seconds [----] I, [2016-09-13T11:29:54.408726 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80178], Delivering... [----] I, [2016-09-13T11:29:54.413814 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80178], State: [ok], Delivered in [0.005098289] seconds [----] I, [2016-09-13T11:29:58.514646 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker.sync_workers) Workers are being synchronized: Current: [], Desired: ["ems_17"] [----] I, [2016-09-13T11:29:58.613270 #2763:34713c] INFO -- : :kill_algorithm: [----] I, [2016-09-13T11:29:58.613406 #2763:34713c] INFO -- : :name: :used_swap_percent_gt_value [----] I, [2016-09-13T11:29:58.613497 #2763:34713c] INFO -- : :value: 80 [----] I, [2016-09-13T11:29:58.613543 #2763:34713c] INFO -- : :miq_server_time_threshold: 120 [----] I, [2016-09-13T11:29:58.613580 #2763:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T11:29:58.613663 #2763:34713c] INFO -- : :poll: 2 [----] I, [2016-09-13T11:29:58.613698 #2763:34713c] INFO -- : :start_algorithm: [----] I, [2016-09-13T11:29:58.613731 #2763:34713c] INFO -- : :name: :used_swap_percent_lt_value [----] I, [2016-09-13T11:29:58.613764 #2763:34713c] INFO -- : :value: 60 [----] I, [2016-09-13T11:29:58.613796 #2763:34713c] INFO -- : :sync_interval: 1800 [----] I, [2016-09-13T11:29:58.613827 #2763:34713c] INFO -- : :wait_for_started_timeout: 600 [----] I, [2016-09-13T11:29:58.994969 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker.close_pg_sockets_inherited_from_parent) Closing socket: 21 [----] I, [2016-09-13T11:29:59.134688 #2763:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80180], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}] [----] I, [2016-09-13T11:29:59.134909 #2763:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#start) Worker started: ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3] [----] I, [2016-09-13T11:29:59.352659 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:29:59.353325 #24051:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T11:29:59.353373 #24051:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:29:59.353399 #24051:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:29:59.353464 #24051:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:29:59.353493 #24051:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T11:29:59.353527 #24051:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T11:29:59.353554 #24051:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:29:59.353587 #24051:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T11:29:59.353613 #24051:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:29:59.353645 #24051:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:29:59.353669 #24051:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T11:29:59.353698 #24051:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:29:59.353726 #24051:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T11:29:59.353757 #24051:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T11:29:59.353779 #24051:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T11:29:59.353807 #24051:34713c] INFO -- : --- [----] I, [2016-09-13T11:29:59.354081 #24051:34713c] INFO -- : :guid: ee14426a-79c6-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:29:59.354144 #24051:34713c] INFO -- : :ems_id: 17 [----] I, [2016-09-13T11:29:59.930260 #24051:34713c] INFO -- : MIQ(AuthUseridPassword#validation_successful) [ExtManagementSystem] [17], previously valid/invalid on: [2016-09-13 14:17:55 UTC]/[], previous status: [Valid] [----] I, [2016-09-13T11:29:59.951006 #24051:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80181], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 17], "ems_auth_valid", {}] [----] I, [2016-09-13T11:30:00.024134 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:30:00.026791 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0061719417572021484, :worker_monitor=>1.6192102432250977, :worker_dequeue=>0.005798816680908203, :total_time=>1.631413221359253} [----] I, [2016-09-13T11:30:00.350797 #24051:34713c] INFO -- : ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner started. ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Zone [default], Role [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket] [----] I, [2016-09-13T11:30:00.351072 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_wait_for_worker_monitor) EMS [livingontheedge.hawkular.org] as [jdoe] Checking that worker monitor has started before doing work [----] I, [2016-09-13T11:30:00.353769 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_wait_for_worker_monitor) EMS [livingontheedge.hawkular.org] as [jdoe] Starting work since worker monitor has started [----] I, [2016-09-13T11:30:00.353839 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#do_before_work_loop) EMS [livingontheedge.hawkular.org] as [jdoe] Queueing initial refresh for EMS. [----] I, [2016-09-13T11:30:00.382340 #24051:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80182], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T11:30:00.384593 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#worker_monitor_drb) EMS [livingontheedge.hawkular.org] as [jdoe] Initializing DRb Connection to MiqServer with ID=[1], NAME=[EVM], PID=[2763], GUID=[36647afc-71a3-11e6-838a-fa163e68952f] DRb URI=[druby://127.0.0.1:41718] [----] I, [2016-09-13T11:30:00.439976 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80180], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["MiqServer", 1], "evm_worker_start", {:event_details=>"Worker started: ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker"}], Dequeued in: [1.383952848] seconds [----] I, [2016-09-13T11:30:00.440150 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80180], Delivering... [----] I, [2016-09-13T11:30:00.453115 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80181], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqEvent.raise_evm_event], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [["ManageIQ::Providers::Hawkular::MiddlewareManager", 17], "ems_auth_valid", {}], Dequeued in: [0.509397935] seconds [----] I, [2016-09-13T11:30:00.453271 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80181], Delivering... [----] I, [2016-09-13T11:30:00.467620 #2937:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"evm_worker_start"> inputs=<{:event_details=>"Worker started: ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1103, :miq_event_id=>1103, "EventStream::event_stream"=>1103, :event_stream_id=>1103}> [----] I, [2016-09-13T11:30:00.484953 #2928:34713c] INFO -- : MiqAeEvent.build_evm_event >> event=<"ems_auth_valid"> inputs=<{"MiqEvent::miq_event"=>1104, :miq_event_id=>1104, "EventStream::event_stream"=>1104, :event_stream_id=>1104}> [----] I, [2016-09-13T11:30:00.491653 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80183], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1103, :miq_event_id=>1103, "EventStream::event_stream"=>1103, :event_stream_id=>1103}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T11:30:00.491967 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80180], State: [ok], Delivered in [0.051835173] seconds [----] I, [2016-09-13T11:30:00.520260 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80184], id: [], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>17, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1104, :miq_event_id=>1104, "EventStream::event_stream"=>1104, :event_stream_id=>1104}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}] [----] I, [2016-09-13T11:30:00.520607 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80181], State: [ok], Delivered in [0.067311889] seconds [----] I, [2016-09-13T11:30:04.831045 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T11:30:04.856910 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80185], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:30:04.873927 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80186], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:30:04.896647 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80187], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:30:04.925365 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80188], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:30:05.027505 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:30:05 UTC]... [----] I, [2016-09-13T11:30:05.062508 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:30:05 UTC]...Complete [----] I, [2016-09-13T11:30:05.074917 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:30:05.079792 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=3, priority=200 [----] I, [2016-09-13T11:30:05.476002 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80183], MiqWorker id: [15], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"MiqServer", :object_id=>1, :attrs=>{:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1103, :miq_event_id=>1103, "EventStream::event_stream"=>1103, :event_stream_id=>1103}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>2, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [5.001730252] seconds [----] I, [2016-09-13T11:30:05.476251 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80183], Delivering... [----] I, [2016-09-13T11:30:05.478311 #2947:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"evm_worker_start", :event_details=>"Worker started: ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3]", :type=>"ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker", "MiqEvent::miq_event"=>1103, :miq_event_id=>1103, "EventStream::event_stream"=>1103, :event_stream_id=>1103} for object [MiqServer.1] with state [] to Automate [----] I, [2016-09-13T11:30:05.483728 #2947:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1103&MiqEvent%3A%3Amiq_event=1103&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B104%5D%2C%20PID%20%5B24051%5D%2C%20GUID%20%5Bee14426a-79c6-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1103&event_type=evm_worker_start&miq_event_id=1103&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server] [----] I, [2016-09-13T11:30:05.513782 #2947:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1103&MiqEvent%3A%3Amiq_event=1103&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_details=Worker%20started%3A%20ID%20%5B104%5D%2C%20PID%20%5B24051%5D%2C%20GUID%20%5Bee14426a-79c6-11e6-87c1-fa163e7d01a3%5D&event_stream_id=1103&event_type=evm_worker_start&miq_event_id=1103&object_name=Event&type=ManageIQ%3A%3AProviders%3A%3AHawkular%3A%3AMiddlewareManager%3A%3ARefreshWorker&vmdb_object_type=miq_server ManageIQ/System] [----] I, [2016-09-13T11:30:05.543335 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80184], MiqWorker id: [16], Zone: [default], Role: [automate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAeEngine.deliver], Timeout: [3600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [{:object_type=>"ManageIQ::Providers::Hawkular::MiddlewareManager", :object_id=>17, :attrs=>{:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1104, :miq_event_id=>1104, "EventStream::event_stream"=>1104, :event_stream_id=>1104}, :instance_name=>"Event", :user_id=>1, :miq_group_id=>1, :tenant_id=>1, :automate_message=>nil}], Dequeued in: [5.043578744] seconds [----] I, [2016-09-13T11:30:05.543543 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80184], Delivering... [----] I, [2016-09-13T11:30:05.545371 #2957:34713c] INFO -- : MIQ(MiqAeEngine.deliver) Delivering {:event_type=>"ems_auth_valid", "MiqEvent::miq_event"=>1104, :miq_event_id=>1104, "EventStream::event_stream"=>1104, :event_stream_id=>1104} for object [ManageIQ::Providers::Hawkular::MiddlewareManager.17] with state [] to Automate [----] I, [2016-09-13T11:30:05.550243 #2957:34713c] INFO -- : Instantiating [/System/Process/Event?EventStream%3A%3Aevent_stream=1104&ExtManagementSystem%3A%3Aext_management_system=17&MiqEvent%3A%3Amiq_event=1104&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1104&event_type=ems_auth_valid&miq_event_id=1104&object_name=Event&vmdb_object_type=ext_management_system] [----] I, [2016-09-13T11:30:05.577031 #2957:34713c] INFO -- : Updated namespace [/System/Process/Event?EventStream%3A%3Aevent_stream=1104&ExtManagementSystem%3A%3Aext_management_system=17&MiqEvent%3A%3Amiq_event=1104&MiqServer%3A%3Amiq_server=1&User%3A%3Auser=1&event_stream_id=1104&event_type=ems_auth_valid&miq_event_id=1104&object_name=Event&vmdb_object_type=ext_management_system ManageIQ/System] [----] I, [2016-09-13T11:30:05.596839 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T11:30:05.617530 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T11:30:05.638827 #2947:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/evm_worker_start] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T11:30:05.656320 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T11:30:05.658993 #2947:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T11:30:05.664726 #2947:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T11:30:05.676827 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create ManageIQ/System/Event/MiqEvent] [----] I, [2016-09-13T11:30:05.680565 #2947:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T11:30:05.687535 #2947:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T11:30:05.691453 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#true, :concurrent_miqproxies=>0}, last_heartbeat: "2016-09-13 15:30:05", os_priority: 30, is_master: true, logo: nil, version: "master", zone_id: 1, upgrade_status: nil, upgrade_message: nil, memory_usage: 433213440, memory_size: 732471296, hostname: "host-192-168-100-106", ipaddress: "192.168.100.106", drb_uri: "druby://127.0.0.1:41718", mac_address: "fa:16:3e:7d:01:a3", vm_id: nil, has_active_userinterface: true, has_active_webservices: true, sql_spid: 2782, rh_registered: nil, rh_subscribed: nil, last_update_check: nil, updates_available: nil, rhn_mirror: false, log_file_depot_id: nil, proportional_set_size: 359292000, has_active_websocket: true>] [----] I, [2016-09-13T11:30:05.691662 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [evm_worker_start] [----] I, [2016-09-13T11:30:05.697434 #2957:34713c] INFO -- : Instance [/ManageIQ/System/Event/MiqEvent/POLICY/ems_auth_valid] not found in MiqAeDatastore - trying [.missing] [----] I, [2016-09-13T11:30:05.713517 #2947:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [evm_worker_start] [----] I, [2016-09-13T11:30:05.713699 #2947:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [evm_worker_start] Target: MiqServer Name: [EVM], Id: [1] [----] I, [2016-09-13T11:30:05.716831 #2957:34713c] INFO -- : Following Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T11:30:05.717451 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T11:30:05.717918 #2947:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/evm_worker_start#create] [----] I, [2016-09-13T11:30:05.718639 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80183], State: [ok], Delivered in [0.242389474] seconds [----] I, [2016-09-13T11:30:05.722136 #2957:34713c] INFO -- : Updated namespace [miqaedb:/System/event_handlers/event_enforce_policy#create ManageIQ/System] [----] I, [2016-09-13T11:30:05.739089 #2957:34713c] INFO -- : Updated namespace [System/event_handlers/event_enforce_policy ManageIQ/System] [----] I, [2016-09-13T11:30:05.747297 #2957:34713c] INFO -- : Invoking [builtin] method [/ManageIQ/System/event_handlers/event_enforce_policy] with inputs [{}] [----] I, [2016-09-13T11:30:05.748013 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80185], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.910347704] seconds [----] I, [2016-09-13T11:30:05.748169 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80185], Delivering... [----] I, [2016-09-13T11:30:05.751402 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) target = [#] [----] I, [2016-09-13T11:30:05.751743 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Event Raised [ems_auth_valid] [----] I, [2016-09-13T11:30:05.752906 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002451658248901367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002466917037963867, :pending_vm_jobs=>0.0006210803985595703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004461050033569336} [----] I, [2016-09-13T11:30:05.753206 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80185], State: [ok], Delivered in [0.00503421] seconds [----] I, [2016-09-13T11:30:05.770706 #2957:34713c] INFO -- : MIQ(MiqEvent#process_evm_event) Alert for Event [ems_auth_valid] [----] I, [2016-09-13T11:30:05.770955 #2957:34713c] INFO -- : MIQ(MiqAlert.evaluate_alerts) [ems_auth_valid] Target: ManageIQ::Providers::Hawkular::MiddlewareManager Name: [Hawkular-Provider], Id: [17] [----] I, [2016-09-13T11:30:05.775843 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/event_handlers/event_enforce_policy#create] [----] I, [2016-09-13T11:30:05.776385 #2957:34713c] INFO -- : Followed Relationship [miqaedb:/System/Event/MiqEvent/POLICY/ems_auth_valid#create] [----] I, [2016-09-13T11:30:05.777185 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80184], State: [ok], Delivered in [0.233638531] seconds [----] I, [2016-09-13T11:30:06.543087 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80186], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.680292858] seconds [----] I, [2016-09-13T11:30:06.543391 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80186], Delivering... [----] I, [2016-09-13T11:30:06.546639 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80186], State: [ok], Delivered in [0.003266623] seconds [----] I, [2016-09-13T11:30:06.578121 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80187], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.698485148] seconds [----] I, [2016-09-13T11:30:06.578326 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80187], Delivering... [----] I, [2016-09-13T11:30:06.582809 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80188], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.680526763] seconds [----] I, [2016-09-13T11:30:06.583035 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80188], Delivering... [----] I, [2016-09-13T11:30:06.588560 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80187], State: [ok], Delivered in [0.010226042] seconds [----] I, [2016-09-13T11:30:06.590374 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80188], State: [ok], Delivered in [0.007318434] seconds [----] I, [2016-09-13T11:30:10.097866 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=3, priority=200 [----] I, [2016-09-13T11:30:10.783991 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [80182], MiqWorker id: [104], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [10.420732525] seconds [----] I, [2016-09-13T11:30:10.784268 #24051:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80182], Delivering... [----] I, [2016-09-13T11:30:10.795780 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T11:30:10.795943 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T11:30:10.796043 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T11:30:10.796180 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T11:30:10.800524 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:11.286186 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:11.609187 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:11.609399 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:12.134838 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:12.450987 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:12.451167 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:12.972632 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:13.263329 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:13.263539 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:13.745149 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:14.079374 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:14.079597 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:14.668467 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:14.988395 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:14.988677 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:15.533825 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:15.838294 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:15.838446 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:16.423967 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:16.429980 #2763:34713c] INFO -- : MIQ(MiqServer#clean_worker_records) SQL Record for Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [102], PID: [17546], GUID: [1d7be00a-79b6-11e6-87c1-fa163e7d01a3], Status: [stopped] is being deleted [----] I, [2016-09-13T11:30:16.764288 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:16.764616 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:16.789380 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004742622375488281, :worker_monitor=>1.6785802841186523, :worker_dequeue=>0.007228374481201172, :total_time=>1.690955638885498} [----] I, [2016-09-13T11:30:17.363877 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:17.690175 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:17.690310 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:18.229503 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:18.571214 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:18.571396 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:19.097621 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:19.384703 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:19.384878 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:19.937827 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:30:19.957202 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80189], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:30:19.973300 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80190], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:30:19.991539 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80191], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:30:20.018955 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80192], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:30:20.161833 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:20.472228 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:20.472381 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:21.386778 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:21.692776 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:21.692966 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:21.896699 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:30:22.360046 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:22.672575 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:22.672757 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:22.886541 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80189], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.941523111] seconds [----] I, [2016-09-13T11:30:22.886842 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80189], Delivering... [----] I, [2016-09-13T11:30:22.891356 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80192], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.894802125] seconds [----] I, [2016-09-13T11:30:22.891581 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80192], Delivering... [----] I, [2016-09-13T11:30:22.896145 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025482177734375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025632381439208984, :pending_vm_jobs=>0.0005376338958740234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004222393035888672} [----] I, [2016-09-13T11:30:22.896389 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80192], State: [ok], Delivered in [0.004833538] seconds [----] I, [2016-09-13T11:30:22.948548 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80189], State: [ok], Delivered in [0.06167829] seconds [----] I, [2016-09-13T11:30:23.218903 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:23.372539 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:23.507007 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:23.638626 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:23.772699 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:24.013301 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:24.147091 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:24.289736 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:24.456048 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:24.605048 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:24.686284 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80190], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.724277069] seconds [----] I, [2016-09-13T11:30:24.686527 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80190], Delivering... [----] I, [2016-09-13T11:30:24.689957 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80190], State: [ok], Delivered in [0.003424797] seconds [----] I, [2016-09-13T11:30:24.714371 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80191], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.734158049] seconds [----] I, [2016-09-13T11:30:24.714588 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80191], Delivering... [----] I, [2016-09-13T11:30:24.719293 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80191], State: [ok], Delivered in [0.004682048] seconds [----] I, [2016-09-13T11:30:24.746164 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:24.881023 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:25.015875 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:25.174045 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:25.308255 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:25.924319 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:26.082862 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:26.231697 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:26.374567 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:26.514299 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:26.662969 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:26.806784 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:33.027971 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:33.192387 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:33.286573 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002839803695678711, :worker_monitor=>1.3566596508026123, :worker_dequeue=>0.00981593132019043, :total_time=>1.3695857524871826} [----] I, [2016-09-13T11:30:33.344070 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:33.480616 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:33.617793 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:33.757501 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:33.953729 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:34.127944 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:34.354786 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:34.536203 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:35.030024 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:30:35.044125 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:35.052641 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80193], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:30:35.214909 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:35.435119 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:35.581668 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:35.724316 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:35.929605 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:36.081375 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:36.219697 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:36.362633 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:36.504225 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:36.664638 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:36.802349 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:36.941761 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:37.079108 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:37.220748 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:37.365745 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:37.507728 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:38.159902 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:38.287201 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:30:38 UTC]... [----] I, [2016-09-13T11:30:38.308519 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:30:38 UTC]...Complete [----] I, [2016-09-13T11:30:38.314494 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:30:38.350638 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:38.494610 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:38.636915 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:38.828687 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:38.965804 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:39.005806 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80193], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.97025835] seconds [----] I, [2016-09-13T11:30:39.005988 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80193], Delivering... [----] I, [2016-09-13T11:30:39.011929 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030517578125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003071308135986328, :pending_vm_jobs=>0.0007181167602539062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005568265914916992} [----] I, [2016-09-13T11:30:39.012294 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80193], State: [ok], Delivered in [0.006302616] seconds [----] I, [2016-09-13T11:30:39.116994 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:39.255235 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:39.389239 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:39.532726 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:39.678365 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:39.875834 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:40.030697 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:40.165933 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:40.305880 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:40.446556 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:40.599002 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:41.307600 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:41.474820 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:41.615230 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:41.762636 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:41.907709 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:42.048530 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:42.188040 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:42.329316 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:42.479935 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:42.667073 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:42.834965 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:42.982723 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:43.134400 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:43.279008 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:43.429263 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:43.569564 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:43.760503 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:44.390479 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:49.518831 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0046236515045166016, :worker_monitor=>1.176398754119873, :worker_dequeue=>0.005646705627441406, :total_time=>1.1870341300964355} [----] I, [2016-09-13T11:30:50.067770 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:30:50.079901 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80194], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:30:50.097383 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80195], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:30:50.580262 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:50.787501 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:50.937960 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:51.077994 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:51.222806 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:51.361207 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:51.518649 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:51.658172 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:51.815202 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:51.979743 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:52.133223 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:52.298684 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:52.447668 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:52.623112 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:52.774505 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:52.913979 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:53.382743 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:53.563385 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:53.715313 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:53.854782 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:53.996514 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:54.138806 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:54.278393 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:54.420487 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:54.525939 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:30:54.569194 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:54.761071 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:54.852717 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80195], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.768052405] seconds [----] I, [2016-09-13T11:30:54.852909 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80195], Delivering... [----] I, [2016-09-13T11:30:54.859523 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034842491149902344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035085678100585938, :pending_vm_jobs=>0.0007998943328857422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006157636642456055} [----] I, [2016-09-13T11:30:54.859913 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80195], State: [ok], Delivered in [0.007000851] seconds [----] I, [2016-09-13T11:30:54.869087 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80194], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.798055171] seconds [----] I, [2016-09-13T11:30:54.869243 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80194], Delivering... [----] I, [2016-09-13T11:30:54.872733 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80194], State: [ok], Delivered in [0.003491147] seconds [----] I, [2016-09-13T11:30:54.908912 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:55.054159 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:55.215775 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:55.369157 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:55.508678 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:55.666875 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:55.823939 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:56.557351 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:56.772881 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:56.917558 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:57.066645 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:57.215463 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:57.400859 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:57.539338 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:57.672583 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:57.817881 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:57.961725 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:58.101361 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:58.240967 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:58.374042 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:58.518507 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:58.658009 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:58.922472 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:59.096223 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:30:59.544840 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T11:30:59.843272 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:00.125320 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:00.292071 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:00.431684 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:00.607169 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:00.863248 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:05.107337 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:31:05.125976 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80196], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:31:05.576481 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:31:05.581172 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.008857488632202148, :worker_monitor=>1.006406307220459, :worker_dequeue=>0.010831356048583984, :total_time=>1.0264484882354736} [----] I, [2016-09-13T11:31:06.249362 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80196], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.137118539] seconds [----] I, [2016-09-13T11:31:06.249536 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80196], Delivering... [----] I, [2016-09-13T11:31:06.253881 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024268627166748047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024411678314208984, :pending_vm_jobs=>0.0005083084106445312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0040662288665771484} [----] I, [2016-09-13T11:31:06.254146 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80196], State: [ok], Delivered in [0.004586271] seconds [----] I, [2016-09-13T11:31:07.027517 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:07.209275 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:07.359847 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:07.515988 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:07.660108 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:07.812232 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:07.948630 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:08.088797 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:08.224910 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:08.373325 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:08.533133 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:09.094927 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:09.261811 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:09.406392 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:09.606694 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:09.782797 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:09.939248 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:10.108771 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:10.248039 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:10.383565 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:10.525470 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:10.581669 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:31:10 UTC]... [----] I, [2016-09-13T11:31:10.597347 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:31:10 UTC]...Complete [----] I, [2016-09-13T11:31:10.668686 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:10.832840 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:10.987914 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:11.141937 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:11.287027 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:11.424378 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:11.583858 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:12.359884 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:12.523872 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:12.659186 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:12.810948 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:12.944942 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:13.098723 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:13.240748 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:13.385048 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:13.533541 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:13.676210 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:13.813132 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:14.009593 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:14.227910 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:14.382871 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:14.517159 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:14.663968 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:14.798019 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:15.313919 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:15.486919 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:15.629545 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:15.770020 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:15.907308 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:16.049515 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:16.193026 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:16.346370 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:16.490275 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:16.628622 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:16.765827 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:16.914674 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:17.050735 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:17.188757 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:17.329575 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:17.479204 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:17.615500 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:18.200471 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:20.138273 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:31:20.174511 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80197], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:31:20.203579 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80198], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:31:20.226689 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80199], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:31:20.249259 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80200], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:31:21.907973 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:31:21.911558 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0027053356170654297, :worker_monitor=>1.2744781970977783, :worker_dequeue=>0.008288145065307617, :total_time=>1.285726547241211} [----] I, [2016-09-13T11:31:21.963917 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80197], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.812034294] seconds [----] I, [2016-09-13T11:31:21.964128 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80197], Delivering... [----] I, [2016-09-13T11:31:21.987274 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80200], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.755170648] seconds [----] I, [2016-09-13T11:31:21.987525 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80200], Delivering... [----] I, [2016-09-13T11:31:21.995124 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004065990447998047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0041620731353759766, :pending_vm_jobs=>0.0009756088256835938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007134675979614258} [----] I, [2016-09-13T11:31:21.995552 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80200], State: [ok], Delivered in [0.008018094] seconds [----] I, [2016-09-13T11:31:22.044289 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80198], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.861102829] seconds [----] I, [2016-09-13T11:31:22.044579 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80198], Delivering... [----] I, [2016-09-13T11:31:22.048177 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80198], State: [ok], Delivered in [0.003582509] seconds [----] I, [2016-09-13T11:31:22.055022 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80197], State: [ok], Delivered in [0.090893107] seconds [----] I, [2016-09-13T11:31:22.112718 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80199], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.902908159] seconds [----] I, [2016-09-13T11:31:22.112909 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80199], Delivering... [----] I, [2016-09-13T11:31:22.117562 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80199], State: [ok], Delivered in [0.004637877] seconds [----] I, [2016-09-13T11:31:24.409270 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:24.548367 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:24.685788 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:24.834235 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:25.013320 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:25.168209 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:25.302259 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:25.441409 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:25.585278 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:25.731759 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:25.871657 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:26.025125 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:26.173231 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:26.316058 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:26.477266 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:26.626203 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:27.255675 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:27.440619 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:27.574234 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:27.713546 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:27.858323 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:27.999406 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:28.132154 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:28.270034 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:28.409594 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:28.561442 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:28.697586 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:28.836249 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:28.979342 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:29.118804 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:29.263229 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:29.404451 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:31:29.549463 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T11:31:29.749128 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T11:31:29.749467 #24051:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T11:31:29.749716 #24051:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T11:31:29.749799 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T11:31:29.749917 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T11:31:29.775157 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T11:31:29.775572 #24051:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [80182], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T11:31:29.775780 #24051:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T11:31:29.775961 #24051:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T11:31:29.776153 #24051:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80182], State: [error], Delivered in [78.991907379] seconds [----] I, [2016-09-13T11:31:35.537535 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:31:35.563624 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80201], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:31:38.319186 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:31:38.322023 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005807399749755859, :worker_monitor=>1.3103811740875244, :worker_dequeue=>0.006228446960449219, :total_time=>1.3227589130401611} [----] I, [2016-09-13T11:31:38.444078 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80201], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.895621937] seconds [----] I, [2016-09-13T11:31:38.444287 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80201], Delivering... [----] I, [2016-09-13T11:31:38.449523 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032444000244140625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032584667205810547, :pending_vm_jobs=>0.0004792213439941406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004881143569946289} [----] I, [2016-09-13T11:31:38.449762 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80201], State: [ok], Delivered in [0.005491261] seconds [----] I, [2016-09-13T11:31:43.322532 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:31:43 UTC]... [----] I, [2016-09-13T11:31:43.340826 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:31:43 UTC]...Complete [----] I, [2016-09-13T11:31:50.575741 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:31:50.592455 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80202], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:31:50.605174 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80203], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:31:54.711914 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:31:54.714484 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002992391586303711, :worker_monitor=>1.3356316089630127, :worker_dequeue=>0.0056476593017578125, :total_time=>1.3444972038269043} [----] I, [2016-09-13T11:31:55.215887 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80203], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.61758164] seconds [----] I, [2016-09-13T11:31:55.216113 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80203], Delivering... [----] I, [2016-09-13T11:31:55.222863 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003568410873413086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035898685455322266, :pending_vm_jobs=>0.0008609294891357422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006355762481689453} [----] I, [2016-09-13T11:31:55.223301 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80203], State: [ok], Delivered in [0.007203345] seconds [----] I, [2016-09-13T11:31:55.261522 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80202], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.681774594] seconds [----] I, [2016-09-13T11:31:55.261712 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80202], Delivering... [----] I, [2016-09-13T11:31:55.266550 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80202], State: [ok], Delivered in [0.00482185] seconds [----] I, [2016-09-13T11:32:05.614957 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:32:05.632793 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80204], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:32:10.598183 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:32:10.689944 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80204], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.069573355] seconds [----] I, [2016-09-13T11:32:10.690112 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80204], Delivering... [----] I, [2016-09-13T11:32:10.694679 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002452373504638672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024673938751220703, :pending_vm_jobs=>0.0005404949188232422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0042879581451416016} [----] I, [2016-09-13T11:32:10.694978 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80204], State: [ok], Delivered in [0.004868566] seconds [----] I, [2016-09-13T11:32:15.601115 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:32:15 UTC]... [----] I, [2016-09-13T11:32:15.621298 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:32:15 UTC]...Complete [----] I, [2016-09-13T11:32:20.649739 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:32:20.674199 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80205], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:32:20.696154 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80206], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:32:20.718653 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80207], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:32:20.735653 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80208], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:32:26.683592 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:32:26.685986 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003816366195678711, :worker_monitor=>1.0138294696807861, :worker_dequeue=>0.005304574966430664, :total_time=>1.0232536792755127} [----] I, [2016-09-13T11:32:26.770578 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80205], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.112772779] seconds [----] I, [2016-09-13T11:32:26.770764 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80205], Delivering... [----] I, [2016-09-13T11:32:26.804712 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80208], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.078529214] seconds [----] I, [2016-09-13T11:32:26.804892 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80208], Delivering... [----] I, [2016-09-13T11:32:26.811119 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032052993774414062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003227710723876953, :pending_vm_jobs=>0.0007793903350830078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005845308303833008} [----] I, [2016-09-13T11:32:26.811521 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80208], State: [ok], Delivered in [0.006622172] seconds [----] I, [2016-09-13T11:32:26.841658 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80205], State: [ok], Delivered in [0.070856874] seconds [----] I, [2016-09-13T11:32:28.333598 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80206], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.652293823] seconds [----] I, [2016-09-13T11:32:28.333802 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80206], Delivering... [----] I, [2016-09-13T11:32:28.337065 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80206], State: [ok], Delivered in [0.003247812] seconds [----] I, [2016-09-13T11:32:28.367251 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80207], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.660560777] seconds [----] I, [2016-09-13T11:32:28.367396 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80207], Delivering... [----] I, [2016-09-13T11:32:28.372121 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80207], State: [ok], Delivered in [0.004676431] seconds [----] I, [2016-09-13T11:32:35.747836 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:32:35.767483 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80209], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:32:36.792817 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:32:36.916050 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80209], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.161344361] seconds [----] I, [2016-09-13T11:32:36.916272 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80209], Delivering... [----] I, [2016-09-13T11:32:36.923132 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036339759826660156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036628246307373047, :pending_vm_jobs=>0.0008392333984375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006440401077270508} [----] I, [2016-09-13T11:32:36.923557 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80209], State: [ok], Delivered in [0.00727111] seconds [----] I, [2016-09-13T11:32:47.690025 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:32:47 UTC]... [----] I, [2016-09-13T11:32:47.704149 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:32:47 UTC]...Complete [----] I, [2016-09-13T11:32:50.781471 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:32:50.797037 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80210], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:32:50.819060 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80211], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:32:52.729591 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:32:53.010615 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80211], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.207499032] seconds [----] I, [2016-09-13T11:32:53.010771 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80211], Delivering... [----] I, [2016-09-13T11:32:53.015623 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002600431442260742, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026161670684814453, :pending_vm_jobs=>0.0005812644958496094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004547595977783203} [----] I, [2016-09-13T11:32:53.015938 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80211], State: [ok], Delivered in [0.005164653] seconds [----] I, [2016-09-13T11:32:55.496911 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80210], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.710632285] seconds [----] I, [2016-09-13T11:32:55.497152 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80210], Delivering... [----] I, [2016-09-13T11:32:55.501795 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80210], State: [ok], Delivered in [0.004660128] seconds [----] I, [2016-09-13T11:32:59.018863 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005008697509765625, :worker_monitor=>1.2706022262573242, :worker_dequeue=>0.010007143020629883, :total_time=>1.2860729694366455} [----] I, [2016-09-13T11:33:05.831130 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:33:05.845106 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80212], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:33:09.049825 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:33:09.136759 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80212], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.300930869] seconds [----] I, [2016-09-13T11:33:09.136949 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80212], Delivering... [----] I, [2016-09-13T11:33:09.143045 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00319671630859375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032143592834472656, :pending_vm_jobs=>0.0007414817810058594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005749225616455078} [----] I, [2016-09-13T11:33:09.143399 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80212], State: [ok], Delivered in [0.006445521] seconds [----] I, [2016-09-13T11:33:15.222231 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004121065139770508, :worker_monitor=>1.1559746265411377, :worker_dequeue=>0.007269620895385742, :total_time=>1.1676626205444336} [----] I, [2016-09-13T11:33:20.222641 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:33:20 UTC]... [----] I, [2016-09-13T11:33:20.240727 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:33:20 UTC]...Complete [----] I, [2016-09-13T11:33:20.857030 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:33:20.898588 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80213], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:33:20.916497 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80214], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:33:20.933552 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80215], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:33:20.952079 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80216], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:33:25.264889 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:33:25.614174 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80213], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.752311889] seconds [----] I, [2016-09-13T11:33:25.614367 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80213], Delivering... [----] I, [2016-09-13T11:33:25.619640 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80216], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.680349102] seconds [----] I, [2016-09-13T11:33:25.619829 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80216], Delivering... [----] I, [2016-09-13T11:33:25.626534 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003591775894165039, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036132335662841797, :pending_vm_jobs=>0.0008516311645507812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006285667419433594} [----] I, [2016-09-13T11:33:25.626874 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80216], State: [ok], Delivered in [0.007045358] seconds [----] I, [2016-09-13T11:33:25.653805 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80214], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.749341548] seconds [----] I, [2016-09-13T11:33:25.653936 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80214], Delivering... [----] I, [2016-09-13T11:33:25.656010 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80214], State: [ok], Delivered in [0.002065934] seconds [----] I, [2016-09-13T11:33:25.664994 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80213], State: [ok], Delivered in [0.050608795] seconds [----] I, [2016-09-13T11:33:25.670641 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80215], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.746479691] seconds [----] I, [2016-09-13T11:33:25.670754 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80215], Delivering... [----] I, [2016-09-13T11:33:25.673824 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80215], State: [ok], Delivered in [0.003064131] seconds [----] I, [2016-09-13T11:33:31.481237 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003589630126953125, :worker_monitor=>1.199136734008789, :worker_dequeue=>0.0076999664306640625, :total_time=>1.2109465599060059} [----] I, [2016-09-13T11:33:35.964130 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:33:35.985404 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80217], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:33:35.996466 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80218], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:33:36.020178 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80219], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:33:36.560631 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:33:37.306501 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80217], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.335986206] seconds [----] I, [2016-09-13T11:33:37.306668 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80217], Delivering... [----] I, [2016-09-13T11:33:37.313240 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031447410583496094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031676292419433594, :pending_vm_jobs=>0.00096893310546875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006230354309082031} [----] I, [2016-09-13T11:33:37.313642 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80217], State: [ok], Delivered in [0.00694864] seconds [----] I, [2016-09-13T11:33:37.328637 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80218], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.337835314] seconds [----] I, [2016-09-13T11:33:37.328867 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80218], Delivering... [----] I, [2016-09-13T11:33:37.329855 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T11:33:37.330100 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4590264320 [----] I, [2016-09-13T11:33:37.330200 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4353662976 [----] I, [2016-09-13T11:33:37.330277 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 236601344 [----] I, [2016-09-13T11:33:37.330343 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T11:33:37.330408 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4296908800 [----] I, [2016-09-13T11:33:37.330531 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T11:33:37.330604 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T11:33:37.330676 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 559271936 [----] I, [2016-09-13T11:33:37.330768 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T11:33:37.330857 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6778077184 [----] I, [2016-09-13T11:33:37.330929 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T11:33:37.330993 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T11:33:37.331057 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T11:33:37.331158 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T11:33:37.331233 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T11:33:37.331296 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T11:33:37.331362 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T11:33:37.331452 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T11:33:37.331537 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T11:33:37.331607 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T11:33:37.331672 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272138240 [----] I, [2016-09-13T11:33:37.331733 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55029760 [----] I, [2016-09-13T11:33:37.331797 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217108480 [----] I, [2016-09-13T11:33:37.331857 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6160384 [----] I, [2016-09-13T11:33:37.331922 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142823424 [----] I, [2016-09-13T11:33:37.331981 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3392966656 [----] I, [2016-09-13T11:33:37.332045 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3073757184 [----] I, [2016-09-13T11:33:37.332140 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T11:33:37.332242 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T11:33:37.332309 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T11:33:37.332372 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37400576 [----] I, [2016-09-13T11:33:37.332462 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76959744 [----] I, [2016-09-13T11:33:37.332550 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49946624 [----] I, [2016-09-13T11:33:37.332614 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111783936 [----] I, [2016-09-13T11:33:37.332679 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126906368 [----] I, [2016-09-13T11:33:37.332741 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T11:33:37.332804 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T11:33:37.332865 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T11:33:37.332961 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T11:33:37.333035 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T11:33:37.333116 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T11:33:37.333185 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T11:33:37.333251 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T11:33:37.333311 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T11:33:37.376266 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T11:33:37.376599 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T11:33:37.382475 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T11:33:37.386904 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T11:33:37.392153 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T11:33:37.397360 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T11:33:37.402604 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T11:33:37.407842 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 857 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T11:33:37.413018 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T11:33:37.416404 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T11:33:37.419159 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T11:33:37.421911 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T11:33:37.424729 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T11:33:37.427412 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T11:33:37.430131 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:33:37.430274 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:33:37.430369 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T11:33:37.434799 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [359292000], Memory % [5.27], CPU Time [207941.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T11:33:37.435187 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80218], State: [ok], Delivered in [0.106310758] seconds [----] I, [2016-09-13T11:33:41.583076 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:33:42.385765 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80219], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.384466584] seconds [----] I, [2016-09-13T11:33:42.385978 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80219], Delivering... [----] I, [2016-09-13T11:33:42.393164 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:33:31 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163160000], Memory % [3.1], CPU Time [38866.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T11:33:42.393831 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:33:28 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359292000], Memory % [5.28], CPU Time [207946.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T11:33:42.394484 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:33:31 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [155147.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:33:42.395003 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:33:31 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [154291.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:33:42.395617 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:33:28 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169749000], Memory % [3.14], CPU Time [52793.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:33:42.396157 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:33:20 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208116000], Memory % [3.52], CPU Time [245866.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T11:33:42.396671 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:33:26 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347856000], Memory % [5.04], CPU Time [106360.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T11:33:42.397115 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:33:21 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213439000], Memory % [3.51], CPU Time [50117.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T11:33:42.400270 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:33:29 UTC], Process Info: Memory Usage [613842944], Memory Size [1042886656], Proportional Set Size: [454621000], Memory % [7.48], CPU Time [262.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T11:33:42.402700 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:33:23 UTC], Process Info: Memory Usage [601722880], Memory Size [944418816], Proportional Set Size: [444989000], Memory % [7.34], CPU Time [823.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T11:33:42.403245 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:33:28 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358591000], Memory % [5.27], CPU Time [215314.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T11:33:42.403766 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:33:28 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178488000], Memory % [3.2], CPU Time [52744.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:33:42.404225 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:33:28 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166760000], Memory % [3.16], CPU Time [39789.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T11:33:42.404572 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80219], State: [ok], Delivered in [0.018610501] seconds [----] I, [2016-09-13T11:33:47.844764 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002668142318725586, :worker_monitor=>1.2407219409942627, :worker_dequeue=>0.010063648223876953, :total_time=>1.2536795139312744} [----] I, [2016-09-13T11:33:51.037694 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:33:51.048312 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80220], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:33:51.065554 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80221], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:33:52.845350 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:33:52 UTC]... [----] I, [2016-09-13T11:33:52.865237 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:33:52 UTC]...Complete [----] I, [2016-09-13T11:33:52.877154 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:33:53.534758 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80221], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.480743926] seconds [----] I, [2016-09-13T11:33:53.535058 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80221], Delivering... [----] I, [2016-09-13T11:33:53.545475 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005360603332519531, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005396127700805664, :pending_vm_jobs=>0.001390695571899414, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009686946868896484} [----] I, [2016-09-13T11:33:53.545963 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80221], State: [ok], Delivered in [0.010917923] seconds [----] I, [2016-09-13T11:33:55.785656 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80220], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.743370649] seconds [----] I, [2016-09-13T11:33:55.785796 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80220], Delivering... [----] I, [2016-09-13T11:33:55.789059 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80220], State: [ok], Delivered in [0.003245983] seconds [----] I, [2016-09-13T11:34:04.241525 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004090309143066406, :worker_monitor=>1.3326904773712158, :worker_dequeue=>0.0074155330657958984, :total_time=>1.3445663452148438} [----] I, [2016-09-13T11:34:06.078484 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T11:34:06.105958 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80222], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:34:06.140188 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80223], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:34:09.251595 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:34:09.666056 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80222], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.580915524] seconds [----] I, [2016-09-13T11:34:09.666281 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80222], Delivering... [----] I, [2016-09-13T11:34:09.672594 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033037662506103516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003322601318359375, :pending_vm_jobs=>0.0007956027984619141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058901309967041016} [----] I, [2016-09-13T11:34:09.672951 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80222], State: [ok], Delivered in [0.00666885] seconds [----] I, [2016-09-13T11:34:10.837469 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80223], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.715685214] seconds [----] I, [2016-09-13T11:34:10.837629 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80223], Delivering... [----] I, [2016-09-13T11:34:10.866523 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80224], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T11:34:10.866864 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80223], State: [ok], Delivered in [0.029223266] seconds [----] I, [2016-09-13T11:34:14.269892 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T11:34:20.090167 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [80224], MiqWorker id: [104], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [9.241089419] seconds [----] I, [2016-09-13T11:34:20.090531 #24051:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80224], Delivering... [----] I, [2016-09-13T11:34:20.100283 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T11:34:20.100506 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T11:34:20.100637 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T11:34:20.100802 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T11:34:20.100966 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:20.562984 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:20.878834 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:20.879040 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:21.156833 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:34:21.174989 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80225], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:34:21.192514 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80226], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:34:21.215269 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80227], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:34:21.249196 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80228], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:34:21.430439 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:22.444046 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:22.444299 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:23.085404 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:23.386780 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:23.386958 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:24.000592 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:24.321970 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:24.322166 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:24.830782 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:25.139468 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:25.139691 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:25.263174 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:34:25 UTC]... [----] I, [2016-09-13T11:34:25.277718 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:34:25 UTC]...Complete [----] I, [2016-09-13T11:34:25.288904 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:34:25.583631 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:25.805376 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80225], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.644825617] seconds [----] I, [2016-09-13T11:34:25.805597 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80225], Delivering... [----] I, [2016-09-13T11:34:25.855472 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80228], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.633742845] seconds [----] I, [2016-09-13T11:34:25.855640 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80228], Delivering... [----] I, [2016-09-13T11:34:25.861308 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80225], State: [ok], Delivered in [0.055692407] seconds [----] I, [2016-09-13T11:34:25.861676 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002971172332763672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002988576889038086, :pending_vm_jobs=>0.0007581710815429688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057086944580078125} [----] I, [2016-09-13T11:34:25.861988 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80228], State: [ok], Delivered in [0.006343293] seconds [----] I, [2016-09-13T11:34:25.876966 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:25.877127 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:25.878887 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80226], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.699054097] seconds [----] I, [2016-09-13T11:34:25.879114 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80226], Delivering... [----] I, [2016-09-13T11:34:25.882202 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80226], State: [ok], Delivered in [0.00309672] seconds [----] I, [2016-09-13T11:34:25.912246 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80227], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.710778706] seconds [----] I, [2016-09-13T11:34:25.912404 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80227], Delivering... [----] I, [2016-09-13T11:34:25.916472 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80227], State: [ok], Delivered in [0.00402446] seconds [----] I, [2016-09-13T11:34:26.347453 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:26.645173 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:26.645482 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:27.142105 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:27.436129 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:27.436328 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:27.937121 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:28.267491 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:28.267755 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:28.821338 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:29.132320 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:29.132610 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:29.586842 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:29.904701 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:29.904809 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:30.384493 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:30.679703 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:30.679824 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:31.179405 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:31.494857 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:31.495098 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:31.961999 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:32.159578 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:32.289711 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:32.432602 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:32.577729 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:32.716233 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:32.850468 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:32.988961 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:33.131123 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:33.271768 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:33.409887 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:33.542361 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:33.691589 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:33.838705 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:34.006017 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:34.439916 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:34.602850 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:34.740460 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:34.907890 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:35.047606 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:35.200584 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:35.334864 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:35.474252 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:35.617885 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:35.756051 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:35.898388 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:36.050547 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:36.187025 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:36.257869 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:34:36.278055 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80229], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:34:36.323274 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:36.464170 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:36.598638 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:36.736105 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:36.780147 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:34:36.784510 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004629373550415039, :worker_monitor=>1.461604118347168, :worker_dequeue=>0.00914764404296875, :total_time=>1.475717544555664} [----] I, [2016-09-13T11:34:36.964869 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80229], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.702295516] seconds [----] I, [2016-09-13T11:34:36.965201 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80229], Delivering... [----] I, [2016-09-13T11:34:36.975262 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005262136459350586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005289554595947266, :pending_vm_jobs=>0.0013022422790527344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009413957595825195} [----] I, [2016-09-13T11:34:36.975723 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80229], State: [ok], Delivered in [0.010551232] seconds [----] I, [2016-09-13T11:34:37.200530 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:37.368782 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:37.532409 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:37.707797 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:37.852406 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:37.995329 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:38.174192 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:38.375167 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:38.508136 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:38.651657 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:38.787911 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:38.927548 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:39.064133 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:39.198387 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:39.346340 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:39.481201 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:39.614702 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:39.939594 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:40.085786 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:40.225875 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:40.362206 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:40.500143 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:40.640648 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:40.773952 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:40.918584 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:41.058910 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:41.211957 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:41.362816 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:41.512462 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:41.662780 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:41.800622 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:41.941448 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:42.083125 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:42.221671 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:42.771929 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:42.916253 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:43.050169 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:43.189544 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:43.327628 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:43.464873 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:43.596312 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:43.734625 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:43.882144 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:44.016033 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:44.160228 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:44.296627 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:44.436681 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:44.587967 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:44.727631 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:44.894926 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:45.029045 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:45.599111 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:45.753062 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:45.891640 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:46.029753 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:46.164796 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:46.307879 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:46.461528 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:46.596996 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:46.738745 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:46.878305 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:47.020032 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:47.165692 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:47.299370 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:47.464063 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:47.629851 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:47.772469 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:47.937278 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:48.762197 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:48.958370 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:49.098827 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:49.242580 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:49.385905 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:49.528468 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:49.673404 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:49.826879 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:49.974896 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:50.128017 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:50.298857 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:50.443289 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:50.591628 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:50.730548 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:50.911696 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:51.047047 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:51.238216 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:51.288604 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:34:51.318968 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80230], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:34:51.341340 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80231], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:34:51.740187 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:51.898268 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:52.045321 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:52.182575 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:52.331053 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:52.467637 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:52.612999 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:52.748999 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:52.884382 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:53.035273 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:53.178842 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:53.312075 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:53.352587 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:34:53.357381 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004688739776611328, :worker_monitor=>1.3394908905029297, :worker_dequeue=>0.011289834976196289, :total_time=>1.355900526046753} [----] I, [2016-09-13T11:34:53.450019 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:53.598126 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:53.740867 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:53.910368 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:34:54.073155 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80231], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.748105396] seconds [----] I, [2016-09-13T11:34:54.073378 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80231], Delivering... [----] I, [2016-09-13T11:34:54.080514 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003756284713745117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003779172897338867, :pending_vm_jobs=>0.0008668899536132812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006649971008300781} [----] I, [2016-09-13T11:34:54.080905 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80231], State: [ok], Delivered in [0.007514008] seconds [----] I, [2016-09-13T11:34:56.015812 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80230], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.722380477] seconds [----] I, [2016-09-13T11:34:56.016020 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80230], Delivering... [----] I, [2016-09-13T11:34:56.022332 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80230], State: [ok], Delivered in [0.006267078] seconds [----] I, [2016-09-13T11:34:58.357918 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:34:58 UTC]... [----] I, [2016-09-13T11:34:58.369512 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:34:58 UTC]...Complete [----] I, [2016-09-13T11:35:00.079062 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:00.615624 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:00.906039 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:01.075871 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:01.230805 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:01.375325 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:01.524666 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:01.675556 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:01.814861 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:01.949778 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:02.110320 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:02.249345 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:02.386612 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:02.519638 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:02.664096 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:02.800319 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:02.942051 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:03.096114 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:03.466146 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:03.619188 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:03.761703 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:03.903783 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:04.040068 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:04.180562 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:04.343766 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:04.484833 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:04.628737 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:04.778836 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:04.919195 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:05.057156 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:05.197647 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:05.332235 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:05.466410 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:05.600468 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:05.735155 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:06.196696 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:06.352743 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:35:06.363964 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80232], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:35:06.370494 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:06.516186 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:06.667662 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:06.810267 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:06.948295 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:07.082581 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:07.223156 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:07.368455 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:07.506231 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:07.645322 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:07.781402 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:07.915937 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:08.049127 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:08.187028 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:08.347224 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:08.487495 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:08.828288 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:08.979801 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:09.125389 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:09.262839 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:09.407767 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:09.483661 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:35:09.488059 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0032563209533691406, :worker_monitor=>1.077221155166626, :worker_dequeue=>0.009562015533447266, :total_time=>1.0904364585876465} [----] I, [2016-09-13T11:35:09.544481 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:09.682690 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:09.823512 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:09.962220 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:10.096581 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:10.227780 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80232], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.870398203] seconds [----] I, [2016-09-13T11:35:10.228053 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80232], Delivering... [----] I, [2016-09-13T11:35:10.234676 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:10.236808 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003319263458251953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033440589904785156, :pending_vm_jobs=>0.0013837814331054688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008119344711303711} [----] I, [2016-09-13T11:35:10.237273 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80232], State: [ok], Delivered in [0.009207377] seconds [----] I, [2016-09-13T11:35:10.375064 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:10.510377 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:10.651039 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:10.784137 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:16.940102 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:17.076672 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:17.481797 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:17.623974 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:17.762801 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:17.900833 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:18.036123 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:18.179535 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:18.331911 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:18.465692 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:18.605726 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:18.745069 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:18.877613 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:19.013672 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:19.155324 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:19.299211 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:19.492203 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:19.633000 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:19.773909 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:20.232105 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:20.378964 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:20.527244 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:20.661692 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:20.806567 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:20.941727 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:21.081396 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:21.212743 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:21.368799 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:21.374876 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:35:21.393016 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80233], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:35:21.410049 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80234], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:35:21.432974 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80235], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:35:21.457106 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80236], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:35:21.511197 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:21.651219 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:21.797535 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:21.936730 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:22.074774 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:22.216736 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:22.352553 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:35:22.501479 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T11:35:22.710477 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T11:35:22.710836 #24051:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T11:35:22.711160 #24051:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T11:35:22.711265 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T11:35:22.711386 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T11:35:22.735962 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T11:35:22.736386 #24051:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [80224], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T11:35:22.736674 #24051:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T11:35:22.736905 #24051:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T11:35:22.737108 #24051:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80224], State: [error], Delivered in [62.646591324] seconds [----] I, [2016-09-13T11:35:25.794218 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:35:25.797901 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004033565521240234, :worker_monitor=>1.2632713317871094, :worker_dequeue=>0.0074024200439453125, :total_time=>1.2750298976898193} [----] I, [2016-09-13T11:35:26.090756 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80233], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.710804983] seconds [----] I, [2016-09-13T11:35:26.090989 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80233], Delivering... [----] I, [2016-09-13T11:35:26.113234 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80236], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.673904799] seconds [----] I, [2016-09-13T11:35:26.113379 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80236], Delivering... [----] I, [2016-09-13T11:35:26.119096 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002700328826904297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002715587615966797, :pending_vm_jobs=>0.0006220340728759766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005327701568603516} [----] I, [2016-09-13T11:35:26.119477 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80236], State: [ok], Delivered in [0.006084998] seconds [----] I, [2016-09-13T11:35:26.145206 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80234], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.746060332] seconds [----] I, [2016-09-13T11:35:26.145485 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80234], Delivering... [----] I, [2016-09-13T11:35:26.148997 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80234], State: [ok], Delivered in [0.003542279] seconds [----] I, [2016-09-13T11:35:26.164587 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80233], State: [ok], Delivered in [0.073593875] seconds [----] I, [2016-09-13T11:35:26.193624 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80235], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.774820372] seconds [----] I, [2016-09-13T11:35:26.193870 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80235], Delivering... [----] I, [2016-09-13T11:35:26.199145 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80235], State: [ok], Delivered in [0.00527258] seconds [----] I, [2016-09-13T11:35:30.798522 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:35:30 UTC]... [----] I, [2016-09-13T11:35:30.821811 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:35:30 UTC]...Complete [----] I, [2016-09-13T11:35:36.471067 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:35:36.503824 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80237], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:35:42.074659 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:35:42.077175 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004118680953979492, :worker_monitor=>1.2173194885253906, :worker_dequeue=>0.005395650863647461, :total_time=>1.2271244525909424} [----] I, [2016-09-13T11:35:42.413151 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80237], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.935296446] seconds [----] I, [2016-09-13T11:35:42.413304 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80237], Delivering... [----] I, [2016-09-13T11:35:42.417460 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002234220504760742, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022461414337158203, :pending_vm_jobs=>0.0004975795745849609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038366317749023438} [----] I, [2016-09-13T11:35:42.417737 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80237], State: [ok], Delivered in [0.004435202] seconds [----] I, [2016-09-13T11:35:51.526061 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:35:51.541723 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80238], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:35:51.555778 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80239], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:35:52.238723 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:35:52.548031 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80239], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.000716475] seconds [----] I, [2016-09-13T11:35:52.548259 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80239], Delivering... [----] I, [2016-09-13T11:35:52.554498 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003300189971923828, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033197402954101562, :pending_vm_jobs=>0.0007698535919189453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057833194732666016} [----] I, [2016-09-13T11:35:52.554836 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80239], State: [ok], Delivered in [0.00658766] seconds [----] I, [2016-09-13T11:35:53.303741 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80238], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.771927915] seconds [----] I, [2016-09-13T11:35:53.303957 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80238], Delivering... [----] I, [2016-09-13T11:35:53.309056 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80238], State: [ok], Delivered in [0.005092075] seconds [----] I, [2016-09-13T11:35:58.409861 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005110979080200195, :worker_monitor=>1.156325101852417, :worker_dequeue=>0.005196332931518555, :total_time=>1.166954755783081} [----] I, [2016-09-13T11:36:03.410246 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:36:03 UTC]... [----] I, [2016-09-13T11:36:03.426051 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:36:03 UTC]...Complete [----] I, [2016-09-13T11:36:03.442464 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T11:36:06.569934 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:36:06.588923 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80240], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:36:08.467144 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:36:08.675062 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80240], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.09871623] seconds [----] I, [2016-09-13T11:36:08.675322 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80240], Delivering... [----] I, [2016-09-13T11:36:08.681837 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003363370895385742, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033822059631347656, :pending_vm_jobs=>0.0008592605590820312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006098747253417969} [----] I, [2016-09-13T11:36:08.682198 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80240], State: [ok], Delivered in [0.006886672] seconds [----] I, [2016-09-13T11:36:14.838606 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004722118377685547, :worker_monitor=>1.3486521244049072, :worker_dequeue=>0.00951242446899414, :total_time=>1.3633232116699219} [----] I, [2016-09-13T11:36:21.601756 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:36:21.630806 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80241], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:36:21.647682 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80242], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:36:21.670727 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80243], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:36:21.693693 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80244], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:36:24.869457 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:36:25.814410 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80241], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.203148009] seconds [----] I, [2016-09-13T11:36:25.814771 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80241], Delivering... [----] I, [2016-09-13T11:36:25.832827 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80244], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.156174159] seconds [----] I, [2016-09-13T11:36:25.833043 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80244], Delivering... [----] I, [2016-09-13T11:36:25.839908 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037386417388916016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003758668899536133, :pending_vm_jobs=>0.0007970333099365234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006457090377807617} [----] I, [2016-09-13T11:36:25.840297 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80244], State: [ok], Delivered in [0.007254912] seconds [----] I, [2016-09-13T11:36:25.864904 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80241], State: [ok], Delivered in [0.050132541] seconds [----] I, [2016-09-13T11:36:26.425835 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80242], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.789184408] seconds [----] I, [2016-09-13T11:36:26.426062 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80242], Delivering... [----] I, [2016-09-13T11:36:26.434036 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80242], State: [ok], Delivered in [0.007957584] seconds [----] I, [2016-09-13T11:36:26.471246 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80243], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.815235778] seconds [----] I, [2016-09-13T11:36:26.471511 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80243], Delivering... [----] I, [2016-09-13T11:36:26.476401 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80243], State: [ok], Delivered in [0.004872858] seconds [----] I, [2016-09-13T11:36:35.840106 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:36:35 UTC]... [----] I, [2016-09-13T11:36:35.861395 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:36:35 UTC]...Complete [----] I, [2016-09-13T11:36:36.707885 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:36:36.753915 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80245], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:36:40.888240 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:36:40.959056 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80245], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.242641473] seconds [----] I, [2016-09-13T11:36:40.959272 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80245], Delivering... [----] I, [2016-09-13T11:36:40.965929 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034821033477783203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003503561019897461, :pending_vm_jobs=>0.0008289813995361328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006263256072998047} [----] I, [2016-09-13T11:36:40.966324 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80245], State: [ok], Delivered in [0.007047058] seconds [----] I, [2016-09-13T11:36:47.318145 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004484891891479492, :worker_monitor=>1.4112775325775146, :worker_dequeue=>0.008519887924194336, :total_time=>1.4246361255645752} [----] I, [2016-09-13T11:36:51.769640 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:36:51.783747 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80246], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:36:51.804814 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80247], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:36:52.398460 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:36:53.078687 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80247], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.287813703] seconds [----] I, [2016-09-13T11:36:53.078814 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80247], Delivering... [----] I, [2016-09-13T11:36:53.082661 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021393299102783203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021562576293945312, :pending_vm_jobs=>0.00044798851013183594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0036072731018066406} [----] I, [2016-09-13T11:36:53.082904 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80247], State: [ok], Delivered in [0.004091267] seconds [----] I, [2016-09-13T11:36:53.553021 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80246], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.77886533] seconds [----] I, [2016-09-13T11:36:53.553216 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80246], Delivering... [----] I, [2016-09-13T11:36:53.557286 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80246], State: [ok], Delivered in [0.004063131] seconds [----] I, [2016-09-13T11:37:03.833087 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038895606994628906, :worker_monitor=>1.4015858173370361, :worker_dequeue=>0.008670568466186523, :total_time=>1.414414644241333} [----] I, [2016-09-13T11:37:06.819658 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:37:06.839757 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80248], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:37:08.833635 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:37:08 UTC]... [----] I, [2016-09-13T11:37:08.850169 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:37:08 UTC]...Complete [----] I, [2016-09-13T11:37:08.860557 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:37:09.181972 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80248], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.355652204] seconds [----] I, [2016-09-13T11:37:09.182193 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80248], Delivering... [----] I, [2016-09-13T11:37:09.188020 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002985239028930664, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030031204223632812, :pending_vm_jobs=>0.0007073879241943359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00543522834777832} [----] I, [2016-09-13T11:37:09.188347 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80248], State: [ok], Delivered in [0.00615651] seconds [----] I, [2016-09-13T11:37:20.338690 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004144906997680664, :worker_monitor=>1.4451603889465332, :worker_dequeue=>0.010029315948486328, :total_time=>1.4596831798553467} [----] I, [2016-09-13T11:37:21.852491 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:37:21.879300 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80249], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:37:21.902308 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80250], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:37:21.931009 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80251], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:37:21.947954 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80252], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:37:25.348741 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:37:25.685214 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80249], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.827953327] seconds [----] I, [2016-09-13T11:37:25.685396 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80249], Delivering... [----] I, [2016-09-13T11:37:25.736270 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80249], State: [ok], Delivered in [0.05082328] seconds [----] I, [2016-09-13T11:37:25.771091 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80252], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.833143032] seconds [----] I, [2016-09-13T11:37:25.771279 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80252], Delivering... [----] I, [2016-09-13T11:37:25.777522 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003254413604736328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032770633697509766, :pending_vm_jobs=>0.0008053779602050781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005854129791259766} [----] I, [2016-09-13T11:37:25.777864 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80252], State: [ok], Delivered in [0.006574521] seconds [----] I, [2016-09-13T11:37:26.656555 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80250], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.771690178] seconds [----] I, [2016-09-13T11:37:26.656748 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80250], Delivering... [----] I, [2016-09-13T11:37:26.659762 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80250], State: [ok], Delivered in [0.002995717] seconds [----] I, [2016-09-13T11:37:26.684941 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80251], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.77294147] seconds [----] I, [2016-09-13T11:37:26.685122 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80251], Delivering... [----] I, [2016-09-13T11:37:26.688990 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80251], State: [ok], Delivered in [0.003864434] seconds [----] I, [2016-09-13T11:37:36.671252 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004434347152709961, :worker_monitor=>1.2880678176879883, :worker_dequeue=>0.009928226470947266, :total_time=>1.3027873039245605} [----] I, [2016-09-13T11:37:36.962453 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:37:36.982486 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80253], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:37:41.671824 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:37:41 UTC]... [----] I, [2016-09-13T11:37:41.691064 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:37:41 UTC]...Complete [----] I, [2016-09-13T11:37:41.703984 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:37:41.896846 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80253], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.927537296] seconds [----] I, [2016-09-13T11:37:41.897093 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80253], Delivering... [----] I, [2016-09-13T11:37:41.903387 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026814937591552734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027022361755371094, :pending_vm_jobs=>0.0009548664093017578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005833864212036133} [----] I, [2016-09-13T11:37:41.903796 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80253], State: [ok], Delivered in [0.00671933] seconds [----] I, [2016-09-13T11:37:51.996927 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:37:52.016916 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80254], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:37:52.039889 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80255], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:37:52.845147 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:37:52.847919 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004701375961303711, :worker_monitor=>1.1198687553405762, :worker_dequeue=>0.006151676177978516, :total_time=>1.1310288906097412} [----] I, [2016-09-13T11:37:52.978212 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80255], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.956281727] seconds [----] I, [2016-09-13T11:37:52.978360 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80255], Delivering... [----] I, [2016-09-13T11:37:52.983166 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025429725646972656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025777816772460938, :pending_vm_jobs=>0.0006034374237060547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004494190216064453} [----] I, [2016-09-13T11:37:52.983402 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80255], State: [ok], Delivered in [0.005043711] seconds [----] I, [2016-09-13T11:37:54.088031 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80254], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.086896456] seconds [----] I, [2016-09-13T11:37:54.088377 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80254], Delivering... [----] I, [2016-09-13T11:37:54.097260 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80254], State: [ok], Delivered in [0.008881772] seconds [----] I, [2016-09-13T11:38:07.051006 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:38:07.068674 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80256], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:38:09.389334 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:38:09.392465 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039021968841552734, :worker_monitor=>1.3936381340026855, :worker_dequeue=>0.007090568542480469, :total_time=>1.404892921447754} [----] I, [2016-09-13T11:38:10.137220 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80256], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.080134844] seconds [----] I, [2016-09-13T11:38:10.137363 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80256], Delivering... [----] I, [2016-09-13T11:38:10.141836 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002453327178955078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024802684783935547, :pending_vm_jobs=>0.0005338191986083984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0041620731353759766} [----] I, [2016-09-13T11:38:10.142123 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80256], State: [ok], Delivered in [0.004748712] seconds [----] I, [2016-09-13T11:38:14.392968 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:38:14 UTC]... [----] I, [2016-09-13T11:38:14.405645 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:38:14 UTC]...Complete [----] I, [2016-09-13T11:38:22.078203 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:38:22.091431 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80257], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:38:22.102525 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80258], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:38:22.114180 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80259], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:38:22.126412 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80260], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:38:25.342328 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:38:26.241294 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80257], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.160160723] seconds [----] I, [2016-09-13T11:38:26.241514 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80257], Delivering... [----] I, [2016-09-13T11:38:26.264937 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80260], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.147180419] seconds [----] I, [2016-09-13T11:38:26.265145 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80260], Delivering... [----] I, [2016-09-13T11:38:26.272524 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036749839782714844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037004947662353516, :pending_vm_jobs=>0.0008959770202636719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006886720657348633} [----] I, [2016-09-13T11:38:26.272945 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80260], State: [ok], Delivered in [0.007788402] seconds [----] I, [2016-09-13T11:38:26.292173 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80257], State: [ok], Delivered in [0.050651707] seconds [----] I, [2016-09-13T11:38:27.207197 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80258], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.112242951] seconds [----] I, [2016-09-13T11:38:27.207455 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80258], Delivering... [----] I, [2016-09-13T11:38:27.222242 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80258], State: [ok], Delivered in [0.014822362] seconds [----] I, [2016-09-13T11:38:27.229912 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80259], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.122748492] seconds [----] I, [2016-09-13T11:38:27.230123 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80259], Delivering... [----] I, [2016-09-13T11:38:27.235133 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80259], State: [ok], Delivered in [0.005000321] seconds [----] I, [2016-09-13T11:38:37.137553 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:38:37.161141 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80261], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:38:37.178226 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80262], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:38:37.207128 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80263], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:38:41.827618 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:38:41.831884 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004033327102661133, :worker_monitor=>1.4378855228424072, :worker_dequeue=>0.00971674919128418, :total_time=>1.4519293308258057} [----] I, [2016-09-13T11:38:42.310089 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80261], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.16480174] seconds [----] I, [2016-09-13T11:38:42.310281 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80261], Delivering... [----] I, [2016-09-13T11:38:42.315655 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80262], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.150641976] seconds [----] I, [2016-09-13T11:38:42.315851 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80262], Delivering... [----] I, [2016-09-13T11:38:42.317258 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T11:38:42.317571 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4601573376 [----] I, [2016-09-13T11:38:42.317701 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4364713984 [----] I, [2016-09-13T11:38:42.317796 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 236859392 [----] I, [2016-09-13T11:38:42.317874 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T11:38:42.317944 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4307947520 [----] I, [2016-09-13T11:38:42.318021 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T11:38:42.318111 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T11:38:42.318182 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 559546368 [----] I, [2016-09-13T11:38:42.318121 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004254579544067383, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004282474517822266, :pending_vm_jobs=>0.0009932518005371094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00740814208984375} [----] I, [2016-09-13T11:38:42.318254 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T11:38:42.318325 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6840483840 [----] I, [2016-09-13T11:38:42.318396 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T11:38:42.318459 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80261], State: [ok], Delivered in [0.008152146] seconds [----] I, [2016-09-13T11:38:42.318514 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T11:38:42.318592 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T11:38:42.318658 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 12288 [----] I, [2016-09-13T11:38:42.318729 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T11:38:42.318800 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T11:38:42.318874 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T11:38:42.318946 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T11:38:42.319017 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T11:38:42.319124 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T11:38:42.319239 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272142336 [----] I, [2016-09-13T11:38:42.319367 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55017472 [----] I, [2016-09-13T11:38:42.319466 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217124864 [----] I, [2016-09-13T11:38:42.319561 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6144000 [----] I, [2016-09-13T11:38:42.319643 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142823424 [----] I, [2016-09-13T11:38:42.319715 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3381211136 [----] I, [2016-09-13T11:38:42.319786 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3061727232 [----] I, [2016-09-13T11:38:42.319864 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T11:38:42.319935 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T11:38:42.320008 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T11:38:42.320095 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37502976 [----] I, [2016-09-13T11:38:42.320171 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76959744 [----] I, [2016-09-13T11:38:42.320247 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49848320 [----] I, [2016-09-13T11:38:42.320317 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111783936 [----] I, [2016-09-13T11:38:42.320388 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126808064 [----] I, [2016-09-13T11:38:42.320487 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T11:38:42.320566 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T11:38:42.320642 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T11:38:42.320717 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T11:38:42.320803 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T11:38:42.320877 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T11:38:42.320947 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T11:38:42.321011 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T11:38:42.321085 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T11:38:42.387171 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T11:38:42.387406 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T11:38:42.391104 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T11:38:42.393899 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T11:38:42.397269 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T11:38:42.400525 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T11:38:42.403703 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T11:38:42.406754 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 856 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T11:38:42.409652 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T11:38:42.412636 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T11:38:42.415518 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T11:38:42.418576 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T11:38:42.421493 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T11:38:42.424475 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T11:38:42.427655 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:38:42.427842 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:38:42.427938 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T11:38:42.432220 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [155249.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:38:42.432556 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80262], State: [ok], Delivered in [0.11669452] seconds [----] I, [2016-09-13T11:38:46.832469 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:38:46 UTC]... [----] I, [2016-09-13T11:38:46.858203 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:38:46 UTC]...Complete [----] I, [2016-09-13T11:38:46.869668 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:38:47.418322 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80263], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [10.234617935] seconds [----] I, [2016-09-13T11:38:47.418465 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80263], Delivering... [----] I, [2016-09-13T11:38:47.424687 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:38:33 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213440000], Memory % [3.51], CPU Time [50125.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T11:38:47.425226 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:38:40 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163162000], Memory % [3.1], CPU Time [38877.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T11:38:47.425702 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:38:39 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359292000], Memory % [5.28], CPU Time [208008.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T11:38:47.426056 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:38:41 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [154405.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:38:47.426339 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:38:41 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [155255.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:38:47.426658 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:38:41 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [52809.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:38:47.426971 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:38:37 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208116000], Memory % [3.52], CPU Time [245993.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T11:38:47.427289 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:38:38 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347857000], Memory % [5.04], CPU Time [106378.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T11:38:47.429143 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:38:33 UTC], Process Info: Memory Usage [624365568], Memory Size [1090138112], Proportional Set Size: [464977000], Memory % [7.61], CPU Time [409.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T11:38:47.430450 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:38:33 UTC], Process Info: Memory Usage [601960448], Memory Size [959623168], Proportional Set Size: [445223000], Memory % [7.34], CPU Time [834.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T11:38:47.430807 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:38:39 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358591000], Memory % [5.27], CPU Time [215382.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T11:38:47.431130 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:38:41 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [52760.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:38:47.431408 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:38:40 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166761000], Memory % [3.16], CPU Time [39800.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T11:38:47.431937 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80263], State: [ok], Delivered in [0.013469807] seconds [----] I, [2016-09-13T11:38:52.218205 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:38:52.235369 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80264], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:38:52.258470 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80265], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:38:58.152832 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:38:58.156504 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002521514892578125, :worker_monitor=>1.2623813152313232, :worker_dequeue=>0.008847713470458984, :total_time=>1.2740025520324707} [----] I, [2016-09-13T11:38:58.533028 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80265], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.291200787] seconds [----] I, [2016-09-13T11:38:58.533255 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80265], Delivering... [----] I, [2016-09-13T11:38:58.540219 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003566741943359375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035893917083740234, :pending_vm_jobs=>0.0008203983306884766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006489276885986328} [----] I, [2016-09-13T11:38:58.540617 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80265], State: [ok], Delivered in [0.007357223] seconds [----] I, [2016-09-13T11:39:00.436806 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80264], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.215038607] seconds [----] I, [2016-09-13T11:39:00.436991 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80264], Delivering... [----] I, [2016-09-13T11:39:00.441841 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80264], State: [ok], Delivered in [0.004842681] seconds [----] I, [2016-09-13T11:39:07.269599 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:39:07.292773 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80266], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:39:08.292537 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:39:08.647394 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80266], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.370054384] seconds [----] I, [2016-09-13T11:39:08.647632 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80266], Delivering... [----] I, [2016-09-13T11:39:08.655601 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0040705204010009766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004098176956176758, :pending_vm_jobs=>0.0010025501251220703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007464170455932617} [----] I, [2016-09-13T11:39:08.656023 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80266], State: [ok], Delivered in [0.008376025] seconds [----] I, [2016-09-13T11:39:14.528195 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004107475280761719, :worker_monitor=>1.2136671543121338, :worker_dequeue=>0.012163400650024414, :total_time=>1.2302770614624023} [----] I, [2016-09-13T11:39:19.528847 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:39:19 UTC]... [----] I, [2016-09-13T11:39:19.552916 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:39:19 UTC]...Complete [----] I, [2016-09-13T11:39:22.301801 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:39:22.321672 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80267], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:39:22.338668 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80268], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:39:22.355506 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80269], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:39:22.378596 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80270], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:39:24.584280 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:39:24.761391 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80267], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.455316415] seconds [----] I, [2016-09-13T11:39:24.761614 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80267], Delivering... [----] I, [2016-09-13T11:39:24.790223 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80270], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.42887329] seconds [----] I, [2016-09-13T11:39:24.790401 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80270], Delivering... [----] I, [2016-09-13T11:39:24.796916 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033397674560546875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003408670425415039, :pending_vm_jobs=>0.0007848739624023438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006114482879638672} [----] I, [2016-09-13T11:39:24.797307 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80270], State: [ok], Delivered in [0.006898282] seconds [----] I, [2016-09-13T11:39:24.830153 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80267], State: [ok], Delivered in [0.068528366] seconds [----] I, [2016-09-13T11:39:27.533482 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80268], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.206074288] seconds [----] I, [2016-09-13T11:39:27.533696 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80268], Delivering... [----] I, [2016-09-13T11:39:27.537507 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80268], State: [ok], Delivered in [0.003796787] seconds [----] I, [2016-09-13T11:39:27.590700 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80269], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.243658815] seconds [----] I, [2016-09-13T11:39:27.590926 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80269], Delivering... [----] I, [2016-09-13T11:39:27.598653 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80269], State: [ok], Delivered in [0.007678564] seconds [----] I, [2016-09-13T11:39:30.623454 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036830902099609375, :worker_monitor=>1.024595022201538, :worker_dequeue=>0.006783485412597656, :total_time=>1.0353419780731201} [----] I, [2016-09-13T11:39:37.394476 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:39:37.413011 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80271], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:39:40.644688 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:39:40.933846 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80271], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.533402724] seconds [----] I, [2016-09-13T11:39:40.934130 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80271], Delivering... [----] I, [2016-09-13T11:39:40.944723 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005237102508544922, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005274772644042969, :pending_vm_jobs=>0.0014069080352783203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.01004481315612793} [----] I, [2016-09-13T11:39:40.945247 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80271], State: [ok], Delivered in [0.011126962] seconds [----] I, [2016-09-13T11:39:46.813297 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.013914346694946289, :worker_monitor=>1.1421277523040771, :worker_dequeue=>0.008509635925292969, :total_time=>1.164961576461792} [----] I, [2016-09-13T11:39:51.813994 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:39:51 UTC]... [----] I, [2016-09-13T11:39:51.843340 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:39:51 UTC]...Complete [----] I, [2016-09-13T11:39:52.424478 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:39:52.441813 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80272], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:39:52.460452 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80273], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:39:56.869295 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:39:57.083478 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80273], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.636634812] seconds [----] I, [2016-09-13T11:39:57.083712 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80273], Delivering... [----] I, [2016-09-13T11:39:57.090824 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037746429443359375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037996768951416016, :pending_vm_jobs=>0.0008599758148193359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006630659103393555} [----] I, [2016-09-13T11:39:57.091199 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80273], State: [ok], Delivered in [0.007490804] seconds [----] I, [2016-09-13T11:39:57.676396 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80272], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.247978315] seconds [----] I, [2016-09-13T11:39:57.676619 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80272], Delivering... [----] I, [2016-09-13T11:39:57.681479 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80272], State: [ok], Delivered in [0.004840893] seconds [----] I, [2016-09-13T11:40:03.156316 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0027627944946289062, :worker_monitor=>1.271651029586792, :worker_dequeue=>0.00836801528930664, :total_time=>1.283043384552002} [----] I, [2016-09-13T11:40:07.473679 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T11:40:07.498946 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80274], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:40:07.516204 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80275], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:40:07.545574 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80276], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:40:07.561613 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80277], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:40:08.264061 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:40:09.185389 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80274], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.70820893] seconds [----] I, [2016-09-13T11:40:09.185611 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80274], Delivering... [----] I, [2016-09-13T11:40:09.192309 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035104751586914062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035581588745117188, :pending_vm_jobs=>0.0008482933044433594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006306171417236328} [----] I, [2016-09-13T11:40:09.192718 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80274], State: [ok], Delivered in [0.007096772] seconds [----] I, [2016-09-13T11:40:09.733706 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80275], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.231470776] seconds [----] I, [2016-09-13T11:40:09.733894 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80275], Delivering... [----] I, [2016-09-13T11:40:09.736092 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80275], State: [ok], Delivered in [0.002194657] seconds [----] I, [2016-09-13T11:40:09.768162 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80276], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.246716913] seconds [----] I, [2016-09-13T11:40:09.768347 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80276], Delivering... [----] I, [2016-09-13T11:40:09.773287 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80277], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.224112497] seconds [----] I, [2016-09-13T11:40:09.773476 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80277], Delivering... [----] I, [2016-09-13T11:40:09.777934 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80276], State: [ok], Delivered in [0.009546967] seconds [----] I, [2016-09-13T11:40:09.780473 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80277], State: [ok], Delivered in [0.006997537] seconds [----] I, [2016-09-13T11:40:20.236152 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004029512405395508, :worker_monitor=>1.9326131343841553, :worker_dequeue=>0.016405105590820312, :total_time=>1.9533960819244385} [----] I, [2016-09-13T11:40:22.571403 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:40:22.592606 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80278], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:40:22.613686 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80279], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:40:22.636375 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80280], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:40:22.659438 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80281], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:40:25.236715 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:40:25 UTC]... [----] I, [2016-09-13T11:40:25.270716 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:40:25 UTC]...Complete [----] I, [2016-09-13T11:40:25.282453 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:40:25.339428 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80278], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.762695889] seconds [----] I, [2016-09-13T11:40:25.339554 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80278], Delivering... [----] I, [2016-09-13T11:40:25.362567 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80281], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.719345282] seconds [----] I, [2016-09-13T11:40:25.362799 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80281], Delivering... [----] I, [2016-09-13T11:40:25.372768 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004759311676025391, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004790782928466797, :pending_vm_jobs=>0.0012941360473632812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009375810623168945} [----] I, [2016-09-13T11:40:25.373254 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80281], State: [ok], Delivered in [0.010433345] seconds [----] I, [2016-09-13T11:40:25.384909 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80278], State: [ok], Delivered in [0.04531503] seconds [----] I, [2016-09-13T11:40:27.865959 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80279], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.266882506] seconds [----] I, [2016-09-13T11:40:27.866122 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80279], Delivering... [----] I, [2016-09-13T11:40:27.868766 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80279], State: [ok], Delivered in [0.002643478] seconds [----] I, [2016-09-13T11:40:27.877032 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80280], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.254492096] seconds [----] I, [2016-09-13T11:40:27.877329 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80280], Delivering... [----] I, [2016-09-13T11:40:27.885019 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80280], State: [ok], Delivered in [0.007673442] seconds [----] I, [2016-09-13T11:40:36.580717 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0053861141204833984, :worker_monitor=>1.2679798603057861, :worker_dequeue=>0.005303382873535156, :total_time=>1.2790229320526123} [----] I, [2016-09-13T11:40:37.672681 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:40:37.687719 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80282], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:40:41.588598 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:40:42.505113 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80282], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.82663591] seconds [----] I, [2016-09-13T11:40:42.505308 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80282], Delivering... [----] I, [2016-09-13T11:40:42.514491 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003677845001220703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003701925277709961, :pending_vm_jobs=>0.0012960433959960938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008664369583129883} [----] I, [2016-09-13T11:40:42.515019 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80282], State: [ok], Delivered in [0.009675155] seconds [----] I, [2016-09-13T11:40:52.699187 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:40:52.710362 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80283], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:40:52.728448 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80284], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:40:52.785239 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:40:52.792304 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004868268966674805, :worker_monitor=>1.1711652278900146, :worker_dequeue=>0.014333963394165039, :total_time=>1.1906936168670654} [----] I, [2016-09-13T11:40:53.614925 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80284], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.901572871] seconds [----] I, [2016-09-13T11:40:53.615184 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80284], Delivering... [----] I, [2016-09-13T11:40:53.623272 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004305601119995117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004331827163696289, :pending_vm_jobs=>0.001012563705444336, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007611513137817383} [----] I, [2016-09-13T11:40:53.623637 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80284], State: [ok], Delivered in [0.008458393] seconds [----] I, [2016-09-13T11:40:54.979997 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80283], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.277747694] seconds [----] I, [2016-09-13T11:40:54.980186 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80283], Delivering... [----] I, [2016-09-13T11:40:54.984470 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80283], State: [ok], Delivered in [0.004269958] seconds [----] I, [2016-09-13T11:40:57.792833 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:40:57 UTC]... [----] I, [2016-09-13T11:40:57.814051 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:40:57 UTC]...Complete [----] I, [2016-09-13T11:41:07.737311 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:41:07.752545 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80285], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:41:07.859230 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T11:41:09.164709 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:41:09.168573 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003988027572631836, :log_active_servers=>0.011024951934814453, :worker_monitor=>1.3006725311279297, :worker_dequeue=>0.008306741714477539, :total_time=>1.3243613243103027} [----] I, [2016-09-13T11:41:09.740239 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80285], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.997769762] seconds [----] I, [2016-09-13T11:41:09.740386 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80285], Delivering... [----] I, [2016-09-13T11:41:09.744756 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023543834686279297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023870468139648438, :pending_vm_jobs=>0.0005099773406982422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004087924957275391} [----] I, [2016-09-13T11:41:09.745018 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80285], State: [ok], Delivered in [0.004643548] seconds [----] I, [2016-09-13T11:41:22.763324 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:41:22.786586 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80286], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:41:22.803359 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80287], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:41:22.831985 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80288], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:41:22.848760 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80289], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:41:25.514343 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:41:25.518922 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004442930221557617, :worker_monitor=>1.205772876739502, :worker_dequeue=>0.009782075881958008, :total_time=>1.2204313278198242} [----] I, [2016-09-13T11:41:25.866321 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80286], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.095512171] seconds [----] I, [2016-09-13T11:41:25.866510 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80286], Delivering... [----] I, [2016-09-13T11:41:25.925122 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80286], State: [ok], Delivered in [0.058549939] seconds [----] I, [2016-09-13T11:41:25.946228 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80289], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.107621814] seconds [----] I, [2016-09-13T11:41:25.946460 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80289], Delivering... [----] I, [2016-09-13T11:41:25.953494 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003609895706176758, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036628246307373047, :pending_vm_jobs=>0.0008540153503417969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006558656692504883} [----] I, [2016-09-13T11:41:25.953884 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80289], State: [ok], Delivered in [0.007458149] seconds [----] I, [2016-09-13T11:41:28.089890 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80287], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.29564058] seconds [----] I, [2016-09-13T11:41:28.090228 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80287], Delivering... [----] I, [2016-09-13T11:41:28.095954 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80287], State: [ok], Delivered in [0.005719458] seconds [----] I, [2016-09-13T11:41:28.096223 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80288], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.281393631] seconds [----] I, [2016-09-13T11:41:28.096395 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80288], Delivering... [----] I, [2016-09-13T11:41:28.101595 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80288], State: [ok], Delivered in [0.005167476] seconds [----] I, [2016-09-13T11:41:30.519376 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:41:30 UTC]... [----] I, [2016-09-13T11:41:30.534544 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:41:30 UTC]...Complete [----] I, [2016-09-13T11:41:37.861633 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:41:37.877205 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80290], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:41:42.347307 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:41:42.351203 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004723310470581055, :worker_monitor=>1.7778327465057373, :worker_dequeue=>0.008417367935180664, :total_time=>1.7913448810577393} [----] I, [2016-09-13T11:41:43.066681 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80290], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.1989483] seconds [----] I, [2016-09-13T11:41:43.066848 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80290], Delivering... [----] I, [2016-09-13T11:41:43.074482 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003895998001098633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003928184509277344, :pending_vm_jobs=>0.0010464191436767578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007292747497558594} [----] I, [2016-09-13T11:41:43.074942 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80290], State: [ok], Delivered in [0.00806144] seconds [----] I, [2016-09-13T11:41:52.889583 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:41:52.900016 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80291], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:41:52.911100 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80292], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:41:58.488266 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:41:58.490694 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005866527557373047, :worker_monitor=>1.1058552265167236, :worker_dequeue=>0.0054264068603515625, :total_time=>1.1176414489746094} [----] I, [2016-09-13T11:41:59.266526 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80292], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.36105783] seconds [----] I, [2016-09-13T11:41:59.266664 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80292], Delivering... [----] I, [2016-09-13T11:41:59.270590 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002216339111328125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022296905517578125, :pending_vm_jobs=>0.0004525184631347656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0036749839782714844} [----] I, [2016-09-13T11:41:59.270810 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80292], State: [ok], Delivered in [0.00414681] seconds [----] I, [2016-09-13T11:42:01.243036 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80291], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.350483241] seconds [----] I, [2016-09-13T11:42:01.243265 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80291], Delivering... [----] I, [2016-09-13T11:42:01.248536 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80291], State: [ok], Delivered in [0.005262983] seconds [----] I, [2016-09-13T11:42:03.491272 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:42:03 UTC]... [----] I, [2016-09-13T11:42:03.512725 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:42:03 UTC]...Complete [----] I, [2016-09-13T11:42:07.921531 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:42:07.940118 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80293], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:42:08.534726 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:42:09.329305 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80293], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.403869066] seconds [----] I, [2016-09-13T11:42:09.329480 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80293], Delivering... [----] I, [2016-09-13T11:42:09.334908 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025963783264160156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002611875534057617, :pending_vm_jobs=>0.000579833984375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005072355270385742} [----] I, [2016-09-13T11:42:09.335209 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80293], State: [ok], Delivered in [0.005715255] seconds [----] I, [2016-09-13T11:42:14.695171 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0031681060791015625, :worker_monitor=>1.1451327800750732, :worker_dequeue=>0.008918523788452148, :total_time=>1.1574699878692627} [----] I, [2016-09-13T11:42:22.949982 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:42:22.969599 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80294], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:42:22.979936 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80295], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:42:22.997409 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80296], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:42:23.008562 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80297], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:42:24.786626 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:42:25.300560 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80294], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.346350677] seconds [----] I, [2016-09-13T11:42:25.300783 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80294], Delivering... [----] I, [2016-09-13T11:42:25.329271 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80297], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.326599669] seconds [----] I, [2016-09-13T11:42:25.329564 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80297], Delivering... [----] I, [2016-09-13T11:42:25.340077 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005319833755493164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005353689193725586, :pending_vm_jobs=>0.0012898445129394531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00974893569946289} [----] I, [2016-09-13T11:42:25.340568 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80297], State: [ok], Delivered in [0.010998824] seconds [----] I, [2016-09-13T11:42:25.380261 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80295], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.40516627] seconds [----] I, [2016-09-13T11:42:25.380494 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80295], Delivering... [----] I, [2016-09-13T11:42:25.383855 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80295], State: [ok], Delivered in [0.003388007] seconds [----] I, [2016-09-13T11:42:25.391746 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80294], State: [ok], Delivered in [0.09094663] seconds [----] I, [2016-09-13T11:42:25.433605 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80296], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.446651405] seconds [----] I, [2016-09-13T11:42:25.433878 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80296], Delivering... [----] I, [2016-09-13T11:42:25.440657 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80296], State: [ok], Delivered in [0.006765117] seconds [----] I, [2016-09-13T11:42:31.053814 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0043909549713134766, :worker_monitor=>1.2522907257080078, :worker_dequeue=>0.007231950759887695, :total_time=>1.2643940448760986} [----] I, [2016-09-13T11:42:36.054314 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:42:36 UTC]... [----] I, [2016-09-13T11:42:36.072907 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:42:36 UTC]...Complete [----] I, [2016-09-13T11:42:38.019277 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:42:38.032974 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80298], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:42:41.099080 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:42:41.535695 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80298], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.510871793] seconds [----] I, [2016-09-13T11:42:41.535891 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80298], Delivering... [----] I, [2016-09-13T11:42:41.542983 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003262758255004883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003313302993774414, :pending_vm_jobs=>0.0008108615875244141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0067369937896728516} [----] I, [2016-09-13T11:42:41.543356 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80298], State: [ok], Delivered in [0.007456538] seconds [----] I, [2016-09-13T11:42:47.291804 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0061359405517578125, :worker_monitor=>1.172492504119873, :worker_dequeue=>0.00938105583190918, :total_time=>1.1883997917175293} [----] I, [2016-09-13T11:42:53.041991 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:42:53.062816 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80299], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:42:53.084729 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80300], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:42:57.322548 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:42:57.661674 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80300], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.591903223] seconds [----] I, [2016-09-13T11:42:57.661871 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80300], Delivering... [----] I, [2016-09-13T11:42:57.669079 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035774707794189453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036008358001708984, :pending_vm_jobs=>0.0009324550628662109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006777286529541016} [----] I, [2016-09-13T11:42:57.669515 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80300], State: [ok], Delivered in [0.007632755] seconds [----] I, [2016-09-13T11:42:58.530470 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80299], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.483735721] seconds [----] I, [2016-09-13T11:42:58.530644 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80299], Delivering... [----] I, [2016-09-13T11:42:58.534636 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80299], State: [ok], Delivered in [0.003985404] seconds [----] I, [2016-09-13T11:43:03.601085 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005002498626708984, :worker_monitor=>1.258939266204834, :worker_dequeue=>0.010386466979980469, :total_time=>1.2748534679412842} [----] I, [2016-09-13T11:43:08.102551 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:43:08.120879 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80301], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:43:08.601738 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:43:08 UTC]... [----] I, [2016-09-13T11:43:08.615651 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:43:08 UTC]...Complete [----] I, [2016-09-13T11:43:08.626210 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:43:08.782052 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80301], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.673394276] seconds [----] I, [2016-09-13T11:43:08.782255 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80301], Delivering... [----] I, [2016-09-13T11:43:08.788794 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034961700439453125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035316944122314453, :pending_vm_jobs=>0.0007917881011962891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00616908073425293} [----] I, [2016-09-13T11:43:08.789139 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80301], State: [ok], Delivered in [0.006875085] seconds [----] I, [2016-09-13T11:43:20.211720 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005936622619628906, :worker_monitor=>1.5558509826660156, :worker_dequeue=>0.009111642837524414, :total_time=>1.571286916732788} [----] I, [2016-09-13T11:43:23.133225 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:43:23.153346 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80302], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:43:23.193866 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80303], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:43:23.222121 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80304], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:43:23.256509 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80305], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:43:25.307382 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:43:25.631325 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80302], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.492916427] seconds [----] I, [2016-09-13T11:43:25.631569 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80302], Delivering... [----] I, [2016-09-13T11:43:25.651894 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80305], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.42546945] seconds [----] I, [2016-09-13T11:43:25.652126 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80305], Delivering... [----] I, [2016-09-13T11:43:25.659445 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038220882415771484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003849029541015625, :pending_vm_jobs=>0.0009062290191650391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006849765777587891} [----] I, [2016-09-13T11:43:25.660343 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80305], State: [ok], Delivered in [0.00821596] seconds [----] I, [2016-09-13T11:43:25.689591 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80303], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.532089503] seconds [----] I, [2016-09-13T11:43:25.689824 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80303], Delivering... [----] I, [2016-09-13T11:43:25.702403 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80303], State: [ok], Delivered in [0.012554777] seconds [----] I, [2016-09-13T11:43:25.730814 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80302], State: [ok], Delivered in [0.099212754] seconds [----] I, [2016-09-13T11:43:25.739855 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80304], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.536567345] seconds [----] I, [2016-09-13T11:43:25.740100 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80304], Delivering... [----] I, [2016-09-13T11:43:25.745860 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80304], State: [ok], Delivered in [0.005772349] seconds [----] I, [2016-09-13T11:43:36.585165 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003335714340209961, :worker_monitor=>1.2420616149902344, :worker_dequeue=>0.007668495178222656, :total_time=>1.2533199787139893} [----] I, [2016-09-13T11:43:38.269683 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:43:38.300713 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80306], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:43:38.351245 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80307], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:43:38.379696 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80308], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:43:41.585701 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:43:41 UTC]... [----] I, [2016-09-13T11:43:41.625576 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:43:41 UTC]...Complete [----] I, [2016-09-13T11:43:41.637279 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:43:41.979972 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80306], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.704455236] seconds [----] I, [2016-09-13T11:43:41.980203 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80306], Delivering... [----] I, [2016-09-13T11:43:41.988523 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00413966178894043, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0041697025299072266, :pending_vm_jobs=>0.0011792182922363281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007842779159545898} [----] I, [2016-09-13T11:43:41.988932 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80306], State: [ok], Delivered in [0.008720397] seconds [----] I, [2016-09-13T11:43:42.025667 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80308], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.670244342] seconds [----] I, [2016-09-13T11:43:42.025845 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80308], Delivering... [----] I, [2016-09-13T11:43:42.031554 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80307], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.726438942] seconds [----] I, [2016-09-13T11:43:42.031818 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80307], Delivering... [----] I, [2016-09-13T11:43:42.033502 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T11:43:42.033824 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4599119872 [----] I, [2016-09-13T11:43:42.034002 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4362072064 [----] I, [2016-09-13T11:43:42.034073 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:43:35 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163163000], Memory % [3.1], CPU Time [38918.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T11:43:42.034180 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 237047808 [----] I, [2016-09-13T11:43:42.034327 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T11:43:42.034504 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4305371136 [----] I, [2016-09-13T11:43:42.034670 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:43:34 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359294000], Memory % [5.28], CPU Time [208057.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T11:43:42.034662 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T11:43:42.034801 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T11:43:42.034936 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 559706112 [----] I, [2016-09-13T11:43:42.035106 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T11:43:42.035232 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:43:35 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [155311.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:43:42.035262 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6847397888 [----] I, [2016-09-13T11:43:42.035408 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T11:43:42.035611 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T11:43:42.035742 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:43:35 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [154464.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:43:42.035782 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T11:43:42.035935 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 12288 [----] I, [2016-09-13T11:43:42.036102 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T11:43:42.036247 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T11:43:42.036295 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:43:33 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [52857.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:43:42.036386 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T11:43:42.036581 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T11:43:42.036729 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T11:43:42.036835 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:43:23 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208116000], Memory % [3.52], CPU Time [246109.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T11:43:42.036879 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T11:43:42.037020 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272134144 [----] I, [2016-09-13T11:43:42.037198 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55005184 [----] I, [2016-09-13T11:43:42.037347 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217128960 [----] I, [2016-09-13T11:43:42.037391 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:43:27 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347858000], Memory % [5.04], CPU Time [106432.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T11:43:42.037528 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6127616 [----] I, [2016-09-13T11:43:42.037678 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142770176 [----] I, [2016-09-13T11:43:42.037854 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:43:34 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213441000], Memory % [3.51], CPU Time [50162.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T11:43:42.037828 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3384246272 [----] I, [2016-09-13T11:43:42.037992 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3064569856 [----] I, [2016-09-13T11:43:42.038166 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T11:43:42.038319 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T11:43:42.038502 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T11:43:42.038655 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36958208 [----] I, [2016-09-13T11:43:42.038800 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76959744 [----] I, [2016-09-13T11:43:42.038941 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49795072 [----] I, [2016-09-13T11:43:42.039091 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111751168 [----] I, [2016-09-13T11:43:42.039237 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126754816 [----] I, [2016-09-13T11:43:42.039387 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T11:43:42.039578 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T11:43:42.039724 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T11:43:42.039867 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T11:43:42.039999 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T11:43:42.040167 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T11:43:42.040312 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T11:43:42.040494 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T11:43:42.040659 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T11:43:42.040894 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:43:33 UTC], Process Info: Memory Usage [624373760], Memory Size [1090138112], Proportional Set Size: [464989000], Memory % [7.61], CPU Time [421.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T11:43:42.043211 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:43:33 UTC], Process Info: Memory Usage [602353664], Memory Size [975937536], Proportional Set Size: [445625000], Memory % [7.34], CPU Time [846.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T11:43:42.043801 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:43:34 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358593000], Memory % [5.27], CPU Time [215428.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T11:43:42.044335 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:43:36 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [52812.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:43:42.044824 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:43:29 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166762000], Memory % [3.16], CPU Time [39832.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T11:43:42.045306 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80308], State: [ok], Delivered in [0.01945402] seconds [----] I, [2016-09-13T11:43:42.088564 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T11:43:42.088868 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T11:43:42.097926 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T11:43:42.103137 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T11:43:42.108826 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T11:43:42.114635 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T11:43:42.120354 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T11:43:42.125789 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 857 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T11:43:42.129167 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T11:43:42.132528 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T11:43:42.135397 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.8 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T11:43:42.138545 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T11:43:42.141685 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T11:43:42.144860 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T11:43:42.148965 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:43:42.149259 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:43:42.149486 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T11:43:42.157116 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359294000], Memory % [5.28], CPU Time [208047.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T11:43:42.158576 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80307], State: [ok], Delivered in [0.126710718] seconds [----] I, [2016-09-13T11:43:52.702087 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005461454391479492, :worker_monitor=>1.0338854789733887, :worker_dequeue=>0.010098934173583984, :total_time=>1.0498478412628174} [----] I, [2016-09-13T11:43:53.391242 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:43:53.402584 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80309], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:43:53.419828 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80310], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:43:57.710324 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:43:58.203582 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80310], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.79477785] seconds [----] I, [2016-09-13T11:43:58.203864 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80310], Delivering... [----] I, [2016-09-13T11:43:58.213914 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00491786003112793, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0049479007720947266, :pending_vm_jobs=>0.0012731552124023438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009532928466796875} [----] I, [2016-09-13T11:43:58.214462 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80310], State: [ok], Delivered in [0.010564689] seconds [----] I, [2016-09-13T11:43:58.877343 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80309], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.482166724] seconds [----] I, [2016-09-13T11:43:58.877553 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80309], Delivering... [----] I, [2016-09-13T11:43:58.882316 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80309], State: [ok], Delivered in [0.004755859] seconds [----] I, [2016-09-13T11:44:08.489961 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:44:08.511248 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80311], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:44:08.757934 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:44:08.760937 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003970623016357422, :worker_monitor=>1.0241138935089111, :worker_dequeue=>0.00691533088684082, :total_time=>1.0352818965911865} [----] I, [2016-09-13T11:44:09.317739 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80311], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.821729142] seconds [----] I, [2016-09-13T11:44:09.318010 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80311], Delivering... [----] I, [2016-09-13T11:44:09.327726 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004212617874145508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004248619079589844, :pending_vm_jobs=>0.0014772415161132812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009210824966430664} [----] I, [2016-09-13T11:44:09.328305 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80311], State: [ok], Delivered in [0.010251662] seconds [----] I, [2016-09-13T11:44:13.761377 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:44:13 UTC]... [----] I, [2016-09-13T11:44:13.785620 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:44:13 UTC]...Complete [----] I, [2016-09-13T11:44:23.526614 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:44:23.552102 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80312], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:44:23.568755 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80313], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:44:23.591741 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80314], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:44:23.608821 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80315], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:44:25.158600 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:44:25.162521 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005868196487426758, :worker_monitor=>1.3433308601379395, :worker_dequeue=>0.00870203971862793, :total_time=>1.3582019805908203} [----] I, [2016-09-13T11:44:25.471437 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80312], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.937099945] seconds [----] I, [2016-09-13T11:44:25.471562 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80312], Delivering... [----] I, [2016-09-13T11:44:25.494465 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80315], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.893068547] seconds [----] I, [2016-09-13T11:44:25.494648 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80315], Delivering... [----] I, [2016-09-13T11:44:25.501933 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003189563751220703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032117366790771484, :pending_vm_jobs=>0.001115560531616211, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006899595260620117} [----] I, [2016-09-13T11:44:25.502382 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80315], State: [ok], Delivered in [0.007710296] seconds [----] I, [2016-09-13T11:44:25.505428 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80312], State: [ok], Delivered in [0.033830688] seconds [----] I, [2016-09-13T11:44:25.952094 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80313], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.390666806] seconds [----] I, [2016-09-13T11:44:25.952375 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80313], Delivering... [----] I, [2016-09-13T11:44:25.960555 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80313], State: [ok], Delivered in [0.00815834] seconds [----] I, [2016-09-13T11:44:25.985986 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80314], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.403067505] seconds [----] I, [2016-09-13T11:44:25.986199 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80314], Delivering... [----] I, [2016-09-13T11:44:25.991551 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80314], State: [ok], Delivered in [0.005330081] seconds [----] I, [2016-09-13T11:44:38.628659 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:44:38.655151 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80316], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:44:41.265936 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:44:41.643656 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80316], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.00646219] seconds [----] I, [2016-09-13T11:44:41.643870 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80316], Delivering... [----] I, [2016-09-13T11:44:41.651468 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003804445266723633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038313865661621094, :pending_vm_jobs=>0.00099945068359375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007142782211303711} [----] I, [2016-09-13T11:44:41.652019 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80316], State: [ok], Delivered in [0.008102582] seconds [----] I, [2016-09-13T11:44:46.271206 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:44:46 UTC]... [----] I, [2016-09-13T11:44:46.340320 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:44:46 UTC]...Complete [----] I, [2016-09-13T11:44:53.665389 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:44:53.695079 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80317], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:44:53.717585 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80318], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:44:58.023814 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:44:58.030935 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040128231048583984, :worker_monitor=>1.644296407699585, :worker_dequeue=>0.014693498611450195, :total_time=>1.6633493900299072} [----] I, [2016-09-13T11:44:58.766482 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80318], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.064422748] seconds [----] I, [2016-09-13T11:44:58.766711 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80318], Delivering... [----] I, [2016-09-13T11:44:58.773766 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037593841552734375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037794113159179688, :pending_vm_jobs=>0.0009095668792724609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00664210319519043} [----] I, [2016-09-13T11:44:58.774173 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80318], State: [ok], Delivered in [0.007457125] seconds [----] I, [2016-09-13T11:44:59.097679 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80317], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.413343208] seconds [----] I, [2016-09-13T11:44:59.097886 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80317], Delivering... [----] I, [2016-09-13T11:44:59.103177 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80317], State: [ok], Delivered in [0.005282799] seconds [----] I, [2016-09-13T11:45:08.727782 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:45:08.748582 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80319], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:45:13.917398 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:45:14.167732 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80319], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.433836165] seconds [----] I, [2016-09-13T11:45:14.167878 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80319], Delivering... [----] I, [2016-09-13T11:45:14.172837 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002385854721069336, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002402067184448242, :pending_vm_jobs=>0.0005598068237304688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004597902297973633} [----] I, [2016-09-13T11:45:14.175758 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80319], State: [ok], Delivered in [0.007829983] seconds [----] I, [2016-09-13T11:45:18.924884 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:45:18 UTC]... [----] I, [2016-09-13T11:45:18.952838 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:45:18 UTC]...Complete [----] I, [2016-09-13T11:45:23.760500 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:45:23.784660 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80320], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:45:23.807609 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80321], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:45:23.827861 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80322], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:45:23.847834 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80323], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:45:23.974934 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:45:24.987994 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80320], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.220410576] seconds [----] I, [2016-09-13T11:45:24.988189 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80320], Delivering... [----] I, [2016-09-13T11:45:25.002146 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80323], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.168076523] seconds [----] I, [2016-09-13T11:45:25.002297 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80323], Delivering... [----] I, [2016-09-13T11:45:25.008886 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003136157989501953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031578540802001953, :pending_vm_jobs=>0.0009765625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006236076354980469} [----] I, [2016-09-13T11:45:25.009379 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80323], State: [ok], Delivered in [0.007041788] seconds [----] I, [2016-09-13T11:45:25.059549 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80320], State: [ok], Delivered in [0.071299592] seconds [----] I, [2016-09-13T11:45:26.216447 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80321], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.425943814] seconds [----] I, [2016-09-13T11:45:26.216655 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80321], Delivering... [----] I, [2016-09-13T11:45:26.219966 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80321], State: [ok], Delivered in [0.003295771] seconds [----] I, [2016-09-13T11:45:26.233656 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80322], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.417655374] seconds [----] I, [2016-09-13T11:45:26.233923 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80322], Delivering... [----] I, [2016-09-13T11:45:26.240551 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80322], State: [ok], Delivered in [0.006630632] seconds [----] I, [2016-09-13T11:45:30.049161 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003016948699951172, :worker_monitor=>1.0596344470977783, :worker_dequeue=>0.005630970001220703, :total_time=>1.0685358047485352} [----] I, [2016-09-13T11:45:38.862556 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:45:38.893991 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80324], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:45:40.200946 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:45:41.151322 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80324], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.277908848] seconds [----] I, [2016-09-13T11:45:41.151472 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80324], Delivering... [----] I, [2016-09-13T11:45:41.156178 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026526451110839844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026733875274658203, :pending_vm_jobs=>0.0005738735198974609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004468679428100586} [----] I, [2016-09-13T11:45:41.156562 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80324], State: [ok], Delivered in [0.005083629] seconds [----] I, [2016-09-13T11:45:46.459178 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004059314727783203, :worker_monitor=>1.237567663192749, :worker_dequeue=>0.008740663528442383, :total_time=>1.2506914138793945} [----] I, [2016-09-13T11:45:51.459777 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:45:51 UTC]... [----] I, [2016-09-13T11:45:51.482189 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:45:51 UTC]...Complete [----] I, [2016-09-13T11:45:53.908327 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:45:53.939286 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80325], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:45:53.962278 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80326], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:45:56.516131 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:45:57.305381 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80326], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.360591469] seconds [----] I, [2016-09-13T11:45:57.305618 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80326], Delivering... [----] I, [2016-09-13T11:45:57.312369 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034999847412109375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035200119018554688, :pending_vm_jobs=>0.0008740425109863281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006367683410644531} [----] I, [2016-09-13T11:45:57.312793 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80326], State: [ok], Delivered in [0.007168401] seconds [----] I, [2016-09-13T11:45:59.356781 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80325], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.444541289] seconds [----] I, [2016-09-13T11:45:59.356999 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80325], Delivering... [----] I, [2016-09-13T11:45:59.364607 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80325], State: [ok], Delivered in [0.007559697] seconds [----] I, [2016-09-13T11:46:02.667569 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037369728088378906, :worker_monitor=>1.1355094909667969, :worker_dequeue=>0.006663322448730469, :total_time=>1.146195650100708} [----] I, [2016-09-13T11:46:08.974302 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:46:08.991110 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80327], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:46:12.694973 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T11:46:12.700072 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:46:13.402535 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80327], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.421446876] seconds [----] I, [2016-09-13T11:46:13.402745 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80327], Delivering... [----] I, [2016-09-13T11:46:13.409687 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035216808319091797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035402774810791016, :pending_vm_jobs=>0.0008280277252197266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065538883209228516} [----] I, [2016-09-13T11:46:13.410040 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80327], State: [ok], Delivered in [0.0072908] seconds [----] I, [2016-09-13T11:46:18.853310 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004622459411621094, :worker_monitor=>1.1313607692718506, :worker_dequeue=>0.009209871292114258, :total_time=>1.1454968452453613} [----] I, [2016-09-13T11:46:23.853847 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:46:23 UTC]... [----] I, [2016-09-13T11:46:23.874856 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:46:23 UTC]...Complete [----] I, [2016-09-13T11:46:24.001308 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:46:24.024322 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80328], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:46:24.040446 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80329], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:46:24.069266 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80330], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:46:24.080482 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80331], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:46:28.899827 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:46:29.457813 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80328], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.451327034] seconds [----] I, [2016-09-13T11:46:29.457938 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80328], Delivering... [----] I, [2016-09-13T11:46:29.469362 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80331], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.396361554] seconds [----] I, [2016-09-13T11:46:29.469614 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80331], Delivering... [----] I, [2016-09-13T11:46:29.476527 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003675699234008789, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003696441650390625, :pending_vm_jobs=>0.0007784366607666016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006491422653198242} [----] I, [2016-09-13T11:46:29.476922 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80331], State: [ok], Delivered in [0.007300464] seconds [----] I, [2016-09-13T11:46:29.491981 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80328], State: [ok], Delivered in [0.034021427] seconds [----] I, [2016-09-13T11:46:29.509219 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80329], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.481350547] seconds [----] I, [2016-09-13T11:46:29.509391 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80329], Delivering... [----] I, [2016-09-13T11:46:29.512524 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80329], State: [ok], Delivered in [0.003116856] seconds [----] I, [2016-09-13T11:46:29.515094 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80330], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.46978571] seconds [----] I, [2016-09-13T11:46:29.515259 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80330], Delivering... [----] I, [2016-09-13T11:46:29.519446 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80330], State: [ok], Delivered in [0.004160577] seconds [----] I, [2016-09-13T11:46:35.517185 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006676673889160156, :worker_monitor=>1.5951569080352783, :worker_dequeue=>0.010036468505859375, :total_time=>1.6123204231262207} [----] I, [2016-09-13T11:46:39.324204 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:46:39.384506 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80332], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:46:40.650821 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:46:41.572619 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80332], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.203269576] seconds [----] I, [2016-09-13T11:46:41.572802 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80332], Delivering... [----] I, [2016-09-13T11:46:41.578802 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029256343841552734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002944469451904297, :pending_vm_jobs=>0.0010480880737304688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005693912506103516} [----] I, [2016-09-13T11:46:41.579262 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80332], State: [ok], Delivered in [0.006450183] seconds [----] I, [2016-09-13T11:46:51.708899 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005679607391357422, :worker_monitor=>1.0262181758880615, :worker_dequeue=>0.009011507034301758, :total_time=>1.0412774085998535} [----] I, [2016-09-13T11:46:54.395717 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:46:54.412682 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80333], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:46:54.458192 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80334], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:46:56.709303 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:46:56 UTC]... [----] I, [2016-09-13T11:46:56.729122 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:46:56 UTC]...Complete [----] I, [2016-09-13T11:46:56.740209 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:46:57.749976 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80334], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.331541826] seconds [----] I, [2016-09-13T11:46:57.750255 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80334], Delivering... [----] I, [2016-09-13T11:46:57.756250 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031325817108154297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031511783599853516, :pending_vm_jobs=>0.0007457733154296875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005595207214355469} [----] I, [2016-09-13T11:46:57.756580 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80334], State: [ok], Delivered in [0.006342201] seconds [----] I, [2016-09-13T11:46:59.689003 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80333], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.290148394] seconds [----] I, [2016-09-13T11:46:59.689337 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80333], Delivering... [----] I, [2016-09-13T11:46:59.696957 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80333], State: [ok], Delivered in [0.007596143] seconds [----] I, [2016-09-13T11:47:08.260222 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003893613815307617, :worker_monitor=>1.4905157089233398, :worker_dequeue=>0.008484125137329102, :total_time=>1.503279209136963} [----] I, [2016-09-13T11:47:09.466787 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T11:47:09.485538 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80335], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:47:09.496657 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80336], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:47:09.508327 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80337], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:47:13.269329 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:47:13.857443 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80335], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.384780328] seconds [----] I, [2016-09-13T11:47:13.857660 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80335], Delivering... [----] I, [2016-09-13T11:47:13.864382 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003650188446044922, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036711692810058594, :pending_vm_jobs=>0.0007898807525634766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063381195068359375} [----] I, [2016-09-13T11:47:13.864795 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80335], State: [ok], Delivered in [0.007137565] seconds [----] I, [2016-09-13T11:47:13.902880 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80336], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.41118845] seconds [----] I, [2016-09-13T11:47:13.903111 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80336], Delivering... [----] I, [2016-09-13T11:47:13.965928 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80336], State: [ok], Delivered in [0.062822037] seconds [----] I, [2016-09-13T11:47:14.708928 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80337], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.207046889] seconds [----] I, [2016-09-13T11:47:14.709242 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80337], Delivering... [----] I, [2016-09-13T11:47:14.713395 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80337], State: [ok], Delivered in [0.004157827] seconds [----] I, [2016-09-13T11:47:24.360752 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003519773483276367, :worker_monitor=>1.0643117427825928, :worker_dequeue=>0.0047419071197509766, :total_time=>1.0728743076324463} [----] I, [2016-09-13T11:47:24.522814 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:47:24.536863 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80338], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:47:24.548189 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80339], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:47:29.361326 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:47:29 UTC]... [----] I, [2016-09-13T11:47:29.377222 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:47:29 UTC]...Complete [----] I, [2016-09-13T11:47:29.391685 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:47:29.805910 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80339], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.263437656] seconds [----] I, [2016-09-13T11:47:29.806083 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80339], Delivering... [----] I, [2016-09-13T11:47:29.811875 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80338], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.284441264] seconds [----] I, [2016-09-13T11:47:29.812126 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80338], Delivering... [----] I, [2016-09-13T11:47:29.812570 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031309127807617188, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031762123107910156, :pending_vm_jobs=>0.0007178783416748047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00607609748840332} [----] I, [2016-09-13T11:47:29.812953 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80339], State: [ok], Delivered in [0.006861018] seconds [----] I, [2016-09-13T11:47:29.826752 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80338], State: [ok], Delivered in [0.014560004] seconds [----] I, [2016-09-13T11:47:39.562140 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:47:39.583188 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80340], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:47:40.775163 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:47:40.777383 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006055355072021484, :worker_monitor=>1.3543012142181396, :worker_dequeue=>0.004778385162353516, :total_time=>1.365612268447876} [----] I, [2016-09-13T11:47:41.071655 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80340], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.499685216] seconds [----] I, [2016-09-13T11:47:41.071819 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80340], Delivering... [----] I, [2016-09-13T11:47:41.076353 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027914047241210938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028069019317626953, :pending_vm_jobs=>0.0004634857177734375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0042724609375} [----] I, [2016-09-13T11:47:41.076603 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80340], State: [ok], Delivered in [0.004800239] seconds [----] I, [2016-09-13T11:47:54.599313 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:47:54.614438 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80341], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:47:54.632195 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80342], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:47:57.280075 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:47:57.283121 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004012107849121094, :worker_monitor=>1.3295373916625977, :worker_dequeue=>0.006523847579956055, :total_time=>1.3403468132019043} [----] I, [2016-09-13T11:47:58.212010 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80342], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.593889946] seconds [----] I, [2016-09-13T11:47:58.212199 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80342], Delivering... [----] I, [2016-09-13T11:47:58.217480 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027136802673339844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027306079864501953, :pending_vm_jobs=>0.0007040500640869141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0049288272857666016} [----] I, [2016-09-13T11:47:58.217796 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80342], State: [ok], Delivered in [0.005599374] seconds [----] I, [2016-09-13T11:47:59.943701 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80341], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.340258897] seconds [----] I, [2016-09-13T11:47:59.943900 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80341], Delivering... [----] I, [2016-09-13T11:47:59.948865 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80341], State: [ok], Delivered in [0.004950075] seconds [----] I, [2016-09-13T11:48:02.285598 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:48:02 UTC]... [----] I, [2016-09-13T11:48:02.303281 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:48:02 UTC]...Complete [----] I, [2016-09-13T11:48:09.642575 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T11:48:09.676842 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80343], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:48:09.726814 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80344], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:48:09.783908 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80345], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:48:13.319078 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:48:13.377991 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80343], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.727471045] seconds [----] I, [2016-09-13T11:48:13.378142 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80343], Delivering... [----] I, [2016-09-13T11:48:13.382173 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022516250610351562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022644996643066406, :pending_vm_jobs=>0.00042128562927246094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0037746429443359375} [----] I, [2016-09-13T11:48:13.382371 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80343], State: [ok], Delivered in [0.004226708] seconds [----] I, [2016-09-13T11:48:13.410068 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80344], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.719915918] seconds [----] I, [2016-09-13T11:48:13.410206 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80344], Delivering... [----] I, [2016-09-13T11:48:13.449783 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80344], State: [ok], Delivered in [0.039552948] seconds [----] I, [2016-09-13T11:48:14.995659 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80345], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.261741765] seconds [----] I, [2016-09-13T11:48:14.995918 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80345], Delivering... [----] I, [2016-09-13T11:48:15.000118 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80345], State: [ok], Delivered in [0.004159973] seconds [----] I, [2016-09-13T11:48:24.805488 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:48:24.824691 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80346], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:48:24.846632 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80347], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:48:29.638163 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:48:29.640601 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004450082778930664, :worker_monitor=>1.2851355075836182, :worker_dequeue=>0.005466461181640625, :total_time=>1.295375108718872} [----] I, [2016-09-13T11:48:30.044613 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80347], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.210578851] seconds [----] I, [2016-09-13T11:48:30.044778 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80347], Delivering... [----] I, [2016-09-13T11:48:30.049831 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032172203063964844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003237485885620117, :pending_vm_jobs=>0.0005245208740234375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004754781723022461} [----] I, [2016-09-13T11:48:30.050089 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80347], State: [ok], Delivered in [0.005318392] seconds [----] I, [2016-09-13T11:48:30.056002 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80346], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.243491911] seconds [----] I, [2016-09-13T11:48:30.056154 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80346], Delivering... [----] I, [2016-09-13T11:48:30.060444 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80346], State: [ok], Delivered in [0.004236278] seconds [----] I, [2016-09-13T11:48:34.641093 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:48:34 UTC]... [----] I, [2016-09-13T11:48:34.655590 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:48:34 UTC]...Complete [----] I, [2016-09-13T11:48:39.864112 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:48:39.884487 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80348], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:48:39.895691 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80349], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:48:39.907181 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80350], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:48:46.001785 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:48:46.006552 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036225318908691406, :worker_monitor=>1.3104603290557861, :worker_dequeue=>0.010124921798706055, :total_time=>1.3245680332183838} [----] I, [2016-09-13T11:48:46.507900 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80348], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.637902951] seconds [----] I, [2016-09-13T11:48:46.508108 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80348], Delivering... [----] I, [2016-09-13T11:48:46.514742 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003406524658203125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034492015838623047, :pending_vm_jobs=>0.00083160400390625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006235599517822266} [----] I, [2016-09-13T11:48:46.515114 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80348], State: [ok], Delivered in [0.006999396] seconds [----] I, [2016-09-13T11:48:46.553626 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80349], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.664686512] seconds [----] I, [2016-09-13T11:48:46.553819 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80349], Delivering... [----] I, [2016-09-13T11:48:46.554730 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T11:48:46.554931 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4578516992 [----] I, [2016-09-13T11:48:46.555017 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4341284864 [----] I, [2016-09-13T11:48:46.555134 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 237232128 [----] I, [2016-09-13T11:48:46.555205 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T11:48:46.555278 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4284538880 [----] I, [2016-09-13T11:48:46.555345 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T11:48:46.555412 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T11:48:46.555527 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 559886336 [----] I, [2016-09-13T11:48:46.555599 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T11:48:46.555669 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6664269824 [----] I, [2016-09-13T11:48:46.555735 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T11:48:46.555804 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T11:48:46.555870 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T11:48:46.555939 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T11:48:46.556006 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T11:48:46.556095 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T11:48:46.556164 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T11:48:46.556230 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T11:48:46.556297 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T11:48:46.556364 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T11:48:46.556456 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272130048 [----] I, [2016-09-13T11:48:46.556546 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55005184 [----] I, [2016-09-13T11:48:46.556616 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217124864 [----] I, [2016-09-13T11:48:46.556685 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6144000 [----] I, [2016-09-13T11:48:46.556765 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142770176 [----] I, [2016-09-13T11:48:46.556837 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3406376960 [----] I, [2016-09-13T11:48:46.556904 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3086520320 [----] I, [2016-09-13T11:48:46.556971 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T11:48:46.557095 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T11:48:46.557221 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T11:48:46.557354 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36671488 [----] I, [2016-09-13T11:48:46.557524 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76959744 [----] I, [2016-09-13T11:48:46.557646 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49479680 [----] I, [2016-09-13T11:48:46.557724 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111751168 [----] I, [2016-09-13T11:48:46.557794 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126439424 [----] I, [2016-09-13T11:48:46.557861 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T11:48:46.557930 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T11:48:46.558001 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T11:48:46.558084 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T11:48:46.558159 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T11:48:46.558222 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T11:48:46.558286 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T11:48:46.558352 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T11:48:46.558438 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T11:48:46.589899 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T11:48:46.590123 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T11:48:46.593644 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T11:48:46.596183 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T11:48:46.599258 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T11:48:46.602281 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T11:48:46.605287 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T11:48:46.608375 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 857 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T11:48:46.611539 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T11:48:46.614627 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T11:48:46.617600 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T11:48:46.620617 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T11:48:46.623655 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T11:48:46.626705 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T11:48:46.629439 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:48:46.629636 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:48:46.629741 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T11:48:46.634118 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [155372.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:48:46.634495 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80349], State: [ok], Delivered in [0.080642997] seconds [----] I, [2016-09-13T11:48:46.667856 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80350], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.767859615] seconds [----] I, [2016-09-13T11:48:46.668031 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80350], Delivering... [----] I, [2016-09-13T11:48:46.674512 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:48:45 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163163000], Memory % [3.1], CPU Time [38928.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T11:48:46.674961 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:48:45 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359294000], Memory % [5.28], CPU Time [208092.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T11:48:46.675381 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:48:45 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [154526.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:48:46.675750 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:48:45 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [155379.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:48:46.676153 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:48:43 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [52872.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:48:46.676554 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:48:39 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208116000], Memory % [3.52], CPU Time [246268.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T11:48:46.676907 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:48:39 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347858000], Memory % [5.04], CPU Time [106448.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T11:48:46.677249 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:48:34 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213441000], Memory % [3.51], CPU Time [50170.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T11:48:46.679708 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:48:44 UTC], Process Info: Memory Usage [603979776], Memory Size [936779776], Proportional Set Size: [445077000], Memory % [7.36], CPU Time [485.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T11:48:46.681476 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:48:44 UTC], Process Info: Memory Usage [601817088], Memory Size [946167808], Proportional Set Size: [445085000], Memory % [7.34], CPU Time [896.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T11:48:46.681897 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:48:45 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358593000], Memory % [5.27], CPU Time [215462.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T11:48:46.682289 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:48:43 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [52828.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:48:46.682705 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:48:41 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166762000], Memory % [3.16], CPU Time [39842.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T11:48:46.683029 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80350], State: [ok], Delivered in [0.014991678] seconds [----] I, [2016-09-13T11:48:54.918910 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:48:54.936376 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80351], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:48:54.953605 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80352], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:48:56.178393 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:48:56.730508 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80352], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.788388272] seconds [----] I, [2016-09-13T11:48:56.730645 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80352], Delivering... [----] I, [2016-09-13T11:48:56.734662 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002154111862182617, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021674633026123047, :pending_vm_jobs=>0.0004875659942626953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0037469863891601562} [----] I, [2016-09-13T11:48:56.734879 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80352], State: [ok], Delivered in [0.004231204] seconds [----] I, [2016-09-13T11:48:57.159345 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80351], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.235662185] seconds [----] I, [2016-09-13T11:48:57.159572 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80351], Delivering... [----] I, [2016-09-13T11:48:57.164577 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80351], State: [ok], Delivered in [0.004982188] seconds [----] I, [2016-09-13T11:49:02.558095 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003714323043823242, :worker_monitor=>1.3594799041748047, :worker_dequeue=>0.008311271667480469, :total_time=>1.3723318576812744} [----] I, [2016-09-13T11:49:07.558760 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:49:07 UTC]... [----] I, [2016-09-13T11:49:07.592329 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:49:07 UTC]...Complete [----] I, [2016-09-13T11:49:09.967230 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 13. [----] I, [2016-09-13T11:49:09.980725 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80353], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:49:10.003688 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80354], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:49:10.026594 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80355], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:49:10.037784 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80356], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:49:12.624361 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:49:12.855927 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80353], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.884813582] seconds [----] I, [2016-09-13T11:49:12.856078 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80353], Delivering... [----] I, [2016-09-13T11:49:12.859883 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.001996755599975586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020112991333007812, :pending_vm_jobs=>0.0004858970642089844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0035812854766845703} [----] I, [2016-09-13T11:49:12.860147 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80353], State: [ok], Delivered in [0.0040756] seconds [----] I, [2016-09-13T11:49:12.883986 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80355], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.87550028] seconds [----] I, [2016-09-13T11:49:12.884131 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80355], Delivering... [----] I, [2016-09-13T11:49:12.918026 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80355], State: [ok], Delivered in [0.033876618] seconds [----] I, [2016-09-13T11:49:15.232609 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80354], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.240551235] seconds [----] I, [2016-09-13T11:49:15.232743 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80354], Delivering... [----] I, [2016-09-13T11:49:15.266824 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80356], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.236709658] seconds [----] I, [2016-09-13T11:49:15.266949 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80356], Delivering... [----] I, [2016-09-13T11:49:15.269056 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80356], State: [ok], Delivered in [0.002096979] seconds [----] I, [2016-09-13T11:49:15.272895 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80357], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T11:49:15.273218 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80354], State: [ok], Delivered in [0.040453377] seconds [----] I, [2016-09-13T11:49:18.961668 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T11:49:18.961902 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004144191741943359, :worker_monitor=>1.3175745010375977, :worker_dequeue=>0.010172843933105469, :total_time=>1.3321843147277832} [----] I, [2016-09-13T11:49:23.976314 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T11:49:24.491402 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [80357], MiqWorker id: [104], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [9.248683326] seconds [----] I, [2016-09-13T11:49:24.491582 #24051:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80357], Delivering... [----] I, [2016-09-13T11:49:24.494060 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T11:49:24.494173 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T11:49:24.494264 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T11:49:24.494378 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T11:49:24.494529 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:24.953168 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:25.053803 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T11:49:25.068341 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80358], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:49:25.085991 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80359], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:49:25.110241 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80360], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:49:25.278729 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:25.279052 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:25.780071 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:26.096497 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:26.096827 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:26.624722 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:26.976096 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:26.976298 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:27.449388 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:27.793015 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:27.793212 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:28.332823 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:28.665624 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:28.665793 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:28.991333 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:49:29.064263 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80359], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.990304539] seconds [----] I, [2016-09-13T11:49:29.064569 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80359], Delivering... [----] I, [2016-09-13T11:49:29.075841 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005635499954223633, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005688190460205078, :pending_vm_jobs=>0.0015270709991455078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010636329650878906} [----] I, [2016-09-13T11:49:29.076377 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80359], State: [ok], Delivered in [0.011795846] seconds [----] I, [2016-09-13T11:49:29.192594 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:30.331589 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80358], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.272476177] seconds [----] I, [2016-09-13T11:49:30.331743 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80358], Delivering... [----] I, [2016-09-13T11:49:30.335354 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80358], State: [ok], Delivered in [0.003579132] seconds [----] I, [2016-09-13T11:49:30.342800 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80360], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.250909958] seconds [----] I, [2016-09-13T11:49:30.342910 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80360], Delivering... [----] I, [2016-09-13T11:49:30.389835 #2928:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 15:49:28 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_17' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 15:49:28.995490') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2927,,2016-09-13 15:49:27 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2936,2016-09-13 15:49:30 UTC,2016-09-13 15:49:30 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2946,2016-09-13 15:49:30 UTC,2016-09-13 15:49:30 UTC,COMMIT,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 15:49:29 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 15:49:30 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 15:49:28 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2986,,2016-09-13 15:49:28 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1, 2997,,2016-09-13 15:49:25 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 15:49:10.047652')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5, 3011,,2016-09-13 15:26:16 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1393, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,523925, 3030,,2016-09-13 14:56:12 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3198, 3054,,2016-09-13 14:56:07 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3202, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,523923, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,523923, 3160,,2016-09-13 15:26:14 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1396, 24059,,2016-09-13 15:49:24 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5, 17563,,2016-09-13 15:26:12 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1397, 27056,,2016-09-13 15:26:21 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1388, 28888,,2016-09-13 14:45:30 UTC,SELECT 1,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3840, ACTIVITY_STATS_CSV [----] I, [2016-09-13T11:49:30.390108 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80360], State: [ok], Delivered in [0.047190788] seconds [----] I, [2016-09-13T11:49:30.496458 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:30.496637 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:30.997676 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:31.288512 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:31.288759 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:31.762553 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:32.094714 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:32.094920 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:32.582897 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:32.892229 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:32.892400 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:33.360498 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:33.676774 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:33.676938 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:34.152877 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:34.473746 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:34.473871 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:34.969767 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:35.034796 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0029861927032470703, :worker_monitor=>1.0226633548736572, :worker_dequeue=>0.009621858596801758, :total_time=>1.035585641860962} [----] I, [2016-09-13T11:49:35.283898 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:35.284175 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:35.768482 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:36.085847 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:36.086104 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:36.574241 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:36.742124 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:36.887730 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:37.025574 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:37.165360 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:37.309481 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:37.448128 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:37.584056 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:37.721975 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:37.857084 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:37.996887 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:38.131151 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:38.268907 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:38.405296 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:38.537025 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:39.027564 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:39.183325 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:39.324107 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:39.464787 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:39.603338 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:39.755878 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:39.898902 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:40.035371 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:49:40 UTC]... [----] I, [2016-09-13T11:49:40.039795 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:40.051363 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:49:40 UTC]...Complete [----] I, [2016-09-13T11:49:40.123269 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:49:40.137000 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80361], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:49:40.182457 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:40.324001 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:40.465238 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:40.606292 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:40.748166 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:40.892006 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:41.031272 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:41.169149 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:41.311781 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:41.626345 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:41.800513 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:41.946858 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:42.081731 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:42.221341 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:42.361766 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:42.502879 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:42.657813 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:42.802548 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:42.973486 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:43.114745 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:43.284296 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:43.453914 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:43.599503 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:43.832598 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:44.022929 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:44.220248 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:44.752793 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:44.967442 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:45.077678 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:49:45.106139 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:45.211565 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80361], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.081605655] seconds [----] I, [2016-09-13T11:49:45.211749 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80361], Delivering... [----] I, [2016-09-13T11:49:45.217771 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032045841217041016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003221750259399414, :pending_vm_jobs=>0.0007297992706298828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005703449249267578} [----] I, [2016-09-13T11:49:45.218139 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80361], State: [ok], Delivered in [0.006368902] seconds [----] I, [2016-09-13T11:49:45.252764 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:45.426232 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:45.603946 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:45.772867 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:45.922493 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:46.066709 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:46.209864 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:46.346705 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:46.484948 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:46.622782 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:46.772710 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:46.911168 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:47.066496 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:47.208258 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:47.626162 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:47.790358 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:47.928162 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:48.077368 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:48.210127 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:48.345310 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:48.490410 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:48.625480 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:48.797324 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:48.936974 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:49.071104 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:49.222112 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:49.382995 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:49.543231 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:49.708670 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:49.862788 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:50.011707 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:50.341633 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:50.509346 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:50.661048 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:50.795112 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:50.938551 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:51.084921 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:51.118824 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0045948028564453125, :worker_monitor=>1.0243663787841797, :worker_dequeue=>0.006103038787841797, :total_time=>1.0353295803070068} [----] I, [2016-09-13T11:49:51.230287 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:51.376659 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:51.514017 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:51.657925 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:51.798007 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:51.937890 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:52.075098 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:52.214951 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:52.351904 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:52.498771 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:52.636328 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:52.908346 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:53.072454 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:53.211354 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:53.349177 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:53.490895 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:53.628779 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:53.767636 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:53.909211 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:54.049604 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:54.188189 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:54.326179 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:54.473259 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:54.613168 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:54.755267 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:54.897366 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:55.036253 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:55.148597 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:49:55.171617 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80362], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:49:55.182146 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:55.188712 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80363], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:49:55.726386 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:55.901518 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:49:56.234982 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:49:56.331843 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80363], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.154358444] seconds [----] I, [2016-09-13T11:49:56.332005 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80363], Delivering... [----] I, [2016-09-13T11:49:56.338497 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003411531448364258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034406185150146484, :pending_vm_jobs=>0.0010101795196533203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006126880645751953} [----] I, [2016-09-13T11:49:56.338840 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80363], State: [ok], Delivered in [0.006831388] seconds [----] I, [2016-09-13T11:49:57.446219 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80362], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.293597931] seconds [----] I, [2016-09-13T11:49:57.446357 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80362], Delivering... [----] I, [2016-09-13T11:49:57.449462 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80362], State: [ok], Delivered in [0.003080411] seconds [----] I, [2016-09-13T11:50:02.075727 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:02.215872 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:02.354569 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:02.494292 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:02.633267 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:02.777241 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:02.919120 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:03.062765 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:03.204673 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:03.350188 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:03.488560 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:03.632713 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:03.781522 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:03.925706 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:04.063624 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:04.562919 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:04.719959 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:04.854442 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:05.004849 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:05.136392 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:05.276930 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:05.419717 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:05.557055 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:05.705759 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:05.844130 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:05.984764 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:06.123386 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:06.262272 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:06.399264 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:06.543395 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:06.684464 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:06.827485 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:07.359061 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:07.505708 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005942583084106445, :worker_monitor=>1.2299084663391113, :worker_dequeue=>0.00866842269897461, :total_time=>1.2449061870574951} [----] I, [2016-09-13T11:50:07.519360 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:07.654806 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:07.791704 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:07.936541 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:08.077319 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:08.214309 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:08.359057 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:08.494381 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:08.638058 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:08.777390 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:08.918340 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:09.059297 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:09.213902 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:09.352930 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:09.487835 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:09.632762 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:10.046661 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:10.191029 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:10.199349 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 8. [----] I, [2016-09-13T11:50:10.219720 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80364], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:50:10.229726 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80365], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:50:10.247394 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80366], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:50:10.258699 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80367], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:50:10.269725 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80368], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:50:10.281217 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80369], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:50:10.292712 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80370], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:50:10.304260 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80371], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:50:10.336632 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:10.485144 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:10.627317 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:10.772856 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:10.918563 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:11.056077 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:11.248436 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:11.382957 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:11.528749 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:11.665002 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:11.815984 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:11.956064 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:12.102318 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:12.242299 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:12.386594 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:12.506213 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:50:12 UTC]... [----] I, [2016-09-13T11:50:12.522279 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:50:12 UTC]...Complete [----] I, [2016-09-13T11:50:12.535908 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 8 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:50:12.765502 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:12.922934 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:13.224982 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80364], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.020026358] seconds [----] I, [2016-09-13T11:50:13.225177 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80364], Delivering... [----] I, [2016-09-13T11:50:13.231979 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003571033477783203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035936832427978516, :pending_vm_jobs=>0.0008339881896972656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006384849548339844} [----] I, [2016-09-13T11:50:13.232384 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80364], State: [ok], Delivered in [0.007186256] seconds [----] I, [2016-09-13T11:50:13.265645 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80370], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.981568147] seconds [----] I, [2016-09-13T11:50:13.265931 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80370], Delivering... [----] I, [2016-09-13T11:50:13.328938 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80370], State: [ok], Delivered in [0.062984178] seconds [----] I, [2016-09-13T11:50:15.516328 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80365], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.29244036] seconds [----] I, [2016-09-13T11:50:15.516564 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80365], Delivering... [----] I, [2016-09-13T11:50:15.522095 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80366], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.289336372] seconds [----] I, [2016-09-13T11:50:15.522309 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80366], Delivering... [----] I, [2016-09-13T11:50:15.534240 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80372], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 15:50:15 UTC] [----] I, [2016-09-13T11:50:15.539058 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80373], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 15:50:15 UTC] [----] I, [2016-09-13T11:50:15.550949 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80374], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 15:50:15 UTC] [----] I, [2016-09-13T11:50:15.551356 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80366], State: [ok], Delivered in [0.029044637] seconds [----] I, [2016-09-13T11:50:15.562813 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80375], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 15:50:15 UTC] [----] I, [2016-09-13T11:50:15.563371 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80365], State: [ok], Delivered in [0.046769126] seconds [----] I, [2016-09-13T11:50:15.578804 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80367], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.326187831] seconds [----] I, [2016-09-13T11:50:15.578959 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80367], Delivering... [----] I, [2016-09-13T11:50:15.580929 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80367], State: [ok], Delivered in [0.001957657] seconds [----] I, [2016-09-13T11:50:15.602029 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80368], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.338230641] seconds [----] I, [2016-09-13T11:50:15.602259 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80368], Delivering... [----] I, [2016-09-13T11:50:15.611116 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80368], State: [ok], Delivered in [0.008845505] seconds [----] I, [2016-09-13T11:50:15.625351 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80369], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.352151142] seconds [----] I, [2016-09-13T11:50:15.625660 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80369], Delivering... [----] I, [2016-09-13T11:50:15.643085 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80369], State: [ok], Delivered in [0.017348564] seconds [----] I, [2016-09-13T11:50:15.659306 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80371], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.363116825] seconds [----] I, [2016-09-13T11:50:15.659583 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80371], Delivering... [----] I, [2016-09-13T11:50:15.662735 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80371], State: [ok], Delivered in [0.003145515] seconds [----] I, [2016-09-13T11:50:17.547446 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:50:18.682587 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80372], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 15:50:15 UTC], Dequeued in: [3.159914646] seconds [----] I, [2016-09-13T11:50:18.682796 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80372], Delivering... [----] I, [2016-09-13T11:50:18.683252 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 15:50:15 UTC]... [----] I, [2016-09-13T11:50:18.686657 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T11:50:18.689325 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 15:50:15 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T11:50:18.689747 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80372], State: [ok], Delivered in [0.006934854] seconds [----] I, [2016-09-13T11:50:18.717201 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80373], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 15:50:15 UTC], Dequeued in: [3.188273573] seconds [----] I, [2016-09-13T11:50:18.717401 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80373], Delivering... [----] I, [2016-09-13T11:50:18.717801 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 15:50:15 UTC]... [----] I, [2016-09-13T11:50:18.721222 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T11:50:18.735815 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80374], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 15:50:15 UTC], Dequeued in: [3.191403365] seconds [----] I, [2016-09-13T11:50:18.736108 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80374], Delivering... [----] I, [2016-09-13T11:50:18.736537 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 15:50:15 UTC]... [----] I, [2016-09-13T11:50:18.740069 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T11:50:18.812398 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 15:50:15 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T11:50:18.812548 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 15:50:15 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T11:50:18.812863 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80373], State: [ok], Delivered in [0.095459249] seconds [----] I, [2016-09-13T11:50:18.812953 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80374], State: [ok], Delivered in [0.076841714] seconds [----] I, [2016-09-13T11:50:18.881137 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80375], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 15:50:15 UTC], Dequeued in: [3.336541441] seconds [----] I, [2016-09-13T11:50:18.881325 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80375], Delivering... [----] I, [2016-09-13T11:50:18.881656 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 15:50:15 UTC]... [----] I, [2016-09-13T11:50:18.884189 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T11:50:18.886607 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 15:50:15 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T11:50:18.886919 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80375], State: [ok], Delivered in [0.005580759] seconds [----] I, [2016-09-13T11:50:19.079055 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:19.214075 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:19.348518 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:19.483727 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:19.629896 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:19.769209 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:19.909329 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:20.043072 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:20.182315 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:20.324329 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:20.458905 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:20.597825 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:20.732999 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:20.869678 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:21.004490 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:21.319013 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:21.467832 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:21.606784 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:21.743239 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:21.880648 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:22.019165 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:22.196870 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:22.344791 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:22.485628 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:22.628989 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:22.776151 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:22.914323 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:23.053146 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:23.193754 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:23.328578 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:23.465846 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:23.611977 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:23.968131 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006209135055541992, :worker_monitor=>1.4027864933013916, :worker_dequeue=>0.008176088333129883, :total_time=>1.4176843166351318} [----] I, [2016-09-13T11:50:24.035219 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:24.185184 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:24.321727 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:24.454225 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:24.596287 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:24.736024 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:24.872070 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:25.017903 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:25.159891 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:25.302107 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:25.318787 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:50:25.330571 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80376], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:50:25.353518 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80377], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:50:25.441167 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:25.582661 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:25.722058 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:25.862267 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:25.997964 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:26.144001 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T11:50:26.280709 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T11:50:26.485558 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T11:50:26.485812 #24051:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T11:50:26.486013 #24051:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T11:50:26.486100 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T11:50:26.486186 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T11:50:26.503700 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T11:50:26.504272 #24051:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [80357], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T11:50:26.504593 #24051:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T11:50:26.504886 #24051:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T11:50:26.505198 #24051:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80357], State: [error], Delivered in [62.013586538] seconds [----] I, [2016-09-13T11:50:28.979131 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:50:29.456696 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80377], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.11998446] seconds [----] I, [2016-09-13T11:50:29.456897 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80377], Delivering... [----] I, [2016-09-13T11:50:29.463636 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035364627838134766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003556489944458008, :pending_vm_jobs=>0.0008447170257568359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006335020065307617} [----] I, [2016-09-13T11:50:29.464053 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80377], State: [ok], Delivered in [0.007134845] seconds [----] I, [2016-09-13T11:50:30.915007 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80376], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.591044568] seconds [----] I, [2016-09-13T11:50:30.915209 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80376], Delivering... [----] I, [2016-09-13T11:50:30.919898 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80376], State: [ok], Delivered in [0.004653938] seconds [----] I, [2016-09-13T11:50:40.006684 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0029807090759277344, :worker_monitor=>0.9912936687469482, :worker_dequeue=>0.009214401245117188, :total_time=>1.0038137435913086} [----] I, [2016-09-13T11:50:40.366991 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:50:40.382175 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80378], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:50:40.393504 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80379], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:50:45.007316 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:50:45 UTC]... [----] I, [2016-09-13T11:50:45.021718 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:50:45 UTC]...Complete [----] I, [2016-09-13T11:50:45.032124 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:50:45.576364 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80378], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.204055026] seconds [----] I, [2016-09-13T11:50:45.576525 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80378], Delivering... [----] I, [2016-09-13T11:50:45.580747 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002259492874145508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022737979888916016, :pending_vm_jobs=>0.0005338191986083984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003969907760620117} [----] I, [2016-09-13T11:50:45.580997 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80378], State: [ok], Delivered in [0.004483572] seconds [----] I, [2016-09-13T11:50:45.972793 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80379], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.586956011] seconds [----] I, [2016-09-13T11:50:45.973157 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80379], Delivering... [----] I, [2016-09-13T11:50:45.980914 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80379], State: [ok], Delivered in [0.007803303] seconds [----] I, [2016-09-13T11:50:55.403601 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:50:55.427668 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80380], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:50:56.102133 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:50:56.106995 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002355337142944336, :worker_monitor=>1.043412208557129, :worker_dequeue=>0.010630369186401367, :total_time=>1.0565943717956543} [----] I, [2016-09-13T11:50:56.686301 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80380], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.278359181] seconds [----] I, [2016-09-13T11:50:56.686531 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80380], Delivering... [----] I, [2016-09-13T11:50:56.693045 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033724308013916016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033948421478271484, :pending_vm_jobs=>0.0008466243743896484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0061244964599609375} [----] I, [2016-09-13T11:50:56.693409 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80380], State: [ok], Delivered in [0.006880338] seconds [----] I, [2016-09-13T11:51:10.438536 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:51:10.473780 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80381], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:51:10.491973 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80382], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:51:10.513998 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80383], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:51:10.537281 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80384], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:51:12.303734 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:51:12.307598 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00603175163269043, :worker_monitor=>1.083366870880127, :worker_dequeue=>0.0079345703125, :total_time=>1.0977258682250977} [----] I, [2016-09-13T11:51:12.823001 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80381], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.378351575] seconds [----] I, [2016-09-13T11:51:12.823187 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80381], Delivering... [----] I, [2016-09-13T11:51:12.829569 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003284931182861328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003305673599243164, :pending_vm_jobs=>0.0008454322814941406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060176849365234375} [----] I, [2016-09-13T11:51:12.829892 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80381], State: [ok], Delivered in [0.006701074] seconds [----] I, [2016-09-13T11:51:12.852457 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80382], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.374317645] seconds [----] I, [2016-09-13T11:51:12.852698 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80382], Delivering... [----] I, [2016-09-13T11:51:12.914603 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80382], State: [ok], Delivered in [0.061878805] seconds [----] I, [2016-09-13T11:51:13.092089 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80383], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.591831919] seconds [----] I, [2016-09-13T11:51:13.092370 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80383], Delivering... [----] I, [2016-09-13T11:51:13.097103 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80383], State: [ok], Delivered in [0.004709166] seconds [----] I, [2016-09-13T11:51:13.109285 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80384], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.58606594] seconds [----] I, [2016-09-13T11:51:13.109585 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80384], Delivering... [----] I, [2016-09-13T11:51:13.116092 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80384], State: [ok], Delivered in [0.006484402] seconds [----] I, [2016-09-13T11:51:17.308099 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:51:17 UTC]... [----] I, [2016-09-13T11:51:17.337311 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:51:17 UTC]...Complete [----] I, [2016-09-13T11:51:17.353591 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T11:51:25.549338 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:51:25.571909 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80385], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:51:28.438797 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:51:28.443791 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025277137756347656, :worker_monitor=>1.0528879165649414, :worker_dequeue=>0.01013803482055664, :total_time=>1.065772533416748} [----] I, [2016-09-13T11:51:28.979874 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80385], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.423586088] seconds [----] I, [2016-09-13T11:51:28.980113 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80385], Delivering... [----] I, [2016-09-13T11:51:28.987023 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036673545837402344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036885738372802734, :pending_vm_jobs=>0.0008289813995361328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006438732147216797} [----] I, [2016-09-13T11:51:28.987454 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80385], State: [ok], Delivered in [0.007312988] seconds [----] I, [2016-09-13T11:51:40.585308 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:51:40.614090 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80386], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:51:40.645459 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80387], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:51:44.359710 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:51:45.114227 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80386], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.519534077] seconds [----] I, [2016-09-13T11:51:45.114452 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80386], Delivering... [----] I, [2016-09-13T11:51:45.120521 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031518936157226562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031690597534179688, :pending_vm_jobs=>0.0007710456848144531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005675315856933594} [----] I, [2016-09-13T11:51:45.120826 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80386], State: [ok], Delivered in [0.006405832] seconds [----] I, [2016-09-13T11:51:46.184490 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80387], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.563633532] seconds [----] I, [2016-09-13T11:51:46.184706 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80387], Delivering... [----] I, [2016-09-13T11:51:46.194160 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80387], State: [ok], Delivered in [0.009403013] seconds [----] I, [2016-09-13T11:51:49.363161 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:51:49 UTC]... [----] I, [2016-09-13T11:51:49.377869 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:51:49 UTC]...Complete [----] I, [2016-09-13T11:51:55.656440 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:51:55.674088 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80388], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:52:00.381021 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:52:01.245769 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80388], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.58477731] seconds [----] I, [2016-09-13T11:52:01.245920 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80388], Delivering... [----] I, [2016-09-13T11:52:01.250784 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026128292083740234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026273727416992188, :pending_vm_jobs=>0.0005645751953125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004537105560302734} [----] I, [2016-09-13T11:52:01.252121 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80388], State: [ok], Delivered in [0.006098357] seconds [----] I, [2016-09-13T11:52:10.686623 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:52:10.703967 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80389], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:52:10.720196 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80390], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:52:10.731627 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80391], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:52:10.748737 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80392], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:52:16.733728 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:52:16.736626 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038607120513916016, :worker_monitor=>1.1876933574676514, :worker_dequeue=>0.007679462432861328, :total_time=>1.199570655822754} [----] I, [2016-09-13T11:52:17.360731 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80389], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.668073629] seconds [----] I, [2016-09-13T11:52:17.360947 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80389], Delivering... [----] I, [2016-09-13T11:52:17.366809 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003289937973022461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033092498779296875, :pending_vm_jobs=>0.0006341934204101562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005484819412231445} [----] I, [2016-09-13T11:52:17.367170 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80389], State: [ok], Delivered in [0.006226885] seconds [----] I, [2016-09-13T11:52:17.389000 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80390], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.678621538] seconds [----] I, [2016-09-13T11:52:17.389209 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80390], Delivering... [----] I, [2016-09-13T11:52:17.445881 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80390], State: [ok], Delivered in [0.056610758] seconds [----] I, [2016-09-13T11:52:19.360824 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80391], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.635084359] seconds [----] I, [2016-09-13T11:52:19.361080 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80391], Delivering... [----] I, [2016-09-13T11:52:19.364735 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80391], State: [ok], Delivered in [0.003678373] seconds [----] I, [2016-09-13T11:52:19.379061 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80392], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.638706387] seconds [----] I, [2016-09-13T11:52:19.379282 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80392], Delivering... [----] I, [2016-09-13T11:52:19.384640 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80392], State: [ok], Delivered in [0.00536095] seconds [----] I, [2016-09-13T11:52:21.737230 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:52:21 UTC]... [----] I, [2016-09-13T11:52:21.760265 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:52:21 UTC]...Complete [----] I, [2016-09-13T11:52:25.762938 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:52:25.783199 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80393], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:52:26.790007 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:52:26.977867 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80393], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.20682909] seconds [----] I, [2016-09-13T11:52:26.978084 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80393], Delivering... [----] I, [2016-09-13T11:52:26.986355 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003610849380493164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036330223083496094, :pending_vm_jobs=>0.0008480548858642578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006371736526489258} [----] I, [2016-09-13T11:52:26.986735 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80393], State: [ok], Delivered in [0.008668599] seconds [----] I, [2016-09-13T11:52:33.135972 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004837751388549805, :worker_monitor=>1.3252732753753662, :worker_dequeue=>0.008072376251220703, :total_time=>1.338569164276123} [----] I, [2016-09-13T11:52:40.794375 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:52:40.812380 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80394], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:52:40.822961 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80395], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:52:43.164761 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:52:43.794995 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80394], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.994183276] seconds [----] I, [2016-09-13T11:52:43.795238 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80394], Delivering... [----] I, [2016-09-13T11:52:43.802125 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038008689880371094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038225650787353516, :pending_vm_jobs=>0.0007898807525634766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0064296722412109375} [----] I, [2016-09-13T11:52:43.802544 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80394], State: [ok], Delivered in [0.007306767] seconds [----] I, [2016-09-13T11:52:43.840664 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80395], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.023571685] seconds [----] I, [2016-09-13T11:52:43.840865 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80395], Delivering... [----] I, [2016-09-13T11:52:43.845441 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80395], State: [ok], Delivered in [0.004548085] seconds [----] I, [2016-09-13T11:52:53.973620 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:52:53 UTC]... [----] I, [2016-09-13T11:52:53.988832 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:52:53 UTC]...Complete [----] I, [2016-09-13T11:52:55.835659 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:52:55.857921 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80396], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:52:59.018506 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:52:59.115326 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80396], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.273821763] seconds [----] I, [2016-09-13T11:52:59.115567 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80396], Delivering... [----] I, [2016-09-13T11:52:59.123085 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003844022750854492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003869771957397461, :pending_vm_jobs=>0.0009417533874511719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007044792175292969} [----] I, [2016-09-13T11:52:59.123583 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80396], State: [ok], Delivered in [0.008000043] seconds [----] I, [2016-09-13T11:53:05.164975 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002645730972290039, :worker_monitor=>1.124009609222412, :worker_dequeue=>0.012241125106811523, :total_time=>1.1391620635986328} [----] I, [2016-09-13T11:53:10.876088 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:53:10.892266 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80397], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:53:10.924215 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80398], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:53:10.952692 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80399], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:53:10.975381 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80400], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:53:15.321238 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:53:16.298143 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80397], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.413795632] seconds [----] I, [2016-09-13T11:53:16.298370 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80397], Delivering... [----] I, [2016-09-13T11:53:16.305603 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036301612854003906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003693103790283203, :pending_vm_jobs=>0.000885009765625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006774425506591797} [----] I, [2016-09-13T11:53:16.305946 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80397], State: [ok], Delivered in [0.007589482] seconds [----] I, [2016-09-13T11:53:16.324337 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80398], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.426114107] seconds [----] I, [2016-09-13T11:53:16.324576 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80398], Delivering... [----] I, [2016-09-13T11:53:16.392695 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80398], State: [ok], Delivered in [0.068073907] seconds [----] I, [2016-09-13T11:53:16.982621 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80399], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.049878815] seconds [----] I, [2016-09-13T11:53:16.982948 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80399], Delivering... [----] I, [2016-09-13T11:53:16.988224 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80399], State: [ok], Delivered in [0.005278968] seconds [----] I, [2016-09-13T11:53:17.034135 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80400], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.06983218] seconds [----] I, [2016-09-13T11:53:17.034378 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80400], Delivering... [----] I, [2016-09-13T11:53:17.040659 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80400], State: [ok], Delivered in [0.006278422] seconds [----] I, [2016-09-13T11:53:21.572158 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002967357635498047, :worker_monitor=>1.2354025840759277, :worker_dequeue=>0.009590864181518555, :total_time=>1.2482666969299316} [----] I, [2016-09-13T11:53:25.991340 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:53:26.012849 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80401], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:53:26.572689 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:53:26 UTC]... [----] I, [2016-09-13T11:53:26.599921 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:53:26 UTC]...Complete [----] I, [2016-09-13T11:53:26.612833 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:53:27.430155 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80401], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.432842621] seconds [----] I, [2016-09-13T11:53:27.430354 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80401], Delivering... [----] I, [2016-09-13T11:53:27.437499 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038182735443115234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038433074951171875, :pending_vm_jobs=>0.0008313655853271484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006680727005004883} [----] I, [2016-09-13T11:53:27.437894 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80401], State: [ok], Delivered in [0.007539083] seconds [----] I, [2016-09-13T11:53:37.888733 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005834102630615234, :worker_monitor=>1.2410151958465576, :worker_dequeue=>0.008743524551391602, :total_time=>1.2559552192687988} [----] I, [2016-09-13T11:53:41.029040 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T11:53:41.044839 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80402], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:53:41.061973 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80403], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:53:41.076963 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80404], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:53:41.096307 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80405], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:53:42.897539 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:53:43.553591 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80402], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.519997222] seconds [----] I, [2016-09-13T11:53:43.553720 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80402], Delivering... [----] I, [2016-09-13T11:53:43.557712 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021767616271972656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002192974090576172, :pending_vm_jobs=>0.0004878044128417969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003766298294067383} [----] I, [2016-09-13T11:53:43.557898 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80402], State: [ok], Delivered in [0.004187114] seconds [----] I, [2016-09-13T11:53:43.582172 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80403], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.534355905] seconds [----] I, [2016-09-13T11:53:43.582346 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80403], Delivering... [----] I, [2016-09-13T11:53:43.583474 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T11:53:43.583660 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4592680960 [----] I, [2016-09-13T11:53:43.583754 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4355166208 [----] I, [2016-09-13T11:53:43.583850 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 237514752 [----] I, [2016-09-13T11:53:43.583936 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T11:53:43.584016 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4298399744 [----] I, [2016-09-13T11:53:43.584107 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T11:53:43.584183 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T11:53:43.584270 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 560214016 [----] I, [2016-09-13T11:53:43.584358 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T11:53:43.584458 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6824742912 [----] I, [2016-09-13T11:53:43.584542 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T11:53:43.584622 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T11:53:43.584697 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T11:53:43.584767 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T11:53:43.584842 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T11:53:43.584915 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T11:53:43.584991 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T11:53:43.585086 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T11:53:43.585162 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T11:53:43.585236 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T11:53:43.585313 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272150528 [----] I, [2016-09-13T11:53:43.585388 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55017472 [----] I, [2016-09-13T11:53:43.585492 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217133056 [----] I, [2016-09-13T11:53:43.585575 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6160384 [----] I, [2016-09-13T11:53:43.585660 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142782464 [----] I, [2016-09-13T11:53:43.585741 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3390873600 [----] I, [2016-09-13T11:53:43.585818 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3070726144 [----] I, [2016-09-13T11:53:43.585908 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T11:53:43.585988 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T11:53:43.586091 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T11:53:43.586177 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37179392 [----] I, [2016-09-13T11:53:43.586263 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76959744 [----] I, [2016-09-13T11:53:43.586351 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49807360 [----] I, [2016-09-13T11:53:43.586462 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111783936 [----] I, [2016-09-13T11:53:43.586560 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126767104 [----] I, [2016-09-13T11:53:43.586642 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T11:53:43.586722 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T11:53:43.586804 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T11:53:43.586879 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T11:53:43.586949 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T11:53:43.587036 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T11:53:43.587117 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T11:53:43.587196 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T11:53:43.587265 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T11:53:43.587699 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80404], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.522900416] seconds [----] I, [2016-09-13T11:53:43.587844 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80404], Delivering... [----] I, [2016-09-13T11:53:43.593322 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:53:36 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163163000], Memory % [3.1], CPU Time [38937.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T11:53:43.593701 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:53:35 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359292000], Memory % [5.28], CPU Time [208164.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T11:53:43.594065 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:53:37 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [154636.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:53:43.594354 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:53:37 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [155493.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:53:43.594676 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:53:35 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [52887.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:53:43.594982 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:53:25 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [246392.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T11:53:43.595262 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:53:27 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347857000], Memory % [5.04], CPU Time [106462.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T11:53:43.595566 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:53:34 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213440000], Memory % [3.51], CPU Time [50178.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T11:53:43.595874 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:53:35 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358591000], Memory % [5.27], CPU Time [215548.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T11:53:43.596177 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:53:37 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [52842.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:53:43.596450 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:53:29 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166761000], Memory % [3.16], CPU Time [39852.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T11:53:43.598274 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:53:36 UTC], Process Info: Memory Usage [616071168], Memory Size [1077821440], Proportional Set Size: [456900000], Memory % [7.51], CPU Time [624.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T11:53:43.599671 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:53:34 UTC], Process Info: Memory Usage [602046464], Memory Size [960847872], Proportional Set Size: [445307000], Memory % [7.34], CPU Time [906.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T11:53:43.599889 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80404], State: [ok], Delivered in [0.012056324] seconds [----] I, [2016-09-13T11:53:43.620356 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T11:53:43.620519 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T11:53:43.624543 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T11:53:43.627087 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T11:53:43.630401 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T11:53:43.632796 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T11:53:43.635034 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T11:53:43.637736 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 857 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T11:53:43.640427 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T11:53:43.642650 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T11:53:43.644844 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.8 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T11:53:43.646962 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T11:53:43.648983 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T11:53:43.650973 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T11:53:43.653016 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:53:43.653157 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:53:43.653250 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T11:53:43.657223 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [155484.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:53:43.657516 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80403], State: [ok], Delivered in [0.07516345] seconds [----] I, [2016-09-13T11:53:44.091074 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80405], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.009921982] seconds [----] I, [2016-09-13T11:53:44.091271 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80405], Delivering... [----] I, [2016-09-13T11:53:44.096627 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80405], State: [ok], Delivered in [0.005343423] seconds [----] I, [2016-09-13T11:53:56.105311 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:53:56.120629 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80406], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:53:58.847177 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:53:58 UTC]... [----] I, [2016-09-13T11:53:58.879694 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:53:58 UTC]...Complete [----] I, [2016-09-13T11:53:58.890696 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:53:59.205155 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80406], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.093953844] seconds [----] I, [2016-09-13T11:53:59.205349 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80406], Delivering... [----] I, [2016-09-13T11:53:59.212825 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033257007598876953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003373384475708008, :pending_vm_jobs=>0.0011165142059326172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007050752639770508} [----] I, [2016-09-13T11:53:59.213283 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80406], State: [ok], Delivered in [0.007905306] seconds [----] I, [2016-09-13T11:54:10.082874 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00391387939453125, :worker_monitor=>1.165494441986084, :worker_dequeue=>0.006911516189575195, :total_time=>1.1766018867492676} [----] I, [2016-09-13T11:54:11.130678 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:54:11.153963 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80407], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:54:11.182364 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80408], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:54:11.205871 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80409], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:54:11.233999 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80410], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:54:15.187775 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:54:15.863706 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80407], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.727234458] seconds [----] I, [2016-09-13T11:54:15.863988 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80407], Delivering... [----] I, [2016-09-13T11:54:15.874782 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0055141448974609375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005566120147705078, :pending_vm_jobs=>0.0014417171478271484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010187625885009766} [----] I, [2016-09-13T11:54:15.875185 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80407], State: [ok], Delivered in [0.011207628] seconds [----] I, [2016-09-13T11:54:15.879933 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80408], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.721829611] seconds [----] I, [2016-09-13T11:54:15.880172 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80408], Delivering... [----] I, [2016-09-13T11:54:15.948314 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80408], State: [ok], Delivered in [0.06812533] seconds [----] I, [2016-09-13T11:54:17.240398 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80409], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.054453471] seconds [----] I, [2016-09-13T11:54:17.240644 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80409], Delivering... [----] I, [2016-09-13T11:54:17.249135 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80409], State: [ok], Delivered in [0.008476625] seconds [----] I, [2016-09-13T11:54:17.285907 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80410], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.073421627] seconds [----] I, [2016-09-13T11:54:17.286207 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80410], Delivering... [----] I, [2016-09-13T11:54:17.294337 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80410], State: [ok], Delivered in [0.008110304] seconds [----] I, [2016-09-13T11:54:26.246668 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:54:26.269853 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80411], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:54:31.162033 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:54:31 UTC]... [----] I, [2016-09-13T11:54:31.178354 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:54:31 UTC]...Complete [----] I, [2016-09-13T11:54:31.191568 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:54:32.007285 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80411], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.754033842] seconds [----] I, [2016-09-13T11:54:32.007486 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80411], Delivering... [----] I, [2016-09-13T11:54:32.012379 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028955936431884766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002912759780883789, :pending_vm_jobs=>0.0004885196685791016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004535675048828125} [----] I, [2016-09-13T11:54:32.012636 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80411], State: [ok], Delivered in [0.00515381] seconds [----] I, [2016-09-13T11:54:41.286412 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:54:41.309266 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80412], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:54:41.321117 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80413], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:54:42.635776 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:54:42.639037 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.01127004623413086, :worker_monitor=>1.3995637893676758, :worker_dequeue=>0.00722050666809082, :total_time=>1.4185895919799805} [----] I, [2016-09-13T11:54:43.121650 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80412], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.82679351] seconds [----] I, [2016-09-13T11:54:43.121937 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80412], Delivering... [----] I, [2016-09-13T11:54:43.133668 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005684852600097656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005751848220825195, :pending_vm_jobs=>0.0016231536865234375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.01109170913696289} [----] I, [2016-09-13T11:54:43.134193 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80412], State: [ok], Delivered in [0.012253712] seconds [----] I, [2016-09-13T11:54:44.337639 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80413], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.023132321] seconds [----] I, [2016-09-13T11:54:44.337833 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80413], Delivering... [----] I, [2016-09-13T11:54:44.344033 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80413], State: [ok], Delivered in [0.006179013] seconds [----] I, [2016-09-13T11:54:56.335670 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:54:56.348957 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80414], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:54:58.991657 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:54:58.995311 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0029044151306152344, :worker_monitor=>1.320828914642334, :worker_dequeue=>0.008481740951538086, :total_time=>1.3324427604675293} [----] I, [2016-09-13T11:54:59.246668 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80414], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.904856405] seconds [----] I, [2016-09-13T11:54:59.246827 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80414], Delivering... [----] I, [2016-09-13T11:54:59.251410 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002560138702392578, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025756359100341797, :pending_vm_jobs=>0.0005433559417724609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004292726516723633} [----] I, [2016-09-13T11:54:59.251681 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80414], State: [ok], Delivered in [0.00484992] seconds [----] I, [2016-09-13T11:55:03.995838 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:55:03 UTC]... [----] I, [2016-09-13T11:55:04.017662 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:55:03 UTC]...Complete [----] I, [2016-09-13T11:55:11.361129 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:55:11.377746 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80415], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:55:11.394889 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80416], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:55:11.417847 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80417], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:55:11.435648 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80418], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:55:15.429935 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:55:15.432449 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003573894500732422, :worker_monitor=>1.3673205375671387, :worker_dequeue=>0.007616519927978516, :total_time=>1.3787412643432617} [----] I, [2016-09-13T11:55:15.457803 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80415], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.091055733] seconds [----] I, [2016-09-13T11:55:15.457958 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80415], Delivering... [----] I, [2016-09-13T11:55:15.463995 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030813217163085938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003103971481323242, :pending_vm_jobs=>0.0007355213165283203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005705595016479492} [----] I, [2016-09-13T11:55:15.464328 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80415], State: [ok], Delivered in [0.006364732] seconds [----] I, [2016-09-13T11:55:15.486379 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80416], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.10470652] seconds [----] I, [2016-09-13T11:55:15.486599 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80416], Delivering... [----] I, [2016-09-13T11:55:15.537481 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80416], State: [ok], Delivered in [0.050855882] seconds [----] I, [2016-09-13T11:55:17.521118 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80417], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.121830256] seconds [----] I, [2016-09-13T11:55:17.521324 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80417], Delivering... [----] I, [2016-09-13T11:55:17.524904 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80417], State: [ok], Delivered in [0.003574659] seconds [----] I, [2016-09-13T11:55:17.526555 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80418], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.100547251] seconds [----] I, [2016-09-13T11:55:17.526754 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80418], Delivering... [----] I, [2016-09-13T11:55:17.532125 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80418], State: [ok], Delivered in [0.005364618] seconds [----] I, [2016-09-13T11:55:26.453336 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:55:26.486854 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80419], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:55:31.793739 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:55:31.800796 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037364959716796875, :worker_monitor=>1.189138412475586, :worker_dequeue=>0.013472557067871094, :total_time=>1.2067015171051025} [----] I, [2016-09-13T11:55:32.538763 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80419], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.078921283] seconds [----] I, [2016-09-13T11:55:32.539052 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80419], Delivering... [----] I, [2016-09-13T11:55:32.547478 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004405498504638672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00446629524230957, :pending_vm_jobs=>0.0009605884552001953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00787663459777832} [----] I, [2016-09-13T11:55:32.547943 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80419], State: [ok], Delivered in [0.00890468] seconds [----] I, [2016-09-13T11:55:36.801445 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:55:36 UTC]... [----] I, [2016-09-13T11:55:36.817979 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:55:36 UTC]...Complete [----] I, [2016-09-13T11:55:41.500369 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:55:41.515385 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80420], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:55:41.526553 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80421], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:55:41.851294 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:55:42.641653 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80420], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.135054078] seconds [----] I, [2016-09-13T11:55:42.641895 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80420], Delivering... [----] I, [2016-09-13T11:55:42.652274 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005613088607788086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005684852600097656, :pending_vm_jobs=>0.0011563301086425781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009854316711425781} [----] I, [2016-09-13T11:55:42.652790 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80420], State: [ok], Delivered in [0.010888719] seconds [----] I, [2016-09-13T11:55:44.618881 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80421], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.099036066] seconds [----] I, [2016-09-13T11:55:44.619132 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80421], Delivering... [----] I, [2016-09-13T11:55:44.625519 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80421], State: [ok], Delivered in [0.006336165] seconds [----] I, [2016-09-13T11:55:48.011562 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006018400192260742, :worker_monitor=>1.1407082080841064, :worker_dequeue=>0.00816655158996582, :total_time=>1.1553051471710205} [----] I, [2016-09-13T11:55:56.535806 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:55:56.549835 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80422], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:55:58.033106 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:55:58.813255 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80422], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.271496218] seconds [----] I, [2016-09-13T11:55:58.813472 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80422], Delivering... [----] I, [2016-09-13T11:55:58.819784 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032799243927001953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003300189971923828, :pending_vm_jobs=>0.0007939338684082031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005930423736572266} [----] I, [2016-09-13T11:55:58.820088 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80422], State: [ok], Delivered in [0.006645246] seconds [----] I, [2016-09-13T11:56:04.038432 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004975557327270508, :worker_monitor=>0.9896481037139893, :worker_dequeue=>0.007219791412353516, :total_time=>1.0021605491638184} [----] I, [2016-09-13T11:56:09.038904 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:56:09 UTC]... [----] I, [2016-09-13T11:56:09.056861 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:56:09 UTC]...Complete [----] I, [2016-09-13T11:56:11.562281 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:56:11.583170 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80423], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:56:11.600309 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80424], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:56:11.617595 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80425], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:56:11.640341 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80426], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:56:14.078160 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:56:14.767478 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80423], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.198390091] seconds [----] I, [2016-09-13T11:56:14.767729 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80423], Delivering... [----] I, [2016-09-13T11:56:14.771980 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80424], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.184230304] seconds [----] I, [2016-09-13T11:56:14.772232 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80424], Delivering... [----] I, [2016-09-13T11:56:14.775484 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004025697708129883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004052400588989258, :pending_vm_jobs=>0.0009565353393554688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007201433181762695} [----] I, [2016-09-13T11:56:14.775852 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80423], State: [ok], Delivered in [0.008134525] seconds [----] I, [2016-09-13T11:56:14.806059 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80425], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.199929751] seconds [----] I, [2016-09-13T11:56:14.806248 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80425], Delivering... [----] I, [2016-09-13T11:56:14.810266 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80425], State: [ok], Delivered in [0.003986016] seconds [----] I, [2016-09-13T11:56:14.846207 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80426], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.21824413] seconds [----] I, [2016-09-13T11:56:14.846405 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80426], Delivering... [----] I, [2016-09-13T11:56:14.851707 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80426], State: [ok], Delivered in [0.005307668] seconds [----] I, [2016-09-13T11:56:14.857701 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80424], State: [ok], Delivered in [0.085450126] seconds [----] I, [2016-09-13T11:56:19.092595 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T11:56:19.966356 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [104], PID: [24051], GUID: [ee14426a-79c6-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:56:19.966525 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [104], PID: [24051], GUID: [ee14426a-79c6-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:56:19.977481 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [103], PID: [17555], GUID: [1dd6952c-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:56:19.977809 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [103], PID: [17555], GUID: [1dd6952c-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:56:20.006865 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:56:20.007110 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:56:20.029720 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:56:20.029933 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:56:20.052145 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:56:20.052300 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:56:20.069566 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:56:20.069775 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:56:20.087254 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:56:20.087619 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:56:20.121378 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:56:20.121619 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:56:20.143928 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:56:20.144173 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:56:20.166755 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:56:20.167036 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:56:20.189857 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:56:20.190115 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:56:20.212199 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:56:20.212346 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:56:20.234574 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T11:56:20.234734 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T11:56:20.242872 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002534627914428711, :log_active_servers=>0.0065686702728271484, :worker_monitor=>1.1438181400299072, :worker_dequeue=>0.0061740875244140625, :total_time=>1.1593585014343262} [----] I, [2016-09-13T11:56:20.760737 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:56:20.760895 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:56:20.761004 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:56:20.933031 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:56:20.933898 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T11:56:20.933972 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:56:20.934032 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:56:20.934074 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:56:20.934112 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T11:56:20.934145 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T11:56:20.934176 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:56:20.934208 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T11:56:20.934258 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:56:20.934297 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:56:20.934330 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:56:20.934360 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:56:20.934393 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T11:56:20.934463 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T11:56:20.934506 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T11:56:20.934538 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T11:56:20.934835 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:56:20.934986 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:56:21.990773 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:56:21.990959 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:56:21.991086 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:56:22.167312 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:56:22.168183 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T11:56:22.168267 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:56:22.168312 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:56:22.168351 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:56:22.168390 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T11:56:22.168463 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T11:56:22.168512 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:56:22.168550 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T11:56:22.168588 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:56:22.168621 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:56:22.168660 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:56:22.168693 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:56:22.168726 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T11:56:22.168758 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T11:56:22.168792 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T11:56:22.168824 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T11:56:22.169168 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:56:22.169462 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:56:22.975074 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:56:22.975310 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:56:22.975527 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:56:23.146588 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:56:23.147344 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T11:56:23.147453 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:56:23.147520 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:56:23.147564 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:56:23.147623 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T11:56:23.147664 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T11:56:23.147702 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:56:23.147737 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T11:56:23.147772 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:56:23.147806 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:56:23.147840 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:56:23.147876 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:56:23.147910 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T11:56:23.147942 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T11:56:23.148273 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:56:23.148598 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:56:24.452695 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T11:56:24.452826 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T11:56:24.452903 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T11:56:24.574868 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:56:24.575641 #17555:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T11:56:24.575713 #17555:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:56:24.575753 #17555:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:56:24.575784 #17555:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:56:24.575814 #17555:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T11:56:24.575842 #17555:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T11:56:24.575871 #17555:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:56:24.575913 #17555:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T11:56:24.575945 #17555:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:56:24.575973 #17555:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:56:24.576000 #17555:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:56:24.576046 #17555:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:56:24.576077 #17555:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T11:56:24.576104 #17555:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T11:56:24.576132 #17555:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T11:56:24.576160 #17555:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T11:56:24.576185 #17555:34713c] INFO -- : --- [----] I, [2016-09-13T11:56:24.576543 #17555:34713c] INFO -- : :guid: 1dd6952c-79b6-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:56:24.576605 #17555:34713c] INFO -- : :ems_id: 17 [----] I, [2016-09-13T11:56:24.576721 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T11:56:26.516999 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:56:26.517183 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:56:26.517299 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:56:26.654044 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:56:26.654319 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:56:26.654498 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:56:26.768004 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:56:26.768940 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T11:56:26.769041 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:56:26.769111 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:56:26.769160 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:56:26.769195 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T11:56:26.769230 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T11:56:26.769264 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:56:26.769299 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T11:56:26.769336 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:56:26.769371 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:56:26.769406 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:56:26.769484 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:56:26.769527 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T11:56:26.769578 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T11:56:26.769615 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T11:56:26.769647 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T11:56:26.769946 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:56:26.770111 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:56:26.815728 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:56:26.817577 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T11:56:26.817682 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:56:26.817741 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:56:26.817790 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:56:26.817836 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T11:56:26.817881 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T11:56:26.817928 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:56:26.817974 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T11:56:26.818046 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:56:26.818111 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:56:26.818165 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:56:26.818214 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:56:26.818260 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T11:56:26.818309 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T11:56:26.818360 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T11:56:26.818409 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T11:56:26.818503 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T11:56:26.818562 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T11:56:26.818622 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T11:56:26.818683 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T11:56:26.818742 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T11:56:26.818798 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T11:56:26.818855 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T11:56:26.818905 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T11:56:26.818956 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T11:56:26.819026 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T11:56:26.819091 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T11:56:26.819146 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T11:56:26.819199 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T11:56:26.819250 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T11:56:26.819304 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T11:56:26.819380 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T11:56:26.819480 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T11:56:26.819567 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T11:56:26.819621 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T11:56:26.819669 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T11:56:26.819715 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T11:56:26.819760 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T11:56:26.819802 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T11:56:26.820186 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:56:26.820379 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:56:26.820551 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:56:26.846462 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80427], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:56:26.916155 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:56:26.916338 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:56:26.916498 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:56:27.026510 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:56:27.026960 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T11:56:27.027002 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:56:27.027041 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:56:27.027063 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:56:27.027083 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T11:56:27.027102 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T11:56:27.027120 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:56:27.027137 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T11:56:27.027157 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:56:27.027174 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:56:27.027192 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:56:27.027210 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:56:27.027228 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T11:56:27.027247 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T11:56:27.027265 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T11:56:27.027281 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T11:56:27.027464 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:56:27.027564 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:56:27.028107 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T11:56:27.028245 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T11:56:27.028319 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T11:56:27.172862 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:56:27.173698 #24051:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T11:56:27.173773 #24051:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:56:27.173814 #24051:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:56:27.173846 #24051:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:56:27.173877 #24051:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T11:56:27.173908 #24051:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T11:56:27.173938 #24051:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:56:27.173967 #24051:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T11:56:27.174000 #24051:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:56:27.174049 #24051:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:56:27.174082 #24051:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T11:56:27.174112 #24051:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:56:27.174140 #24051:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T11:56:27.174170 #24051:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T11:56:27.174199 #24051:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T11:56:27.174225 #24051:34713c] INFO -- : --- [----] I, [2016-09-13T11:56:27.174562 #24051:34713c] INFO -- : :guid: ee14426a-79c6-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:56:27.174628 #24051:34713c] INFO -- : :ems_id: 17 [----] I, [2016-09-13T11:56:27.174796 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T11:56:27.857177 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:56:27.857359 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:56:27.857502 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:56:28.002666 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:56:28.003251 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T11:56:28.003309 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:56:28.003361 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:56:28.003394 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:56:28.003466 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T11:56:28.003505 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T11:56:28.003535 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:56:28.003561 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T11:56:28.003587 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:56:28.003614 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:56:28.003640 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:56:28.003666 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:56:28.003691 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T11:56:28.003715 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T11:56:28.003928 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:56:28.004150 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:56:28.027691 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:56:28.027827 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:56:28.027894 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:56:28.156743 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:56:28.157440 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T11:56:28.157509 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:56:28.157546 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:56:28.157575 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:56:28.157602 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T11:56:28.157628 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T11:56:28.157654 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:56:28.157683 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T11:56:28.157710 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:56:28.157735 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:56:28.157763 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:56:28.157790 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:56:28.157817 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T11:56:28.157844 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T11:56:28.157867 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T11:56:28.157893 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T11:56:28.158157 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:56:28.158322 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:56:29.864738 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:56:29.864876 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:56:29.864948 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:56:29.916717 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:56:29.916862 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:56:29.916949 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:56:30.014886 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:56:30.015600 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T11:56:30.015681 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:56:30.015725 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:56:30.015762 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:56:30.015796 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T11:56:30.015829 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T11:56:30.015862 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:56:30.015896 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T11:56:30.015928 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:56:30.015965 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:56:30.016001 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:56:30.016055 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:56:30.016092 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T11:56:30.016124 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T11:56:30.016385 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:56:30.016672 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:56:30.090298 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:56:30.091141 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T11:56:30.091222 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:56:30.091285 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:56:30.091327 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:56:30.091362 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T11:56:30.091395 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T11:56:30.091467 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:56:30.091516 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T11:56:30.091552 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:56:30.091584 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:56:30.091617 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:56:30.091647 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:56:30.091685 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T11:56:30.091717 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T11:56:30.091747 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T11:56:30.091776 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T11:56:30.092082 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:56:30.092263 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:56:30.350313 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:56:31.194796 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80427], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.366168816] seconds [----] I, [2016-09-13T11:56:31.194927 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80427], Delivering... [----] I, [2016-09-13T11:56:31.199150 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022552013397216797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022695064544677734, :pending_vm_jobs=>0.0005064010620117188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003953695297241211} [----] I, [2016-09-13T11:56:31.199429 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80427], State: [ok], Delivered in [0.004485056] seconds [----] I, [2016-09-13T11:56:31.599560 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T11:56:31.599680 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T11:56:31.599736 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T11:56:31.702944 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T11:56:31.703565 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T11:56:31.703628 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T11:56:31.703662 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T11:56:31.703702 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T11:56:31.703732 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T11:56:31.703758 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T11:56:31.703783 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T11:56:31.703807 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T11:56:31.703831 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T11:56:31.703855 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T11:56:31.703878 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T11:56:31.703902 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T11:56:31.703925 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T11:56:31.703948 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T11:56:31.703971 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T11:56:31.703993 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T11:56:31.704216 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T11:56:31.704328 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T11:56:36.769972 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003711223602294922, :worker_monitor=>1.4031612873077393, :worker_dequeue=>0.006003618240356445, :total_time=>1.413132667541504} [----] I, [2016-09-13T11:56:41.770382 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:56:41 UTC]... [----] I, [2016-09-13T11:56:41.790994 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:56:41 UTC]...Complete [----] I, [2016-09-13T11:56:41.861214 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:56:41.881946 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80428], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:56:41.899162 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80429], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:56:46.818965 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:56:47.319871 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80428], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.452342884] seconds [----] I, [2016-09-13T11:56:47.320058 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80428], Delivering... [----] I, [2016-09-13T11:56:47.325374 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028200149536132812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002838134765625, :pending_vm_jobs=>0.0006649494171142578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004976511001586914} [----] I, [2016-09-13T11:56:47.325685 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80428], State: [ok], Delivered in [0.00565006] seconds [----] I, [2016-09-13T11:56:48.097202 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80429], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.210780677] seconds [----] I, [2016-09-13T11:56:48.097465 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80429], Delivering... [----] I, [2016-09-13T11:56:48.103048 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80429], State: [ok], Delivered in [0.005580283] seconds [----] I, [2016-09-13T11:56:52.908997 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004164457321166992, :worker_monitor=>1.07548189163208, :worker_dequeue=>0.004960536956787109, :total_time=>1.0850327014923096} [----] I, [2016-09-13T11:56:56.909767 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:56:56.931008 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80430], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:56:57.918704 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:56:58.440471 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80430], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.524701843] seconds [----] I, [2016-09-13T11:56:58.440707 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80430], Delivering... [----] I, [2016-09-13T11:56:58.449112 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004296302795410156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00432133674621582, :pending_vm_jobs=>0.0010831356048583984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007877826690673828} [----] I, [2016-09-13T11:56:58.449603 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80430], State: [ok], Delivered in [0.008894487] seconds [----] I, [2016-09-13T11:57:09.101715 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003926992416381836, :worker_monitor=>1.1520106792449951, :worker_dequeue=>0.007336139678955078, :total_time=>1.1635818481445312} [----] I, [2016-09-13T11:57:11.941471 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:57:11.971686 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80431], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:57:12.005865 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80432], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:57:12.040156 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80433], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:57:12.068489 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80434], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:57:14.102292 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:57:14 UTC]... [----] I, [2016-09-13T11:57:14.120078 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:57:14 UTC]...Complete [----] I, [2016-09-13T11:57:14.133718 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:57:14.565722 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80431], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.616204447] seconds [----] I, [2016-09-13T11:57:14.565851 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80431], Delivering... [----] I, [2016-09-13T11:57:14.570071 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022199153900146484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002235889434814453, :pending_vm_jobs=>0.0005269050598144531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0039560794830322266} [----] I, [2016-09-13T11:57:14.570356 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80431], State: [ok], Delivered in [0.004499322] seconds [----] I, [2016-09-13T11:57:14.571444 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80432], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.594062601] seconds [----] I, [2016-09-13T11:57:14.571575 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80432], Delivering... [----] I, [2016-09-13T11:57:14.617028 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80432], State: [ok], Delivered in [0.045402162] seconds [----] I, [2016-09-13T11:57:15.228866 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80433], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.215545639] seconds [----] I, [2016-09-13T11:57:15.229093 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80433], Delivering... [----] I, [2016-09-13T11:57:15.232719 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80433], State: [ok], Delivered in [0.003606153] seconds [----] I, [2016-09-13T11:57:15.234214 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80434], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.182986534] seconds [----] I, [2016-09-13T11:57:15.234457 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80434], Delivering... [----] I, [2016-09-13T11:57:15.239585 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80434], State: [ok], Delivered in [0.005149901] seconds [----] I, [2016-09-13T11:57:25.294379 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003749847412109375, :worker_monitor=>1.137228012084961, :worker_dequeue=>0.0054340362548828125, :total_time=>1.1466994285583496} [----] I, [2016-09-13T11:57:27.082497 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:57:27.114742 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80435], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:57:30.428070 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:57:30.697264 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80435], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.610796512] seconds [----] I, [2016-09-13T11:57:30.697394 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80435], Delivering... [----] I, [2016-09-13T11:57:30.703366 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031189918518066406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031976699829101562, :pending_vm_jobs=>0.0008435249328613281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0056798458099365234} [----] I, [2016-09-13T11:57:30.703671 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80435], State: [ok], Delivered in [0.006261652] seconds [----] I, [2016-09-13T11:57:41.663115 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035021305084228516, :worker_monitor=>1.202035903930664, :worker_dequeue=>0.008538007736206055, :total_time=>1.2143511772155762} [----] I, [2016-09-13T11:57:42.123624 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:57:42.149357 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80436], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:57:42.172171 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80437], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:57:46.663598 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:57:46 UTC]... [----] I, [2016-09-13T11:57:46.686507 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:57:46 UTC]...Complete [----] I, [2016-09-13T11:57:46.696135 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:57:46.812100 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80436], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.682624596] seconds [----] I, [2016-09-13T11:57:46.812288 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80436], Delivering... [----] I, [2016-09-13T11:57:46.817896 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029616355895996094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030698776245117188, :pending_vm_jobs=>0.0006506443023681641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005259275436401367} [----] I, [2016-09-13T11:57:46.818259 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80436], State: [ok], Delivered in [0.005960269] seconds [----] I, [2016-09-13T11:57:48.355357 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80437], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.201833993] seconds [----] I, [2016-09-13T11:57:48.355614 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80437], Delivering... [----] I, [2016-09-13T11:57:48.360974 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80437], State: [ok], Delivered in [0.005336324] seconds [----] I, [2016-09-13T11:57:57.193796 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:57:57.220271 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80438], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:57:57.725641 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:57:57.729653 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002858400344848633, :worker_monitor=>1.0079782009124756, :worker_dequeue=>0.008513927459716797, :total_time=>1.0196285247802734} [----] I, [2016-09-13T11:57:57.895669 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80438], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.697891317] seconds [----] I, [2016-09-13T11:57:57.895859 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80438], Delivering... [----] I, [2016-09-13T11:57:57.899997 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023708343505859375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023865699768066406, :pending_vm_jobs=>0.0004374980926513672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003813505172729492} [----] I, [2016-09-13T11:57:57.900241 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80438], State: [ok], Delivered in [0.004402122] seconds [----] I, [2016-09-13T11:58:12.228837 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:58:12.244193 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80439], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:58:12.255807 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80440], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:58:12.289677 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80441], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:58:12.318316 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80442], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:58:13.791233 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:58:13.795740 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038590431213378906, :worker_monitor=>1.0230417251586914, :worker_dequeue=>0.010251283645629883, :total_time=>1.0375175476074219} [----] I, [2016-09-13T11:58:14.022204 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80439], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.788374588] seconds [----] I, [2016-09-13T11:58:14.022403 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80439], Delivering... [----] I, [2016-09-13T11:58:14.028339 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031652450561523438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031890869140625, :pending_vm_jobs=>0.0007157325744628906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00557398796081543} [----] I, [2016-09-13T11:58:14.028636 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80439], State: [ok], Delivered in [0.006240021] seconds [----] I, [2016-09-13T11:58:14.043194 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80440], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.795504294] seconds [----] I, [2016-09-13T11:58:14.043320 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80440], Delivering... [----] I, [2016-09-13T11:58:14.071548 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80440], State: [ok], Delivered in [0.028212791] seconds [----] I, [2016-09-13T11:58:15.455043 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80441], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.192186211] seconds [----] I, [2016-09-13T11:58:15.455242 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80441], Delivering... [----] I, [2016-09-13T11:58:15.458243 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80441], State: [ok], Delivered in [0.002987479] seconds [----] I, [2016-09-13T11:58:15.489385 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80442], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.193250967] seconds [----] I, [2016-09-13T11:58:15.489571 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80442], Delivering... [----] I, [2016-09-13T11:58:15.493952 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80442], State: [ok], Delivered in [0.004357647] seconds [----] I, [2016-09-13T11:58:18.796284 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:58:18 UTC]... [----] I, [2016-09-13T11:58:18.821328 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:58:18 UTC]...Complete [----] I, [2016-09-13T11:58:27.328750 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:58:27.352210 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80443], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:58:30.295796 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:58:30.302913 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0050618648529052734, :worker_monitor=>1.4347376823425293, :worker_dequeue=>0.015187501907348633, :total_time=>1.455411434173584} [----] I, [2016-09-13T11:58:30.530669 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80443], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.196572975] seconds [----] I, [2016-09-13T11:58:30.530895 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80443], Delivering... [----] I, [2016-09-13T11:58:30.537848 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035953521728515625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036208629608154297, :pending_vm_jobs=>0.0008928775787353516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006514549255371094} [----] I, [2016-09-13T11:58:30.538696 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80443], State: [ok], Delivered in [0.007793219] seconds [----] I, [2016-09-13T11:58:42.364810 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T11:58:42.385953 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80444], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:58:42.403061 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80445], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:58:42.443388 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80446], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:58:42.506195 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80447], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:58:46.547392 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:58:46.550703 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004070281982421875, :worker_monitor=>1.086256504058838, :worker_dequeue=>0.007631063461303711, :total_time=>1.0982732772827148} [----] I, [2016-09-13T11:58:47.232344 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80444], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.859889483] seconds [----] I, [2016-09-13T11:58:47.232585 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80444], Delivering... [----] I, [2016-09-13T11:58:47.241121 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003438711166381836, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003464937210083008, :pending_vm_jobs=>0.0013773441314697266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008036136627197266} [----] I, [2016-09-13T11:58:47.241804 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80444], State: [ok], Delivered in [0.009188922] seconds [----] I, [2016-09-13T11:58:47.278282 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80445], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.888679475] seconds [----] I, [2016-09-13T11:58:47.278610 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80445], Delivering... [----] I, [2016-09-13T11:58:47.280100 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T11:58:47.280345 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4593475584 [----] I, [2016-09-13T11:58:47.280459 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4355735552 [----] I, [2016-09-13T11:58:47.280548 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 237740032 [----] I, [2016-09-13T11:58:47.280618 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T11:58:47.280729 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4298989568 [----] I, [2016-09-13T11:58:47.280797 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T11:58:47.280867 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T11:58:47.280963 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 560406528 [----] I, [2016-09-13T11:58:47.281085 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T11:58:47.281175 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6837952512 [----] I, [2016-09-13T11:58:47.281244 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T11:58:47.281311 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T11:58:47.281373 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T11:58:47.281466 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 139264 [----] I, [2016-09-13T11:58:47.281549 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T11:58:47.281617 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T11:58:47.281680 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T11:58:47.281744 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T11:58:47.281802 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T11:58:47.281863 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T11:58:47.281924 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272142336 [----] I, [2016-09-13T11:58:47.281994 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55005184 [----] I, [2016-09-13T11:58:47.282085 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217137152 [----] I, [2016-09-13T11:58:47.282152 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6144000 [----] I, [2016-09-13T11:58:47.282261 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142778368 [----] I, [2016-09-13T11:58:47.282328 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3390738432 [----] I, [2016-09-13T11:58:47.282397 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3070361600 [----] I, [2016-09-13T11:58:47.282499 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T11:58:47.282575 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T11:58:47.282663 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T11:58:47.282729 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36937728 [----] I, [2016-09-13T11:58:47.282793 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76959744 [----] I, [2016-09-13T11:58:47.282855 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49807360 [----] I, [2016-09-13T11:58:47.282921 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111751168 [----] I, [2016-09-13T11:58:47.282986 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126767104 [----] I, [2016-09-13T11:58:47.283069 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T11:58:47.283135 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T11:58:47.283197 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T11:58:47.283258 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T11:58:47.283324 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T11:58:47.283387 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T11:58:47.283487 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T11:58:47.283555 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 8192 [----] I, [2016-09-13T11:58:47.283619 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T11:58:47.322284 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T11:58:47.322489 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T11:58:47.325496 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T11:58:47.327628 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T11:58:47.330197 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T11:58:47.332736 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T11:58:47.335341 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T11:58:47.337850 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 857 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T11:58:47.340328 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T11:58:47.342831 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T11:58:47.345266 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T11:58:47.347761 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T11:58:47.350442 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T11:58:47.352918 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T11:58:47.355746 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:58:47.355941 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T11:58:47.356047 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T11:58:47.360310 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [155566.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:58:47.360679 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80445], State: [ok], Delivered in [0.082065046] seconds [----] I, [2016-09-13T11:58:48.620487 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80447], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.17181637] seconds [----] I, [2016-09-13T11:58:48.620623 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80447], Delivering... [----] I, [2016-09-13T11:58:48.623749 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80447], State: [ok], Delivered in [0.003125585] seconds [----] I, [2016-09-13T11:58:51.551229 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:58:51 UTC]... [----] I, [2016-09-13T11:58:51.569840 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:58:51 UTC]...Complete [----] I, [2016-09-13T11:58:51.581281 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:58:51.643255 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80446], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [9.236902071] seconds [----] I, [2016-09-13T11:58:51.643437 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80446], Delivering... [----] I, [2016-09-13T11:58:51.648755 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:58:43 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163163000], Memory % [3.1], CPU Time [38980.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T11:58:51.649155 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:58:45 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359294000], Memory % [5.28], CPU Time [208213.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T11:58:51.649519 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:58:46 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [154710.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:58:51.649825 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:58:46 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [155571.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T11:58:51.650188 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:58:45 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [52942.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:58:51.650533 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:58:42 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [246534.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T11:58:51.650829 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:58:40 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347858000], Memory % [5.04], CPU Time [106533.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T11:58:51.651140 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:58:35 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213441000], Memory % [3.51], CPU Time [50236.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T11:58:51.653150 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:58:44 UTC], Process Info: Memory Usage [602771456], Memory Size [978030592], Proportional Set Size: [446093000], Memory % [7.35], CPU Time [929.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T11:58:51.653518 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:58:45 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358593000], Memory % [5.27], CPU Time [215598.0], CPU % [0.41], Priority [30] [----] I, [2016-09-13T11:58:51.653841 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:58:45 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [52910.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T11:58:51.654146 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:58:42 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166763000], Memory % [3.16], CPU Time [39901.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T11:58:51.655863 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 15:58:37 UTC], Process Info: Memory Usage [616816640], Memory Size [1077821440], Proportional Set Size: [457645000], Memory % [7.52], CPU Time [648.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T11:58:51.656105 #2928:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80446], State: [ok], Delivered in [0.012686503] seconds [----] I, [2016-09-13T11:58:57.517533 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:58:57.534713 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80448], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:59:03.056061 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:59:03.059549 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0028357505798339844, :worker_monitor=>1.4488821029663086, :worker_dequeue=>0.007907390594482422, :total_time=>1.4598455429077148} [----] I, [2016-09-13T11:59:03.403661 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80448], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.880803319] seconds [----] I, [2016-09-13T11:59:03.403874 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80448], Delivering... [----] I, [2016-09-13T11:59:03.410602 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034945011138916016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035135746002197266, :pending_vm_jobs=>0.0009045600891113281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063173770904541016} [----] I, [2016-09-13T11:59:03.411019 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80448], State: [ok], Delivered in [0.007134896] seconds [----] I, [2016-09-13T11:59:12.551208 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T11:59:12.592210 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80449], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:59:12.615088 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80450], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:59:12.649176 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80451], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:59:12.668881 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80452], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:59:13.091450 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:59:13.518534 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80449], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.962129153] seconds [----] I, [2016-09-13T11:59:13.518676 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80449], Delivering... [----] I, [2016-09-13T11:59:13.523558 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00254058837890625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025539398193359375, :pending_vm_jobs=>0.0006074905395507812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004594326019287109} [----] I, [2016-09-13T11:59:13.523911 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80449], State: [ok], Delivered in [0.005227175] seconds [----] I, [2016-09-13T11:59:13.604561 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80450], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.006948453] seconds [----] I, [2016-09-13T11:59:13.604790 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80450], Delivering... [----] I, [2016-09-13T11:59:13.655817 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80450], State: [ok], Delivered in [0.050985086] seconds [----] I, [2016-09-13T11:59:15.733818 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80451], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.112246036] seconds [----] I, [2016-09-13T11:59:15.733989 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80451], Delivering... [----] I, [2016-09-13T11:59:15.740257 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80451], State: [ok], Delivered in [0.006232215] seconds [----] I, [2016-09-13T11:59:15.749215 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80452], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.09296717] seconds [----] I, [2016-09-13T11:59:15.749394 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80452], Delivering... [----] I, [2016-09-13T11:59:15.754114 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80452], State: [ok], Delivered in [0.004700271] seconds [----] I, [2016-09-13T11:59:19.184048 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025577545166015625, :worker_monitor=>1.0762052536010742, :worker_dequeue=>0.005625009536743164, :total_time=>1.0845890045166016} [----] I, [2016-09-13T11:59:24.184579 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:59:24 UTC]... [----] I, [2016-09-13T11:59:24.216411 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:59:24 UTC]...Complete [----] I, [2016-09-13T11:59:27.683524 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:59:27.696995 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80453], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:59:29.235393 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:59:29.668354 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80453], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.979899034] seconds [----] I, [2016-09-13T11:59:29.668597 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80453], Delivering... [----] I, [2016-09-13T11:59:29.676287 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003771066665649414, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038042068481445312, :pending_vm_jobs=>0.0010209083557128906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007237434387207031} [----] I, [2016-09-13T11:59:29.676725 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80453], State: [ok], Delivered in [0.008125535] seconds [----] I, [2016-09-13T11:59:35.326396 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002817869186401367, :worker_monitor=>1.0686407089233398, :worker_dequeue=>0.014923095703125, :total_time=>1.0866131782531738} [----] I, [2016-09-13T11:59:42.706750 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T11:59:42.731063 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80454], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:59:42.755309 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80455], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T11:59:45.450477 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T11:59:45.822373 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80454], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.110281823] seconds [----] I, [2016-09-13T11:59:45.822540 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80454], Delivering... [----] I, [2016-09-13T11:59:45.827874 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002421140670776367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024421215057373047, :pending_vm_jobs=>0.0007665157318115234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005068778991699219} [----] I, [2016-09-13T11:59:45.828192 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80454], State: [ok], Delivered in [0.005633369] seconds [----] I, [2016-09-13T11:59:45.856633 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80455], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.121512382] seconds [----] I, [2016-09-13T11:59:45.856750 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80455], Delivering... [----] I, [2016-09-13T11:59:45.859838 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80455], State: [ok], Delivered in [0.00307936] seconds [----] I, [2016-09-13T11:59:51.709299 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00383758544921875, :worker_monitor=>1.245037317276001, :worker_dequeue=>0.004986763000488281, :total_time=>1.254223108291626} [----] I, [2016-09-13T11:59:56.709752 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:59:56 UTC]... [----] I, [2016-09-13T11:59:56.719562 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 15:59:56 UTC]...Complete [----] I, [2016-09-13T11:59:57.766971 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T11:59:57.776911 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80456], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:00:01.739329 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:00:01.994277 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80456], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.222472215] seconds [----] I, [2016-09-13T12:00:01.994482 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80456], Delivering... [----] I, [2016-09-13T12:00:02.000718 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032088756561279297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003231048583984375, :pending_vm_jobs=>0.0008373260498046875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005885601043701172} [----] I, [2016-09-13T12:00:02.008811 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80456], State: [ok], Delivered in [0.014296402] seconds [----] I, [2016-09-13T12:00:08.299166 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036821365356445312, :worker_monitor=>1.5365214347839355, :worker_dequeue=>0.014085054397583008, :total_time=>1.5546512603759766} [----] I, [2016-09-13T12:00:12.786220 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T12:00:12.805543 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80457], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:00:12.806708 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget] [----] I, [2016-09-13T12:00:12.817304 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80458], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473786000] [----] I, [2016-09-13T12:00:12.817428 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T12:00:12.818380 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget] [----] I, [2016-09-13T12:00:12.828603 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80459], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473786000] [----] I, [2016-09-13T12:00:12.828710 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T12:00:12.846160 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80460], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:00:12.856937 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80461], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:00:12.868559 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80462], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:00:12.885585 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80463], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:00:12.896710 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80464], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:00:12.914165 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80465], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:00:13.310048 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 9 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:00:14.034578 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80457], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.242819539] seconds [----] I, [2016-09-13T12:00:14.034799 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80457], Delivering... [----] I, [2016-09-13T12:00:14.042636 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003929615020751953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0039556026458740234, :pending_vm_jobs=>0.0010166168212890625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00732731819152832} [----] I, [2016-09-13T12:00:14.043082 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80457], State: [ok], Delivered in [0.00825627] seconds [----] I, [2016-09-13T12:00:14.086145 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80463], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.213749162] seconds [----] I, [2016-09-13T12:00:14.086363 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80463], Delivering... [----] I, [2016-09-13T12:00:14.154292 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80463], State: [ok], Delivered in [0.067929218] seconds [----] I, [2016-09-13T12:00:15.954787 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80460], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.12281445] seconds [----] I, [2016-09-13T12:00:15.955033 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80460], Delivering... [----] I, [2016-09-13T12:00:15.957728 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80460], State: [ok], Delivered in [0.002706011] seconds [----] I, [2016-09-13T12:00:16.046177 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80461], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.195014498] seconds [----] I, [2016-09-13T12:00:16.046364 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80461], Delivering... [----] I, [2016-09-13T12:00:16.054973 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80461], State: [ok], Delivered in [0.00859425] seconds [----] I, [2016-09-13T12:00:16.092122 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80462], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.230183635] seconds [----] I, [2016-09-13T12:00:16.092314 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80462], Delivering... [----] I, [2016-09-13T12:00:16.097991 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80462], State: [ok], Delivered in [0.005668178] seconds [----] I, [2016-09-13T12:00:16.160172 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80464], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.271298969] seconds [----] I, [2016-09-13T12:00:16.160319 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80464], Delivering... [----] I, [2016-09-13T12:00:16.162864 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80464], State: [ok], Delivered in [0.002532619] seconds [----] I, [2016-09-13T12:00:16.217762 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80465], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.316542422] seconds [----] I, [2016-09-13T12:00:16.217941 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80465], Delivering... [----] I, [2016-09-13T12:00:16.222694 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80465], State: [ok], Delivered in [0.004736434] seconds [----] I, [2016-09-13T12:00:16.235288 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80458], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473786000], Dequeued in: [3.427528867] seconds [----] I, [2016-09-13T12:00:16.235496 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80458], Delivering... [----] I, [2016-09-13T12:00:16.249127 #2928:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered Hosts] invoking action: [generate_widget] for target: [rss_newest_hosts] [----] I, [2016-09-13T12:00:16.287082 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80459], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473786000], Dequeued in: [3.46762019] seconds [----] I, [2016-09-13T12:00:16.287305 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80459], Delivering... [----] I, [2016-09-13T12:00:16.300569 #2937:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered VMs] invoking action: [generate_widget] for target: [rss_newest_vms] [----] I, [2016-09-13T12:00:16.313802 #2928:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [225], Name: [Generate Widget: 'EVM: Recently Discovered Hosts'] for: [1] groups [----] I, [2016-09-13T12:00:16.338254 #2928:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered Hosts] ID: [18] Queueing Content Generation [----] I, [2016-09-13T12:00:16.349974 #2937:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [226], Name: [Generate Widget: 'EVM: Recently Discovered VMs'] for: [1] groups [----] I, [2016-09-13T12:00:16.361299 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80466], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T12:00:16.361553 #2928:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered Hosts] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered Hosts] [----] I, [2016-09-13T12:00:16.372320 #2937:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered VMs] ID: [19] Queueing Content Generation [----] I, [2016-09-13T12:00:16.391819 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80458], State: [ok], Delivered in [0.156267474] seconds [----] I, [2016-09-13T12:00:16.401725 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80467], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T12:00:16.402060 #2937:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered VMs] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered VMs] [----] I, [2016-09-13T12:00:16.447053 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80459], State: [ok], Delivered in [0.159708214] seconds [----] I, [2016-09-13T12:00:18.326772 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=reporting, wcount=2, priority=200 [----] I, [2016-09-13T12:00:18.367607 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [80466], MiqWorker id: [17], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [2.021233673] seconds [----] I, [2016-09-13T12:00:18.367820 #2967:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80466], Delivering... [----] I, [2016-09-13T12:00:18.385217 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T12:00:18.447308 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T12:00:18.447725 #2967:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80466], State: [ok], Delivered in [0.079920188] seconds [----] I, [2016-09-13T12:00:18.449998 #2967:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [80466], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T12:00:18.450161 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [18], MiqTask ID: [225], Status: [ok] [----] I, [2016-09-13T12:00:18.456118 #2967:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [225] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T12:00:18.611330 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [80467], MiqWorker id: [18], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [2.229739489] seconds [----] I, [2016-09-13T12:00:18.611593 #2978:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80467], Delivering... [----] I, [2016-09-13T12:00:18.647455 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T12:00:18.710528 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T12:00:18.711058 #2978:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80467], State: [ok], Delivered in [0.09942538] seconds [----] I, [2016-09-13T12:00:18.713895 #2978:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [80467], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T12:00:18.714103 #2978:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [19], MiqTask ID: [226], Status: [ok] [----] I, [2016-09-13T12:00:18.719889 #2978:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [226] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T12:00:25.116310 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003968477249145508, :worker_monitor=>1.7740509510040283, :worker_dequeue=>0.008485555648803711, :total_time=>1.78682279586792} [----] I, [2016-09-13T12:00:27.923022 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:00:27.961984 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80468], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:00:27.969971 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered Hosts] with id: [18] [----] I, [2016-09-13T12:00:27.970248 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_18 [----] I, [2016-09-13T12:00:27.974281 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T12:00:27.974711 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 17:00:00 UTC [----] I, [2016-09-13T12:00:27.977170 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered Hosts] schedule updated to run at 2016-09-13 17:00:00 UTC with interval 3600 [----] I, [2016-09-13T12:00:27.977636 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered VMs] with id: [19] [----] I, [2016-09-13T12:00:27.977779 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_19 [----] I, [2016-09-13T12:00:27.980829 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T12:00:27.981083 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 17:00:00 UTC [----] I, [2016-09-13T12:00:27.982213 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered VMs] schedule updated to run at 2016-09-13 17:00:00 UTC with interval 3600 [----] I, [2016-09-13T12:00:30.116817 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:00:30 UTC]... [----] I, [2016-09-13T12:00:30.144206 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:00:30 UTC]...Complete [----] I, [2016-09-13T12:00:30.151079 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:00:30.304644 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80468], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.375615798] seconds [----] I, [2016-09-13T12:00:30.304783 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80468], Delivering... [----] I, [2016-09-13T12:00:30.309402 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025293827056884766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025475025177001953, :pending_vm_jobs=>0.0005538463592529297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004347801208496094} [----] I, [2016-09-13T12:00:30.314497 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80468], State: [ok], Delivered in [0.009628617] seconds [----] I, [2016-09-13T12:00:41.671192 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0027761459350585938, :worker_monitor=>1.4977433681488037, :worker_dequeue=>0.004902839660644531, :total_time=>1.5056772232055664} [----] I, [2016-09-13T12:00:42.984974 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:00:43.001472 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80469], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:00:43.024251 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80470], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:00:46.790143 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:00:47.396945 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80469], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.408189097] seconds [----] I, [2016-09-13T12:00:47.397109 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80469], Delivering... [----] I, [2016-09-13T12:00:47.401581 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025184154510498047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025370121002197266, :pending_vm_jobs=>0.0005400180816650391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004208803176879883} [----] I, [2016-09-13T12:00:47.401837 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80469], State: [ok], Delivered in [0.004722644] seconds [----] I, [2016-09-13T12:00:49.521879 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80470], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.51770996] seconds [----] I, [2016-09-13T12:00:49.522062 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80470], Delivering... [----] I, [2016-09-13T12:00:49.526345 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80470], State: [ok], Delivered in [0.004265058] seconds [----] I, [2016-09-13T12:00:57.981387 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002629995346069336, :worker_monitor=>1.1657443046569824, :worker_dequeue=>0.010491609573364258, :total_time=>1.179086446762085} [----] I, [2016-09-13T12:00:58.035364 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:00:58.053073 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80471], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:01:02.981890 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:01:02 UTC]... [----] I, [2016-09-13T12:01:02.995873 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:01:02 UTC]...Complete [----] I, [2016-09-13T12:01:03.009453 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:01:03.573899 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80471], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.532980561] seconds [----] I, [2016-09-13T12:01:03.574221 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80471], Delivering... [----] I, [2016-09-13T12:01:03.582144 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004215717315673828, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004292488098144531, :pending_vm_jobs=>0.0008828639984130859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0073816776275634766} [----] I, [2016-09-13T12:01:03.582550 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80471], State: [ok], Delivered in [0.008369961] seconds [----] I, [2016-09-13T12:01:13.061988 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T12:01:13.082254 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80472], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:01:13.110823 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80473], id: [], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:01:13.127958 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80474], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:01:13.156436 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80475], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:01:13.179391 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80476], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:01:14.589138 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:01:14.595162 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0032265186309814453, :worker_monitor=>1.5540416240692139, :worker_dequeue=>0.009688138961791992, :total_time=>1.5672187805175781} [----] I, [2016-09-13T12:01:14.643690 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80472], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.574771541] seconds [----] I, [2016-09-13T12:01:14.643840 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80472], Delivering... [----] I, [2016-09-13T12:01:14.647964 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002230405807495117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002246856689453125, :pending_vm_jobs=>0.0005207061767578125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00385284423828125} [----] I, [2016-09-13T12:01:14.648287 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80472], State: [ok], Delivered in [0.004427659] seconds [----] I, [2016-09-13T12:01:14.700959 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80474], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.584642606] seconds [----] I, [2016-09-13T12:01:14.701142 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80474], Delivering... [----] I, [2016-09-13T12:01:14.752082 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80474], State: [ok], Delivered in [0.05092265] seconds [----] I, [2016-09-13T12:01:16.723889 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80473], MiqWorker id: [13], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.627819914] seconds [----] I, [2016-09-13T12:01:16.724097 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80473], Delivering... [----] I, [2016-09-13T12:01:16.735505 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80475], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.601269778] seconds [----] I, [2016-09-13T12:01:16.735710 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80475], Delivering... [----] I, [2016-09-13T12:01:16.738920 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80475], State: [ok], Delivered in [0.003194787] seconds [----] I, [2016-09-13T12:01:16.780835 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80476], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.61335355] seconds [----] I, [2016-09-13T12:01:16.780960 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80476], Delivering... [----] I, [2016-09-13T12:01:16.783959 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80476], State: [ok], Delivered in [0.002987914] seconds [----] I, [2016-09-13T12:01:19.607507 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T12:01:28.190214 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:01:28.246855 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80477], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:01:31.333061 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:01:31.336612 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025687217712402344, :worker_monitor=>1.703977108001709, :worker_dequeue=>0.007834672927856445, :total_time=>1.7146213054656982} [----] I, [2016-09-13T12:01:31.840215 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80477], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.644421978] seconds [----] I, [2016-09-13T12:01:31.840518 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80477], Delivering... [----] I, [2016-09-13T12:01:31.850044 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004580259323120117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004618644714355469, :pending_vm_jobs=>0.0013537406921386719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009018182754516602} [----] I, [2016-09-13T12:01:31.850506 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80477], State: [ok], Delivered in [0.009963474] seconds [----] I, [2016-09-13T12:01:36.337255 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:01:36 UTC]... [----] I, [2016-09-13T12:01:36.514941 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:01:36 UTC]...Complete [----] I, [2016-09-13T12:01:43.513020 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:01:43.560974 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80478], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:01:43.598970 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80479], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:01:48.937644 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:01:48.946394 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003472566604614258, :worker_monitor=>2.381427526473999, :worker_dequeue=>0.013576269149780273, :total_time=>2.398775815963745} [----] I, [2016-09-13T12:01:48.982967 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80478], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.463233469] seconds [----] I, [2016-09-13T12:01:48.983128 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80478], Delivering... [----] I, [2016-09-13T12:01:48.990070 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032384395599365234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032625198364257812, :pending_vm_jobs=>0.0011200904846191406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00660252571105957} [----] I, [2016-09-13T12:01:48.990562 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80478], State: [ok], Delivered in [0.007404603] seconds [----] I, [2016-09-13T12:01:49.946947 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80479], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.382812917] seconds [----] I, [2016-09-13T12:01:49.947161 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80479], Delivering... [----] I, [2016-09-13T12:01:49.951576 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80479], State: [ok], Delivered in [0.004389833] seconds [----] I, [2016-09-13T12:01:58.613392 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:01:58.650276 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80480], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:01:59.065371 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:01:59.196927 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80480], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.577847769] seconds [----] I, [2016-09-13T12:01:59.197082 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80480], Delivering... [----] I, [2016-09-13T12:01:59.202861 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023975372314453125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024123191833496094, :pending_vm_jobs=>0.0008728504180908203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005475282669067383} [----] I, [2016-09-13T12:01:59.203305 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80480], State: [ok], Delivered in [0.006198604] seconds [----] I, [2016-09-13T12:02:06.926561 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004598379135131836, :worker_monitor=>2.8386735916137695, :worker_dequeue=>0.014805793762207031, :total_time=>2.8583626747131348} [----] I, [2016-09-13T12:02:11.927273 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:02:11 UTC]... [----] I, [2016-09-13T12:02:11.952538 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:02:11 UTC]...Complete [----] I, [2016-09-13T12:02:13.662136 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:02:13.718881 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80481], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:02:13.788376 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80482], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:02:13.873319 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80483], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:02:13.896159 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80484], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:02:16.970439 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:02:17.131549 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80481], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.464706214] seconds [----] I, [2016-09-13T12:02:17.131715 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80481], Delivering... [----] I, [2016-09-13T12:02:17.137110 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030329227447509766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030541419982910156, :pending_vm_jobs=>0.0006771087646484375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005087137222290039} [----] I, [2016-09-13T12:02:17.137453 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80481], State: [ok], Delivered in [0.005714099] seconds [----] I, [2016-09-13T12:02:17.175770 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80483], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.381202814] seconds [----] I, [2016-09-13T12:02:17.175943 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80483], Delivering... [----] I, [2016-09-13T12:02:17.257028 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80483], State: [ok], Delivered in [0.081044385] seconds [----] I, [2016-09-13T12:02:17.257593 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80482], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.534084964] seconds [----] I, [2016-09-13T12:02:17.257803 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80482], Delivering... [----] I, [2016-09-13T12:02:17.261570 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80482], State: [ok], Delivered in [0.003739999] seconds [----] I, [2016-09-13T12:02:17.371668 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80484], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.494267807] seconds [----] I, [2016-09-13T12:02:17.371807 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80484], Delivering... [----] I, [2016-09-13T12:02:17.374932 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80484], State: [ok], Delivered in [0.003106421] seconds [----] I, [2016-09-13T12:02:23.893393 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003475189208984375, :worker_monitor=>1.9047651290893555, :worker_dequeue=>0.009905338287353516, :total_time=>1.91843581199646} [----] I, [2016-09-13T12:02:28.909681 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:02:28.964083 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80485], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:02:33.918782 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:02:34.394179 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80485], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.477811247] seconds [----] I, [2016-09-13T12:02:34.394390 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80485], Delivering... [----] I, [2016-09-13T12:02:34.401468 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031783580780029297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032041072845458984, :pending_vm_jobs=>0.0010018348693847656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0066835880279541016} [----] I, [2016-09-13T12:02:34.401960 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80485], State: [ok], Delivered in [0.007550334] seconds [----] I, [2016-09-13T12:02:40.721567 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003473520278930664, :worker_monitor=>1.7834417819976807, :worker_dequeue=>0.010209083557128906, :total_time=>1.7974367141723633} [----] I, [2016-09-13T12:02:43.978313 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:02:44.088231 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80486], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:02:44.172711 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80487], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:02:45.722093 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:02:45 UTC]... [----] I, [2016-09-13T12:02:45.791327 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:02:45 UTC]...Complete [----] I, [2016-09-13T12:02:45.798044 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:02:46.586103 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80486], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.603293984] seconds [----] I, [2016-09-13T12:02:46.586240 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80486], Delivering... [----] I, [2016-09-13T12:02:46.590206 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022122859954833984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002225160598754883, :pending_vm_jobs=>0.0004730224609375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0037336349487304688} [----] I, [2016-09-13T12:02:46.590484 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80486], State: [ok], Delivered in [0.004239813] seconds [----] I, [2016-09-13T12:02:47.540202 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80487], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.447368403] seconds [----] I, [2016-09-13T12:02:47.540464 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80487], Delivering... [----] I, [2016-09-13T12:02:47.547067 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80487], State: [ok], Delivered in [0.006565718] seconds [----] I, [2016-09-13T12:02:58.611280 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0050506591796875, :server_monitor=>0.1763615608215332, :worker_monitor=>2.604140043258667, :worker_dequeue=>0.011798381805419922, :total_time=>2.7978105545043945} [----] I, [2016-09-13T12:02:58.633560 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80473], State: [ok], Delivered in [101.909418989] seconds [----] I, [2016-09-13T12:02:59.186685 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:02:59.263242 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80488], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:03:03.623874 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:03:03.715578 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80488], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.522567886] seconds [----] I, [2016-09-13T12:03:03.715715 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80488], Delivering... [----] I, [2016-09-13T12:03:03.719641 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022194385528564453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002233743667602539, :pending_vm_jobs=>0.00045228004455566406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003672361373901367} [----] I, [2016-09-13T12:03:03.719863 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80488], State: [ok], Delivered in [0.004149626] seconds [----] I, [2016-09-13T12:03:14.273617 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:03:14.302370 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80489], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:03:14.346669 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80490], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:03:14.409805 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80491], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:03:14.481092 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80492], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:03:15.533054 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:03:15.536077 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005986690521240234, :worker_monitor=>1.879080057144165, :worker_dequeue=>0.007072925567626953, :total_time=>1.8926951885223389} [----] I, [2016-09-13T12:03:15.844179 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80489], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.565626447] seconds [----] I, [2016-09-13T12:03:15.844378 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80489], Delivering... [----] I, [2016-09-13T12:03:15.852566 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004111289978027344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0041391849517822266, :pending_vm_jobs=>0.0010502338409423828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007721424102783203} [----] I, [2016-09-13T12:03:15.853281 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80489], State: [ok], Delivered in [0.008883544] seconds [----] I, [2016-09-13T12:03:15.918905 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80490], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.612930339] seconds [----] I, [2016-09-13T12:03:15.919132 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80490], Delivering... [----] I, [2016-09-13T12:03:15.992837 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80490], State: [ok], Delivered in [0.073650424] seconds [----] I, [2016-09-13T12:03:16.811881 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80491], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.460623852] seconds [----] I, [2016-09-13T12:03:16.812202 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80491], Delivering... [----] I, [2016-09-13T12:03:16.823741 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80491], State: [ok], Delivered in [0.011537016] seconds [----] I, [2016-09-13T12:03:16.914457 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80492], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.499136023] seconds [----] I, [2016-09-13T12:03:16.914890 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80492], Delivering... [----] I, [2016-09-13T12:03:16.922022 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80492], State: [ok], Delivered in [0.007266531] seconds [----] I, [2016-09-13T12:03:20.536768 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:03:20 UTC]... [----] I, [2016-09-13T12:03:20.578540 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:03:20 UTC]...Complete [----] I, [2016-09-13T12:03:29.494688 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:03:29.515899 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80493], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:03:32.525366 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:03:32.530084 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003915548324584961, :worker_monitor=>1.8905761241912842, :worker_dequeue=>0.010122060775756836, :total_time=>1.9048810005187988} [----] I, [2016-09-13T12:03:32.746371 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80493], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.245317829] seconds [----] I, [2016-09-13T12:03:32.746702 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80493], Delivering... [----] I, [2016-09-13T12:03:32.756563 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005742311477661133, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00577545166015625, :pending_vm_jobs=>0.0014069080352783203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009324789047241211} [----] I, [2016-09-13T12:03:32.757071 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80493], State: [ok], Delivered in [0.010361055] seconds [----] I, [2016-09-13T12:03:44.524329 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T12:03:44.538242 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80494], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:03:44.588280 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80495], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:03:44.599540 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80496], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:03:44.622669 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80497], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:03:48.946468 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:03:48.949213 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0059947967529296875, :worker_monitor=>1.3908030986785889, :worker_dequeue=>0.0061283111572265625, :total_time=>1.4033641815185547} [----] I, [2016-09-13T12:03:49.128896 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80494], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.600306769] seconds [----] I, [2016-09-13T12:03:49.129079 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80494], Delivering... [----] I, [2016-09-13T12:03:49.129911 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T12:03:49.130131 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4580597760 [----] I, [2016-09-13T12:03:49.130232 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4342673408 [----] I, [2016-09-13T12:03:49.130319 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 237924352 [----] I, [2016-09-13T12:03:49.130403 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T12:03:49.130519 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4285956096 [----] I, [2016-09-13T12:03:49.130602 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T12:03:49.130688 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T12:03:49.130764 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 561016832 [----] I, [2016-09-13T12:03:49.130841 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T12:03:49.130920 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6663696384 [----] I, [2016-09-13T12:03:49.131012 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T12:03:49.131105 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T12:03:49.131198 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T12:03:49.131293 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 417792 [----] I, [2016-09-13T12:03:49.131390 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T12:03:49.131501 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T12:03:49.131588 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T12:03:49.131681 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T12:03:49.131761 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T12:03:49.131861 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T12:03:49.131945 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272588800 [----] I, [2016-09-13T12:03:49.132053 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55205888 [----] I, [2016-09-13T12:03:49.132145 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217382912 [----] I, [2016-09-13T12:03:49.132231 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6144000 [----] I, [2016-09-13T12:03:49.132320 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142356480 [----] I, [2016-09-13T12:03:49.132444 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3404214272 [----] I, [2016-09-13T12:03:49.132547 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3083407360 [----] I, [2016-09-13T12:03:49.132643 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T12:03:49.132735 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T12:03:49.132824 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T12:03:49.132912 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36401152 [----] I, [2016-09-13T12:03:49.133012 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76959744 [----] I, [2016-09-13T12:03:49.133108 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49577984 [----] I, [2016-09-13T12:03:49.133198 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111931392 [----] I, [2016-09-13T12:03:49.133285 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126537728 [----] I, [2016-09-13T12:03:49.133389 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T12:03:49.133517 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T12:03:49.133631 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T12:03:49.133721 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T12:03:49.133820 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T12:03:49.133912 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T12:03:49.134006 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T12:03:49.134094 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T12:03:49.134169 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T12:03:49.167870 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T12:03:49.168079 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T12:03:49.171812 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T12:03:49.174744 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T12:03:49.178127 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T12:03:49.181554 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T12:03:49.184949 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T12:03:49.188451 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 857 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T12:03:49.191812 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T12:03:49.195292 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.3 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T12:03:49.198752 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.8 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T12:03:49.202147 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T12:03:49.205618 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 183 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T12:03:49.208985 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T12:03:49.211827 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:03:49.211967 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:03:49.212112 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T12:03:49.216526 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [155623.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:03:49.216910 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80494], State: [ok], Delivered in [0.087811306] seconds [----] I, [2016-09-13T12:03:49.237305 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80497], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.633912332] seconds [----] I, [2016-09-13T12:03:49.237440 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80497], Delivering... [----] I, [2016-09-13T12:03:49.241203 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.001932382583618164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0019481182098388672, :pending_vm_jobs=>0.00048160552978515625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003528118133544922} [----] I, [2016-09-13T12:03:49.241482 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80497], State: [ok], Delivered in [0.00406151] seconds [----] I, [2016-09-13T12:03:49.243133 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80495], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.702225982] seconds [----] I, [2016-09-13T12:03:49.243262 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80495], Delivering... [----] I, [2016-09-13T12:03:49.248713 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:03:47 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359296000], Memory % [5.28], CPU Time [208259.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T12:03:49.249145 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:03:48 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [155631.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:03:49.249537 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:03:48 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [154777.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:03:49.249955 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:03:46 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [52966.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:03:49.250346 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:03:44 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [246681.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T12:03:49.250693 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:03:40 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347859000], Memory % [5.04], CPU Time [106548.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T12:03:49.251030 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:03:47 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213441000], Memory % [3.51], CPU Time [50244.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T12:03:49.251473 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:03:47 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163163000], Memory % [3.1], CPU Time [38990.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T12:03:49.253736 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:03:48 UTC], Process Info: Memory Usage [605892608], Memory Size [940855296], Proportional Set Size: [446985000], Memory % [7.39], CPU Time [710.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T12:03:49.255282 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:03:45 UTC], Process Info: Memory Usage [602030080], Memory Size [945401856], Proportional Set Size: [445295000], Memory % [7.34], CPU Time [979.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T12:03:49.255680 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:03:47 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358595000], Memory % [5.27], CPU Time [216909.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T12:03:49.256061 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:03:46 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [52932.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:03:49.256380 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:03:42 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166763000], Memory % [3.16], CPU Time [39912.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T12:03:49.256663 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80495], State: [ok], Delivered in [0.013394251] seconds [----] I, [2016-09-13T12:03:50.060955 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80496], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.469792624] seconds [----] I, [2016-09-13T12:03:50.061226 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80496], Delivering... [----] I, [2016-09-13T12:03:50.067290 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80496], State: [ok], Delivered in [0.006068329] seconds [----] I, [2016-09-13T12:03:53.949629 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:03:53 UTC]... [----] I, [2016-09-13T12:03:53.980241 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:03:53 UTC]...Complete [----] I, [2016-09-13T12:03:59.631084 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:03:59.649046 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80498], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:04:05.212588 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:04:05.216886 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005613565444946289, :worker_monitor=>1.038163185119629, :worker_dequeue=>0.01072239875793457, :total_time=>1.054767370223999} [----] I, [2016-09-13T12:04:05.386489 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80498], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.750000716] seconds [----] I, [2016-09-13T12:04:05.386626 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80498], Delivering... [----] I, [2016-09-13T12:04:05.390519 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021524429321289062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002165079116821289, :pending_vm_jobs=>0.00046944618225097656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0036492347717285156} [----] I, [2016-09-13T12:04:05.390824 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80498], State: [ok], Delivered in [0.004191903] seconds [----] I, [2016-09-13T12:04:14.658942 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 14. [----] I, [2016-09-13T12:04:14.700445 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80499], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:04:14.734973 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80500], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:04:14.763666 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80501], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:04:14.797650 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80502], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:04:14.832014 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80503], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:04:15.237518 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:04:15.426686 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80500], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.720578822] seconds [----] I, [2016-09-13T12:04:15.426893 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80500], Delivering... [----] I, [2016-09-13T12:04:15.495454 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80500], State: [ok], Delivered in [0.068483889] seconds [----] I, [2016-09-13T12:04:15.529836 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80503], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.728536765] seconds [----] I, [2016-09-13T12:04:15.530036 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80503], Delivering... [----] I, [2016-09-13T12:04:15.537693 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033452510833740234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003370523452758789, :pending_vm_jobs=>0.000911712646484375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0072803497314453125} [----] I, [2016-09-13T12:04:15.538238 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80503], State: [ok], Delivered in [0.008205779] seconds [----] I, [2016-09-13T12:04:17.174860 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80499], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.504764462] seconds [----] I, [2016-09-13T12:04:17.175008 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80499], Delivering... [----] I, [2016-09-13T12:04:17.215018 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80504], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T12:04:17.215338 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80499], State: [ok], Delivered in [0.040324432] seconds [----] I, [2016-09-13T12:04:17.266833 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80501], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.52779593] seconds [----] I, [2016-09-13T12:04:17.266959 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80501], Delivering... [----] I, [2016-09-13T12:04:17.269401 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80501], State: [ok], Delivered in [0.002422136] seconds [----] I, [2016-09-13T12:04:17.341731 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80502], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.57270285] seconds [----] I, [2016-09-13T12:04:17.341859 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80502], Delivering... [----] I, [2016-09-13T12:04:17.345393 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80502], State: [ok], Delivered in [0.003517346] seconds [----] I, [2016-09-13T12:04:21.502863 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T12:04:21.503105 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003453493118286133, :worker_monitor=>1.2496490478515625, :worker_dequeue=>0.009235143661499023, :total_time=>1.262702226638794} [----] I, [2016-09-13T12:04:26.503634 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:04:26 UTC]... [----] I, [2016-09-13T12:04:26.535076 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:04:26 UTC]...Complete [----] I, [2016-09-13T12:04:26.549920 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T12:04:28.410152 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [80504], MiqWorker id: [104], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [11.224995074] seconds [----] I, [2016-09-13T12:04:28.410380 #24051:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80504], Delivering... [----] I, [2016-09-13T12:04:28.421362 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T12:04:28.421608 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T12:04:28.421760 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T12:04:28.421920 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T12:04:28.422108 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:28.942084 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:29.253037 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:29.253224 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:29.763809 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:29.844654 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:04:29.860825 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80505], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:04:30.113626 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:30.113800 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:30.667177 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:30.992871 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:30.993050 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:31.556616 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:04:31.632382 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80505], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.782620658] seconds [----] I, [2016-09-13T12:04:31.632532 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80505], Delivering... [----] I, [2016-09-13T12:04:31.636537 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002238035202026367, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022521018981933594, :pending_vm_jobs=>0.0004985332489013672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0037615299224853516} [----] I, [2016-09-13T12:04:31.636855 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80505], State: [ok], Delivered in [0.004307439] seconds [----] I, [2016-09-13T12:04:37.519814 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:37.830628 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:37.830800 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:38.017861 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040607452392578125, :worker_monitor=>1.4451451301574707, :worker_dequeue=>0.008498430252075195, :total_time=>1.4580678939819336} [----] I, [2016-09-13T12:04:38.344495 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:38.695294 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:38.695404 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:39.304307 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:39.754290 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:39.754471 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:40.376646 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:40.753462 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:40.753580 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:41.374602 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:41.746253 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:41.746403 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:42.269279 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:42.630123 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:42.630255 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:43.227242 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:43.637927 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:43.638059 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:44.231852 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:44.608169 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:44.608337 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:44.874279 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:04:44.907027 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80506], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:04:44.930009 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80507], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:04:45.300549 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:45.708952 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:45.709101 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:46.344727 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:46.703192 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:46.703407 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:47.270458 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:47.483160 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:47.679170 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:47.832276 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:48.036404 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:04:48.781123 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80507], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.867825472] seconds [----] I, [2016-09-13T12:04:48.781263 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80507], Delivering... [----] I, [2016-09-13T12:04:48.786111 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025289058685302734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025484561920166016, :pending_vm_jobs=>0.0006499290466308594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00457000732421875} [----] I, [2016-09-13T12:04:48.786428 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80507], State: [ok], Delivered in [0.005139519] seconds [----] I, [2016-09-13T12:04:50.507850 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80506], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.628443589] seconds [----] I, [2016-09-13T12:04:50.508019 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80506], Delivering... [----] I, [2016-09-13T12:04:50.511404 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80506], State: [ok], Delivered in [0.003397504] seconds [----] I, [2016-09-13T12:04:53.991456 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:54.128723 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:54.260708 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:54.404099 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:54.546906 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:54.688169 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:54.878699 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:55.071281 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:55.284765 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:55.482827 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:55.631631 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:56.185371 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:56.340772 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:56.480948 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:56.679802 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:56.822663 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:56.968682 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:57.111216 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:57.256878 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:57.460252 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:57.609560 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:57.754156 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:57.943609 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:58.082005 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:58.254906 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:58.431880 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:58.584717 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:58.728899 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:58.890644 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:04:58 UTC]... [----] I, [2016-09-13T12:04:58.912449 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:04:58 UTC]...Complete [----] I, [2016-09-13T12:04:59.274644 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:59.433025 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:59.576619 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:59.729306 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:59.879806 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:04:59.941910 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:04:59.952471 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80508], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:05:00.059848 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:00.200187 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:00.341037 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:00.504907 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:00.674569 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:00.840470 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:00.982242 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:01.120590 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:01.270005 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:01.463061 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:01.676894 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:01.824617 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:02.280998 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:02.670783 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:02.827673 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:02.973616 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:03.163018 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:03.365816 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:03.512244 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:03.689603 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:03.828370 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:03.971487 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:04.079441 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:05:04.144824 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:04.324513 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:04.471093 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:04.653867 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:04.847895 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:04.881280 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80508], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.934534059] seconds [----] I, [2016-09-13T12:05:04.881538 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80508], Delivering... [----] I, [2016-09-13T12:05:04.889167 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003760099411010742, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003789186477661133, :pending_vm_jobs=>0.0010442733764648438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007196664810180664} [----] I, [2016-09-13T12:05:04.889572 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80508], State: [ok], Delivered in [0.008028839] seconds [----] I, [2016-09-13T12:05:10.491291 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006707191467285156, :worker_monitor=>1.393763542175293, :worker_dequeue=>0.00545501708984375, :total_time=>1.4062185287475586} [----] I, [2016-09-13T12:05:11.024220 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:11.181104 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:11.587438 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:11.749193 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:11.896644 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:12.039392 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:12.189504 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:12.357441 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:12.507698 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:12.651310 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:12.832092 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:12.984373 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:13.155861 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:13.299835 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:13.487510 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:13.659891 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:13.802844 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:13.977840 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:14.162915 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:14.659166 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:14.815348 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:14.963298 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:05:14.994725 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80509], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:05:15.006534 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:15.025219 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80510], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:05:15.042136 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80511], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:05:15.065788 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80512], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:05:15.159373 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:15.317083 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:15.459307 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:15.500615 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:05:15.605039 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:15.842748 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:16.014192 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80509], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.044817295] seconds [----] I, [2016-09-13T12:05:16.014395 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80509], Delivering... [----] I, [2016-09-13T12:05:16.019439 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80512], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.971836194] seconds [----] I, [2016-09-13T12:05:16.019594 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80512], Delivering... [----] I, [2016-09-13T12:05:16.024347 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0027039051055908203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027229785919189453, :pending_vm_jobs=>0.0005676746368408203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004488229751586914} [----] I, [2016-09-13T12:05:16.024665 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80512], State: [ok], Delivered in [0.005054746] seconds [----] I, [2016-09-13T12:05:16.053536 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:16.065142 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80509], State: [ok], Delivered in [0.05069502] seconds [----] I, [2016-09-13T12:05:16.272549 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:16.502871 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:16.642508 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:16.830604 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:16.979538 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:17.122215 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:17.309239 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:17.450260 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:17.608214 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80510], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.605215032] seconds [----] I, [2016-09-13T12:05:17.608373 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80510], Delivering... [----] I, [2016-09-13T12:05:17.611297 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80510], State: [ok], Delivered in [0.002886005] seconds [----] I, [2016-09-13T12:05:17.636267 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80511], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.603673545] seconds [----] I, [2016-09-13T12:05:17.636398 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80511], Delivering... [----] I, [2016-09-13T12:05:17.639779 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80511], State: [ok], Delivered in [0.003371759] seconds [----] I, [2016-09-13T12:05:17.908633 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:18.124133 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:18.273306 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:18.463879 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:18.659618 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:18.852298 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:19.033461 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:19.175616 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:19.325339 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:19.504708 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:19.642057 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:19.790682 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:19.930381 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:20.074658 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:20.214880 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:20.360165 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:20.518604 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:20.893728 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:21.067950 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:21.224938 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:21.388468 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:21.565570 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:21.733625 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:21.874645 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:26.640407 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002470254898071289, :worker_monitor=>1.1159088611602783, :worker_dequeue=>0.008654117584228516, :total_time=>1.127256155014038} [----] I, [2016-09-13T12:05:28.039733 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:28.182279 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:28.395066 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:28.603654 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:28.806077 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:28.949388 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:29.155468 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:29.300171 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:29.529521 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:29.678487 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:30.078408 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:05:30.100356 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80513], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:05:30.162480 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:30.360914 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:30.504251 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:30.682349 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:30.873770 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:31.071583 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:31.270845 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:31.477504 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:31.616442 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:31.640966 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:05:31 UTC]... [----] I, [2016-09-13T12:05:31.660519 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:05:31 UTC]...Complete [----] I, [2016-09-13T12:05:31.679278 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:05:31.770714 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:31.964769 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:32.166012 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:32.174606 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80513], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.088936001] seconds [----] I, [2016-09-13T12:05:32.174862 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80513], Delivering... [----] I, [2016-09-13T12:05:32.181492 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034704208374023438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003492116928100586, :pending_vm_jobs=>0.0008089542388916016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006142854690551758} [----] I, [2016-09-13T12:05:32.181901 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80513], State: [ok], Delivered in [0.007047521] seconds [----] I, [2016-09-13T12:05:32.306787 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:32.492283 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:32.632830 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:32.851137 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:32.995813 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:33.467525 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:33.667818 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:33.869572 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:34.040963 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:34.191022 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:34.358641 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:34.506308 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:34.658208 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:34.858021 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:35.007317 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:35.160048 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:35.320352 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:35.497111 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:35.658730 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:35.820882 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:35.970555 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:36.171627 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:36.648086 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:36.864535 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:37.064290 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:37.261307 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:37.413966 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:37.554153 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:37.689682 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:37.833771 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:38.105580 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:38.345110 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:38.593044 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:38.840707 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:43.189007 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0061604976654052734, :worker_monitor=>1.4814939498901367, :worker_dequeue=>0.005374431610107422, :total_time=>1.4934356212615967} [----] I, [2016-09-13T12:05:45.077632 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:45.111376 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:05:45.128095 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80514], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:05:45.145396 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80515], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:05:45.216033 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:45.364405 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:45.517578 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:45.729202 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:46.197977 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:46.434623 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:46.583489 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:46.787297 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:46.931684 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:47.080093 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:47.226911 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:47.396489 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:47.598165 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:47.747252 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:47.961090 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:48.104439 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:48.197854 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:05:48.306482 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:48.364302 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80515], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.232420962] seconds [----] I, [2016-09-13T12:05:48.364500 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80515], Delivering... [----] I, [2016-09-13T12:05:48.370443 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031900405883789062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032079219818115234, :pending_vm_jobs=>0.0007076263427734375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055463314056396484} [----] I, [2016-09-13T12:05:48.370770 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80515], State: [ok], Delivered in [0.006263442] seconds [----] I, [2016-09-13T12:05:48.503564 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:48.720813 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:48.948151 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:49.158064 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:49.676223 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:49.874370 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:50.100565 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:50.311696 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:50.504839 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:50.715636 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:50.777839 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80514], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.663431882] seconds [----] I, [2016-09-13T12:05:50.778210 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80514], Delivering... [----] I, [2016-09-13T12:05:50.784862 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80514], State: [ok], Delivered in [0.006696954] seconds [----] I, [2016-09-13T12:05:50.930256 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:51.156971 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:51.324696 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:51.534666 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:51.752636 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:51.961844 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:52.114215 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:52.341582 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:52.574468 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:52.797592 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:52.943035 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:53.432336 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:53.678730 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:53.901679 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:54.115841 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:54.290459 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:54.461089 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:54.621285 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:54.788376 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:54.966022 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:55.183271 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:55.412294 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:55.645821 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:55.892211 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:05:59.624071 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004295825958251953, :worker_monitor=>1.3955316543579102, :worker_dequeue=>0.010980367660522461, :total_time=>1.4111347198486328} [----] I, [2016-09-13T12:06:00.154054 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:06:00.171301 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80516], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:06:02.133892 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:06:02.268601 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:06:02.464581 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:06:02.673635 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T12:06:02.894933 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T12:06:02.895335 #24051:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T12:06:02.895676 #24051:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T12:06:02.895800 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T12:06:02.895918 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T12:06:02.931495 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T12:06:02.931910 #24051:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [80504], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T12:06:02.932195 #24051:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T12:06:02.932465 #24051:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T12:06:02.932669 #24051:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80504], State: [error], Delivered in [94.522305742] seconds [----] I, [2016-09-13T12:06:04.624534 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:06:04 UTC]... [----] I, [2016-09-13T12:06:04.651192 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:06:04 UTC]...Complete [----] I, [2016-09-13T12:06:04.757282 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:06:05.502924 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80516], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.345211019] seconds [----] I, [2016-09-13T12:06:05.503082 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80516], Delivering... [----] I, [2016-09-13T12:06:05.507261 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002312898635864258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002325773239135742, :pending_vm_jobs=>0.00046062469482421875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0039250850677490234} [----] I, [2016-09-13T12:06:05.507507 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80516], State: [ok], Delivered in [0.004425205] seconds [----] I, [2016-09-13T12:06:15.196928 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:06:15.228547 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80517], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:06:15.256942 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80518], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:06:15.274061 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80519], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:06:15.302854 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80520], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:06:16.091142 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:06:16.093842 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0032684803009033203, :worker_monitor=>1.3058373928070068, :worker_dequeue=>0.00605463981628418, :total_time=>1.315420389175415} [----] I, [2016-09-13T12:06:16.633543 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80517], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.433648013] seconds [----] I, [2016-09-13T12:06:16.633761 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80517], Delivering... [----] I, [2016-09-13T12:06:16.638976 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80520], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.359261004] seconds [----] I, [2016-09-13T12:06:16.639153 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80520], Delivering... [----] I, [2016-09-13T12:06:16.644646 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028722286224365234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028913021087646484, :pending_vm_jobs=>0.0007040500640869141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005199909210205078} [----] I, [2016-09-13T12:06:16.645022 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80520], State: [ok], Delivered in [0.005827257] seconds [----] I, [2016-09-13T12:06:16.753663 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80517], State: [ok], Delivered in [0.11984635] seconds [----] I, [2016-09-13T12:06:17.890697 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80518], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.658424114] seconds [----] I, [2016-09-13T12:06:17.890887 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80518], Delivering... [----] I, [2016-09-13T12:06:17.894733 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80518], State: [ok], Delivered in [0.003811493] seconds [----] I, [2016-09-13T12:06:17.962916 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80519], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.701111322] seconds [----] I, [2016-09-13T12:06:17.963165 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80519], Delivering... [----] I, [2016-09-13T12:06:17.968177 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80519], State: [ok], Delivered in [0.005024049] seconds [----] I, [2016-09-13T12:06:21.107184 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T12:06:30.314210 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:06:30.336188 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80521], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:06:32.276325 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:06:32.281738 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002524137496948242, :worker_monitor=>1.134887933731079, :worker_dequeue=>0.013515710830688477, :total_time=>1.1513259410858154} [----] I, [2016-09-13T12:06:32.834140 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80521], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.513683105] seconds [----] I, [2016-09-13T12:06:32.834326 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80521], Delivering... [----] I, [2016-09-13T12:06:32.839893 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002770662307739258, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027883052825927734, :pending_vm_jobs=>0.0007944107055664062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005252361297607422} [----] I, [2016-09-13T12:06:32.840280 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80521], State: [ok], Delivered in [0.005935786] seconds [----] I, [2016-09-13T12:06:37.282341 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:06:37 UTC]... [----] I, [2016-09-13T12:06:37.303524 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:06:37 UTC]...Complete [----] I, [2016-09-13T12:06:45.344487 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:06:45.354014 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80522], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:06:45.370916 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80523], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:06:48.831796 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:06:48.835131 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006415843963623047, :worker_monitor=>1.4834096431732178, :worker_dequeue=>0.008745193481445312, :total_time=>1.4989166259765625} [----] I, [2016-09-13T12:06:48.965319 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80523], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.6079732] seconds [----] I, [2016-09-13T12:06:48.965509 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80523], Delivering... [----] I, [2016-09-13T12:06:48.971548 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031423568725585938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031609535217285156, :pending_vm_jobs=>0.0007364749908447266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005717039108276367} [----] I, [2016-09-13T12:06:48.971844 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80523], State: [ok], Delivered in [0.006326561] seconds [----] I, [2016-09-13T12:06:51.102837 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80522], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.755402271] seconds [----] I, [2016-09-13T12:06:51.102977 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80522], Delivering... [----] I, [2016-09-13T12:06:51.106043 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80522], State: [ok], Delivered in [0.003052682] seconds [----] I, [2016-09-13T12:07:00.378225 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:07:00.394147 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80524], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:07:05.671729 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:07:05.676381 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0067212581634521484, :worker_monitor=>1.7898874282836914, :worker_dequeue=>0.009779691696166992, :total_time=>1.806885004043579} [----] I, [2016-09-13T12:07:06.080256 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80524], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.697698532] seconds [----] I, [2016-09-13T12:07:06.080447 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80524], Delivering... [----] I, [2016-09-13T12:07:06.085311 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026133060455322266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026290416717529297, :pending_vm_jobs=>0.0005524158477783203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0045392513275146484} [----] I, [2016-09-13T12:07:06.085600 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80524], State: [ok], Delivered in [0.005164686] seconds [----] I, [2016-09-13T12:07:10.677034 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:07:10 UTC]... [----] I, [2016-09-13T12:07:10.702640 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:07:10 UTC]...Complete [----] I, [2016-09-13T12:07:15.403482 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:07:15.439614 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80525], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:07:15.456744 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80526], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:07:15.502808 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80527], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:07:15.520003 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80528], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:07:15.838243 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:07:16.177411 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80525], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.770820384] seconds [----] I, [2016-09-13T12:07:16.177637 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80525], Delivering... [----] I, [2016-09-13T12:07:16.223841 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80528], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.717113737] seconds [----] I, [2016-09-13T12:07:16.224219 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80528], Delivering... [----] I, [2016-09-13T12:07:16.236788 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.006456851959228516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0064983367919921875, :pending_vm_jobs=>0.001672506332397461, :vm_jobs_to_dispatch_count=>0, :total_time=>0.011902570724487305} [----] I, [2016-09-13T12:07:16.237362 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80528], State: [ok], Delivered in [0.013130516] seconds [----] I, [2016-09-13T12:07:16.245780 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80525], State: [ok], Delivered in [0.068098754] seconds [----] I, [2016-09-13T12:07:18.211683 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80526], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.768582991] seconds [----] I, [2016-09-13T12:07:18.211840 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80526], Delivering... [----] I, [2016-09-13T12:07:18.214732 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80526], State: [ok], Delivered in [0.002876697] seconds [----] I, [2016-09-13T12:07:18.282456 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80527], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.820680166] seconds [----] I, [2016-09-13T12:07:18.282785 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80527], Delivering... [----] I, [2016-09-13T12:07:18.286971 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80527], State: [ok], Delivered in [0.004169138] seconds [----] I, [2016-09-13T12:07:22.055568 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035669803619384766, :worker_monitor=>1.2045345306396484, :worker_dequeue=>0.0051212310791015625, :total_time=>1.2134995460510254} [----] I, [2016-09-13T12:07:30.530474 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:07:30.545373 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80529], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:07:32.076679 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:07:32.764078 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80529], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.229738106] seconds [----] I, [2016-09-13T12:07:32.764375 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80529], Delivering... [----] I, [2016-09-13T12:07:32.775183 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005198478698730469, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00523066520690918, :pending_vm_jobs=>0.0013568401336669922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010213136672973633} [----] I, [2016-09-13T12:07:32.776444 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80529], State: [ok], Delivered in [0.012027447] seconds [----] I, [2016-09-13T12:07:38.902645 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00701451301574707, :worker_monitor=>1.805112600326538, :worker_dequeue=>0.010150909423828125, :total_time=>1.822758674621582} [----] I, [2016-09-13T12:07:43.903109 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:07:43 UTC]... [----] I, [2016-09-13T12:07:43.929908 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:07:43 UTC]...Complete [----] I, [2016-09-13T12:07:45.554044 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:07:45.569924 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80530], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:07:45.579807 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80531], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:07:48.950479 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:07:49.969885 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80531], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.394537739] seconds [----] I, [2016-09-13T12:07:49.970087 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80531], Delivering... [----] I, [2016-09-13T12:07:49.977312 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003094911575317383, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003156900405883789, :pending_vm_jobs=>0.0009245872497558594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006708383560180664} [----] I, [2016-09-13T12:07:49.977791 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80531], State: [ok], Delivered in [0.007684907] seconds [----] I, [2016-09-13T12:07:51.929258 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80530], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.371032117] seconds [----] I, [2016-09-13T12:07:51.929556 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80530], Delivering... [----] I, [2016-09-13T12:07:51.936502 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80530], State: [ok], Delivered in [0.006906126] seconds [----] I, [2016-09-13T12:07:55.463271 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004088401794433594, :worker_monitor=>1.49375581741333, :worker_dequeue=>0.011894702911376953, :total_time=>1.510042667388916} [----] I, [2016-09-13T12:08:00.589907 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:08:00.609109 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80532], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:08:05.484044 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:08:06.082464 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80532], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.488319421] seconds [----] I, [2016-09-13T12:08:06.082704 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80532], Delivering... [----] I, [2016-09-13T12:08:06.090378 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004154205322265625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0041806697845458984, :pending_vm_jobs=>0.0008924007415771484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0072057247161865234} [----] I, [2016-09-13T12:08:06.093733 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80532], State: [ok], Delivered in [0.011001373] seconds [----] I, [2016-09-13T12:08:11.657883 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035829544067382812, :worker_monitor=>1.1597697734832764, :worker_dequeue=>0.007314205169677734, :total_time=>1.1710195541381836} [----] I, [2016-09-13T12:08:15.620626 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:08:15.636662 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80533], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:08:15.653811 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80534], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:08:15.682463 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80535], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:08:15.698995 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80536], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:08:16.659971 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:08:16 UTC]... [----] I, [2016-09-13T12:08:16.682213 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:08:16 UTC]...Complete [----] I, [2016-09-13T12:08:16.760914 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:08:17.175683 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80533], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.551245853] seconds [----] I, [2016-09-13T12:08:17.175883 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80533], Delivering... [----] I, [2016-09-13T12:08:17.190923 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80536], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.503388614] seconds [----] I, [2016-09-13T12:08:17.191110 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80536], Delivering... [----] I, [2016-09-13T12:08:17.197558 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034112930297851562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034334659576416016, :pending_vm_jobs=>0.0007927417755126953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006086111068725586} [----] I, [2016-09-13T12:08:17.197964 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80536], State: [ok], Delivered in [0.006848401] seconds [----] I, [2016-09-13T12:08:17.230991 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80533], State: [ok], Delivered in [0.055073623] seconds [----] I, [2016-09-13T12:08:19.019846 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80534], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.377940313] seconds [----] I, [2016-09-13T12:08:19.020102 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80534], Delivering... [----] I, [2016-09-13T12:08:19.029632 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80534], State: [ok], Delivered in [0.009513532] seconds [----] I, [2016-09-13T12:08:19.042500 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80535], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.381620829] seconds [----] I, [2016-09-13T12:08:19.042701 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80535], Delivering... [----] I, [2016-09-13T12:08:19.046440 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80535], State: [ok], Delivered in [0.003733936] seconds [----] I, [2016-09-13T12:08:28.253669 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00400233268737793, :worker_monitor=>1.4587481021881104, :worker_dequeue=>0.007328033447265625, :total_time=>1.4704315662384033} [----] I, [2016-09-13T12:08:30.709692 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:08:30.739631 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80537], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:08:33.267461 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:08:33.334596 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80537], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.621069911] seconds [----] I, [2016-09-13T12:08:33.334839 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80537], Delivering... [----] I, [2016-09-13T12:08:33.344958 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004998922348022461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0050394535064697266, :pending_vm_jobs=>0.001394510269165039, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009527206420898438} [----] I, [2016-09-13T12:08:33.345498 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80537], State: [ok], Delivered in [0.010603476] seconds [----] I, [2016-09-13T12:08:44.448869 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005211591720581055, :worker_monitor=>1.131514310836792, :worker_dequeue=>0.013973474502563477, :total_time=>1.1510412693023682} [----] I, [2016-09-13T12:08:45.749809 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T12:08:45.785556 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80538], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:08:45.814076 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80539], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:08:45.836836 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80540], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:08:45.865577 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80541], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:08:49.449550 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:08:49 UTC]... [----] I, [2016-09-13T12:08:49.476904 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:08:49 UTC]...Complete [----] I, [2016-09-13T12:08:49.493040 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:08:50.483276 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80538], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.727156371] seconds [----] I, [2016-09-13T12:08:50.483595 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80538], Delivering... [----] I, [2016-09-13T12:08:50.485503 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T12:08:50.485735 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4592308224 [----] I, [2016-09-13T12:08:50.485837 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4353916928 [----] I, [2016-09-13T12:08:50.485931 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 238391296 [----] I, [2016-09-13T12:08:50.486036 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T12:08:50.486128 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4297191424 [----] I, [2016-09-13T12:08:50.486212 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T12:08:50.486293 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T12:08:50.486379 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 561278976 [----] I, [2016-09-13T12:08:50.486521 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T12:08:50.486614 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 7086854144 [----] I, [2016-09-13T12:08:50.486702 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T12:08:50.486788 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T12:08:50.486869 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T12:08:50.486950 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 12288 [----] I, [2016-09-13T12:08:50.487056 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T12:08:50.487143 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T12:08:50.487223 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T12:08:50.487303 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T12:08:50.487384 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T12:08:50.487503 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T12:08:50.487613 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272379904 [----] I, [2016-09-13T12:08:50.487754 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55205888 [----] I, [2016-09-13T12:08:50.487849 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217174016 [----] I, [2016-09-13T12:08:50.487932 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6111232 [----] I, [2016-09-13T12:08:50.488056 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142356480 [----] I, [2016-09-13T12:08:50.488187 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3393650688 [----] I, [2016-09-13T12:08:50.488293 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3072585728 [----] I, [2016-09-13T12:08:50.488374 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T12:08:50.488497 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T12:08:50.488585 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T12:08:50.488668 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36888576 [----] I, [2016-09-13T12:08:50.488754 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76959744 [----] I, [2016-09-13T12:08:50.488839 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49631232 [----] I, [2016-09-13T12:08:50.488922 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111931392 [----] I, [2016-09-13T12:08:50.489022 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126590976 [----] I, [2016-09-13T12:08:50.489111 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T12:08:50.489193 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T12:08:50.489273 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T12:08:50.489359 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T12:08:50.489465 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T12:08:50.489572 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T12:08:50.489655 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T12:08:50.489738 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T12:08:50.489824 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T12:08:50.528463 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T12:08:50.528715 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T12:08:50.528848 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80541], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.686600511] seconds [----] I, [2016-09-13T12:08:50.529075 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80541], Delivering... [----] I, [2016-09-13T12:08:50.533014 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T12:08:50.536196 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T12:08:50.536850 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004019260406494141, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004050731658935547, :pending_vm_jobs=>0.0009937286376953125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00731205940246582} [----] I, [2016-09-13T12:08:50.537240 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80541], State: [ok], Delivered in [0.008177715] seconds [----] I, [2016-09-13T12:08:50.539839 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T12:08:50.543503 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T12:08:50.547136 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T12:08:50.550768 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 859 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T12:08:50.554294 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T12:08:50.557743 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T12:08:50.561262 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T12:08:50.564640 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T12:08:50.568247 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T12:08:50.571560 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T12:08:50.574784 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:08:50.575021 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:08:50.575159 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T12:08:50.579828 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [154876.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:08:50.580281 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80538], State: [ok], Delivered in [0.096698368] seconds [----] I, [2016-09-13T12:08:52.191886 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80540], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.373537327] seconds [----] I, [2016-09-13T12:08:52.192222 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80540], Delivering... [----] I, [2016-09-13T12:08:52.200763 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80540], State: [ok], Delivered in [0.008561357] seconds [----] I, [2016-09-13T12:08:54.506791 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:08:54.591450 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80539], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.802044709] seconds [----] I, [2016-09-13T12:08:54.591655 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80539], Delivering... [----] I, [2016-09-13T12:08:54.599849 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:08:42 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163163000], Memory % [3.1], CPU Time [38998.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T12:08:54.600543 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:08:43 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359296000], Memory % [5.28], CPU Time [208324.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T12:08:54.601170 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:08:43 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [155733.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:08:54.601744 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:08:43 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [154884.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:08:54.602317 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:08:43 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [52980.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:08:54.602877 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:08:30 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [246786.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T12:08:54.603496 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:08:40 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347859000], Memory % [5.04], CPU Time [106566.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T12:08:54.603964 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:08:35 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213441000], Memory % [3.51], CPU Time [50252.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T12:08:54.607197 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:08:43 UTC], Process Info: Memory Usage [616562688], Memory Size [1077972992], Proportional Set Size: [457405000], Memory % [7.52], CPU Time [849.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T12:08:54.609902 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:08:35 UTC], Process Info: Memory Usage [602259456], Memory Size [960081920], Proportional Set Size: [445519000], Memory % [7.34], CPU Time [990.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T12:08:54.610624 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:08:43 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358595000], Memory % [5.27], CPU Time [216998.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T12:08:54.611220 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:08:43 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [52947.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:08:54.611724 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:08:42 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166763000], Memory % [3.16], CPU Time [39921.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T12:08:54.612084 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80539], State: [ok], Delivered in [0.020411645] seconds [----] I, [2016-09-13T12:09:00.873958 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:09:00.934367 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80542], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:09:01.082696 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:09:01.088827 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003072977066040039, :worker_monitor=>1.5611419677734375, :worker_dequeue=>0.013185977935791016, :total_time=>1.577664852142334} [----] I, [2016-09-13T12:09:01.220183 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80542], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.341632125] seconds [----] I, [2016-09-13T12:09:01.220474 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80542], Delivering... [----] I, [2016-09-13T12:09:01.229025 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004457950592041016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00448298454284668, :pending_vm_jobs=>0.001186370849609375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00798940658569336} [----] I, [2016-09-13T12:09:01.229438 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80542], State: [ok], Delivered in [0.008972639] seconds [----] I, [2016-09-13T12:09:15.947552 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:09:15.968729 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80543], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:09:15.986307 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80544], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:09:16.025764 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80545], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:09:16.054258 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80546], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:09:17.596545 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:09:17.599218 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036613941192626953, :worker_monitor=>1.4682297706604004, :worker_dequeue=>0.00649714469909668, :total_time=>1.4787633419036865} [----] I, [2016-09-13T12:09:17.755443 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80543], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.803632567] seconds [----] I, [2016-09-13T12:09:17.755627 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80543], Delivering... [----] I, [2016-09-13T12:09:17.818033 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80543], State: [ok], Delivered in [0.06233851] seconds [----] I, [2016-09-13T12:09:17.823720 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80546], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.791591094] seconds [----] I, [2016-09-13T12:09:17.823923 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80546], Delivering... [----] I, [2016-09-13T12:09:17.829610 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030477046966552734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030701160430908203, :pending_vm_jobs=>0.0006701946258544922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005316257476806641} [----] I, [2016-09-13T12:09:17.829924 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80546], State: [ok], Delivered in [0.006010302] seconds [----] I, [2016-09-13T12:09:19.309179 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80544], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.335367414] seconds [----] I, [2016-09-13T12:09:19.309309 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80544], Delivering... [----] I, [2016-09-13T12:09:19.311646 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80544], State: [ok], Delivered in [0.00232179] seconds [----] I, [2016-09-13T12:09:19.315208 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80545], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.320273378] seconds [----] I, [2016-09-13T12:09:19.315334 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80545], Delivering... [----] I, [2016-09-13T12:09:19.318722 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80545], State: [ok], Delivered in [0.003372467] seconds [----] I, [2016-09-13T12:09:22.599857 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:09:22 UTC]... [----] I, [2016-09-13T12:09:22.624169 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:09:22 UTC]...Complete [----] I, [2016-09-13T12:09:31.066876 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:09:31.087332 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80547], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:09:33.976067 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:09:33.981316 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004887104034423828, :worker_monitor=>1.1728346347808838, :worker_dequeue=>0.010640621185302734, :total_time=>1.1886482238769531} [----] I, [2016-09-13T12:09:34.407404 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80547], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.335746208] seconds [----] I, [2016-09-13T12:09:34.407646 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80547], Delivering... [----] I, [2016-09-13T12:09:34.413790 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033617019653320312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003385305404663086, :pending_vm_jobs=>0.0007224082946777344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057315826416015625} [----] I, [2016-09-13T12:09:34.414172 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80547], State: [ok], Delivered in [0.006511665] seconds [----] I, [2016-09-13T12:09:46.099486 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:09:46.121570 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80548], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:09:46.155847 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80549], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:09:50.113052 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:09:50.116900 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0061800479888916016, :worker_monitor=>1.0897903442382812, :worker_dequeue=>0.010617971420288086, :total_time=>1.1069743633270264} [----] I, [2016-09-13T12:09:51.087251 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80549], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.959637013] seconds [----] I, [2016-09-13T12:09:51.087517 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80549], Delivering... [----] I, [2016-09-13T12:09:51.093066 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003498554229736328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035181045532226562, :pending_vm_jobs=>0.0005209445953369141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005196094512939453} [----] I, [2016-09-13T12:09:51.093321 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80549], State: [ok], Delivered in [0.005845354] seconds [----] I, [2016-09-13T12:09:52.544813 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80548], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.440273414] seconds [----] I, [2016-09-13T12:09:52.545056 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80548], Delivering... [----] I, [2016-09-13T12:09:52.552373 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80548], State: [ok], Delivered in [0.007289665] seconds [----] I, [2016-09-13T12:09:55.117410 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:09:55 UTC]... [----] I, [2016-09-13T12:09:55.139739 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:09:55 UTC]...Complete [----] I, [2016-09-13T12:10:01.168171 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:10:01.184114 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80550], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:10:06.758271 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:10:06.766402 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0032608509063720703, :worker_monitor=>1.5770258903503418, :worker_dequeue=>0.017057180404663086, :total_time=>1.5976088047027588} [----] I, [2016-09-13T12:10:07.173447 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80550], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.000111704] seconds [----] I, [2016-09-13T12:10:07.173682 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80550], Delivering... [----] I, [2016-09-13T12:10:07.181498 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004000425338745117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004027605056762695, :pending_vm_jobs=>0.0009961128234863281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007348060607910156} [----] I, [2016-09-13T12:10:07.181862 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80550], State: [ok], Delivered in [0.008190397] seconds [----] I, [2016-09-13T12:10:16.195480 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 8. [----] I, [2016-09-13T12:10:16.224572 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80551], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:10:16.247338 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80552], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:10:16.276362 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80553], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:10:16.310695 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80554], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:10:16.333322 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80555], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:10:16.356408 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80556], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:10:16.367233 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80557], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:10:16.792156 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 7 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:10:17.357735 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80554], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.074354276] seconds [----] I, [2016-09-13T12:10:17.357993 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80554], Delivering... [----] I, [2016-09-13T12:10:17.367987 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80557], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.007183239] seconds [----] I, [2016-09-13T12:10:17.368168 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80557], Delivering... [----] I, [2016-09-13T12:10:17.375335 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003545522689819336, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003583669662475586, :pending_vm_jobs=>0.0008897781372070312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006776094436645508} [----] I, [2016-09-13T12:10:17.375995 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80557], State: [ok], Delivered in [0.007810181] seconds [----] I, [2016-09-13T12:10:17.436042 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80554], State: [ok], Delivered in [0.078022409] seconds [----] I, [2016-09-13T12:10:19.642149 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80551], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.438667496] seconds [----] I, [2016-09-13T12:10:19.642403 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80551], Delivering... [----] I, [2016-09-13T12:10:19.645589 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80551], State: [ok], Delivered in [0.003160034] seconds [----] I, [2016-09-13T12:10:19.659061 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80552], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.425797469] seconds [----] I, [2016-09-13T12:10:19.659217 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80552], Delivering... [----] I, [2016-09-13T12:10:19.666604 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80552], State: [ok], Delivered in [0.007375604] seconds [----] I, [2016-09-13T12:10:19.710621 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80553], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.454761021] seconds [----] I, [2016-09-13T12:10:19.710814 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80553], Delivering... [----] I, [2016-09-13T12:10:19.717168 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80553], State: [ok], Delivered in [0.006336205] seconds [----] I, [2016-09-13T12:10:19.721954 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80555], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.402950688] seconds [----] I, [2016-09-13T12:10:19.722158 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80555], Delivering... [----] I, [2016-09-13T12:10:19.725553 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80555], State: [ok], Delivered in [0.003386218] seconds [----] I, [2016-09-13T12:10:19.744354 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80556], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.400815938] seconds [----] I, [2016-09-13T12:10:19.744506 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80556], Delivering... [----] I, [2016-09-13T12:10:19.748269 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80556], State: [ok], Delivered in [0.003733016] seconds [----] I, [2016-09-13T12:10:23.180062 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005250215530395508, :worker_monitor=>1.3630445003509521, :worker_dequeue=>0.013224363327026367, :total_time=>1.3819997310638428} [----] I, [2016-09-13T12:10:28.180679 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:10:28 UTC]... [----] I, [2016-09-13T12:10:28.201811 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:10:28 UTC]...Complete [----] I, [2016-09-13T12:10:31.375918 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:10:31.396051 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80558], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:10:33.375174 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:10:33.510694 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80558], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.128767027] seconds [----] I, [2016-09-13T12:10:33.510887 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80558], Delivering... [----] I, [2016-09-13T12:10:33.520674 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004966020584106445, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004998445510864258, :pending_vm_jobs=>0.0013256072998046875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00937032699584961} [----] I, [2016-09-13T12:10:33.521245 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80558], State: [ok], Delivered in [0.010328266] seconds [----] I, [2016-09-13T12:10:39.671009 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005198001861572266, :worker_monitor=>1.268078327178955, :worker_dequeue=>0.011377334594726562, :total_time=>1.285179615020752} [----] I, [2016-09-13T12:10:46.407804 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:10:46.428061 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80559], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:10:46.455938 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80560], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:10:49.705919 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:10:49.874877 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80560], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.441723202] seconds [----] I, [2016-09-13T12:10:49.875123 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80560], Delivering... [----] I, [2016-09-13T12:10:49.882724 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0039751529693603516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004000425338745117, :pending_vm_jobs=>0.0009067058563232422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00697636604309082} [----] I, [2016-09-13T12:10:49.883120 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80560], State: [ok], Delivered in [0.007998148] seconds [----] I, [2016-09-13T12:10:49.890315 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80559], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.478342523] seconds [----] I, [2016-09-13T12:10:49.890534 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80559], Delivering... [----] I, [2016-09-13T12:10:49.895852 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80559], State: [ok], Delivered in [0.005310097] seconds [----] I, [2016-09-13T12:10:55.863890 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003498077392578125, :worker_monitor=>1.1434540748596191, :worker_dequeue=>0.006098270416259766, :total_time=>1.153346061706543} [----] I, [2016-09-13T12:11:00.864402 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:11:00 UTC]... [----] I, [2016-09-13T12:11:00.884160 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:11:00 UTC]...Complete [----] I, [2016-09-13T12:11:01.469466 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:11:01.495934 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80561], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:11:05.905952 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:11:06.752999 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80561], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.276825221] seconds [----] I, [2016-09-13T12:11:06.753236 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80561], Delivering... [----] I, [2016-09-13T12:11:06.760001 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003645181655883789, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036687850952148438, :pending_vm_jobs=>0.0008330345153808594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063326358795166016} [----] I, [2016-09-13T12:11:06.760399 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80561], State: [ok], Delivered in [0.007181072] seconds [----] I, [2016-09-13T12:11:12.567733 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039031505584716797, :worker_monitor=>1.645029067993164, :worker_dequeue=>0.009876012802124023, :total_time=>1.6590955257415771} [----] I, [2016-09-13T12:11:16.507749 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:11:16.524203 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80562], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:11:16.541160 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80563], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:11:16.559279 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80564], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:11:16.581455 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80565], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:11:17.580012 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:11:17.907236 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80562], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.396061009] seconds [----] I, [2016-09-13T12:11:17.907385 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80562], Delivering... [----] I, [2016-09-13T12:11:17.913021 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80565], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.347682615] seconds [----] I, [2016-09-13T12:11:17.913220 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80565], Delivering... [----] I, [2016-09-13T12:11:17.919011 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003111124038696289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031316280364990234, :pending_vm_jobs=>0.0006799697875976562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005400419235229492} [----] I, [2016-09-13T12:11:17.919325 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80565], State: [ok], Delivered in [0.006128779] seconds [----] I, [2016-09-13T12:11:17.976292 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80562], State: [ok], Delivered in [0.068805031] seconds [----] I, [2016-09-13T12:11:19.987474 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80563], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.458817228] seconds [----] I, [2016-09-13T12:11:19.987804 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80563], Delivering... [----] I, [2016-09-13T12:11:19.993004 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80563], State: [ok], Delivered in [0.005160191] seconds [----] I, [2016-09-13T12:11:20.010683 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80564], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.463828947] seconds [----] I, [2016-09-13T12:11:20.011017 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80564], Delivering... [----] I, [2016-09-13T12:11:20.016729 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80564], State: [ok], Delivered in [0.005764827] seconds [----] I, [2016-09-13T12:11:22.624257 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T12:11:28.991344 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002520322799682617, :worker_monitor=>1.3401291370391846, :worker_dequeue=>0.010884761810302734, :total_time=>1.3537483215332031} [----] I, [2016-09-13T12:11:31.593293 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:11:31.615848 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80566], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:11:33.991934 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:11:33 UTC]... [----] I, [2016-09-13T12:11:34.021564 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:11:33 UTC]...Complete [----] I, [2016-09-13T12:11:34.170733 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:11:35.084493 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80566], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.478213492] seconds [----] I, [2016-09-13T12:11:35.084646 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80566], Delivering... [----] I, [2016-09-13T12:11:35.088877 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023756027221679688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023920536041259766, :pending_vm_jobs=>0.0004894733428955078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003983020782470703} [----] I, [2016-09-13T12:11:35.089144 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80566], State: [ok], Delivered in [0.004511664] seconds [----] I, [2016-09-13T12:11:45.675763 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003518819808959961, :worker_monitor=>1.4746971130371094, :worker_dequeue=>0.005944490432739258, :total_time=>1.4844110012054443} [----] I, [2016-09-13T12:11:46.631351 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:11:46.644402 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80567], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:11:46.667200 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80568], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:11:50.693984 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:11:51.267363 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80568], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.619070226] seconds [----] I, [2016-09-13T12:11:51.267577 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80568], Delivering... [----] I, [2016-09-13T12:11:51.272959 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00299835205078125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030541419982910156, :pending_vm_jobs=>0.0006537437438964844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005019426345825195} [----] I, [2016-09-13T12:11:51.273246 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80568], State: [ok], Delivered in [0.00568107] seconds [----] I, [2016-09-13T12:11:53.164740 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80567], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.53032394] seconds [----] I, [2016-09-13T12:11:53.164882 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80567], Delivering... [----] I, [2016-09-13T12:11:53.168337 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80567], State: [ok], Delivered in [0.003449204] seconds [----] I, [2016-09-13T12:12:01.701819 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:12:01.734822 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80569], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:12:01.902904 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:12:01.906473 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025179386138916016, :worker_monitor=>1.1672427654266357, :worker_dequeue=>0.007727146148681641, :total_time=>1.1777031421661377} [----] I, [2016-09-13T12:12:02.187411 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80569], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.480473835] seconds [----] I, [2016-09-13T12:12:02.187644 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80569], Delivering... [----] I, [2016-09-13T12:12:02.194687 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003498554229736328, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003523111343383789, :pending_vm_jobs=>0.0009191036224365234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006527900695800781} [----] I, [2016-09-13T12:12:02.195119 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80569], State: [ok], Delivered in [0.007483834] seconds [----] I, [2016-09-13T12:12:06.907062 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:12:06 UTC]... [----] I, [2016-09-13T12:12:06.930504 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:12:06 UTC]...Complete [----] I, [2016-09-13T12:12:16.750955 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:12:16.776080 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80570], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:12:16.844771 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80571], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:12:16.879855 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80572], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:12:16.947393 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80573], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:12:18.754436 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:12:18.759794 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004846811294555664, :worker_monitor=>1.7735543251037598, :worker_dequeue=>0.01179814338684082, :total_time=>1.7905924320220947} [----] I, [2016-09-13T12:12:19.481336 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80570], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.726016707] seconds [----] I, [2016-09-13T12:12:19.481605 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80570], Delivering... [----] I, [2016-09-13T12:12:19.486799 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80573], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.596057017] seconds [----] I, [2016-09-13T12:12:19.486977 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80573], Delivering... [----] I, [2016-09-13T12:12:19.492685 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002875804901123047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028984546661376953, :pending_vm_jobs=>0.0007634162902832031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005366086959838867} [----] I, [2016-09-13T12:12:19.493017 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80573], State: [ok], Delivered in [0.006046775] seconds [----] I, [2016-09-13T12:12:19.544291 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80570], State: [ok], Delivered in [0.062678949] seconds [----] I, [2016-09-13T12:12:20.247133 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80571], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.465617915] seconds [----] I, [2016-09-13T12:12:20.247316 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80571], Delivering... [----] I, [2016-09-13T12:12:20.250674 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80571], State: [ok], Delivered in [0.003345144] seconds [----] I, [2016-09-13T12:12:20.293033 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80572], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.439235911] seconds [----] I, [2016-09-13T12:12:20.293198 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80572], Delivering... [----] I, [2016-09-13T12:12:20.297650 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80572], State: [ok], Delivered in [0.004441427] seconds [----] I, [2016-09-13T12:12:31.958348 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:12:31.972717 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80574], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:12:35.097775 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:12:35.102775 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00679326057434082, :worker_monitor=>1.2936503887176514, :worker_dequeue=>0.010731220245361328, :total_time=>1.3117642402648926} [----] I, [2016-09-13T12:12:35.327461 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80574], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.364005067] seconds [----] I, [2016-09-13T12:12:35.327743 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80574], Delivering... [----] I, [2016-09-13T12:12:35.338955 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005568265914916992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0056798458099365234, :pending_vm_jobs=>0.0013973712921142578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.01057744026184082} [----] I, [2016-09-13T12:12:35.339508 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80574], State: [ok], Delivered in [0.011726372] seconds [----] I, [2016-09-13T12:12:40.103304 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:12:40 UTC]... [----] I, [2016-09-13T12:12:40.120912 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:12:40 UTC]...Complete [----] I, [2016-09-13T12:12:46.984626 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:12:47.001318 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80575], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:12:47.041512 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80576], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:12:51.700585 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:12:51.704549 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005277395248413086, :worker_monitor=>1.4337108135223389, :worker_dequeue=>0.009540319442749023, :total_time=>1.448876142501831} [----] I, [2016-09-13T12:12:51.716110 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80576], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.708272695] seconds [----] I, [2016-09-13T12:12:51.716232 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80576], Delivering... [----] I, [2016-09-13T12:12:51.722968 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034074783325195312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003434419631958008, :pending_vm_jobs=>0.0008533000946044922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006380796432495117} [----] I, [2016-09-13T12:12:51.723335 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80576], State: [ok], Delivered in [0.007082745] seconds [----] I, [2016-09-13T12:12:53.459556 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80575], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.470585153] seconds [----] I, [2016-09-13T12:12:53.459789 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80575], Delivering... [----] I, [2016-09-13T12:12:53.465781 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80575], State: [ok], Delivered in [0.005979816] seconds [----] I, [2016-09-13T12:13:02.056481 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:13:02.105305 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80577], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:13:09.049126 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:13:09.052524 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003951549530029297, :worker_monitor=>2.3112993240356445, :worker_dequeue=>0.00739288330078125, :total_time=>2.3230388164520264} [----] I, [2016-09-13T12:13:09.911153 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80577], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.848703746] seconds [----] I, [2016-09-13T12:13:09.911352 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80577], Delivering... [----] I, [2016-09-13T12:13:09.919028 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003970623016357422, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003993511199951172, :pending_vm_jobs=>0.0009129047393798828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0071866512298583984} [----] I, [2016-09-13T12:13:09.919556 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80577], State: [ok], Delivered in [0.008164424] seconds [----] I, [2016-09-13T12:13:14.053103 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:13:14 UTC]... [----] I, [2016-09-13T12:13:14.082386 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:13:14 UTC]...Complete [----] I, [2016-09-13T12:13:17.126795 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:13:17.148408 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80578], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:13:17.175029 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80579], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:13:17.200561 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80580], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:13:17.222603 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80581], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:13:19.116744 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:13:19.931822 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80578], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.799237774] seconds [----] I, [2016-09-13T12:13:19.932121 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80578], Delivering... [----] I, [2016-09-13T12:13:19.977004 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80578], State: [ok], Delivered in [0.044872346] seconds [----] I, [2016-09-13T12:13:20.040052 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80581], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.832504918] seconds [----] I, [2016-09-13T12:13:20.040246 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80581], Delivering... [----] I, [2016-09-13T12:13:20.046833 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003271818161010742, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032939910888671875, :pending_vm_jobs=>0.0008800029754638672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006189823150634766} [----] I, [2016-09-13T12:13:20.047179 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80581], State: [ok], Delivered in [0.006940137] seconds [----] I, [2016-09-13T12:13:20.497836 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80579], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.343721254] seconds [----] I, [2016-09-13T12:13:20.498191 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80579], Delivering... [----] I, [2016-09-13T12:13:20.512697 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80579], State: [ok], Delivered in [0.014519414] seconds [----] I, [2016-09-13T12:13:20.554100 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80580], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.372684744] seconds [----] I, [2016-09-13T12:13:20.554308 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80580], Delivering... [----] I, [2016-09-13T12:13:20.560436 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80580], State: [ok], Delivered in [0.006080801] seconds [----] I, [2016-09-13T12:13:25.489894 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003866910934448242, :worker_monitor=>1.3526625633239746, :worker_dequeue=>0.009905576705932617, :total_time=>1.3667073249816895} [----] I, [2016-09-13T12:13:32.234461 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:13:32.260132 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80582], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:13:35.513781 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:13:35.598031 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80582], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.359924715] seconds [----] I, [2016-09-13T12:13:35.598244 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80582], Delivering... [----] I, [2016-09-13T12:13:35.606637 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004216194152832031, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0042476654052734375, :pending_vm_jobs=>0.00121307373046875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007913589477539062} [----] I, [2016-09-13T12:13:35.607844 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80582], State: [ok], Delivered in [0.009586988] seconds [----] I, [2016-09-13T12:13:42.074829 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003095388412475586, :server_monitor=>0.07737183570861816, :worker_monitor=>1.464571475982666, :worker_dequeue=>0.012641191482543945, :total_time=>1.5580253601074219} [----] I, [2016-09-13T12:13:47.075367 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:13:47 UTC]... [----] I, [2016-09-13T12:13:47.091872 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:13:47 UTC]...Complete [----] I, [2016-09-13T12:13:47.269765 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T12:13:47.286549 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80583], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:13:47.320923 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80584], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:13:47.337558 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80585], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:13:47.349292 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80586], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:13:52.108750 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:13:52.219713 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80583], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.946886737] seconds [----] I, [2016-09-13T12:13:52.219874 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80583], Delivering... [----] I, [2016-09-13T12:13:52.221659 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T12:13:52.221945 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4593192960 [----] I, [2016-09-13T12:13:52.222094 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4354617344 [----] I, [2016-09-13T12:13:52.222192 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 238575616 [----] I, [2016-09-13T12:13:52.222285 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T12:13:52.222371 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4297932800 [----] I, [2016-09-13T12:13:52.222520 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T12:13:52.222674 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T12:13:52.222770 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 561455104 [----] I, [2016-09-13T12:13:52.222858 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T12:13:52.222943 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6832209920 [----] I, [2016-09-13T12:13:52.223053 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T12:13:52.223141 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T12:13:52.223227 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T12:13:52.223306 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 16384 [----] I, [2016-09-13T12:13:52.223390 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T12:13:52.223516 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T12:13:52.223610 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T12:13:52.223694 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T12:13:52.223777 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T12:13:52.223857 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T12:13:52.223943 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272375808 [----] I, [2016-09-13T12:13:52.224048 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55205888 [----] I, [2016-09-13T12:13:52.224134 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217169920 [----] I, [2016-09-13T12:13:52.224241 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6094848 [----] I, [2016-09-13T12:13:52.224326 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142356480 [----] I, [2016-09-13T12:13:52.224412 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3392999424 [----] I, [2016-09-13T12:13:52.224580 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3071754240 [----] I, [2016-09-13T12:13:52.224677 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T12:13:52.224759 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T12:13:52.224836 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T12:13:52.224922 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36659200 [----] I, [2016-09-13T12:13:52.225033 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76959744 [----] I, [2016-09-13T12:13:52.225132 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49573888 [----] I, [2016-09-13T12:13:52.225219 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111931392 [----] I, [2016-09-13T12:13:52.225300 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126533632 [----] I, [2016-09-13T12:13:52.225408 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T12:13:52.225531 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T12:13:52.225618 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T12:13:52.225704 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T12:13:52.225790 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T12:13:52.225875 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T12:13:52.225955 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T12:13:52.226064 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T12:13:52.226145 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T12:13:52.272259 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T12:13:52.272510 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T12:13:52.276642 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T12:13:52.279677 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T12:13:52.283339 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T12:13:52.287085 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T12:13:52.290545 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T12:13:52.294407 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 859 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T12:13:52.297608 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T12:13:52.300907 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T12:13:52.304317 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T12:13:52.307690 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T12:13:52.311045 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T12:13:52.314402 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T12:13:52.317236 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:13:52.317434 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:13:52.317570 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T12:13:52.322691 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [154955.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:13:52.323784 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80586], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.982465297] seconds [----] I, [2016-09-13T12:13:52.324043 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80586], Delivering... [----] I, [2016-09-13T12:13:52.324816 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80583], State: [ok], Delivered in [0.104831264] seconds [----] I, [2016-09-13T12:13:52.336476 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.007067441940307617, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.007138729095458984, :pending_vm_jobs=>0.0014696121215820312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.011839151382446289} [----] I, [2016-09-13T12:13:52.337029 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80586], State: [ok], Delivered in [0.012967037] seconds [----] I, [2016-09-13T12:13:53.698449 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80585], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.373063991] seconds [----] I, [2016-09-13T12:13:53.698684 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80585], Delivering... [----] I, [2016-09-13T12:13:53.705660 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80585], State: [ok], Delivered in [0.006975725] seconds [----] I, [2016-09-13T12:13:58.481331 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:13:58.484378 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004347562789916992, :worker_monitor=>1.3612072467803955, :worker_dequeue=>0.006565570831298828, :total_time=>1.3724510669708252} [----] I, [2016-09-13T12:13:59.441567 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80584], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [12.151072111] seconds [----] I, [2016-09-13T12:13:59.441773 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80584], Delivering... [----] I, [2016-09-13T12:13:59.449170 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:13:55 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163163000], Memory % [3.1], CPU Time [39042.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T12:13:59.449779 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:13:56 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359296000], Memory % [5.28], CPU Time [208362.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T12:13:59.450373 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:13:57 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [155803.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:13:59.450902 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:13:57 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [154968.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:13:59.451470 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:13:57 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [53033.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:13:59.452004 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:13:47 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [246919.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T12:13:59.452475 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:13:53 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347859000], Memory % [5.04], CPU Time [106630.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T12:13:59.452905 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:13:47 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213441000], Memory % [3.51], CPU Time [50293.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T12:13:59.455659 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:13:53 UTC], Process Info: Memory Usage [616562688], Memory Size [1077972992], Proportional Set Size: [457405000], Memory % [7.52], CPU Time [863.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T12:13:59.457869 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:13:55 UTC], Process Info: Memory Usage [602628096], Memory Size [976740352], Proportional Set Size: [445895000], Memory % [7.35], CPU Time [1002.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T12:13:59.458446 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:13:56 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358595000], Memory % [5.27], CPU Time [217037.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T12:13:59.459002 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:13:56 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [52987.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:13:59.459472 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:13:54 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166763000], Memory % [3.16], CPU Time [39965.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T12:13:59.459849 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80584], State: [ok], Delivered in [0.018072128] seconds [----] I, [2016-09-13T12:14:02.359301 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:14:02.395303 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80587], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:14:03.492647 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:14:03.532631 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80587], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.165424858] seconds [----] I, [2016-09-13T12:14:03.532796 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80587], Delivering... [----] I, [2016-09-13T12:14:03.538477 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030431747436523438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003094196319580078, :pending_vm_jobs=>0.000682830810546875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005339145660400391} [----] I, [2016-09-13T12:14:03.538754 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80587], State: [ok], Delivered in [0.005953826] seconds [----] I, [2016-09-13T12:14:14.867336 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004599094390869141, :worker_monitor=>1.3419818878173828, :worker_dequeue=>0.01058816909790039, :total_time=>1.3574883937835693} [----] I, [2016-09-13T12:14:17.411191 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:14:17.429324 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80588], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:14:17.452283 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80589], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:14:17.474915 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80590], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:14:17.492097 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80591], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:14:19.868115 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:14:19 UTC]... [----] I, [2016-09-13T12:14:19.892721 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:14:19 UTC]...Complete [----] I, [2016-09-13T12:14:19.905914 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:14:20.527212 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80588], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.111549098] seconds [----] I, [2016-09-13T12:14:20.527354 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80588], Delivering... [----] I, [2016-09-13T12:14:20.566349 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80588], State: [ok], Delivered in [0.038969685] seconds [----] I, [2016-09-13T12:14:20.601190 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80591], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.120926323] seconds [----] I, [2016-09-13T12:14:20.601378 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80591], Delivering... [----] I, [2016-09-13T12:14:20.607734 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003636598587036133, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003660917282104492, :pending_vm_jobs=>0.0010294914245605469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060007572174072266} [----] I, [2016-09-13T12:14:20.608048 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80591], State: [ok], Delivered in [0.006671718] seconds [----] I, [2016-09-13T12:14:20.841837 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80589], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.407123428] seconds [----] I, [2016-09-13T12:14:20.842120 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80589], Delivering... [----] I, [2016-09-13T12:14:20.852951 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80589], State: [ok], Delivered in [0.010795318] seconds [----] I, [2016-09-13T12:14:20.858342 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80590], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.398809453] seconds [----] I, [2016-09-13T12:14:20.858524 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80590], Delivering... [----] I, [2016-09-13T12:14:20.862197 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80590], State: [ok], Delivered in [0.003669407] seconds [----] I, [2016-09-13T12:14:31.588229 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004174470901489258, :worker_monitor=>1.6404407024383545, :worker_dequeue=>0.016991853713989258, :total_time=>1.6620128154754639} [----] I, [2016-09-13T12:14:32.503459 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:14:32.527013 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80592], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:14:36.600226 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:14:36.801785 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80592], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.292897082] seconds [----] I, [2016-09-13T12:14:36.801999 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80592], Delivering... [----] I, [2016-09-13T12:14:36.809173 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003846406936645508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003873586654663086, :pending_vm_jobs=>0.0008792877197265625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00680088996887207} [----] I, [2016-09-13T12:14:36.809568 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80592], State: [ok], Delivered in [0.007578721] seconds [----] I, [2016-09-13T12:14:47.538330 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:14:47.567026 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80593], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:14:47.612644 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80594], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:14:47.868932 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:14:47.874380 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.008342266082763672, :worker_monitor=>1.1011230945587158, :worker_dequeue=>0.01320505142211914, :total_time=>1.1231002807617188} [----] I, [2016-09-13T12:14:47.892374 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80594], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.320977088] seconds [----] I, [2016-09-13T12:14:47.892518 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80594], Delivering... [----] I, [2016-09-13T12:14:47.896516 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020754337310791016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002090930938720703, :pending_vm_jobs=>0.0004911422729492188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0037648677825927734} [----] I, [2016-09-13T12:14:47.896762 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80594], State: [ok], Delivered in [0.004240963] seconds [----] I, [2016-09-13T12:14:48.087432 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80593], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.545490918] seconds [----] I, [2016-09-13T12:14:48.087594 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80593], Delivering... [----] I, [2016-09-13T12:14:48.091970 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80593], State: [ok], Delivered in [0.004372376] seconds [----] I, [2016-09-13T12:14:52.874985 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:14:52 UTC]... [----] I, [2016-09-13T12:14:52.886503 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:14:52 UTC]...Complete [----] I, [2016-09-13T12:15:02.632538 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:15:02.646834 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80595], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:15:04.288714 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:15:04.294623 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00738835334777832, :worker_monitor=>1.3614885807037354, :worker_dequeue=>0.014323711395263672, :total_time=>1.3837015628814697} [----] I, [2016-09-13T12:15:04.989571 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80595], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.350283374] seconds [----] I, [2016-09-13T12:15:04.989760 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80595], Delivering... [----] I, [2016-09-13T12:15:04.995884 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031332969665527344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031502246856689453, :pending_vm_jobs=>0.0007855892181396484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005722522735595703} [----] I, [2016-09-13T12:15:04.996254 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80595], State: [ok], Delivered in [0.00649255] seconds [----] I, [2016-09-13T12:15:17.658920 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:15:17.669210 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80596], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:15:17.680539 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80597], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:15:17.705005 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80598], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:15:17.720780 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80599], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:15:20.326124 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:15:20.328517 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036585330963134766, :worker_monitor=>0.9923207759857178, :worker_dequeue=>0.005335330963134766, :total_time=>1.0015881061553955} [----] I, [2016-09-13T12:15:21.041305 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80596], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.377394429] seconds [----] I, [2016-09-13T12:15:21.041565 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80596], Delivering... [----] I, [2016-09-13T12:15:21.115141 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80596], State: [ok], Delivered in [0.073586569] seconds [----] I, [2016-09-13T12:15:21.121137 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80599], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.409994071] seconds [----] I, [2016-09-13T12:15:21.121355 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80599], Delivering... [----] I, [2016-09-13T12:15:21.128608 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004423856735229492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004441976547241211, :pending_vm_jobs=>0.0007252693176269531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006829500198364258} [----] I, [2016-09-13T12:15:21.128970 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80599], State: [ok], Delivered in [0.007608088] seconds [----] I, [2016-09-13T12:15:21.143510 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80597], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.46927025] seconds [----] I, [2016-09-13T12:15:21.143659 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80597], Delivering... [----] I, [2016-09-13T12:15:21.145961 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80597], State: [ok], Delivered in [0.002291021] seconds [----] I, [2016-09-13T12:15:21.172340 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80598], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.484667466] seconds [----] I, [2016-09-13T12:15:21.172489 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80598], Delivering... [----] I, [2016-09-13T12:15:21.175631 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80598], State: [ok], Delivered in [0.00313912] seconds [----] I, [2016-09-13T12:15:25.328930 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:15:25 UTC]... [----] I, [2016-09-13T12:15:25.343387 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:15:25 UTC]...Complete [----] I, [2016-09-13T12:15:32.732635 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:15:32.756276 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80600], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:15:36.673552 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:15:36.677854 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00408935546875, :worker_monitor=>1.2967393398284912, :worker_dequeue=>0.009030818939208984, :total_time=>1.3101327419281006} [----] I, [2016-09-13T12:15:37.261141 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80600], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.521084582] seconds [----] I, [2016-09-13T12:15:37.261374 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80600], Delivering... [----] I, [2016-09-13T12:15:37.268262 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036547183990478516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036773681640625, :pending_vm_jobs=>0.0007917881011962891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0064585208892822266} [----] I, [2016-09-13T12:15:37.268651 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80600], State: [ok], Delivered in [0.007265153] seconds [----] I, [2016-09-13T12:15:47.773650 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:15:47.792184 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80601], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:15:47.804729 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80602], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:15:53.320698 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:15:53.325206 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004884958267211914, :worker_monitor=>1.485314130783081, :worker_dequeue=>0.009547948837280273, :total_time=>1.5000684261322021} [----] I, [2016-09-13T12:15:53.375772 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80602], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.577975272] seconds [----] I, [2016-09-13T12:15:53.376013 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80602], Delivering... [----] I, [2016-09-13T12:15:53.382538 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034127235412597656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034339427947998047, :pending_vm_jobs=>0.0008180141448974609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006098508834838867} [----] I, [2016-09-13T12:15:53.382903 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80602], State: [ok], Delivered in [0.006922577] seconds [----] I, [2016-09-13T12:15:54.324439 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80601], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.546334141] seconds [----] I, [2016-09-13T12:15:54.324620 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80601], Delivering... [----] I, [2016-09-13T12:15:54.328865 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80601], State: [ok], Delivered in [0.004236227] seconds [----] I, [2016-09-13T12:15:58.325713 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:15:58 UTC]... [----] I, [2016-09-13T12:15:58.347930 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:15:58 UTC]...Complete [----] I, [2016-09-13T12:16:02.815917 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:16:02.833094 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80603], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:16:03.378188 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:16:03.478727 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80603], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.656573254] seconds [----] I, [2016-09-13T12:16:03.479030 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80603], Delivering... [----] I, [2016-09-13T12:16:03.489069 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005284786224365234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005315303802490234, :pending_vm_jobs=>0.0012447834014892578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009434223175048828} [----] I, [2016-09-13T12:16:03.489575 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80603], State: [ok], Delivered in [0.01056907] seconds [----] I, [2016-09-13T12:16:09.642263 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004031658172607422, :worker_monitor=>1.245152473449707, :worker_dequeue=>0.007399559020996094, :total_time=>1.2569406032562256} [----] I, [2016-09-13T12:16:17.844885 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:16:17.858875 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80604], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:16:17.883831 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80605], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:16:17.916278 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80606], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:16:17.938894 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80607], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:16:19.667106 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:16:20.632313 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80604], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.782723273] seconds [----] I, [2016-09-13T12:16:20.632633 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80604], Delivering... [----] I, [2016-09-13T12:16:20.676649 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80607], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.75182823] seconds [----] I, [2016-09-13T12:16:20.676845 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80607], Delivering... [----] I, [2016-09-13T12:16:20.683795 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037047863006591797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037262439727783203, :pending_vm_jobs=>0.0008482933044433594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006564617156982422} [----] I, [2016-09-13T12:16:20.684152 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80607], State: [ok], Delivered in [0.007305639] seconds [----] I, [2016-09-13T12:16:20.739284 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80604], State: [ok], Delivered in [0.106615983] seconds [----] I, [2016-09-13T12:16:21.419151 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80605], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.554616909] seconds [----] I, [2016-09-13T12:16:21.419340 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80605], Delivering... [----] I, [2016-09-13T12:16:21.422700 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80605], State: [ok], Delivered in [0.003354458] seconds [----] I, [2016-09-13T12:16:21.424992 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80606], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.528692531] seconds [----] I, [2016-09-13T12:16:21.425291 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80606], Delivering... [----] I, [2016-09-13T12:16:21.432251 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80606], State: [ok], Delivered in [0.006977777] seconds [----] I, [2016-09-13T12:16:24.693496 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T12:16:25.857919 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005017280578613281, :log_active_servers=>0.016553401947021484, :worker_monitor=>1.1545226573944092, :worker_dequeue=>0.009485483169555664, :total_time=>1.1860029697418213} [----] I, [2016-09-13T12:16:30.858310 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:16:30 UTC]... [----] I, [2016-09-13T12:16:30.907354 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:16:30 UTC]...Complete [----] I, [2016-09-13T12:16:32.951764 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:16:32.984738 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80608], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:16:35.930708 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:16:36.490077 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80608], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.527286205] seconds [----] I, [2016-09-13T12:16:36.490192 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80608], Delivering... [----] I, [2016-09-13T12:16:36.494214 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022056102752685547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022187232971191406, :pending_vm_jobs=>0.0005180835723876953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0037796497344970703} [----] I, [2016-09-13T12:16:36.494486 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80608], State: [ok], Delivered in [0.004286977] seconds [----] I, [2016-09-13T12:16:42.240994 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036377906799316406, :worker_monitor=>1.2956490516662598, :worker_dequeue=>0.005541563034057617, :total_time=>1.3051033020019531} [----] I, [2016-09-13T12:16:48.286278 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:16:48.359180 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80609], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:16:48.393694 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80610], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:16:52.443229 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:16:52.936551 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80610], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.563478406] seconds [----] I, [2016-09-13T12:16:52.936745 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80610], Delivering... [----] I, [2016-09-13T12:16:52.941492 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002758026123046875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027761459350585938, :pending_vm_jobs=>0.0005242824554443359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00442957878112793} [----] I, [2016-09-13T12:16:52.941751 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80610], State: [ok], Delivered in [0.005027813] seconds [----] I, [2016-09-13T12:16:54.605273 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80609], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.262979237] seconds [----] I, [2016-09-13T12:16:54.605479 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80609], Delivering... [----] I, [2016-09-13T12:16:54.610044 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80609], State: [ok], Delivered in [0.004558969] seconds [----] I, [2016-09-13T12:16:59.345702 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004202842712402344, :worker_monitor=>1.8833367824554443, :worker_dequeue=>0.0068531036376953125, :total_time=>1.894744873046875} [----] I, [2016-09-13T12:17:03.408099 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:17:03.444675 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80611], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:17:04.346330 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:17:04 UTC]... [----] I, [2016-09-13T12:17:04.370778 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:17:04 UTC]...Complete [----] I, [2016-09-13T12:17:04.387366 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:17:05.079481 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80611], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.667505156] seconds [----] I, [2016-09-13T12:17:05.079702 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80611], Delivering... [----] I, [2016-09-13T12:17:05.085609 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00342559814453125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003444671630859375, :pending_vm_jobs=>0.0006868839263916016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005506992340087891} [----] I, [2016-09-13T12:17:05.085909 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80611], State: [ok], Delivered in [0.006209169] seconds [----] I, [2016-09-13T12:17:16.473030 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035524368286132812, :worker_monitor=>2.043992757797241, :worker_dequeue=>0.008133411407470703, :total_time=>2.0559475421905518} [----] I, [2016-09-13T12:17:18.454053 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:17:18.467907 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80612], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:17:18.496504 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80613], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:17:18.518925 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80614], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:17:18.530593 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80615], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:17:21.484247 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:17:21.650463 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80612], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.191569278] seconds [----] I, [2016-09-13T12:17:21.650596 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80612], Delivering... [----] I, [2016-09-13T12:17:21.707849 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80612], State: [ok], Delivered in [0.057210074] seconds [----] I, [2016-09-13T12:17:21.742184 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80615], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.219647858] seconds [----] I, [2016-09-13T12:17:21.742346 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80615], Delivering... [----] I, [2016-09-13T12:17:21.748642 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032455921173095703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003268003463745117, :pending_vm_jobs=>0.0008561611175537109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005948781967163086} [----] I, [2016-09-13T12:17:21.748940 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80615], State: [ok], Delivered in [0.00659131] seconds [----] I, [2016-09-13T12:17:21.770903 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80613], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.297031078] seconds [----] I, [2016-09-13T12:17:21.771102 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80613], Delivering... [----] I, [2016-09-13T12:17:21.774033 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80613], State: [ok], Delivered in [0.002914396] seconds [----] I, [2016-09-13T12:17:21.845095 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80614], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.340335998] seconds [----] I, [2016-09-13T12:17:21.845278 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80614], Delivering... [----] I, [2016-09-13T12:17:21.849576 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80614], State: [ok], Delivered in [0.004304471] seconds [----] I, [2016-09-13T12:17:32.764734 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004179954528808594, :worker_monitor=>1.2548739910125732, :worker_dequeue=>0.008038759231567383, :total_time=>1.2674660682678223} [----] I, [2016-09-13T12:17:33.541767 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:17:33.571684 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80616], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:17:37.765212 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:17:37 UTC]... [----] I, [2016-09-13T12:17:37.810778 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:17:37 UTC]...Complete [----] I, [2016-09-13T12:17:37.821665 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:17:38.251749 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80616], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.701955849] seconds [----] I, [2016-09-13T12:17:38.251975 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80616], Delivering... [----] I, [2016-09-13T12:17:38.258556 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034246444702148438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035364627838134766, :pending_vm_jobs=>0.0008254051208496094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00618743896484375} [----] I, [2016-09-13T12:17:38.258936 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80616], State: [ok], Delivered in [0.006965839] seconds [----] I, [2016-09-13T12:17:48.580406 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:17:48.634363 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80617], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:17:48.662702 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80618], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:17:49.202542 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:17:49.206972 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0034046173095703125, :server_monitor=>0.08477449417114258, :worker_monitor=>1.2701528072357178, :worker_dequeue=>0.009558677673339844, :total_time=>1.368276596069336} [----] I, [2016-09-13T12:17:49.428908 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80618], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.788998036] seconds [----] I, [2016-09-13T12:17:49.429059 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80618], Delivering... [----] I, [2016-09-13T12:17:49.433879 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002526998519897461, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025453567504882812, :pending_vm_jobs=>0.0005805492401123047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004561424255371094} [----] I, [2016-09-13T12:17:49.434250 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80618], State: [ok], Delivered in [0.005186148] seconds [----] I, [2016-09-13T12:17:51.931688 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80617], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.347631483] seconds [----] I, [2016-09-13T12:17:51.931821 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80617], Delivering... [----] I, [2016-09-13T12:17:51.935077 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80617], State: [ok], Delivered in [0.003246832] seconds [----] I, [2016-09-13T12:18:03.675299 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T12:18:03.723311 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80619], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [3600] [----] I, [2016-09-13T12:18:03.740019 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80620], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:18:05.641597 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:18:05.646668 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006136894226074219, :worker_monitor=>1.3896944522857666, :worker_dequeue=>0.010942935943603516, :total_time=>1.4072515964508057} [----] I, [2016-09-13T12:18:06.500481 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80620], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.77058766] seconds [----] I, [2016-09-13T12:18:06.500684 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80620], Delivering... [----] I, [2016-09-13T12:18:06.507223 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003266572952270508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032875537872314453, :pending_vm_jobs=>0.0008444786071777344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006163120269775391} [----] I, [2016-09-13T12:18:06.507619 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80620], State: [ok], Delivered in [0.006915649] seconds [----] I, [2016-09-13T12:18:07.015753 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80619], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [3600], Dequeued in: [3.328386346] seconds [----] I, [2016-09-13T12:18:07.016331 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80619], Delivering... [----] I, [2016-09-13T12:18:07.032018 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80619], State: [ok], Delivered in [0.015720685] seconds [----] I, [2016-09-13T12:18:10.647113 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:18:10 UTC]... [----] I, [2016-09-13T12:18:10.665967 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:18:10 UTC]...Complete [----] I, [2016-09-13T12:18:18.750440 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:18:18.763242 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80621], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:18:18.786410 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80622], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:18:18.814682 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80623], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:18:18.843266 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80624], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:18:22.003125 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:18:22.005706 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002591371536254883, :worker_monitor=>1.3012394905090332, :worker_dequeue=>0.00585174560546875, :total_time=>1.3156490325927734} [----] I, [2016-09-13T12:18:22.089407 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80621], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.335797563] seconds [----] I, [2016-09-13T12:18:22.089636 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80621], Delivering... [----] I, [2016-09-13T12:18:22.106782 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80624], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.286485802] seconds [----] I, [2016-09-13T12:18:22.107073 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80624], Delivering... [----] I, [2016-09-13T12:18:22.116225 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0056841373443603516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005715131759643555, :pending_vm_jobs=>0.0009253025054931641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008599996566772461} [----] I, [2016-09-13T12:18:22.116674 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80624], State: [ok], Delivered in [0.009620889] seconds [----] I, [2016-09-13T12:18:22.163775 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80621], State: [ok], Delivered in [0.074105922] seconds [----] I, [2016-09-13T12:18:22.172311 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80622], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.405253368] seconds [----] I, [2016-09-13T12:18:22.172672 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80622], Delivering... [----] I, [2016-09-13T12:18:22.177054 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80622], State: [ok], Delivered in [0.004377754] seconds [----] I, [2016-09-13T12:18:22.249367 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80623], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.454910273] seconds [----] I, [2016-09-13T12:18:22.249579 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80623], Delivering... [----] I, [2016-09-13T12:18:22.254154 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80623], State: [ok], Delivered in [0.004551841] seconds [----] I, [2016-09-13T12:18:33.852338 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:18:33.871854 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80625], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:18:38.510859 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:18:38.514164 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038404464721679688, :worker_monitor=>1.4599628448486328, :worker_dequeue=>0.007513523101806641, :total_time=>1.4716517925262451} [----] I, [2016-09-13T12:18:38.720772 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80625], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.86266787] seconds [----] I, [2016-09-13T12:18:38.720931 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80625], Delivering... [----] I, [2016-09-13T12:18:38.726131 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002716541290283203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002737760543823242, :pending_vm_jobs=>0.0004825592041015625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0042476654052734375} [----] I, [2016-09-13T12:18:38.726452 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80625], State: [ok], Delivered in [0.00550102] seconds [----] I, [2016-09-13T12:18:43.514619 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:18:43 UTC]... [----] I, [2016-09-13T12:18:43.561678 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:18:43 UTC]...Complete [----] I, [2016-09-13T12:18:48.880916 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T12:18:48.897580 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80626], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:18:48.914755 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80627], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:18:48.926105 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80628], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:18:48.943464 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80629], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:18:54.747551 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:18:54.749924 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0066547393798828125, :worker_monitor=>1.067972183227539, :worker_dequeue=>0.005181550979614258, :total_time=>1.0801658630371094} [----] I, [2016-09-13T12:18:54.880886 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80626], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.99451228] seconds [----] I, [2016-09-13T12:18:54.881142 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80626], Delivering... [----] I, [2016-09-13T12:18:54.882288 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T12:18:54.882594 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4580577280 [----] I, [2016-09-13T12:18:54.882740 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4341821440 [----] I, [2016-09-13T12:18:54.882868 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 238755840 [----] I, [2016-09-13T12:18:54.883011 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T12:18:54.883134 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4284837888 [----] I, [2016-09-13T12:18:54.883250 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T12:18:54.883370 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T12:18:54.883521 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 561647616 [----] I, [2016-09-13T12:18:54.883630 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T12:18:54.883724 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6660231168 [----] I, [2016-09-13T12:18:54.883836 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T12:18:54.883974 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T12:18:54.884096 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T12:18:54.884217 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 12288 [----] I, [2016-09-13T12:18:54.884340 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T12:18:54.884491 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T12:18:54.884622 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T12:18:54.884740 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T12:18:54.884858 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T12:18:54.884992 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T12:18:54.885115 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272384000 [----] I, [2016-09-13T12:18:54.885237 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55205888 [----] I, [2016-09-13T12:18:54.885355 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217178112 [----] I, [2016-09-13T12:18:54.885511 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6111232 [----] I, [2016-09-13T12:18:54.885641 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142356480 [----] I, [2016-09-13T12:18:54.885763 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3404627968 [----] I, [2016-09-13T12:18:54.885879 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3083194368 [----] I, [2016-09-13T12:18:54.886018 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T12:18:54.886142 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T12:18:54.886263 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T12:18:54.886386 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36397056 [----] I, [2016-09-13T12:18:54.886550 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76959744 [----] I, [2016-09-13T12:18:54.886694 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49577984 [----] I, [2016-09-13T12:18:54.886812 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111931392 [----] I, [2016-09-13T12:18:54.886928 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126537728 [----] I, [2016-09-13T12:18:54.887084 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T12:18:54.887209 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T12:18:54.887328 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T12:18:54.887469 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T12:18:54.887599 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T12:18:54.887725 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T12:18:54.887845 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T12:18:54.887984 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T12:18:54.888100 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T12:18:54.921540 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80629], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.99081424] seconds [----] I, [2016-09-13T12:18:54.921748 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80629], Delivering... [----] I, [2016-09-13T12:18:54.926851 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T12:18:54.927082 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T12:18:54.927663 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030171871185302734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003036022186279297, :pending_vm_jobs=>0.0007460117340087891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005555868148803711} [----] I, [2016-09-13T12:18:54.927988 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80629], State: [ok], Delivered in [0.00622703] seconds [----] I, [2016-09-13T12:18:54.931711 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T12:18:54.935132 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T12:18:54.939228 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T12:18:54.943362 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T12:18:54.947520 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T12:18:54.950018 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 859 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T12:18:54.952365 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T12:18:54.954892 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T12:18:54.957270 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.8 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T12:18:54.959652 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T12:18:54.962094 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 176 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T12:18:54.964446 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T12:18:54.966698 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:18:54.966811 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:18:54.966895 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T12:18:54.970337 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358595000], Memory % [5.27], CPU Time [217072.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T12:18:54.970653 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80626], State: [ok], Delivered in [0.089528051] seconds [----] I, [2016-09-13T12:18:55.321291 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80628], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.403034046] seconds [----] I, [2016-09-13T12:18:55.321654 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80628], Delivering... [----] I, [2016-09-13T12:18:55.327012 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80628], State: [ok], Delivered in [0.005376094] seconds [----] I, [2016-09-13T12:18:59.755935 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:18:59.993014 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80627], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [11.09096202] seconds [----] I, [2016-09-13T12:18:59.993189 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80627], Delivering... [----] I, [2016-09-13T12:18:59.999985 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:18:52 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163163000], Memory % [3.1], CPU Time [39051.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T12:19:00.000528 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:18:52 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359296000], Memory % [5.28], CPU Time [208396.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T12:19:00.001063 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:18:53 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201170000], Memory % [3.36], CPU Time [155855.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:19:00.001510 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:18:53 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202686000], Memory % [3.38], CPU Time [155021.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:19:00.001977 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:18:51 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [53049.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:19:00.002432 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:18:48 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [247075.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T12:19:00.002851 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:18:53 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347859000], Memory % [5.04], CPU Time [106649.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T12:19:00.003264 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:18:48 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213441000], Memory % [3.51], CPU Time [50301.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T12:19:00.005969 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:18:44 UTC], Process Info: Memory Usage [604274688], Memory Size [936779776], Proportional Set Size: [445405000], Memory % [7.37], CPU Time [925.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T12:19:00.007444 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:18:46 UTC], Process Info: Memory Usage [602062848], Memory Size [945250304], Proportional Set Size: [445327000], Memory % [7.34], CPU Time [1057.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T12:19:00.007771 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:18:52 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358595000], Memory % [5.27], CPU Time [217081.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T12:19:00.008080 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:18:54 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [53002.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:19:00.008339 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:18:43 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166763000], Memory % [3.16], CPU Time [39976.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T12:19:00.008553 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80627], State: [ok], Delivered in [0.015376597] seconds [----] I, [2016-09-13T12:19:03.955078 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:19:03.995486 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80630], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:19:04.768910 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:19:05.057983 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80630], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.095718352] seconds [----] I, [2016-09-13T12:19:05.058160 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80630], Delivering... [----] I, [2016-09-13T12:19:05.064253 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031311511993408203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031554698944091797, :pending_vm_jobs=>0.0007996559143066406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005765199661254883} [----] I, [2016-09-13T12:19:05.064659 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80630], State: [ok], Delivered in [0.006492873] seconds [----] I, [2016-09-13T12:19:10.877439 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0032095909118652344, :worker_monitor=>1.094264268875122, :worker_dequeue=>0.005095481872558594, :total_time=>1.1028637886047363} [----] I, [2016-09-13T12:19:15.877869 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:19:15 UTC]... [----] I, [2016-09-13T12:19:15.897711 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:19:15 UTC]...Complete [----] I, [2016-09-13T12:19:19.007477 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 14. [----] I, [2016-09-13T12:19:19.069579 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80631], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:19:19.097923 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80632], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:19:19.120805 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80633], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:19:19.155101 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80634], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:19:19.177887 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80635], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:19:20.916069 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:19:21.166616 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80632], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.090263073] seconds [----] I, [2016-09-13T12:19:21.166741 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80632], Delivering... [----] I, [2016-09-13T12:19:21.189379 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80635], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.028763232] seconds [----] I, [2016-09-13T12:19:21.189539 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80635], Delivering... [----] I, [2016-09-13T12:19:21.193048 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0019674301147460938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0019791126251220703, :pending_vm_jobs=>0.0004367828369140625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0033006668090820312} [----] I, [2016-09-13T12:19:21.193231 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80635], State: [ok], Delivered in [0.003693374] seconds [----] I, [2016-09-13T12:19:21.223808 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80632], State: [ok], Delivered in [0.057004384] seconds [----] I, [2016-09-13T12:19:22.418139 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80631], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.398920706] seconds [----] I, [2016-09-13T12:19:22.418327 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80631], Delivering... [----] I, [2016-09-13T12:19:22.461166 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80633], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.357513996] seconds [----] I, [2016-09-13T12:19:22.461556 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80633], Delivering... [----] I, [2016-09-13T12:19:22.464101 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80636], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T12:19:22.464462 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80631], State: [ok], Delivered in [0.046104867] seconds [----] I, [2016-09-13T12:19:22.472018 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80633], State: [ok], Delivered in [0.010519315] seconds [----] I, [2016-09-13T12:19:22.486353 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80634], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.358108769] seconds [----] I, [2016-09-13T12:19:22.486489 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80634], Delivering... [----] I, [2016-09-13T12:19:22.489926 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80634], State: [ok], Delivered in [0.003424762] seconds [----] I, [2016-09-13T12:19:27.356085 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T12:19:27.356343 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00423884391784668, :worker_monitor=>1.4224979877471924, :worker_dequeue=>0.009506940841674805, :total_time=>1.4365267753601074} [----] I, [2016-09-13T12:19:32.369227 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T12:19:34.191729 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:19:34.222140 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80637], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:19:34.244837 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80638], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:19:34.703999 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [80636], MiqWorker id: [104], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [12.26366962] seconds [----] I, [2016-09-13T12:19:34.704364 #24051:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80636], Delivering... [----] I, [2016-09-13T12:19:34.710544 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T12:19:34.710840 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T12:19:34.711072 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T12:19:34.711368 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T12:19:34.711703 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:35.371716 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:35.654592 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:35.654726 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:36.169452 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:36.466655 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:36.466817 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:37.086987 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:37.379986 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:19:37.397984 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:37.398172 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:37.433204 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80638], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.204811904] seconds [----] I, [2016-09-13T12:19:37.433316 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80638], Delivering... [----] I, [2016-09-13T12:19:37.437022 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020411014556884766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002053499221801758, :pending_vm_jobs=>0.0004477500915527344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003479480743408203} [----] I, [2016-09-13T12:19:37.437252 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80638], State: [ok], Delivered in [0.003929315] seconds [----] I, [2016-09-13T12:19:37.530359 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80637], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.334265489] seconds [----] I, [2016-09-13T12:19:37.530505 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80637], Delivering... [----] I, [2016-09-13T12:19:37.587240 #2928:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 16:19:37 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_17' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 16:19:37.383835') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2927,,2016-09-13 16:19:35 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2936,2016-09-13 16:19:37 UTC,2016-09-13 16:19:37 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2946,,2016-09-13 16:19:37 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 16:19:37 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 16:19:37 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 16:19:36 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2986,,2016-09-13 16:19:36 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2997,,2016-09-13 16:19:34 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 16:19:19.185129')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3, 3011,,2016-09-13 15:56:30 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1387, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,525732, 3030,,2016-09-13 14:56:12 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5005, 3054,,2016-09-13 15:56:23 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1394, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,525731, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,525730, 3160,,2016-09-13 15:26:14 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3203, 24059,,2016-09-13 16:19:34 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 17563,,2016-09-13 15:56:24 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1393, 27056,,2016-09-13 15:26:21 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3196, 28888,,2016-09-13 15:56:27 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1389, ACTIVITY_STATS_CSV [----] I, [2016-09-13T12:19:37.587650 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80637], State: [ok], Delivered in [0.057131054] seconds [----] I, [2016-09-13T12:19:37.882615 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:38.172979 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:38.173097 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:38.638133 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:38.944879 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:38.945068 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:39.396841 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:39.701197 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:39.701410 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:40.205105 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:40.552294 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:40.552544 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:41.020514 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:41.308586 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:41.308702 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:41.789653 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:42.097861 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:42.097990 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:42.580185 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:42.885879 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:42.886016 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:43.405733 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:43.432510 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033948421478271484, :worker_monitor=>1.0327301025390625, :worker_dequeue=>0.00933527946472168, :total_time=>1.0457229614257812} [----] I, [2016-09-13T12:19:43.723991 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:43.724180 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:44.242275 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:44.547729 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:44.547904 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:45.050358 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:45.351248 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:45.351468 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:45.825813 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:48.433049 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:19:48 UTC]... [----] I, [2016-09-13T12:19:48.484751 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:19:48 UTC]...Complete [----] I, [2016-09-13T12:19:49.255210 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:19:49.273575 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80639], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:19:49.302348 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80640], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:19:52.007472 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:52.149184 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:52.282955 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:52.420117 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:52.557630 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:52.696842 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:52.833369 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:52.972403 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:53.107073 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:53.240549 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:53.375363 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:53.512580 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:53.597161 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:19:53.648835 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:53.786354 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:54.136424 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:54.295512 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:54.422288 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80640], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.14251794] seconds [----] I, [2016-09-13T12:19:54.422456 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80640], Delivering... [----] I, [2016-09-13T12:19:54.426003 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0019693374633789062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0019807815551757812, :pending_vm_jobs=>0.0004181861877441406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0033049583435058594} [----] I, [2016-09-13T12:19:54.426226 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80640], State: [ok], Delivered in [0.003790131] seconds [----] I, [2016-09-13T12:19:54.433362 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:54.579899 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:54.713777 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:54.863196 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:54.999319 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:55.139708 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:55.282692 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:55.421010 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:55.559966 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:55.612328 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80639], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.352250565] seconds [----] I, [2016-09-13T12:19:55.612594 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80639], Delivering... [----] I, [2016-09-13T12:19:55.618259 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80639], State: [ok], Delivered in [0.00565051] seconds [----] I, [2016-09-13T12:19:55.700995 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:55.842755 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:55.983495 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:56.167431 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:56.323393 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:56.455247 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:56.893107 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:57.055599 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:57.197108 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:57.340306 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:57.489370 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:57.626728 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:57.765405 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:57.897672 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:58.034735 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:58.179492 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:58.317640 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:58.457601 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:58.602776 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:58.755644 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:58.903248 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:59.039870 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:59.175589 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:59.573769 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:59.721911 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:19:59.860712 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:00.007882 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:00.104814 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.008295774459838867, :worker_monitor=>1.486792802810669, :worker_dequeue=>0.009207487106323242, :total_time=>1.5046892166137695} [----] I, [2016-09-13T12:20:00.147447 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:00.287589 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:00.472443 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:00.611355 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:00.771106 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:00.907689 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:01.048645 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:01.187519 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:01.326981 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:01.468866 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:01.610796 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:01.752759 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:01.894849 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:02.328031 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:02.498050 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:02.641449 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:02.781115 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:02.919380 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:04.318587 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T12:20:04.342507 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80641], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:20:04.367617 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80642], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:20:04.390518 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80643], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:20:04.407641 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80644], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:20:05.113707 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:20:05.593862 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80641], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.269402103] seconds [----] I, [2016-09-13T12:20:05.594076 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80641], Delivering... [----] I, [2016-09-13T12:20:05.600509 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033380985260009766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003362417221069336, :pending_vm_jobs=>0.0008499622344970703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006081819534301758} [----] I, [2016-09-13T12:20:05.600840 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80641], State: [ok], Delivered in [0.006756368] seconds [----] I, [2016-09-13T12:20:07.727671 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80642], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.379349216] seconds [----] I, [2016-09-13T12:20:07.727817 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80642], Delivering... [----] I, [2016-09-13T12:20:07.729676 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80642], State: [ok], Delivered in [0.001848288] seconds [----] I, [2016-09-13T12:20:07.748115 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80643], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.37521545] seconds [----] I, [2016-09-13T12:20:07.748282 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80643], Delivering... [----] I, [2016-09-13T12:20:07.758230 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80643], State: [ok], Delivered in [0.009917256] seconds [----] I, [2016-09-13T12:20:07.784858 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80644], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.388802961] seconds [----] I, [2016-09-13T12:20:07.785013 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80644], Delivering... [----] I, [2016-09-13T12:20:07.790609 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80644], State: [ok], Delivered in [0.005569855] seconds [----] I, [2016-09-13T12:20:09.077096 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:09.214913 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:09.356635 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:09.494984 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:09.633115 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:09.781272 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:09.933014 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:10.078071 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:10.223006 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:10.363245 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:10.505103 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:10.644155 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:11.134232 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:11.286519 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:11.436851 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:11.592134 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:11.725515 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:11.868240 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:12.013836 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:12.152998 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:12.295340 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:12.429487 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:12.574309 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:12.715489 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:12.849536 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:12.991901 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:13.135691 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:13.282883 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:13.420583 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:13.977075 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:14.130643 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:14.278225 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:14.459865 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:14.653096 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:14.873056 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:16.029438 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:16.166618 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:16.308598 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:16.452480 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:16.590092 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:16.692167 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006020069122314453, :worker_monitor=>1.538163661956787, :worker_dequeue=>0.02082228660583496, :total_time=>1.5654151439666748} [----] I, [2016-09-13T12:20:16.726622 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:16.897815 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:17.039153 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:17.180340 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:17.327025 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:17.470495 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:17.944345 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:18.114530 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:18.263090 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:18.406500 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:18.552140 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:18.690251 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:18.832499 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:18.975972 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:19.126839 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:19.276089 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:19.418874 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:19.421081 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:20:19.476189 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80645], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:20:19.510549 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80646], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:20:19.546107 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80647], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:20:19.564543 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:19.573712 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80648], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:20:19.713111 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:19.854035 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:21.692705 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:20:21 UTC]... [----] I, [2016-09-13T12:20:21.711865 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:20:21 UTC]...Complete [----] I, [2016-09-13T12:20:21.731099 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:20:22.785271 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80645], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.359996899] seconds [----] I, [2016-09-13T12:20:22.785393 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80645], Delivering... [----] I, [2016-09-13T12:20:22.859678 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80648], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.308153311] seconds [----] I, [2016-09-13T12:20:22.859920 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80648], Delivering... [----] I, [2016-09-13T12:20:22.868755 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004830360412597656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004858493804931641, :pending_vm_jobs=>0.0012018680572509766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008366107940673828} [----] I, [2016-09-13T12:20:22.869141 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80648], State: [ok], Delivered in [0.00924054] seconds [----] I, [2016-09-13T12:20:22.956501 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80646], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.475194509] seconds [----] I, [2016-09-13T12:20:22.956649 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80646], Delivering... [----] I, [2016-09-13T12:20:22.957303 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80647], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.437183065] seconds [----] I, [2016-09-13T12:20:22.957555 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80647], Delivering... [----] I, [2016-09-13T12:20:22.958776 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80646], State: [ok], Delivered in [0.002125568] seconds [----] I, [2016-09-13T12:20:22.962405 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80645], State: [ok], Delivered in [0.176930966] seconds [----] I, [2016-09-13T12:20:22.967851 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80647], State: [ok], Delivered in [0.010281661] seconds [----] I, [2016-09-13T12:20:26.017236 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:26.157685 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:26.300639 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:26.757384 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:26.913252 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:27.067274 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:27.206465 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:27.347822 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:27.492879 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:27.636490 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:27.777048 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:27.920172 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:28.065102 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:28.205745 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:28.347495 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:28.492140 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:28.643314 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:28.783924 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:28.929864 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:29.067593 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:29.454765 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:29.608320 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:29.747897 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:29.887162 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:30.035268 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:30.172624 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:30.323230 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:30.463694 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:30.600400 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:30.741987 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:30.881303 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:31.024237 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:31.167977 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:31.304657 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:31.443926 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:31.590040 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:31.733904 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:32.134364 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:32.278412 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:32.425384 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:32.568480 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:32.707105 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:32.850793 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:32.988963 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:33.190583 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:33.290646 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037288665771484375, :worker_monitor=>1.5298960208892822, :worker_dequeue=>0.005078554153442383, :total_time=>1.5389642715454102} [----] I, [2016-09-13T12:20:33.342773 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:33.482320 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:33.616035 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:33.751517 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:33.895801 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:34.037490 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:34.177696 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:34.320770 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:34.454256 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:34.585200 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:20:34.602031 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80649], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:20:34.802211 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:34.963451 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:35.100665 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:35.241995 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:35.377066 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:35.514676 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:35.653517 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:35.833802 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:35.967905 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:36.124973 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:36.268091 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:36.426557 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:36.580351 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:36.723903 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:36.872956 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:37.014844 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:37.155161 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:37.586370 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:37.761216 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:37.905039 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:38.055763 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:38.202861 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:38.306795 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:20:38.344254 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:38.486605 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:38.624786 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:38.770256 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:38.912279 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:39.060646 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:39.093352 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80649], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.504364278] seconds [----] I, [2016-09-13T12:20:39.093519 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80649], Delivering... [----] I, [2016-09-13T12:20:39.098431 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023674964904785156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002384185791015625, :pending_vm_jobs=>0.0006649494171142578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004634380340576172} [----] I, [2016-09-13T12:20:39.098719 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80649], State: [ok], Delivered in [0.005204515] seconds [----] I, [2016-09-13T12:20:39.200411 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:39.339885 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:39.485164 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:39.631499 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:39.779487 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:39.921143 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:40.346240 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:40.514512 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:40.677906 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:40.853393 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:41.032478 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:41.178015 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:41.351504 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:41.504714 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:41.676231 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:41.811886 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:41.979562 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:42.119496 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:42.257672 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:42.400294 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:42.543768 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:42.684495 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:20:42.829375 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T12:20:43.036571 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T12:20:43.036839 #24051:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T12:20:43.037085 #24051:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T12:20:43.037158 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T12:20:43.037246 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T12:20:43.059370 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T12:20:43.059732 #24051:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [80636], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T12:20:43.059920 #24051:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T12:20:43.060139 #24051:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T12:20:43.060273 #24051:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80636], State: [error], Delivered in [68.355964219] seconds [----] I, [2016-09-13T12:20:49.611383 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:20:49.647933 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80650], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:20:49.682721 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80651], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:20:49.757604 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:20:49.760362 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040509700775146484, :worker_monitor=>1.4262523651123047, :worker_dequeue=>0.00610804557800293, :total_time=>1.4367384910583496} [----] I, [2016-09-13T12:20:50.128091 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80650], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.509863332] seconds [----] I, [2016-09-13T12:20:50.128230 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80650], Delivering... [----] I, [2016-09-13T12:20:50.131706 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80650], State: [ok], Delivered in [0.003474095] seconds [----] I, [2016-09-13T12:20:50.134478 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80651], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.478707144] seconds [----] I, [2016-09-13T12:20:50.134649 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80651], Delivering... [----] I, [2016-09-13T12:20:50.140014 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028924942016601562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029103755950927734, :pending_vm_jobs=>0.0006537437438964844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005033016204833984} [----] I, [2016-09-13T12:20:50.140336 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80651], State: [ok], Delivered in [0.005684685] seconds [----] I, [2016-09-13T12:20:54.760891 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:20:54 UTC]... [----] I, [2016-09-13T12:20:54.785125 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:20:54 UTC]...Complete [----] I, [2016-09-13T12:21:04.698862 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:21:04.716318 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80652], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:21:06.284120 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:21:06.288966 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003405332565307617, :worker_monitor=>1.3749945163726807, :worker_dequeue=>0.012813806533813477, :total_time=>1.3915550708770752} [----] I, [2016-09-13T12:21:06.351319 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80652], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.646726735] seconds [----] I, [2016-09-13T12:21:06.351514 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80652], Delivering... [----] I, [2016-09-13T12:21:06.357582 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029718875885009766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002986907958984375, :pending_vm_jobs=>0.0006709098815917969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005144596099853516} [----] I, [2016-09-13T12:21:06.357892 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80652], State: [ok], Delivered in [0.006378568] seconds [----] I, [2016-09-13T12:21:19.727677 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:21:19.751054 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80653], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:21:19.774130 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80654], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:21:19.802574 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80655], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:21:19.831123 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80656], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:21:22.611448 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:21:22.613994 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038170814514160156, :worker_monitor=>1.290069818496704, :worker_dequeue=>0.005699872970581055, :total_time=>1.2998507022857666} [----] I, [2016-09-13T12:21:23.262583 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80653], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.528272482] seconds [----] I, [2016-09-13T12:21:23.262696 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80653], Delivering... [----] I, [2016-09-13T12:21:23.268496 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80656], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.457441712] seconds [----] I, [2016-09-13T12:21:23.268669 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80656], Delivering... [----] I, [2016-09-13T12:21:23.274351 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028514862060546875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002870321273803711, :pending_vm_jobs=>0.000823974609375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0054149627685546875} [----] I, [2016-09-13T12:21:23.274658 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80656], State: [ok], Delivered in [0.005979408] seconds [----] I, [2016-09-13T12:21:23.297109 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80654], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.5377925] seconds [----] I, [2016-09-13T12:21:23.297285 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80654], Delivering... [----] I, [2016-09-13T12:21:23.299201 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80654], State: [ok], Delivered in [0.001925727] seconds [----] I, [2016-09-13T12:21:23.302569 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80653], State: [ok], Delivered in [0.039843671] seconds [----] I, [2016-09-13T12:21:23.319818 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80655], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.533332586] seconds [----] I, [2016-09-13T12:21:23.320009 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80655], Delivering... [----] I, [2016-09-13T12:21:23.323487 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80655], State: [ok], Delivered in [0.003484437] seconds [----] I, [2016-09-13T12:21:27.614588 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:21:27 UTC]... [----] I, [2016-09-13T12:21:27.645803 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:21:27 UTC]...Complete [----] I, [2016-09-13T12:21:27.663815 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T12:21:34.846196 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:21:34.903025 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80657], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:21:39.005133 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:21:39.007800 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036003589630126953, :worker_monitor=>1.316328763961792, :worker_dequeue=>0.0057811737060546875, :total_time=>1.3259973526000977} [----] I, [2016-09-13T12:21:39.554558 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80657], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.702740697] seconds [----] I, [2016-09-13T12:21:39.554817 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80657], Delivering... [----] I, [2016-09-13T12:21:39.562923 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004064321517944336, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0040934085845947266, :pending_vm_jobs=>0.0010406970977783203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007645130157470703} [----] I, [2016-09-13T12:21:39.563304 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80657], State: [ok], Delivered in [0.008509435] seconds [----] I, [2016-09-13T12:21:49.912460 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:21:49.925634 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80658], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:21:49.942879 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80659], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:21:55.658881 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:21:55.661689 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005633831024169922, :worker_monitor=>1.6172051429748535, :worker_dequeue=>0.0061109066009521484, :total_time=>1.6293597221374512} [----] I, [2016-09-13T12:21:55.703665 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80659], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.774436684] seconds [----] I, [2016-09-13T12:21:55.703845 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80659], Delivering... [----] I, [2016-09-13T12:21:55.708280 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024216175079345703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024378299713134766, :pending_vm_jobs=>0.0005116462707519531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004107236862182617} [----] I, [2016-09-13T12:21:55.708585 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80659], State: [ok], Delivered in [0.004730634] seconds [----] I, [2016-09-13T12:21:56.451883 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80658], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.536272814] seconds [----] I, [2016-09-13T12:21:56.452105 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80658], Delivering... [----] I, [2016-09-13T12:21:56.456652 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80658], State: [ok], Delivered in [0.004540993] seconds [----] I, [2016-09-13T12:22:00.662234 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:22:00 UTC]... [----] I, [2016-09-13T12:22:00.679924 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:22:00 UTC]...Complete [----] I, [2016-09-13T12:22:04.954255 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:22:04.984968 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80660], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:22:05.785244 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:22:06.772279 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80660], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.808127894] seconds [----] I, [2016-09-13T12:22:06.772543 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80660], Delivering... [----] I, [2016-09-13T12:22:06.780703 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004065990447998047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0041582584381103516, :pending_vm_jobs=>0.0011296272277832031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007684230804443359} [----] I, [2016-09-13T12:22:06.781105 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80660], State: [ok], Delivered in [0.00856439] seconds [----] I, [2016-09-13T12:22:12.335350 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0070497989654541016, :worker_monitor=>1.532932996749878, :worker_dequeue=>0.006927013397216797, :total_time=>1.5472002029418945} [----] I, [2016-09-13T12:22:19.996599 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:22:20.018543 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80661], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:22:20.183124 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80662], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:22:20.217817 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80663], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:22:20.269246 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80664], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:22:22.379162 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:22:22.905068 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80661], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.905381095] seconds [----] I, [2016-09-13T12:22:22.905308 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80661], Delivering... [----] I, [2016-09-13T12:22:22.960575 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80661], State: [ok], Delivered in [0.055221653] seconds [----] I, [2016-09-13T12:22:23.040829 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80664], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.817271104] seconds [----] I, [2016-09-13T12:22:23.040997 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80664], Delivering... [----] I, [2016-09-13T12:22:23.045235 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002599477767944336, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002613544464111328, :pending_vm_jobs=>0.00042939186096191406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003989219665527344} [----] I, [2016-09-13T12:22:23.045475 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80664], State: [ok], Delivered in [0.004478039] seconds [----] I, [2016-09-13T12:22:23.532232 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80662], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.510102946] seconds [----] I, [2016-09-13T12:22:23.532467 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80662], Delivering... [----] I, [2016-09-13T12:22:23.535650 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80662], State: [ok], Delivered in [0.003223996] seconds [----] I, [2016-09-13T12:22:23.589626 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80663], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.401358539] seconds [----] I, [2016-09-13T12:22:23.589862 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80663], Delivering... [----] I, [2016-09-13T12:22:23.595645 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80663], State: [ok], Delivered in [0.005766182] seconds [----] I, [2016-09-13T12:22:33.305747 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:22:33 UTC]... [----] I, [2016-09-13T12:22:33.326743 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:22:33 UTC]...Complete [----] I, [2016-09-13T12:22:35.279849 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:22:35.323225 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80665], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:22:38.347677 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:22:38.569164 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80665], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.285361399] seconds [----] I, [2016-09-13T12:22:38.569364 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80665], Delivering... [----] I, [2016-09-13T12:22:38.575075 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002948760986328125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00296783447265625, :pending_vm_jobs=>0.0007147789001464844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0053403377532958984} [----] I, [2016-09-13T12:22:38.575480 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80665], State: [ok], Delivered in [0.006088631] seconds [----] I, [2016-09-13T12:22:44.803303 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033643245697021484, :worker_monitor=>1.4389243125915527, :worker_dequeue=>0.00850820541381836, :total_time=>1.451049566268921} [----] I, [2016-09-13T12:22:50.332770 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:22:50.352057 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80666], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:22:50.385665 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80667], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:22:54.825133 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:22:55.499689 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80667], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.142268359] seconds [----] I, [2016-09-13T12:22:55.499833 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80667], Delivering... [----] I, [2016-09-13T12:22:55.504246 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002371072769165039, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002387523651123047, :pending_vm_jobs=>0.0005180835723876953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0041005611419677734} [----] I, [2016-09-13T12:22:55.504524 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80667], State: [ok], Delivered in [0.004699293] seconds [----] I, [2016-09-13T12:22:57.030821 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80666], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.694115675] seconds [----] I, [2016-09-13T12:22:57.031066 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80666], Delivering... [----] I, [2016-09-13T12:22:57.037565 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80666], State: [ok], Delivered in [0.006493087] seconds [----] I, [2016-09-13T12:23:01.493961 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00409245491027832, :worker_monitor=>1.6437339782714844, :worker_dequeue=>0.015951871871948242, :total_time=>1.6640939712524414} [----] I, [2016-09-13T12:23:05.400435 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:23:05.420880 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80668], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:23:05.438207 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80669], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:23:06.494512 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:23:06 UTC]... [----] I, [2016-09-13T12:23:06.523632 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:23:06 UTC]...Complete [----] I, [2016-09-13T12:23:06.614022 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:23:06.832710 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80669], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.406095922] seconds [----] I, [2016-09-13T12:23:06.832853 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80669], Delivering... [----] I, [2016-09-13T12:23:06.837274 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023381710052490234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023572444915771484, :pending_vm_jobs=>0.0005609989166259766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004125118255615234} [----] I, [2016-09-13T12:23:06.837586 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80669], State: [ok], Delivered in [0.004733477] seconds [----] I, [2016-09-13T12:23:09.097682 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80668], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.68992072] seconds [----] I, [2016-09-13T12:23:09.098017 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80668], Delivering... [----] I, [2016-09-13T12:23:09.098514 #2928:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Starting [----] I, [2016-09-13T12:23:09.104665 #2928:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Complete [----] I, [2016-09-13T12:23:09.105003 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80668], State: [ok], Delivered in [0.007023097] seconds [----] I, [2016-09-13T12:23:17.873997 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.008090972900390625, :worker_monitor=>1.2296395301818848, :worker_dequeue=>0.00538325309753418, :total_time=>1.24344801902771} [----] I, [2016-09-13T12:23:20.450398 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:23:20.466629 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80670], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:23:20.483881 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80671], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:23:20.501113 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80672], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:23:20.524101 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80673], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:23:22.883211 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:23:22.964268 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80670], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.509242885] seconds [----] I, [2016-09-13T12:23:22.964469 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80670], Delivering... [----] I, [2016-09-13T12:23:23.026957 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80670], State: [ok], Delivered in [0.062458596] seconds [----] I, [2016-09-13T12:23:23.068672 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80673], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.56382859] seconds [----] I, [2016-09-13T12:23:23.068874 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80673], Delivering... [----] I, [2016-09-13T12:23:23.075772 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003571748733520508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035982131958007812, :pending_vm_jobs=>0.0009260177612304688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006507396697998047} [----] I, [2016-09-13T12:23:23.076164 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80673], State: [ok], Delivered in [0.007281023] seconds [----] I, [2016-09-13T12:23:24.136888 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80671], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.666735299] seconds [----] I, [2016-09-13T12:23:24.137034 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80671], Delivering... [----] I, [2016-09-13T12:23:24.139286 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80671], State: [ok], Delivered in [0.002234004] seconds [----] I, [2016-09-13T12:23:24.181405 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80672], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.69217434] seconds [----] I, [2016-09-13T12:23:24.181631 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80672], Delivering... [----] I, [2016-09-13T12:23:24.186511 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80672], State: [ok], Delivered in [0.004891518] seconds [----] I, [2016-09-13T12:23:34.692069 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00543665885925293, :worker_monitor=>1.7726900577545166, :worker_dequeue=>0.00537419319152832, :total_time=>1.7838857173919678} [----] I, [2016-09-13T12:23:35.535267 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:23:35.576024 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80674], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:23:35.604488 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80675], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:23:35.655874 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80676], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:23:39.692621 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:23:39 UTC]... [----] I, [2016-09-13T12:23:39.718687 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:23:39 UTC]...Complete [----] I, [2016-09-13T12:23:39.734403 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:23:39.781689 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80674], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.235375886] seconds [----] I, [2016-09-13T12:23:39.781920 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80674], Delivering... [----] I, [2016-09-13T12:23:39.791955 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004900455474853516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004937171936035156, :pending_vm_jobs=>0.0013086795806884766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009503602981567383} [----] I, [2016-09-13T12:23:39.792483 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80674], State: [ok], Delivered in [0.010525864] seconds [----] I, [2016-09-13T12:23:39.832620 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80675], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.249497606] seconds [----] I, [2016-09-13T12:23:39.832738 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80675], Delivering... [----] I, [2016-09-13T12:23:39.833574 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T12:23:39.833691 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4596043776 [----] I, [2016-09-13T12:23:39.833746 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4357005312 [----] I, [2016-09-13T12:23:39.833795 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 239038464 [----] I, [2016-09-13T12:23:39.833841 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T12:23:39.833884 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4300238848 [----] I, [2016-09-13T12:23:39.833937 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T12:23:39.833986 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T12:23:39.834032 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 561995776 [----] I, [2016-09-13T12:23:39.834076 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T12:23:39.834119 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6824050688 [----] I, [2016-09-13T12:23:39.834163 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T12:23:39.834206 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T12:23:39.834248 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T12:23:39.834299 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 12288 [----] I, [2016-09-13T12:23:39.834343 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T12:23:39.834385 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T12:23:39.834445 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T12:23:39.834500 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T12:23:39.834541 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T12:23:39.834580 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T12:23:39.834622 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272412672 [----] I, [2016-09-13T12:23:39.834663 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55230464 [----] I, [2016-09-13T12:23:39.834700 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217182208 [----] I, [2016-09-13T12:23:39.834741 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6144000 [----] I, [2016-09-13T12:23:39.834782 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 143015936 [----] I, [2016-09-13T12:23:39.834821 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3388456960 [----] I, [2016-09-13T12:23:39.834863 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3066744832 [----] I, [2016-09-13T12:23:39.834904 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T12:23:39.834957 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T12:23:39.835001 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T12:23:39.835039 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37203968 [----] I, [2016-09-13T12:23:39.835081 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76947456 [----] I, [2016-09-13T12:23:39.835123 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49766400 [----] I, [2016-09-13T12:23:39.835164 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111996928 [----] I, [2016-09-13T12:23:39.835206 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126713856 [----] I, [2016-09-13T12:23:39.835246 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T12:23:39.835300 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T12:23:39.835348 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T12:23:39.835403 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T12:23:39.835491 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T12:23:39.835542 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T12:23:39.835584 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T12:23:39.835624 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T12:23:39.835672 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T12:23:39.868546 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T12:23:39.868753 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T12:23:39.872741 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T12:23:39.875887 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T12:23:39.879706 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T12:23:39.883473 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T12:23:39.887115 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T12:23:39.890724 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 859 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T12:23:39.893381 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T12:23:39.895718 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T12:23:39.898357 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.8 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T12:23:39.900592 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T12:23:39.903716 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T12:23:39.907197 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T12:23:39.910034 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:23:39.910197 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:23:39.910314 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T12:23:39.915088 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202687000], Memory % [3.38], CPU Time [155121.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:23:39.915587 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80675], State: [ok], Delivered in [0.08279808] seconds [----] I, [2016-09-13T12:23:39.987591 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80676], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.377886562] seconds [----] I, [2016-09-13T12:23:39.987866 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80676], Delivering... [----] I, [2016-09-13T12:23:39.998055 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:23:32 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163163000], Memory % [3.1], CPU Time [39061.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T12:23:39.998831 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:23:33 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359292000], Memory % [5.28], CPU Time [208462.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T12:23:39.999578 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:23:33 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [155939.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:23:40.000219 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:23:34 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202687000], Memory % [3.38], CPU Time [155129.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:23:40.000944 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:23:34 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [53062.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:23:40.001670 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:23:20 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [247195.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T12:23:40.002308 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:23:29 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347857000], Memory % [5.04], CPU Time [106666.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T12:23:40.002915 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:23:24 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213440000], Memory % [3.51], CPU Time [50308.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T12:23:40.003616 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:23:34 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [53017.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:23:40.004249 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:23:31 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166762000], Memory % [3.16], CPU Time [39986.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T12:23:40.008242 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:23:33 UTC], Process Info: Memory Usage [616067072], Memory Size [1077575680], Proportional Set Size: [456939000], Memory % [7.51], CPU Time [1069.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T12:23:40.011192 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:23:26 UTC], Process Info: Memory Usage [602275840], Memory Size [958881792], Proportional Set Size: [445532000], Memory % [7.34], CPU Time [1070.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T12:23:40.011969 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:23:33 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358591000], Memory % [5.27], CPU Time [217154.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T12:23:40.012380 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80676], State: [ok], Delivered in [0.024515035] seconds [----] I, [2016-09-13T12:23:50.680161 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:23:50.690107 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80677], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:23:50.724449 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80678], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:23:51.121822 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:23:51.124649 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040051937103271484, :worker_monitor=>1.3638992309570312, :worker_dequeue=>0.006474971771240234, :total_time=>1.3747258186340332} [----] I, [2016-09-13T12:23:51.171056 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80678], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.475605573] seconds [----] I, [2016-09-13T12:23:51.171275 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80678], Delivering... [----] I, [2016-09-13T12:23:51.177066 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032186508178710938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032694339752197266, :pending_vm_jobs=>0.0006229877471923828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00538945198059082} [----] I, [2016-09-13T12:23:51.177366 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80678], State: [ok], Delivered in [0.006117877] seconds [----] I, [2016-09-13T12:23:51.281516 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80677], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.597719394] seconds [----] I, [2016-09-13T12:23:51.281725 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80677], Delivering... [----] I, [2016-09-13T12:23:51.286844 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80677], State: [ok], Delivered in [0.005113836] seconds [----] I, [2016-09-13T12:24:05.738572 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:24:05.764771 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80679], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:24:07.519805 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:24:07.525247 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0031104087829589844, :worker_monitor=>1.3451507091522217, :worker_dequeue=>0.012506723403930664, :total_time=>1.361098051071167} [----] I, [2016-09-13T12:24:08.328447 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80679], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.581926185] seconds [----] I, [2016-09-13T12:24:08.328620 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80679], Delivering... [----] I, [2016-09-13T12:24:08.336025 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003470897674560547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003498554229736328, :pending_vm_jobs=>0.0010929107666015625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0070536136627197266} [----] I, [2016-09-13T12:24:08.336482 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80679], State: [ok], Delivered in [0.007826053] seconds [----] I, [2016-09-13T12:24:12.526164 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:24:12 UTC]... [----] I, [2016-09-13T12:24:12.553287 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:24:12 UTC]...Complete [----] I, [2016-09-13T12:24:20.776784 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:24:20.821980 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80680], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:24:20.861777 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80681], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:24:20.890638 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80682], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:24:20.924703 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80683], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:24:24.294381 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:24:24.303611 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037539005279541016, :worker_monitor=>1.5700984001159668, :worker_dequeue=>0.01725292205810547, :total_time=>1.5913727283477783} [----] I, [2016-09-13T12:24:24.399058 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80681], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.567373288] seconds [----] I, [2016-09-13T12:24:24.399252 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80681], Delivering... [----] I, [2016-09-13T12:24:24.426020 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80683], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.528719414] seconds [----] I, [2016-09-13T12:24:24.426233 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80683], Delivering... [----] I, [2016-09-13T12:24:24.433845 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003957509994506836, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003984928131103516, :pending_vm_jobs=>0.0009806156158447266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007157564163208008} [----] I, [2016-09-13T12:24:24.434221 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80683], State: [ok], Delivered in [0.007983873] seconds [----] I, [2016-09-13T12:24:24.488312 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80681], State: [ok], Delivered in [0.089046617] seconds [----] I, [2016-09-13T12:24:24.517082 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80680], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.734939528] seconds [----] I, [2016-09-13T12:24:24.517217 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80680], Delivering... [----] I, [2016-09-13T12:24:24.519581 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80680], State: [ok], Delivered in [0.002352611] seconds [----] I, [2016-09-13T12:24:24.581008 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80682], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.714912253] seconds [----] I, [2016-09-13T12:24:24.581213 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80682], Delivering... [----] I, [2016-09-13T12:24:24.585986 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80682], State: [ok], Delivered in [0.004749647] seconds [----] I, [2016-09-13T12:24:35.941599 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:24:35.974906 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80684], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:24:41.040645 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:24:41.045070 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003982067108154297, :worker_monitor=>1.6797184944152832, :worker_dequeue=>0.009637117385864258, :total_time=>1.6936769485473633} [----] I, [2016-09-13T12:24:41.574443 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80684], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.629071333] seconds [----] I, [2016-09-13T12:24:41.574678 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80684], Delivering... [----] I, [2016-09-13T12:24:41.584534 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004605293273925781, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004632472991943359, :pending_vm_jobs=>0.0014240741729736328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009388208389282227} [----] I, [2016-09-13T12:24:41.585024 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80684], State: [ok], Delivered in [0.010322474] seconds [----] I, [2016-09-13T12:24:46.045617 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:24:46 UTC]... [----] I, [2016-09-13T12:24:46.076493 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:24:46 UTC]...Complete [----] I, [2016-09-13T12:24:50.986314 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:24:51.014153 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80685], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:24:51.048583 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80686], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:24:51.093693 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:24:51.700542 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80686], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.682069942] seconds [----] I, [2016-09-13T12:24:51.700818 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80686], Delivering... [----] I, [2016-09-13T12:24:51.711384 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005230903625488281, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005263566970825195, :pending_vm_jobs=>0.001402139663696289, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009854555130004883} [----] I, [2016-09-13T12:24:51.711594 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80685], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.721260185] seconds [----] I, [2016-09-13T12:24:51.711771 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80685], Delivering... [----] I, [2016-09-13T12:24:51.711883 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80686], State: [ok], Delivered in [0.01107286] seconds [----] I, [2016-09-13T12:24:51.716786 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80685], State: [ok], Delivered in [0.005011478] seconds [----] I, [2016-09-13T12:24:57.569902 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025653839111328125, :worker_monitor=>1.458214521408081, :worker_dequeue=>0.009455204010009766, :total_time=>1.470487356185913} [----] I, [2016-09-13T12:25:06.060541 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:25:06.100357 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80687], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:25:07.591365 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:25:07.786137 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80687], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.717253664] seconds [----] I, [2016-09-13T12:25:07.786334 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80687], Delivering... [----] I, [2016-09-13T12:25:07.792491 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003274679183959961, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032949447631835938, :pending_vm_jobs=>0.0007414817810058594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005751609802246094} [----] I, [2016-09-13T12:25:07.792841 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80687], State: [ok], Delivered in [0.006508939] seconds [----] I, [2016-09-13T12:25:14.069343 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004559516906738281, :server_monitor=>0.08234810829162598, :worker_monitor=>1.3792681694030762, :worker_dequeue=>0.007089138031005859, :total_time=>1.4737162590026855} [----] I, [2016-09-13T12:25:19.069998 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:25:19 UTC]... [----] I, [2016-09-13T12:25:19.106342 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:25:19 UTC]...Complete [----] I, [2016-09-13T12:25:21.110731 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:25:21.122952 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80688], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:25:21.140123 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80689], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:25:21.168888 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80690], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:25:21.192894 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80691], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:25:24.135672 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:25:24.861886 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80688], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.748263863] seconds [----] I, [2016-09-13T12:25:24.862125 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80688], Delivering... [----] I, [2016-09-13T12:25:24.917383 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80691], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.74372647] seconds [----] I, [2016-09-13T12:25:24.917584 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80691], Delivering... [----] I, [2016-09-13T12:25:24.923221 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030639171600341797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030813217163085938, :pending_vm_jobs=>0.0006902217864990234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005306720733642578} [----] I, [2016-09-13T12:25:24.923521 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80691], State: [ok], Delivered in [0.005934497] seconds [----] I, [2016-09-13T12:25:24.934739 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80688], State: [ok], Delivered in [0.072598485] seconds [----] I, [2016-09-13T12:25:25.020458 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80689], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.89244958] seconds [----] I, [2016-09-13T12:25:25.020607 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80689], Delivering... [----] I, [2016-09-13T12:25:25.022982 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80689], State: [ok], Delivered in [0.002344755] seconds [----] I, [2016-09-13T12:25:25.100486 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80690], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.954511789] seconds [----] I, [2016-09-13T12:25:25.100624 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80690], Delivering... [----] I, [2016-09-13T12:25:25.103860 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80690], State: [ok], Delivered in [0.003247963] seconds [----] I, [2016-09-13T12:25:30.484274 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0079803466796875, :worker_monitor=>1.3224687576293945, :worker_dequeue=>0.011758089065551758, :total_time=>1.3425288200378418} [----] I, [2016-09-13T12:25:36.203640 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:25:36.223451 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80692], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:25:40.513473 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:25:41.126893 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80692], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.916449649] seconds [----] I, [2016-09-13T12:25:41.127107 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80692], Delivering... [----] I, [2016-09-13T12:25:41.132203 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002913236618041992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029296875, :pending_vm_jobs=>0.0005490779876708984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004681587219238281} [----] I, [2016-09-13T12:25:41.132492 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80692], State: [ok], Delivered in [0.005408126] seconds [----] I, [2016-09-13T12:25:47.147267 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036826133728027344, :worker_monitor=>1.6188225746154785, :worker_dequeue=>0.007029533386230469, :total_time=>1.6298418045043945} [----] I, [2016-09-13T12:25:51.237677 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:25:51.269323 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80693], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:25:51.296179 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80694], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:25:52.147810 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:25:52 UTC]... [----] I, [2016-09-13T12:25:52.169936 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:25:52 UTC]...Complete [----] I, [2016-09-13T12:25:52.186684 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:25:52.215966 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80694], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.937902048] seconds [----] I, [2016-09-13T12:25:52.216215 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80694], Delivering... [----] I, [2016-09-13T12:25:52.223606 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004252433776855469, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004276752471923828, :pending_vm_jobs=>0.0008168220520019531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068759918212890625} [----] I, [2016-09-13T12:25:52.224005 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80694], State: [ok], Delivered in [0.007762444] seconds [----] I, [2016-09-13T12:25:52.235248 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80693], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.992395416] seconds [----] I, [2016-09-13T12:25:52.235455 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80693], Delivering... [----] I, [2016-09-13T12:25:52.240122 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80693], State: [ok], Delivered in [0.004683227] seconds [----] I, [2016-09-13T12:26:04.092409 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037119388580322266, :worker_monitor=>1.8769757747650146, :worker_dequeue=>0.0056400299072265625, :total_time=>1.8865931034088135} [----] I, [2016-09-13T12:26:06.311521 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:26:06.353294 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80695], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:26:09.098958 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:26:09.273222 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80695], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.955460019] seconds [----] I, [2016-09-13T12:26:09.273368 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80695], Delivering... [----] I, [2016-09-13T12:26:09.277817 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002396821975708008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024132728576660156, :pending_vm_jobs=>0.000545501708984375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0041463375091552734} [----] I, [2016-09-13T12:26:09.278081 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80695], State: [ok], Delivered in [0.004710937] seconds [----] I, [2016-09-13T12:26:20.182324 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [104], PID: [24051], GUID: [ee14426a-79c6-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:26:20.182469 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [104], PID: [24051], GUID: [ee14426a-79c6-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:26:20.201075 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [103], PID: [17555], GUID: [1dd6952c-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:26:20.201337 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [103], PID: [17555], GUID: [1dd6952c-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:26:20.222472 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:26:20.222636 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:26:20.249166 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:26:20.249308 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:26:20.262168 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:26:20.262301 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:26:20.285669 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:26:20.285883 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:26:20.296501 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:26:20.296748 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:26:20.314327 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:26:20.314562 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:26:20.354268 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:26:20.354508 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:26:20.371205 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:26:20.371402 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:26:20.400017 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:26:20.400243 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:26:20.445444 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:26:20.445587 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:26:20.497867 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:26:20.498031 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:26:20.508182 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00667119026184082, :worker_monitor=>1.2774300575256348, :worker_dequeue=>0.007382631301879883, :total_time=>1.2917819023132324} [----] I, [2016-09-13T12:26:21.367668 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:26:21.367808 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:26:21.367862 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:26:21.481367 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:26:21.483199 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T12:26:21.483302 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:26:21.483371 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:26:21.483464 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:26:21.483531 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T12:26:21.483587 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T12:26:21.483641 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:26:21.483700 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T12:26:21.483751 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:26:21.483803 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:26:21.483855 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:26:21.483910 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:26:21.483982 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T12:26:21.484030 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T12:26:21.484076 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T12:26:21.484119 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T12:26:21.484163 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T12:26:21.484190 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T12:26:21.484214 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T12:26:21.484239 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T12:26:21.484263 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T12:26:21.484286 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T12:26:21.484308 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T12:26:21.484330 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T12:26:21.484352 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T12:26:21.484375 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T12:26:21.484397 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T12:26:21.484443 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T12:26:21.484481 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T12:26:21.484506 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T12:26:21.484529 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T12:26:21.484551 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T12:26:21.484573 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T12:26:21.484595 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T12:26:21.484617 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T12:26:21.484639 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T12:26:21.484660 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T12:26:21.484682 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T12:26:21.484703 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T12:26:21.484939 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:26:21.485061 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:26:21.485117 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:26:21.504029 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80696], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:26:21.530977 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80697], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:26:21.559501 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80698], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:26:21.588347 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80699], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:26:23.590000 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T12:26:23.590110 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T12:26:23.590159 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T12:26:23.683891 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:26:23.684371 #24051:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T12:26:23.684429 #24051:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:26:23.684465 #24051:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:26:23.684490 #24051:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:26:23.684510 #24051:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T12:26:23.684529 #24051:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T12:26:23.684549 #24051:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:26:23.684568 #24051:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T12:26:23.684591 #24051:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:26:23.684609 #24051:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:26:23.684629 #24051:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T12:26:23.684649 #24051:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:26:23.684667 #24051:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T12:26:23.684685 #24051:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T12:26:23.684703 #24051:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T12:26:23.684718 #24051:34713c] INFO -- : --- [----] I, [2016-09-13T12:26:23.684933 #24051:34713c] INFO -- : :guid: ee14426a-79c6-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:26:23.684973 #24051:34713c] INFO -- : :ems_id: 17 [----] I, [2016-09-13T12:26:23.685072 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T12:26:23.936701 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:26:23.936826 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:26:23.936880 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:26:24.061761 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:26:24.062759 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T12:26:24.062851 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:26:24.062913 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:26:24.062992 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:26:24.063051 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T12:26:24.063104 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T12:26:24.063159 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:26:24.063216 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T12:26:24.063271 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:26:24.063325 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:26:24.063378 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:26:24.063455 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:26:24.063524 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T12:26:24.063580 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T12:26:24.063629 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T12:26:24.063676 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T12:26:24.064033 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:26:24.064201 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:26:24.578717 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:26:24.578860 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:26:24.578949 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:26:24.802786 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:26:24.803601 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T12:26:24.803686 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:26:24.803732 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:26:24.803770 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:26:24.803806 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T12:26:24.803841 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T12:26:24.803876 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:26:24.803910 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T12:26:24.803972 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:26:24.804009 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:26:24.804044 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:26:24.804076 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:26:24.804108 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T12:26:24.804154 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T12:26:24.804461 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:26:24.804744 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:26:25.397242 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:26:25.397392 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:26:25.397496 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:26:25.438288 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:26:25.438464 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:26:25.438556 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:26:25.508607 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:26:25 UTC]... [----] I, [2016-09-13T12:26:25.525711 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:26:25 UTC]...Complete [----] I, [2016-09-13T12:26:25.534332 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:26:25.580335 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:26:25.580989 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T12:26:25.581053 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:26:25.581087 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:26:25.581117 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:26:25.581144 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T12:26:25.581170 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T12:26:25.581195 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:26:25.581219 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T12:26:25.581243 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:26:25.581270 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:26:25.581293 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:26:25.581317 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:26:25.581342 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T12:26:25.581367 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T12:26:25.581389 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T12:26:25.581461 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T12:26:25.581701 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:26:25.581845 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:26:25.600514 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80696], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.111529026] seconds [----] I, [2016-09-13T12:26:25.600768 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80696], Delivering... [----] I, [2016-09-13T12:26:25.613877 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:26:25.614633 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T12:26:25.614701 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:26:25.614740 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:26:25.614772 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:26:25.614803 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T12:26:25.614833 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T12:26:25.614862 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:26:25.614891 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T12:26:25.614936 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:26:25.614972 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:26:25.615001 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:26:25.615029 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:26:25.615058 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T12:26:25.615086 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T12:26:25.615115 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T12:26:25.615140 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T12:26:25.615393 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:26:25.615562 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:26:25.640310 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80699], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.076603278] seconds [----] I, [2016-09-13T12:26:25.640525 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80699], Delivering... [----] I, [2016-09-13T12:26:25.646008 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002864837646484375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0028884410858154297, :pending_vm_jobs=>0.0006420612335205078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0051233768463134766} [----] I, [2016-09-13T12:26:25.646318 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80699], State: [ok], Delivered in [0.005793906] seconds [----] I, [2016-09-13T12:26:25.667877 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80696], State: [ok], Delivered in [0.067127821] seconds [----] I, [2016-09-13T12:26:25.690807 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80697], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.180226653] seconds [----] I, [2016-09-13T12:26:25.690981 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80697], Delivering... [----] I, [2016-09-13T12:26:25.694106 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80697], State: [ok], Delivered in [0.003116307] seconds [----] I, [2016-09-13T12:26:25.719539 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80698], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.179861168] seconds [----] I, [2016-09-13T12:26:25.719721 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80698], Delivering... [----] I, [2016-09-13T12:26:25.724605 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80698], State: [ok], Delivered in [0.004874605] seconds [----] I, [2016-09-13T12:26:26.275281 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:26:26.275452 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:26:26.275545 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:26:26.340948 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T12:26:26.341078 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T12:26:26.341142 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T12:26:26.479999 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:26:26.480849 #17555:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T12:26:26.480942 #17555:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:26:26.481006 #17555:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:26:26.481045 #17555:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:26:26.481077 #17555:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T12:26:26.481107 #17555:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T12:26:26.481137 #17555:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:26:26.481166 #17555:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T12:26:26.481195 #17555:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:26:26.481223 #17555:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:26:26.481251 #17555:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:26:26.481293 #17555:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:26:26.481326 #17555:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T12:26:26.481355 #17555:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T12:26:26.481383 #17555:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T12:26:26.481411 #17555:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T12:26:26.481477 #17555:34713c] INFO -- : --- [----] I, [2016-09-13T12:26:26.481818 #17555:34713c] INFO -- : :guid: 1dd6952c-79b6-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:26:26.481875 #17555:34713c] INFO -- : :ems_id: 17 [----] I, [2016-09-13T12:26:26.482010 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T12:26:26.495146 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:26:26.496076 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T12:26:26.496182 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:26:26.496243 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:26:26.496281 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:26:26.496345 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T12:26:26.496390 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T12:26:26.496463 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:26:26.496505 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T12:26:26.496541 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:26:26.496574 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:26:26.496604 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:26:26.496638 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:26:26.496673 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T12:26:26.496703 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T12:26:26.496735 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T12:26:26.496766 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T12:26:26.497091 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:26:26.497248 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:26:29.517992 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:26:29.518114 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:26:29.518183 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:26:29.670481 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:26:29.671275 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T12:26:29.671333 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:26:29.671378 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:26:29.671439 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:26:29.671493 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T12:26:29.671536 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T12:26:29.671580 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:26:29.671626 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T12:26:29.671665 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:26:29.671700 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:26:29.671743 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:26:29.671786 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:26:29.671828 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T12:26:29.671870 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T12:26:29.671913 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T12:26:29.671963 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T12:26:29.672245 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:26:29.672391 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:26:29.761552 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:26:29.761651 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:26:29.761694 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:26:29.855397 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:26:29.855934 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T12:26:29.855988 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:26:29.856017 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:26:29.856040 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:26:29.856064 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T12:26:29.856087 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T12:26:29.856109 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:26:29.856130 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T12:26:29.856152 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:26:29.856172 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:26:29.856192 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:26:29.856212 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:26:29.856233 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T12:26:29.856252 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T12:26:29.856476 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:26:29.856678 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:26:30.546716 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T12:26:31.423240 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:26:31.423401 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:26:31.423533 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:26:31.478408 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:26:31.478524 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:26:31.478585 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:26:31.559694 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:26:31.560093 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T12:26:31.560133 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:26:31.560155 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:26:31.560175 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:26:31.560194 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T12:26:31.560212 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T12:26:31.560230 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:26:31.560247 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T12:26:31.560265 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:26:31.560282 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:26:31.560300 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:26:31.560317 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:26:31.560334 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T12:26:31.560351 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T12:26:31.560514 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:26:31.560665 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:26:31.595665 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:26:31.597031 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T12:26:31.597134 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:26:31.597200 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:26:31.597254 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:26:31.597307 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T12:26:31.597355 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T12:26:31.597439 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:26:31.597514 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T12:26:31.597576 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:26:31.597637 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:26:31.597695 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:26:31.597750 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:26:31.597801 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T12:26:31.597850 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T12:26:31.597897 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T12:26:31.597968 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T12:26:31.598358 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:26:31.598631 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:26:31.854204 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:26:31.854362 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:26:31.854484 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:26:32.050367 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:26:32.051976 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T12:26:32.052116 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:26:32.052210 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:26:32.052304 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:26:32.052388 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T12:26:32.052546 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T12:26:32.052640 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:26:32.052719 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T12:26:32.052799 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:26:32.052884 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:26:32.052980 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:26:32.053066 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:26:32.053144 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T12:26:32.053241 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T12:26:32.053321 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T12:26:32.053395 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T12:26:32.054085 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:26:32.054344 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:26:36.598150 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:26:36.646404 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80700], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:26:37.591125 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:26:37.595372 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003484964370727539, :worker_monitor=>2.030339002609253, :worker_dequeue=>0.008893013000488281, :total_time=>2.042989730834961} [----] I, [2016-09-13T12:26:37.634810 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80700], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.032676979] seconds [----] I, [2016-09-13T12:26:37.635001 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80700], Delivering... [----] I, [2016-09-13T12:26:37.640802 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030341148376464844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030519962310791016, :pending_vm_jobs=>0.0007977485656738281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0054666996002197266} [----] I, [2016-09-13T12:26:37.641321 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80700], State: [ok], Delivered in [0.006300473] seconds [----] I, [2016-09-13T12:26:51.655095 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:26:51.674209 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80701], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:26:51.697259 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80702], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:26:53.907139 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:26:53.911972 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005640268325805664, :worker_monitor=>1.2766366004943848, :worker_dequeue=>0.010794401168823242, :total_time=>1.2934892177581787} [----] I, [2016-09-13T12:26:54.834380 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80702], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.154791839] seconds [----] I, [2016-09-13T12:26:54.834623 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80702], Delivering... [----] I, [2016-09-13T12:26:54.840635 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003131866455078125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003152608871459961, :pending_vm_jobs=>0.0007221698760986328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005641937255859375} [----] I, [2016-09-13T12:26:54.841197 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80702], State: [ok], Delivered in [0.006563985] seconds [----] I, [2016-09-13T12:26:55.731248 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80701], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.072276692] seconds [----] I, [2016-09-13T12:26:55.731378 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80701], Delivering... [----] I, [2016-09-13T12:26:55.734469 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80701], State: [ok], Delivered in [0.003080534] seconds [----] I, [2016-09-13T12:26:58.912547 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:26:58 UTC]... [----] I, [2016-09-13T12:26:58.937014 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:26:58 UTC]...Complete [----] I, [2016-09-13T12:27:06.708811 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:27:06.737282 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80703], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:27:11.194083 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:27:11.196959 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038170814514160156, :worker_monitor=>2.2184700965881348, :worker_dequeue=>0.006261110305786133, :total_time=>2.2288336753845215} [----] I, [2016-09-13T12:27:12.017371 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80703], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.301610323] seconds [----] I, [2016-09-13T12:27:12.017582 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80703], Delivering... [----] I, [2016-09-13T12:27:12.024479 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034699440002441406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034894943237304688, :pending_vm_jobs=>0.0007424354553222656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065538883209228516} [----] I, [2016-09-13T12:27:12.024826 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80703], State: [ok], Delivered in [0.007253853] seconds [----] I, [2016-09-13T12:27:21.753005 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:27:21.772741 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80704], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:27:21.783071 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80705], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:27:21.800191 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80706], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:27:21.811449 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80707], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:27:28.018814 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:27:28.022654 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0050394535064697266, :worker_monitor=>1.7126295566558838, :worker_dequeue=>0.008092641830444336, :total_time=>1.7260701656341553} [----] I, [2016-09-13T12:27:28.189288 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80704], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.43081899] seconds [----] I, [2016-09-13T12:27:28.189493 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80704], Delivering... [----] I, [2016-09-13T12:27:28.223385 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80707], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.417593177] seconds [----] I, [2016-09-13T12:27:28.223641 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80707], Delivering... [----] I, [2016-09-13T12:27:28.231979 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004452943801879883, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004602193832397461, :pending_vm_jobs=>0.0012199878692626953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007899999618530273} [----] I, [2016-09-13T12:27:28.232375 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80707], State: [ok], Delivered in [0.008734978] seconds [----] I, [2016-09-13T12:27:28.246264 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80704], State: [ok], Delivered in [0.056742193] seconds [----] I, [2016-09-13T12:27:28.852144 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80705], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.074029976] seconds [----] I, [2016-09-13T12:27:28.852394 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80705], Delivering... [----] I, [2016-09-13T12:27:28.856554 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80705], State: [ok], Delivered in [0.004147589] seconds [----] I, [2016-09-13T12:27:28.900116 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80706], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.109194271] seconds [----] I, [2016-09-13T12:27:28.900382 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80706], Delivering... [----] I, [2016-09-13T12:27:28.907063 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80706], State: [ok], Delivered in [0.006669624] seconds [----] I, [2016-09-13T12:27:33.023099 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:27:33 UTC]... [----] I, [2016-09-13T12:27:33.045882 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:27:33 UTC]...Complete [----] I, [2016-09-13T12:27:36.823899 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:27:36.846119 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80708], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:27:38.066395 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:27:38.355945 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80708], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.522521404] seconds [----] I, [2016-09-13T12:27:38.356128 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80708], Delivering... [----] I, [2016-09-13T12:27:38.363132 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035254955291748047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003575563430786133, :pending_vm_jobs=>0.0009181499481201172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006645679473876953} [----] I, [2016-09-13T12:27:38.363546 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80708], State: [ok], Delivered in [0.007409661] seconds [----] I, [2016-09-13T12:27:44.859856 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00641942024230957, :worker_monitor=>1.722660779953003, :worker_dequeue=>0.009628534317016602, :total_time=>1.7391443252563477} [----] I, [2016-09-13T12:27:51.858210 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:27:51.916348 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80709], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:27:51.962166 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80710], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:27:54.898542 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:27:55.499691 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80710], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.57721069] seconds [----] I, [2016-09-13T12:27:55.499937 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80710], Delivering... [----] I, [2016-09-13T12:27:55.507205 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004036664962768555, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0040628910064697266, :pending_vm_jobs=>0.0008795261383056641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006812334060668945} [----] I, [2016-09-13T12:27:55.507601 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80710], State: [ok], Delivered in [0.007677888] seconds [----] I, [2016-09-13T12:27:56.013473 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80709], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.151281898] seconds [----] I, [2016-09-13T12:27:56.013629 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80709], Delivering... [----] I, [2016-09-13T12:27:56.017127 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80709], State: [ok], Delivered in [0.00349147] seconds [----] I, [2016-09-13T12:28:01.095305 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003477334976196289, :worker_monitor=>1.1780128479003906, :worker_dequeue=>0.0076143741607666016, :total_time=>1.1893727779388428} [----] I, [2016-09-13T12:28:06.095827 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:28:06 UTC]... [----] I, [2016-09-13T12:28:06.160910 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:28:06 UTC]...Complete [----] I, [2016-09-13T12:28:06.975382 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:28:06.996295 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80711], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:28:11.200756 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:28:11.745263 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80711], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.764137017] seconds [----] I, [2016-09-13T12:28:11.745534 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80711], Delivering... [----] I, [2016-09-13T12:28:11.753277 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003945589065551758, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00397181510925293, :pending_vm_jobs=>0.001094818115234375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007333517074584961} [----] I, [2016-09-13T12:28:11.753721 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80711], State: [ok], Delivered in [0.008200802] seconds [----] I, [2016-09-13T12:28:18.272862 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003541231155395508, :server_monitor=>0.17370104789733887, :worker_monitor=>1.8782193660736084, :worker_dequeue=>0.009348630905151367, :total_time=>2.0652060508728027} [----] I, [2016-09-13T12:28:22.006066 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:28:22.057644 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80712], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:28:22.078303 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80713], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:28:22.105317 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80714], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:28:22.133794 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80715], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:28:23.283389 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:28:23.894329 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80712], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.883605173] seconds [----] I, [2016-09-13T12:28:23.894507 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80712], Delivering... [----] I, [2016-09-13T12:28:23.917711 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80715], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.803150488] seconds [----] I, [2016-09-13T12:28:23.917991 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80715], Delivering... [----] I, [2016-09-13T12:28:23.928856 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005268096923828125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005300998687744141, :pending_vm_jobs=>0.0014560222625732422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010340690612792969} [----] I, [2016-09-13T12:28:23.929438 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80715], State: [ok], Delivered in [0.011434497] seconds [----] I, [2016-09-13T12:28:23.974464 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80712], State: [ok], Delivered in [0.079882635] seconds [----] I, [2016-09-13T12:28:26.128586 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80713], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.063109488] seconds [----] I, [2016-09-13T12:28:26.128777 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80713], Delivering... [----] I, [2016-09-13T12:28:26.131964 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80713], State: [ok], Delivered in [0.003163615] seconds [----] I, [2016-09-13T12:28:26.133986 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80714], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.043701568] seconds [----] I, [2016-09-13T12:28:26.134138 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80714], Delivering... [----] I, [2016-09-13T12:28:26.138111 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80714], State: [ok], Delivered in [0.003965625] seconds [----] I, [2016-09-13T12:28:34.983592 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004567623138427734, :worker_monitor=>1.669285535812378, :worker_dequeue=>0.01144266128540039, :total_time=>1.685600996017456} [----] I, [2016-09-13T12:28:37.147989 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:28:37.180296 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80716], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:28:37.233894 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80717], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:28:37.295516 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80718], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:28:39.984183 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:28:39 UTC]... [----] I, [2016-09-13T12:28:40.002516 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:28:39 UTC]...Complete [----] I, [2016-09-13T12:28:40.010994 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:28:40.106077 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80716], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.95125893] seconds [----] I, [2016-09-13T12:28:40.106252 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80716], Delivering... [----] I, [2016-09-13T12:28:40.110399 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002222299575805664, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022683143615722656, :pending_vm_jobs=>0.0004949569702148438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038254261016845703} [----] I, [2016-09-13T12:28:40.110667 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80716], State: [ok], Delivered in [0.00442524] seconds [----] I, [2016-09-13T12:28:40.151850 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80717], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.967031811] seconds [----] I, [2016-09-13T12:28:40.152061 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80717], Delivering... [----] I, [2016-09-13T12:28:40.152835 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T12:28:40.153015 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4596097024 [----] I, [2016-09-13T12:28:40.153101 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4356833280 [----] I, [2016-09-13T12:28:40.153179 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 239263744 [----] I, [2016-09-13T12:28:40.153250 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T12:28:40.153327 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4300087296 [----] I, [2016-09-13T12:28:40.153391 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T12:28:40.153459 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T12:28:40.153509 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 562192384 [----] I, [2016-09-13T12:28:40.153549 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T12:28:40.153588 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6834610176 [----] I, [2016-09-13T12:28:40.153628 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T12:28:40.153668 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T12:28:40.153707 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T12:28:40.153747 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T12:28:40.153796 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T12:28:40.153840 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T12:28:40.153879 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T12:28:40.153929 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T12:28:40.153973 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T12:28:40.154013 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T12:28:40.154052 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272404480 [----] I, [2016-09-13T12:28:40.154091 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55218176 [----] I, [2016-09-13T12:28:40.154129 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217186304 [----] I, [2016-09-13T12:28:40.154168 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6144000 [----] I, [2016-09-13T12:28:40.154204 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 143011840 [----] I, [2016-09-13T12:28:40.154244 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3389829120 [----] I, [2016-09-13T12:28:40.154283 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3067887616 [----] I, [2016-09-13T12:28:40.154322 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T12:28:40.154358 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T12:28:40.154394 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T12:28:40.154453 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36941824 [----] I, [2016-09-13T12:28:40.154497 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76947456 [----] I, [2016-09-13T12:28:40.154536 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49647616 [----] I, [2016-09-13T12:28:40.154576 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111964160 [----] I, [2016-09-13T12:28:40.154613 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126595072 [----] I, [2016-09-13T12:28:40.154653 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T12:28:40.154691 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T12:28:40.154729 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T12:28:40.154766 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T12:28:40.154809 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T12:28:40.154851 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T12:28:40.154887 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T12:28:40.154938 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T12:28:40.154981 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T12:28:40.183338 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T12:28:40.183483 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T12:28:40.185565 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T12:28:40.187056 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T12:28:40.188840 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T12:28:40.190560 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T12:28:40.192252 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T12:28:40.193958 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 860 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T12:28:40.195739 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T12:28:40.197503 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T12:28:40.199213 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.8 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T12:28:40.201375 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T12:28:40.204167 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T12:28:40.207056 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T12:28:40.208844 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:28:40.208951 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:28:40.209038 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T12:28:40.211659 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [156020.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:28:40.211882 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80717], State: [ok], Delivered in [0.059844167] seconds [----] I, [2016-09-13T12:28:45.025144 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:28:45.231583 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80718], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.993379746] seconds [----] I, [2016-09-13T12:28:45.231805 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80718], Delivering... [----] I, [2016-09-13T12:28:45.241361 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:28:33 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163163000], Memory % [3.1], CPU Time [39105.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T12:28:45.241960 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:28:32 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359294000], Memory % [5.28], CPU Time [208522.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T12:28:45.242514 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:28:34 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [156025.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:28:45.243029 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:28:34 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202687000], Memory % [3.38], CPU Time [155191.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:28:45.243555 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:28:32 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [53124.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:28:45.244076 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:28:22 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [247332.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T12:28:45.244522 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:28:30 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347858000], Memory % [5.04], CPU Time [106732.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T12:28:45.244972 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:28:24 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213441000], Memory % [3.51], CPU Time [50361.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T12:28:45.247953 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:28:33 UTC], Process Info: Memory Usage [616783872], Memory Size [1077575680], Proportional Set Size: [457641000], Memory % [7.52], CPU Time [1088.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T12:28:45.250133 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:28:26 UTC], Process Info: Memory Usage [602673152], Memory Size [973893632], Proportional Set Size: [445950000], Memory % [7.35], CPU Time [1098.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T12:28:45.250750 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:28:32 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358593000], Memory % [5.27], CPU Time [217210.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T12:28:45.251277 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:28:32 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [53074.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:28:45.251749 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:28:31 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166763000], Memory % [3.16], CPU Time [40027.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T12:28:45.252071 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80718], State: [ok], Delivered in [0.020283733] seconds [----] I, [2016-09-13T12:28:51.657409 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0057790279388427734, :worker_monitor=>1.6074631214141846, :worker_dequeue=>0.009644508361816406, :total_time=>1.6232876777648926} [----] I, [2016-09-13T12:28:52.310075 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:28:52.328728 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80719], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:28:52.357235 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80720], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:28:56.673004 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:28:57.386091 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80720], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.051108091] seconds [----] I, [2016-09-13T12:28:57.386282 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80720], Delivering... [----] I, [2016-09-13T12:28:57.392209 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003135204315185547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031528472900390625, :pending_vm_jobs=>0.0008444786071777344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005567789077758789} [----] I, [2016-09-13T12:28:57.392605 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80720], State: [ok], Delivered in [0.006310467] seconds [----] I, [2016-09-13T12:28:59.306288 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80719], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.991825968] seconds [----] I, [2016-09-13T12:28:59.306478 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80719], Delivering... [----] I, [2016-09-13T12:28:59.310206 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80719], State: [ok], Delivered in [0.003724151] seconds [----] I, [2016-09-13T12:29:07.368861 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:29:07.408809 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80721], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:29:07.979730 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:29:07.982150 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004038095474243164, :worker_monitor=>1.2681684494018555, :worker_dequeue=>0.005276203155517578, :total_time=>1.277836561203003} [----] I, [2016-09-13T12:29:08.300613 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80721], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.928128957] seconds [----] I, [2016-09-13T12:29:08.300797 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80721], Delivering... [----] I, [2016-09-13T12:29:08.307161 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034029483795166016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003421783447265625, :pending_vm_jobs=>0.0008001327514648438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060083866119384766} [----] I, [2016-09-13T12:29:08.307594 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80721], State: [ok], Delivered in [0.006787726] seconds [----] I, [2016-09-13T12:29:12.982836 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:29:12 UTC]... [----] I, [2016-09-13T12:29:13.003045 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:29:12 UTC]...Complete [----] I, [2016-09-13T12:29:22.417739 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:29:22.460696 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80722], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:29:22.506518 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80723], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:29:22.539632 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80724], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:29:22.569492 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80725], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:29:24.641342 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:29:24.643698 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.009311914443969727, :worker_monitor=>1.5023839473724365, :worker_dequeue=>0.00539708137512207, :total_time=>1.5175139904022217} [----] I, [2016-09-13T12:29:25.590782 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80722], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.168492436] seconds [----] I, [2016-09-13T12:29:25.590987 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80722], Delivering... [----] I, [2016-09-13T12:29:25.647612 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80722], State: [ok], Delivered in [0.056621506] seconds [----] I, [2016-09-13T12:29:25.710803 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80725], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.165202252] seconds [----] I, [2016-09-13T12:29:25.711021 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80725], Delivering... [----] I, [2016-09-13T12:29:25.716748 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031044483184814453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003122091293334961, :pending_vm_jobs=>0.0006394386291503906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005385875701904297} [----] I, [2016-09-13T12:29:25.717137 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80725], State: [ok], Delivered in [0.006113861] seconds [----] I, [2016-09-13T12:29:26.408895 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80723], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.94216758] seconds [----] I, [2016-09-13T12:29:26.409080 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80723], Delivering... [----] I, [2016-09-13T12:29:26.411967 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80723], State: [ok], Delivered in [0.002880468] seconds [----] I, [2016-09-13T12:29:26.448652 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80724], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.932158017] seconds [----] I, [2016-09-13T12:29:26.448872 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80724], Delivering... [----] I, [2016-09-13T12:29:26.453572 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80724], State: [ok], Delivered in [0.004683716] seconds [----] I, [2016-09-13T12:29:37.583134 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:29:37.602240 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80726], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:29:40.883633 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:29:40.892326 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004765987396240234, :worker_monitor=>1.1994810104370117, :worker_dequeue=>0.01711249351501465, :total_time=>1.2217028141021729} [----] I, [2016-09-13T12:29:41.579624 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80726], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.989435121] seconds [----] I, [2016-09-13T12:29:41.579803 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80726], Delivering... [----] I, [2016-09-13T12:29:41.585405 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030133724212646484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030312538146972656, :pending_vm_jobs=>0.000690460205078125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0052471160888671875} [----] I, [2016-09-13T12:29:41.585733 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80726], State: [ok], Delivered in [0.005922818] seconds [----] I, [2016-09-13T12:29:45.893054 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:29:45 UTC]... [----] I, [2016-09-13T12:29:45.912718 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:29:45 UTC]...Complete [----] I, [2016-09-13T12:29:52.617103 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:29:52.637150 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80727], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:29:52.671382 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80728], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:29:57.396322 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:29:57.401888 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002682209014892578, :worker_monitor=>1.44297456741333, :worker_dequeue=>0.012274503707885742, :total_time=>1.4582092761993408} [----] I, [2016-09-13T12:29:57.895202 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80728], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.248151182] seconds [----] I, [2016-09-13T12:29:57.895376 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80728], Delivering... [----] I, [2016-09-13T12:29:57.900185 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002577543258666992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002595186233520508, :pending_vm_jobs=>0.0005786418914794922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004486799240112305} [----] I, [2016-09-13T12:29:57.903010 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80728], State: [ok], Delivered in [0.00759789] seconds [----] I, [2016-09-13T12:29:59.620932 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80727], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.996507853] seconds [----] I, [2016-09-13T12:29:59.621130 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80727], Delivering... [----] I, [2016-09-13T12:29:59.625284 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80727], State: [ok], Delivered in [0.004148527] seconds [----] I, [2016-09-13T12:30:07.689738 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T12:30:07.710776 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80729], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:30:07.751169 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80730], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:30:07.762154 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80731], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:30:07.808219 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80732], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:30:13.613653 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:30:13.616450 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004946231842041016, :worker_monitor=>1.1760354042053223, :worker_dequeue=>0.006265163421630859, :total_time=>1.1876885890960693} [----] I, [2016-09-13T12:30:14.053970 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80729], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.358330097] seconds [----] I, [2016-09-13T12:30:14.054109 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80729], Delivering... [----] I, [2016-09-13T12:30:14.060538 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003558635711669922, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035855770111083984, :pending_vm_jobs=>0.0007960796356201172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060727596282958984} [----] I, [2016-09-13T12:30:14.060930 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80729], State: [ok], Delivered in [0.006794033] seconds [----] I, [2016-09-13T12:30:14.728149 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80730], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.01204047] seconds [----] I, [2016-09-13T12:30:14.728260 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80730], Delivering... [----] I, [2016-09-13T12:30:14.729718 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80730], State: [ok], Delivered in [0.001449245] seconds [----] I, [2016-09-13T12:30:14.751545 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80731], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.99508376] seconds [----] I, [2016-09-13T12:30:14.751755 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80731], Delivering... [----] I, [2016-09-13T12:30:14.762669 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80731], State: [ok], Delivered in [0.010891715] seconds [----] I, [2016-09-13T12:30:14.773922 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80732], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.007033522] seconds [----] I, [2016-09-13T12:30:14.774039 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80732], Delivering... [----] I, [2016-09-13T12:30:14.777622 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80732], State: [ok], Delivered in [0.003562355] seconds [----] I, [2016-09-13T12:30:18.616884 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:30:18 UTC]... [----] I, [2016-09-13T12:30:18.637069 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:30:18 UTC]...Complete [----] I, [2016-09-13T12:30:22.818445 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:30:22.854726 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80733], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:30:22.889174 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80734], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:30:22.929187 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80735], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:30:22.952149 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80736], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:30:23.764830 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:30:23.842950 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80733], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.021553834] seconds [----] I, [2016-09-13T12:30:23.843115 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80733], Delivering... [----] I, [2016-09-13T12:30:23.860256 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80736], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.922310229] seconds [----] I, [2016-09-13T12:30:23.860439 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80736], Delivering... [----] I, [2016-09-13T12:30:23.865507 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026941299438476562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027120113372802734, :pending_vm_jobs=>0.0006330013275146484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0047206878662109375} [----] I, [2016-09-13T12:30:23.865835 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80736], State: [ok], Delivered in [0.005392142] seconds [----] I, [2016-09-13T12:30:23.939945 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80733], State: [ok], Delivered in [0.09678681] seconds [----] I, [2016-09-13T12:30:23.974248 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80734], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.111080631] seconds [----] I, [2016-09-13T12:30:23.974395 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80734], Delivering... [----] I, [2016-09-13T12:30:23.977028 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80734], State: [ok], Delivered in [0.002606935] seconds [----] I, [2016-09-13T12:30:24.077059 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80735], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.17603571] seconds [----] I, [2016-09-13T12:30:24.077234 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80735], Delivering... [----] I, [2016-09-13T12:30:24.081516 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80735], State: [ok], Delivered in [0.004275808] seconds [----] I, [2016-09-13T12:30:30.043112 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00354766845703125, :worker_monitor=>1.263505220413208, :worker_dequeue=>0.008219718933105469, :total_time=>1.2755436897277832} [----] I, [2016-09-13T12:30:37.969255 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:30:37.991953 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80737], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:30:40.064327 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:30:40.185934 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80737], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.209155418] seconds [----] I, [2016-09-13T12:30:40.186087 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80737], Delivering... [----] I, [2016-09-13T12:30:40.189689 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0019631385803222656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0019750595092773438, :pending_vm_jobs=>0.0004432201385498047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0033986568450927734} [----] I, [2016-09-13T12:30:40.189945 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80737], State: [ok], Delivered in [0.003855539] seconds [----] I, [2016-09-13T12:30:46.120306 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00315093994140625, :worker_monitor=>1.0426759719848633, :worker_dequeue=>0.006537437438964844, :total_time=>1.052591323852539} [----] I, [2016-09-13T12:30:51.120677 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:30:51 UTC]... [----] I, [2016-09-13T12:30:51.145861 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:30:51 UTC]...Complete [----] I, [2016-09-13T12:30:53.005165 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:30:53.031646 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80738], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:30:53.049315 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80739], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:30:56.175503 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:30:56.317461 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80739], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.281170525] seconds [----] I, [2016-09-13T12:30:56.317604 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80739], Delivering... [----] I, [2016-09-13T12:30:56.322044 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002355813980102539, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023703575134277344, :pending_vm_jobs=>0.0005495548248291016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004159688949584961} [----] I, [2016-09-13T12:30:56.322305 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80739], State: [ok], Delivered in [0.004698432] seconds [----] I, [2016-09-13T12:30:57.152672 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80738], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.143120885] seconds [----] I, [2016-09-13T12:30:57.152895 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80738], Delivering... [----] I, [2016-09-13T12:30:57.157542 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80738], State: [ok], Delivered in [0.004645471] seconds [----] I, [2016-09-13T12:31:03.134077 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00529932975769043, :worker_monitor=>1.9371881484985352, :worker_dequeue=>0.010021209716796875, :total_time=>1.9528913497924805} [----] I, [2016-09-13T12:31:08.060407 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:31:08.087354 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80740], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:31:08.140617 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:31:08.432682 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80740], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.364739456] seconds [----] I, [2016-09-13T12:31:08.432870 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80740], Delivering... [----] I, [2016-09-13T12:31:08.439283 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003338336944580078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033626556396484375, :pending_vm_jobs=>0.0008387565612792969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006058454513549805} [----] I, [2016-09-13T12:31:08.439690 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80740], State: [ok], Delivered in [0.006806781] seconds [----] I, [2016-09-13T12:31:19.228853 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004836559295654297, :worker_monitor=>1.0600621700286865, :worker_dequeue=>0.005605459213256836, :total_time=>1.0709178447723389} [----] I, [2016-09-13T12:31:23.102314 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:31:23.124000 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80741], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:31:23.140937 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80742], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:31:23.164138 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80743], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:31:23.188035 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80744], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:31:24.229324 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:31:24 UTC]... [----] I, [2016-09-13T12:31:24.250657 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:31:24 UTC]...Complete [----] I, [2016-09-13T12:31:24.359694 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:31:24.582712 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80742], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.447852685] seconds [----] I, [2016-09-13T12:31:24.582986 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80742], Delivering... [----] I, [2016-09-13T12:31:24.599131 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80744], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.427622893] seconds [----] I, [2016-09-13T12:31:24.599256 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80744], Delivering... [----] I, [2016-09-13T12:31:24.603229 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021479129791259766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021610260009765625, :pending_vm_jobs=>0.00045108795166015625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0037109851837158203} [----] I, [2016-09-13T12:31:24.603505 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80744], State: [ok], Delivered in [0.004241012] seconds [----] I, [2016-09-13T12:31:24.627641 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80742], State: [ok], Delivered in [0.044658787] seconds [----] I, [2016-09-13T12:31:27.245015 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80741], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.135160797] seconds [----] I, [2016-09-13T12:31:27.245154 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80741], Delivering... [----] I, [2016-09-13T12:31:27.247497 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80741], State: [ok], Delivered in [0.00233206] seconds [----] I, [2016-09-13T12:31:27.279523 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80743], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.133295567] seconds [----] I, [2016-09-13T12:31:27.279702 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80743], Delivering... [----] I, [2016-09-13T12:31:27.284065 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80743], State: [ok], Delivered in [0.004349232] seconds [----] I, [2016-09-13T12:31:34.396987 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T12:31:35.576555 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038690567016601562, :log_active_servers=>0.011615753173828125, :worker_monitor=>1.174375057220459, :worker_dequeue=>0.004884243011474609, :total_time=>1.1950557231903076} [----] I, [2016-09-13T12:31:38.204690 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:31:38.268124 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80745], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:31:40.586233 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:31:40.725024 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80745], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.513197264] seconds [----] I, [2016-09-13T12:31:40.725158 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80745], Delivering... [----] I, [2016-09-13T12:31:40.730979 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002582073211669922, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026023387908935547, :pending_vm_jobs=>0.0009129047393798828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055348873138427734} [----] I, [2016-09-13T12:31:40.731843 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80745], State: [ok], Delivered in [0.00665964] seconds [----] I, [2016-09-13T12:31:51.637014 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0029134750366210938, :worker_monitor=>1.0244982242584229, :worker_dequeue=>0.006217479705810547, :total_time=>1.033872127532959} [----] I, [2016-09-13T12:31:53.643333 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:31:53.668018 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80746], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:31:53.685291 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80747], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:31:56.637499 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:31:56 UTC]... [----] I, [2016-09-13T12:31:56.662109 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:31:56 UTC]...Complete [----] I, [2016-09-13T12:31:56.668524 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:31:56.845043 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80747], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.171025569] seconds [----] I, [2016-09-13T12:31:56.845177 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80747], Delivering... [----] I, [2016-09-13T12:31:56.848936 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002098560333251953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002112150192260742, :pending_vm_jobs=>0.00043892860412597656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0035123825073242188} [----] I, [2016-09-13T12:31:56.849162 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80747], State: [ok], Delivered in [0.003981767] seconds [----] I, [2016-09-13T12:31:57.371213 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80746], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.719114485] seconds [----] I, [2016-09-13T12:31:57.371370 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80746], Delivering... [----] I, [2016-09-13T12:31:57.375282 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80746], State: [ok], Delivered in [0.003910628] seconds [----] I, [2016-09-13T12:32:08.700181 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:32:08.885647 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80748], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:32:09.341734 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:32:09.346822 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003877401351928711, :worker_monitor=>2.6325888633728027, :worker_dequeue=>0.01195526123046875, :total_time=>2.6487114429473877} [----] I, [2016-09-13T12:32:09.445513 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80748], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.739404526] seconds [----] I, [2016-09-13T12:32:09.445725 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80748], Delivering... [----] I, [2016-09-13T12:32:09.452712 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037255287170410156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00374603271484375, :pending_vm_jobs=>0.0008807182312011719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0065708160400390625} [----] I, [2016-09-13T12:32:09.453156 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80748], State: [ok], Delivered in [0.007428896] seconds [----] I, [2016-09-13T12:32:23.897339 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:32:23.926049 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80749], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:32:23.948446 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80750], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:32:23.971059 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80751], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:32:23.994104 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80752], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:32:26.201184 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:32:26.208813 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006159305572509766, :server_monitor=>0.1204824447631836, :worker_monitor=>1.69057297706604, :worker_dequeue=>0.015509366989135742, :total_time=>1.8332023620605469} [----] I, [2016-09-13T12:32:27.027861 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80749], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.125635163] seconds [----] I, [2016-09-13T12:32:27.028113 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80749], Delivering... [----] I, [2016-09-13T12:32:27.090739 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80752], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.113978338] seconds [----] I, [2016-09-13T12:32:27.090934 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80752], Delivering... [----] I, [2016-09-13T12:32:27.094863 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022084712982177734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022211074829101562, :pending_vm_jobs=>0.0004489421844482422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0036482810974121094} [----] I, [2016-09-13T12:32:27.095119 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80752], State: [ok], Delivered in [0.004215725] seconds [----] I, [2016-09-13T12:32:27.110305 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80749], State: [ok], Delivered in [0.082209532] seconds [----] I, [2016-09-13T12:32:27.491079 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80750], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.559263445] seconds [----] I, [2016-09-13T12:32:27.491236 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80750], Delivering... [----] I, [2016-09-13T12:32:27.496499 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80750], State: [ok], Delivered in [0.005261298] seconds [----] I, [2016-09-13T12:32:27.564367 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80751], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.606494627] seconds [----] I, [2016-09-13T12:32:27.564534 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80751], Delivering... [----] I, [2016-09-13T12:32:27.567663 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80751], State: [ok], Delivered in [0.003124874] seconds [----] I, [2016-09-13T12:32:31.209462 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:32:31 UTC]... [----] I, [2016-09-13T12:32:31.233210 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:32:31 UTC]...Complete [----] I, [2016-09-13T12:32:39.006382 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:32:39.027478 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80753], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:32:43.929094 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:32:43.933875 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004246234893798828, :worker_monitor=>2.6544532775878906, :worker_dequeue=>0.010341644287109375, :total_time=>2.669346809387207} [----] I, [2016-09-13T12:32:44.582314 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80753], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.569463989] seconds [----] I, [2016-09-13T12:32:44.582513 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80753], Delivering... [----] I, [2016-09-13T12:32:44.588285 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030794143676757812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030982494354248047, :pending_vm_jobs=>0.0006785392761230469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005445718765258789} [----] I, [2016-09-13T12:32:44.588630 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80753], State: [ok], Delivered in [0.006118391] seconds [----] I, [2016-09-13T12:32:54.038611 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:32:54.056886 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80754], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:32:54.085290 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80755], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:33:00.668514 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:33:00.671134 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004294633865356445, :worker_monitor=>1.70109224319458, :worker_dequeue=>0.005938291549682617, :total_time=>1.7116217613220215} [----] I, [2016-09-13T12:33:00.703201 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80755], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.639269021] seconds [----] I, [2016-09-13T12:33:00.703440 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80755], Delivering... [----] I, [2016-09-13T12:33:00.709920 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033864974975585938, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034036636352539062, :pending_vm_jobs=>0.0007920265197753906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006032466888427734} [----] I, [2016-09-13T12:33:00.710251 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80755], State: [ok], Delivered in [0.006852806] seconds [----] I, [2016-09-13T12:33:00.743365 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80754], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.699084324] seconds [----] I, [2016-09-13T12:33:00.743580 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80754], Delivering... [----] I, [2016-09-13T12:33:00.748302 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80754], State: [ok], Delivered in [0.004707013] seconds [----] I, [2016-09-13T12:33:05.671529 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:33:05 UTC]... [----] I, [2016-09-13T12:33:05.691342 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:33:05 UTC]...Complete [----] I, [2016-09-13T12:33:09.096957 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:33:09.108431 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80756], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:33:10.710713 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:33:10.795016 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80756], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.69316825] seconds [----] I, [2016-09-13T12:33:10.795223 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80756], Delivering... [----] I, [2016-09-13T12:33:10.805653 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0052869319915771484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0053141117095947266, :pending_vm_jobs=>0.0013599395751953125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009913921356201172} [----] I, [2016-09-13T12:33:10.806180 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80756], State: [ok], Delivered in [0.010929053] seconds [----] I, [2016-09-13T12:33:17.231590 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004650115966796875, :worker_monitor=>1.4988322257995605, :worker_dequeue=>0.010447025299072266, :total_time=>1.5142583847045898} [----] I, [2016-09-13T12:33:24.118315 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:33:24.142969 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80757], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:33:24.171813 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80758], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:33:24.195794 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80759], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:33:24.223252 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80760], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:33:27.384586 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:33:27.549172 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80757], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.425370666] seconds [----] I, [2016-09-13T12:33:27.549368 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80757], Delivering... [----] I, [2016-09-13T12:33:27.623182 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80757], State: [ok], Delivered in [0.073786817] seconds [----] I, [2016-09-13T12:33:27.674562 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80760], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.47230643] seconds [----] I, [2016-09-13T12:33:27.674676 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80760], Delivering... [----] I, [2016-09-13T12:33:27.678758 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024232864379882812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002435445785522461, :pending_vm_jobs=>0.0004401206970214844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038623809814453125} [----] I, [2016-09-13T12:33:27.679005 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80760], State: [ok], Delivered in [0.004323679] seconds [----] I, [2016-09-13T12:33:27.703341 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80758], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.555663956] seconds [----] I, [2016-09-13T12:33:27.703533 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80758], Delivering... [----] I, [2016-09-13T12:33:27.706076 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80758], State: [ok], Delivered in [0.002537687] seconds [----] I, [2016-09-13T12:33:27.731662 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80759], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.554002014] seconds [----] I, [2016-09-13T12:33:27.731798 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80759], Delivering... [----] I, [2016-09-13T12:33:27.735451 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80759], State: [ok], Delivered in [0.0036232] seconds [----] I, [2016-09-13T12:33:33.670943 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039403438568115234, :worker_monitor=>1.2720630168914795, :worker_dequeue=>0.005906581878662109, :total_time=>1.282111644744873} [----] I, [2016-09-13T12:33:38.671612 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:33:38 UTC]... [----] I, [2016-09-13T12:33:38.696993 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:33:38 UTC]...Complete [----] I, [2016-09-13T12:33:39.235313 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:33:39.256936 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80761], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:33:39.297782 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80762], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:33:39.343490 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80763], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:33:43.724153 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:33:43.828636 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80761], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.587285164] seconds [----] I, [2016-09-13T12:33:43.828823 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80761], Delivering... [----] I, [2016-09-13T12:33:43.834204 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031147003173828125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031976699829101562, :pending_vm_jobs=>0.0007565021514892578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005075693130493164} [----] I, [2016-09-13T12:33:43.836156 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80761], State: [ok], Delivered in [0.007322823] seconds [----] I, [2016-09-13T12:33:43.914364 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80762], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.652944077] seconds [----] I, [2016-09-13T12:33:43.914555 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80762], Delivering... [----] I, [2016-09-13T12:33:43.915475 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T12:33:43.915635 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4583256064 [----] I, [2016-09-13T12:33:43.915714 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4343799808 [----] I, [2016-09-13T12:33:43.915785 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 239456256 [----] I, [2016-09-13T12:33:43.915853 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T12:33:43.915950 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4287082496 [----] I, [2016-09-13T12:33:43.916033 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T12:33:43.916102 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T12:33:43.916171 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 562356224 [----] I, [2016-09-13T12:33:43.916246 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T12:33:43.916333 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6665388032 [----] I, [2016-09-13T12:33:43.916405 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T12:33:43.916509 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T12:33:43.916587 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T12:33:43.916659 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T12:33:43.916738 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T12:33:43.916819 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T12:33:43.916905 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T12:33:43.916984 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T12:33:43.917059 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T12:33:43.917128 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T12:33:43.917196 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272396288 [----] I, [2016-09-13T12:33:43.917268 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55205888 [----] I, [2016-09-13T12:33:43.917337 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217190400 [----] I, [2016-09-13T12:33:43.917408 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6160384 [----] I, [2016-09-13T12:33:43.917509 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142376960 [----] I, [2016-09-13T12:33:43.917580 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3403595776 [----] I, [2016-09-13T12:33:43.917652 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3081457664 [----] I, [2016-09-13T12:33:43.917724 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T12:33:43.917795 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T12:33:43.917868 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T12:33:43.917956 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36409344 [----] I, [2016-09-13T12:33:43.918026 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76943360 [----] I, [2016-09-13T12:33:43.918095 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49537024 [----] I, [2016-09-13T12:33:43.918158 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111931392 [----] I, [2016-09-13T12:33:43.918227 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126480384 [----] I, [2016-09-13T12:33:43.918298 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T12:33:43.918377 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T12:33:43.918484 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T12:33:43.918560 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T12:33:43.918631 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T12:33:43.918709 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T12:33:43.918775 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T12:33:43.918851 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T12:33:43.918941 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T12:33:43.950393 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T12:33:43.950583 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T12:33:43.953796 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T12:33:43.955698 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T12:33:43.957315 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T12:33:43.958845 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T12:33:43.960393 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T12:33:43.961932 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 860 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T12:33:43.963921 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T12:33:43.965685 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.3 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T12:33:43.967256 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.9 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T12:33:43.968875 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T12:33:43.970450 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T12:33:43.971974 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T12:33:43.973919 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:33:43.974047 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:33:43.974145 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T12:33:43.977871 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202687000], Memory % [3.38], CPU Time [155241.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:33:43.978166 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80762], State: [ok], Delivered in [0.063598248] seconds [----] I, [2016-09-13T12:33:44.022963 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80763], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.721414687] seconds [----] I, [2016-09-13T12:33:44.023132 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80763], Delivering... [----] I, [2016-09-13T12:33:44.029515 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:33:31 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163163000], Memory % [3.1], CPU Time [39114.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T12:33:44.030014 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:33:30 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359296000], Memory % [5.28], CPU Time [208557.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T12:33:44.030491 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:33:32 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [156086.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:33:44.030885 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:33:32 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202687000], Memory % [3.38], CPU Time [155250.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:33:44.031301 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:33:30 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [53137.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:33:44.031757 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:33:24 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [247499.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T12:33:44.032141 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:33:30 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347859000], Memory % [5.04], CPU Time [106751.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T12:33:44.032510 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:33:25 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213441000], Memory % [3.51], CPU Time [50369.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T12:33:44.035015 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:33:24 UTC], Process Info: Memory Usage [605884416], Memory Size [940740608], Proportional Set Size: [446999000], Memory % [7.39], CPU Time [1142.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T12:33:44.036749 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:33:27 UTC], Process Info: Memory Usage [602189824], Memory Size [945729536], Proportional Set Size: [445452000], Memory % [7.34], CPU Time [1148.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T12:33:44.037215 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:33:30 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358595000], Memory % [5.27], CPU Time [217240.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T12:33:44.037656 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:33:33 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [53090.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:33:44.037933 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:33:31 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166763000], Memory % [3.16], CPU Time [40036.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T12:33:44.038133 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80763], State: [ok], Delivered in [0.015012323] seconds [----] I, [2016-09-13T12:33:49.751464 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038917064666748047, :worker_monitor=>1.0130579471588135, :worker_dequeue=>0.0052449703216552734, :total_time=>1.0224685668945312} [----] I, [2016-09-13T12:33:54.356432 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:33:54.378949 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80764], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:33:54.413437 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80765], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:33:54.760926 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:33:54.848023 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80765], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.462291979] seconds [----] I, [2016-09-13T12:33:54.848290 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80765], Delivering... [----] I, [2016-09-13T12:33:54.857726 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0043332576751708984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004361629486083984, :pending_vm_jobs=>0.0011358261108398438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008926868438720703} [----] I, [2016-09-13T12:33:54.858208 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80765], State: [ok], Delivered in [0.009911304] seconds [----] I, [2016-09-13T12:33:54.893378 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80764], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.531464818] seconds [----] I, [2016-09-13T12:33:54.893623 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80764], Delivering... [----] I, [2016-09-13T12:33:54.899192 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80764], State: [ok], Delivered in [0.005534818] seconds [----] I, [2016-09-13T12:34:06.191501 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004992008209228516, :worker_monitor=>1.3912780284881592, :worker_dequeue=>0.018851518630981445, :total_time=>1.4155664443969727} [----] I, [2016-09-13T12:34:09.426406 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T12:34:09.459191 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80766], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:34:09.495237 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80767], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:34:11.192293 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:34:11 UTC]... [----] I, [2016-09-13T12:34:11.224955 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:34:11 UTC]...Complete [----] I, [2016-09-13T12:34:11.245405 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:34:12.419753 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80766], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.988424435] seconds [----] I, [2016-09-13T12:34:12.419980 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80766], Delivering... [----] I, [2016-09-13T12:34:12.426468 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034608840942382812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003481149673461914, :pending_vm_jobs=>0.0008096694946289062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006062030792236328} [----] I, [2016-09-13T12:34:12.426828 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80766], State: [ok], Delivered in [0.006842936] seconds [----] I, [2016-09-13T12:34:12.968477 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80767], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.499127081] seconds [----] I, [2016-09-13T12:34:12.968707 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80767], Delivering... [----] I, [2016-09-13T12:34:13.014123 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80768], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T12:34:13.014603 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80767], State: [ok], Delivered in [0.045885081] seconds [----] I, [2016-09-13T12:34:16.263766 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T12:34:22.661717 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T12:34:22.661859 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0025937557220458984, :worker_monitor=>1.389291524887085, :worker_dequeue=>0.00567317008972168, :total_time=>1.3977506160736084} [----] I, [2016-09-13T12:34:24.514435 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:34:24.533918 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80769], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:34:24.568266 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80770], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:34:24.591151 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80771], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:34:24.614242 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80772], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:34:24.786245 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [80768], MiqWorker id: [104], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [11.799557076] seconds [----] I, [2016-09-13T12:34:24.786554 #24051:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80768], Delivering... [----] I, [2016-09-13T12:34:24.791113 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T12:34:24.791375 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T12:34:24.791565 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T12:34:24.791751 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T12:34:24.791992 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:26.241117 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:26.544445 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:26.544755 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:27.009159 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:27.327257 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:27.327383 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:27.771680 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:34:27.806754 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:28.002153 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80769], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.482078337] seconds [----] I, [2016-09-13T12:34:28.002281 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80769], Delivering... [----] I, [2016-09-13T12:34:28.042105 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80769], State: [ok], Delivered in [0.039783615] seconds [----] I, [2016-09-13T12:34:28.106868 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:28.107014 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:28.114944 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80772], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.514857655] seconds [----] I, [2016-09-13T12:34:28.115129 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80772], Delivering... [----] I, [2016-09-13T12:34:28.121970 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037102699279785156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003729581832885742, :pending_vm_jobs=>0.0008304119110107422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006451129913330078} [----] I, [2016-09-13T12:34:28.122312 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80772], State: [ok], Delivered in [0.007181203] seconds [----] I, [2016-09-13T12:34:28.128141 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80770], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.587369201] seconds [----] I, [2016-09-13T12:34:28.128273 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80770], Delivering... [----] I, [2016-09-13T12:34:28.130705 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80770], State: [ok], Delivered in [0.002425997] seconds [----] I, [2016-09-13T12:34:28.196992 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80771], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.618022951] seconds [----] I, [2016-09-13T12:34:28.197186 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80771], Delivering... [----] I, [2016-09-13T12:34:28.201650 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80771], State: [ok], Delivered in [0.004447567] seconds [----] I, [2016-09-13T12:34:28.600558 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:28.921169 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:28.921393 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:29.418626 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:29.714515 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:29.714653 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:30.221527 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:30.524653 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:30.524917 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:31.016671 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:31.333724 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:31.333912 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:31.809623 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:32.110836 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:32.111012 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:32.580986 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:32.884184 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:32.884406 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:39.144459 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003557920455932617, :worker_monitor=>1.3389172554016113, :worker_dequeue=>0.010112285614013672, :total_time=>1.3528578281402588} [----] I, [2016-09-13T12:34:39.373360 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:39.634786 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:34:39.654829 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80773], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:34:39.684651 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:39.684882 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:40.160967 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:40.456917 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:40.457094 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:40.921706 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:41.218301 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:41.218471 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:41.679369 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:41.988278 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:41.988435 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:42.455477 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:42.613102 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:42.747829 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:42.901993 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:43.048530 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:43.183992 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:43.337035 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:43.479767 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:43.622492 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:43.759722 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:43.899684 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:44.038633 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:44.145067 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:34:44 UTC]... [----] I, [2016-09-13T12:34:44.162074 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:34:44 UTC]...Complete [----] I, [2016-09-13T12:34:44.168830 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:34:44.178212 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:44.316636 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:44.425473 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80773], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.782419044] seconds [----] I, [2016-09-13T12:34:44.425705 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80773], Delivering... [----] I, [2016-09-13T12:34:44.432556 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003440380096435547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034627914428710938, :pending_vm_jobs=>0.0009448528289794922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006367206573486328} [----] I, [2016-09-13T12:34:44.432936 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80773], State: [ok], Delivered in [0.007217812] seconds [----] I, [2016-09-13T12:34:44.450605 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:44.941566 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:45.098064 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:45.235840 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:45.375109 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:45.514389 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:45.664995 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:45.805573 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:45.940339 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:46.078663 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:46.214866 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:46.356147 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:46.495720 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:46.636533 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:46.783287 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:46.927912 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:47.069858 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:47.205593 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:47.679611 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:47.842412 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:47.976231 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:48.116628 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:48.267618 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:48.406751 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:48.584012 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:48.729281 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:48.869356 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:49.022588 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:49.163003 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:49.314535 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:49.478652 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:49.628810 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:49.767608 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:49.906710 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:50.246933 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:50.702143 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:50.867558 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:51.003030 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:51.137298 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:51.268591 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:51.437773 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:51.575757 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:51.721830 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:51.864359 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:52.001384 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:52.144215 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:52.276750 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:52.411473 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:52.556611 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:52.690191 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:52.823048 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:52.978713 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:53.350778 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:53.495791 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:53.639627 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:53.782491 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:53.930587 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:54.073167 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:54.212364 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:54.356937 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:54.501128 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:54.643478 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:54.666564 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:34:54.688126 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80774], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:34:54.726973 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80775], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:34:54.810962 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:54.963263 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:55.114853 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:55.250761 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:55.393236 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:55.532297 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:55.595671 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:34:55.599818 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005881547927856445, :worker_monitor=>1.3999669551849365, :worker_dequeue=>0.008488893508911133, :total_time=>1.4147052764892578} [----] I, [2016-09-13T12:34:55.673921 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:55.722542 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80775], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.030655638] seconds [----] I, [2016-09-13T12:34:55.722683 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80775], Delivering... [----] I, [2016-09-13T12:34:55.726615 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022249221801757812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022401809692382812, :pending_vm_jobs=>0.0004608631134033203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0036673545837402344} [----] I, [2016-09-13T12:34:55.726874 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80775], State: [ok], Delivered in [0.004191691] seconds [----] I, [2016-09-13T12:34:56.168595 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:56.320560 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:56.465738 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:56.608712 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:56.747499 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:56.892779 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:57.034966 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:57.173518 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:57.312625 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:57.454749 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:57.592664 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:57.735555 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:57.878173 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:58.017281 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:58.152376 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:58.271506 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80774], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.60120323] seconds [----] I, [2016-09-13T12:34:58.271741 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80774], Delivering... [----] I, [2016-09-13T12:34:58.277296 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80774], State: [ok], Delivered in [0.005539833] seconds [----] I, [2016-09-13T12:34:58.288134 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:58.432264 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:58.941407 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:59.086311 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:59.232263 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:59.367770 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:59.510174 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:59.663772 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:59.805644 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:34:59.940336 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:00.078331 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:00.214174 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:00.355593 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:00.497888 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:00.651014 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:00.791613 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:00.941102 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:01.077442 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:01.229700 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:01.622177 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:01.769216 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:01.909453 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:02.062260 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:02.209537 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:02.363618 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:02.513499 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:02.651953 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:02.801649 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:02.936346 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:03.082342 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:03.221212 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:03.360331 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:03.502562 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:03.645593 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:03.783298 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:03.923652 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:04.359554 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:04.512671 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:04.654451 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:04.803850 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:04.944020 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:05.090442 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:05.231219 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:05.372029 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:05.511967 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:05.654024 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:05.790164 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:05.926833 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:06.065394 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:06.206460 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:06.356426 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:06.500024 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:06.641647 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:07.134849 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:07.287777 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:07.423117 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:07.563245 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:07.703855 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:07.871176 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:08.007317 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:08.144694 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:08.289369 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:08.431513 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:08.567252 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:08.711078 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:08.853112 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:08.994724 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:09.128793 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:09.263384 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:09.399480 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:09.744046 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:35:09.768388 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80776], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:35:09.855923 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:10.012132 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:10.152976 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:10.300638 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:10.443217 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:10.585442 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:10.726346 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:10.914337 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:11.058579 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:11.195839 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:11.338123 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:11.478006 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:11.612745 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:11.752019 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:11.893359 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:11.950025 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:35:11.955345 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003974199295043945, :worker_monitor=>1.315432071685791, :worker_dequeue=>0.010215044021606445, :total_time=>1.3299379348754883} [----] I, [2016-09-13T12:35:12.034520 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:12.065561 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80776], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.311252442] seconds [----] I, [2016-09-13T12:35:12.065709 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80776], Delivering... [----] I, [2016-09-13T12:35:12.070623 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026175975799560547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002657175064086914, :pending_vm_jobs=>0.0005867481231689453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004638195037841797} [----] I, [2016-09-13T12:35:12.070960 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80776], State: [ok], Delivered in [0.005229683] seconds [----] I, [2016-09-13T12:35:12.178071 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:12.666278 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:12.826280 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:12.969350 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:13.115590 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:13.275587 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:13.426033 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:13.573684 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:13.731739 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:13.875841 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:14.021533 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:14.170689 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:14.317109 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:14.457776 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:14.593832 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:14.730744 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:14.865575 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:15.005080 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:15.494830 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:15.659298 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:15.794713 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:15.938213 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:16.097827 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:16.239483 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:16.383402 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:16.523989 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:16.666380 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:16.838246 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:16.956047 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:35:16 UTC]... [----] I, [2016-09-13T12:35:16.979730 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:35:16 UTC]...Complete [----] I, [2016-09-13T12:35:16.989586 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:17.132700 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:17.275934 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:17.423821 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:17.574799 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:17.714728 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:17.857750 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:18.261861 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:18.421879 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:18.573163 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:18.721211 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:18.859210 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:18.998574 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:19.167040 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:19.323681 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:19.461360 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:19.608408 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:19.753703 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:19.898786 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:20.070967 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:20.217939 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:20.361754 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:20.508085 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:35:20.670219 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T12:35:20.869868 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T12:35:20.870246 #24051:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T12:35:20.870610 #24051:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T12:35:20.870733 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T12:35:20.870844 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T12:35:20.894166 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T12:35:20.894578 #24051:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [80768], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T12:35:20.894832 #24051:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T12:35:20.895071 #24051:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T12:35:20.895236 #24051:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80768], State: [error], Delivered in [56.108718528] seconds [----] I, [2016-09-13T12:35:24.785208 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:35:24.802627 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80777], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:35:24.819435 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80778], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:35:24.865468 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80779], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:35:24.882549 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80780], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:35:28.187201 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:35:28.189862 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030121803283691406, :worker_monitor=>1.1698064804077148, :worker_dequeue=>0.006147146224975586, :total_time=>1.1792335510253906} [----] I, [2016-09-13T12:35:28.386079 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80777], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.596025591] seconds [----] I, [2016-09-13T12:35:28.386270 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80777], Delivering... [----] I, [2016-09-13T12:35:28.414434 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80780], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.544646763] seconds [----] I, [2016-09-13T12:35:28.414606 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80780], Delivering... [----] I, [2016-09-13T12:35:28.424525 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005286693572998047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005314826965332031, :pending_vm_jobs=>0.0013136863708496094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009477376937866211} [----] I, [2016-09-13T12:35:28.425068 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80780], State: [ok], Delivered in [0.010422595] seconds [----] I, [2016-09-13T12:35:28.443378 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80777], State: [ok], Delivered in [0.057073669] seconds [----] I, [2016-09-13T12:35:28.478175 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80778], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.671620781] seconds [----] I, [2016-09-13T12:35:28.478451 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80778], Delivering... [----] I, [2016-09-13T12:35:28.482038 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80778], State: [ok], Delivered in [0.003618931] seconds [----] I, [2016-09-13T12:35:28.512383 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80779], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.68716881] seconds [----] I, [2016-09-13T12:35:28.512600 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80779], Delivering... [----] I, [2016-09-13T12:35:28.517237 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80779], State: [ok], Delivered in [0.004612704] seconds [----] I, [2016-09-13T12:35:39.892012 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:35:39.911755 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80781], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:35:44.934302 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:35:44.936594 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004759550094604492, :worker_monitor=>1.4871628284454346, :worker_dequeue=>0.005215883255004883, :total_time=>1.4974515438079834} [----] I, [2016-09-13T12:35:45.295740 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80781], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.399050882] seconds [----] I, [2016-09-13T12:35:45.295867 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80781], Delivering... [----] I, [2016-09-13T12:35:45.299629 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021369457244873047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021500587463378906, :pending_vm_jobs=>0.00043320655822753906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003542661666870117} [----] I, [2016-09-13T12:35:45.299910 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80781], State: [ok], Delivered in [0.004030951] seconds [----] I, [2016-09-13T12:35:49.937086 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:35:49 UTC]... [----] I, [2016-09-13T12:35:49.957741 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:35:49 UTC]...Complete [----] I, [2016-09-13T12:35:54.921100 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:35:54.958100 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80782], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:35:54.981772 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:35:54.987293 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80783], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:35:55.661024 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80782], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.735255487] seconds [----] I, [2016-09-13T12:35:55.661220 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80782], Delivering... [----] I, [2016-09-13T12:35:55.666098 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80782], State: [ok], Delivered in [0.00485966] seconds [----] I, [2016-09-13T12:36:01.237046 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:36:01.239610 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003857135772705078, :worker_monitor=>1.2370374202728271, :worker_dequeue=>0.0055391788482666016, :total_time=>1.2467100620269775} [----] I, [2016-09-13T12:36:01.443805 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80783], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.479964223] seconds [----] I, [2016-09-13T12:36:01.444002 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80783], Delivering... [----] I, [2016-09-13T12:36:01.449639 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030329227447509766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003050565719604492, :pending_vm_jobs=>0.0007085800170898438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005312204360961914} [----] I, [2016-09-13T12:36:01.449964 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80783], State: [ok], Delivered in [0.00595914] seconds [----] I, [2016-09-13T12:36:10.000268 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:36:10.015173 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80784], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:36:11.258760 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:36:11.552159 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80784], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.548000867] seconds [----] I, [2016-09-13T12:36:11.552290 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80784], Delivering... [----] I, [2016-09-13T12:36:11.556016 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020580291748046875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020732879638671875, :pending_vm_jobs=>0.00043129920959472656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0034847259521484375} [----] I, [2016-09-13T12:36:11.556241 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80784], State: [ok], Delivered in [0.003940035] seconds [----] I, [2016-09-13T12:36:17.452535 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004407405853271484, :worker_monitor=>1.1808996200561523, :worker_dequeue=>0.005583524703979492, :total_time=>1.191256046295166} [----] I, [2016-09-13T12:36:22.453108 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:36:22 UTC]... [----] I, [2016-09-13T12:36:22.478487 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:36:22 UTC]...Complete [----] I, [2016-09-13T12:36:25.023837 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:36:25.046925 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80785], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:36:25.066929 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80786], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:36:25.083991 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80787], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:36:25.106945 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80788], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:36:27.511818 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:36:27.707064 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80785], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.675034626] seconds [----] I, [2016-09-13T12:36:27.707249 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80785], Delivering... [----] I, [2016-09-13T12:36:27.815623 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80785], State: [ok], Delivered in [0.108342589] seconds [----] I, [2016-09-13T12:36:27.912971 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80788], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.823562248] seconds [----] I, [2016-09-13T12:36:27.913091 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80788], Delivering... [----] I, [2016-09-13T12:36:27.916655 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0019261837005615234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0019383430480957031, :pending_vm_jobs=>0.0004315376281738281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0033490657806396484} [----] I, [2016-09-13T12:36:27.916917 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80788], State: [ok], Delivered in [0.003815099] seconds [----] I, [2016-09-13T12:36:28.729942 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80786], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.677228478] seconds [----] I, [2016-09-13T12:36:28.730081 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80786], Delivering... [----] I, [2016-09-13T12:36:28.732186 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80786], State: [ok], Delivered in [0.002099863] seconds [----] I, [2016-09-13T12:36:28.747323 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80787], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.677626879] seconds [----] I, [2016-09-13T12:36:28.747528 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80787], Delivering... [----] I, [2016-09-13T12:36:28.751347 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80787], State: [ok], Delivered in [0.003808915] seconds [----] I, [2016-09-13T12:36:33.963563 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0070269107818603516, :worker_monitor=>1.4310128688812256, :worker_dequeue=>0.00815582275390625, :total_time=>1.4466750621795654} [----] I, [2016-09-13T12:36:39.073484 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T12:36:40.116924 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:36:40.158768 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80789], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:36:44.091625 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:36:44.187269 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80789], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.06426787] seconds [----] I, [2016-09-13T12:36:44.187465 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80789], Delivering... [----] I, [2016-09-13T12:36:44.193204 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0029687881469726562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029871463775634766, :pending_vm_jobs=>0.0007188320159912109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00539088249206543} [----] I, [2016-09-13T12:36:44.193520 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80789], State: [ok], Delivered in [0.006070696] seconds [----] I, [2016-09-13T12:36:50.164561 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030040740966796875, :worker_monitor=>1.0573322772979736, :worker_dequeue=>0.008496761322021484, :total_time=>1.069025993347168} [----] I, [2016-09-13T12:36:55.165101 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:36:55 UTC]... [----] I, [2016-09-13T12:36:55.172716 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:36:55.192994 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:36:55 UTC]...Complete [----] I, [2016-09-13T12:36:55.222625 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80790], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:36:55.250573 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80791], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:37:00.212676 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:37:00.314574 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80791], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.085167603] seconds [----] I, [2016-09-13T12:37:00.314834 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80791], Delivering... [----] I, [2016-09-13T12:37:00.323044 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004210233688354492, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004257917404174805, :pending_vm_jobs=>0.0010616779327392578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007718801498413086} [----] I, [2016-09-13T12:37:00.323542 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80791], State: [ok], Delivered in [0.008698931] seconds [----] I, [2016-09-13T12:37:01.850517 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80790], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.673034392] seconds [----] I, [2016-09-13T12:37:01.850655 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80790], Delivering... [----] I, [2016-09-13T12:37:01.854124 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80790], State: [ok], Delivered in [0.003459324] seconds [----] I, [2016-09-13T12:37:06.697239 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005059719085693359, :worker_monitor=>1.4647729396820068, :worker_dequeue=>0.009723186492919922, :total_time=>1.4799919128417969} [----] I, [2016-09-13T12:37:10.263526 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:37:10.285595 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80792], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:37:11.703513 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:37:12.233636 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80792], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.963825766] seconds [----] I, [2016-09-13T12:37:12.233913 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80792], Delivering... [----] I, [2016-09-13T12:37:12.243463 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004966020584106445, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00507044792175293, :pending_vm_jobs=>0.0012326240539550781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009029388427734375} [----] I, [2016-09-13T12:37:12.243950 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80792], State: [ok], Delivered in [0.010033625] seconds [----] I, [2016-09-13T12:37:23.229295 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0028095245361328125, :worker_monitor=>1.4949815273284912, :worker_dequeue=>0.008982419967651367, :total_time=>1.5069999694824219} [----] I, [2016-09-13T12:37:25.297024 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:37:25.319000 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80793], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:37:25.336330 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80794], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:37:25.359197 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80795], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:37:25.381911 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80796], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:37:28.229914 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:37:28 UTC]... [----] I, [2016-09-13T12:37:28.279159 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:37:28 UTC]...Complete [----] I, [2016-09-13T12:37:28.293742 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:37:28.525583 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80793], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.225022025] seconds [----] I, [2016-09-13T12:37:28.525776 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80793], Delivering... [----] I, [2016-09-13T12:37:28.633796 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80793], State: [ok], Delivered in [0.107963206] seconds [----] I, [2016-09-13T12:37:28.696587 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80796], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.333328216] seconds [----] I, [2016-09-13T12:37:28.696759 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80796], Delivering... [----] I, [2016-09-13T12:37:28.705735 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004589557647705078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0046138763427734375, :pending_vm_jobs=>0.0011768341064453125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008580446243286133} [----] I, [2016-09-13T12:37:28.706182 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80796], State: [ok], Delivered in [0.009388069] seconds [----] I, [2016-09-13T12:37:29.010670 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80794], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.687343476] seconds [----] I, [2016-09-13T12:37:29.010831 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80794], Delivering... [----] I, [2016-09-13T12:37:29.016830 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80794], State: [ok], Delivered in [0.005984727] seconds [----] I, [2016-09-13T12:37:29.068004 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80795], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.725543733] seconds [----] I, [2016-09-13T12:37:29.068189 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80795], Delivering... [----] I, [2016-09-13T12:37:29.071848 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80795], State: [ok], Delivered in [0.003666179] seconds [----] I, [2016-09-13T12:37:39.765058 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002467632293701172, :worker_monitor=>1.444617748260498, :worker_dequeue=>0.00858616828918457, :total_time=>1.4558937549591064} [----] I, [2016-09-13T12:37:40.391968 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:37:40.410755 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80797], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:37:44.898079 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:37:45.217075 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80797], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.818938309] seconds [----] I, [2016-09-13T12:37:45.217288 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80797], Delivering... [----] I, [2016-09-13T12:37:45.223712 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00327301025390625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003295421600341797, :pending_vm_jobs=>0.0007193088531494141, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005885124206542969} [----] I, [2016-09-13T12:37:45.224085 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80797], State: [ok], Delivered in [0.006792618] seconds [----] I, [2016-09-13T12:37:55.422725 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:37:55.456300 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80798], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:37:55.469262 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80799], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:37:56.376001 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:37:56.380444 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0029315948486328125, :worker_monitor=>1.4500956535339355, :worker_dequeue=>0.00962066650390625, :total_time=>1.462961196899414} [----] I, [2016-09-13T12:37:56.428385 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80799], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.968200998] seconds [----] I, [2016-09-13T12:37:56.428651 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80799], Delivering... [----] I, [2016-09-13T12:37:56.436032 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003737926483154297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037643909454345703, :pending_vm_jobs=>0.0008995532989501953, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0069005489349365234} [----] I, [2016-09-13T12:37:56.436391 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80799], State: [ok], Delivered in [0.007746496] seconds [----] I, [2016-09-13T12:37:56.485759 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80798], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.058510913] seconds [----] I, [2016-09-13T12:37:56.486070 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80798], Delivering... [----] I, [2016-09-13T12:37:56.493797 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80798], State: [ok], Delivered in [0.007707225] seconds [----] I, [2016-09-13T12:38:01.380964 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:38:01 UTC]... [----] I, [2016-09-13T12:38:01.400508 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:38:01 UTC]...Complete [----] I, [2016-09-13T12:38:10.480779 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:38:10.526617 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80800], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:38:12.997448 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:38:13.002356 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0035431385040283203, :worker_monitor=>1.5499229431152344, :worker_dequeue=>0.010368585586547852, :total_time=>1.5641553401947021} [----] I, [2016-09-13T12:38:13.131456 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80800], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.641785093] seconds [----] I, [2016-09-13T12:38:13.131675 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80800], Delivering... [----] I, [2016-09-13T12:38:13.139048 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003978252410888672, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0040073394775390625, :pending_vm_jobs=>0.0008809566497802734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006925344467163086} [----] I, [2016-09-13T12:38:13.139453 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80800], State: [ok], Delivered in [0.007751389] seconds [----] I, [2016-09-13T12:38:25.539019 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:38:25.554159 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80801], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:38:25.582691 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80802], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:38:25.611267 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80803], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:38:25.634171 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80804], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:38:29.455565 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:38:29.461038 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00444793701171875, :worker_monitor=>1.414759874343872, :worker_dequeue=>0.011025190353393555, :total_time=>1.430565357208252} [----] I, [2016-09-13T12:38:29.560472 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80801], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.017847897] seconds [----] I, [2016-09-13T12:38:29.560695 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80801], Delivering... [----] I, [2016-09-13T12:38:29.671066 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80804], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.054490217] seconds [----] I, [2016-09-13T12:38:29.671347 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80804], Delivering... [----] I, [2016-09-13T12:38:29.681337 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005378246307373047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0054111480712890625, :pending_vm_jobs=>0.0012242794036865234, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009366273880004883} [----] I, [2016-09-13T12:38:29.681778 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80804], State: [ok], Delivered in [0.010430969] seconds [----] I, [2016-09-13T12:38:29.691874 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80801], State: [ok], Delivered in [0.131158538] seconds [----] I, [2016-09-13T12:38:29.691982 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80802], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.131118157] seconds [----] I, [2016-09-13T12:38:29.692175 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80802], Delivering... [----] I, [2016-09-13T12:38:29.695563 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80802], State: [ok], Delivered in [0.003383626] seconds [----] I, [2016-09-13T12:38:29.754966 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80803], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.163143782] seconds [----] I, [2016-09-13T12:38:29.755232 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80803], Delivering... [----] I, [2016-09-13T12:38:29.762179 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80803], State: [ok], Delivered in [0.00693333] seconds [----] I, [2016-09-13T12:38:34.461611 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:38:34 UTC]... [----] I, [2016-09-13T12:38:34.514196 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:38:34 UTC]...Complete [----] I, [2016-09-13T12:38:40.649232 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:38:40.674978 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80805], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:38:40.703460 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80806], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:38:40.726169 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80807], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:38:45.937344 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:38:45.943667 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005295753479003906, :worker_monitor=>1.383162021636963, :worker_dequeue=>0.013900279998779297, :total_time=>1.4027328491210938} [----] I, [2016-09-13T12:38:46.372922 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80805], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.712624418] seconds [----] I, [2016-09-13T12:38:46.373096 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80805], Delivering... [----] I, [2016-09-13T12:38:46.378744 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002991914749145508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030095577239990234, :pending_vm_jobs=>0.0007064342498779297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0053119659423828125} [----] I, [2016-09-13T12:38:46.379066 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80805], State: [ok], Delivered in [0.005967046] seconds [----] I, [2016-09-13T12:38:46.429215 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80806], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.748939074] seconds [----] I, [2016-09-13T12:38:46.429446 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80806], Delivering... [----] I, [2016-09-13T12:38:46.430799 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T12:38:46.431030 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4596088832 [----] I, [2016-09-13T12:38:46.431136 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4356370432 [----] I, [2016-09-13T12:38:46.431224 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 239718400 [----] I, [2016-09-13T12:38:46.431305 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T12:38:46.431382 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4299653120 [----] I, [2016-09-13T12:38:46.431509 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T12:38:46.431599 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T12:38:46.431676 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 562630656 [----] I, [2016-09-13T12:38:46.431754 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T12:38:46.431827 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6818201600 [----] I, [2016-09-13T12:38:46.431936 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T12:38:46.432033 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T12:38:46.432114 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T12:38:46.432191 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T12:38:46.432273 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T12:38:46.432347 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T12:38:46.432458 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T12:38:46.432561 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T12:38:46.432644 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T12:38:46.432739 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T12:38:46.432820 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272408576 [----] I, [2016-09-13T12:38:46.432918 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55205888 [----] I, [2016-09-13T12:38:46.433007 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217202688 [----] I, [2016-09-13T12:38:46.433086 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6094848 [----] I, [2016-09-13T12:38:46.433162 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142376960 [----] I, [2016-09-13T12:38:46.433231 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3391107072 [----] I, [2016-09-13T12:38:46.433309 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3068698624 [----] I, [2016-09-13T12:38:46.433385 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T12:38:46.433507 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T12:38:46.433594 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T12:38:46.433675 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36634624 [----] I, [2016-09-13T12:38:46.433753 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76939264 [----] I, [2016-09-13T12:38:46.433836 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49594368 [----] I, [2016-09-13T12:38:46.433934 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111931392 [----] I, [2016-09-13T12:38:46.434020 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126533632 [----] I, [2016-09-13T12:38:46.434098 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T12:38:46.434181 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T12:38:46.434260 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T12:38:46.434343 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T12:38:46.434449 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T12:38:46.434557 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T12:38:46.434640 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T12:38:46.434717 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T12:38:46.434793 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T12:38:46.474074 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T12:38:46.474338 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T12:38:46.478631 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T12:38:46.481841 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T12:38:46.486699 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T12:38:46.491056 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T12:38:46.496190 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T12:38:46.500051 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 860 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T12:38:46.504018 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T12:38:46.507139 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T12:38:46.509988 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.9 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T12:38:46.512909 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T12:38:46.516035 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 176 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T12:38:46.518774 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T12:38:46.521356 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:38:46.521544 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:38:46.521651 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T12:38:46.525339 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [155344.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T12:38:46.525648 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80806], State: [ok], Delivered in [0.096239124] seconds [----] I, [2016-09-13T12:38:46.566497 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80807], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.857683445] seconds [----] I, [2016-09-13T12:38:46.566765 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80807], Delivering... [----] I, [2016-09-13T12:38:46.574982 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:38:43 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163164000], Memory % [3.1], CPU Time [39126.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T12:38:46.575732 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:38:44 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359296000], Memory % [5.28], CPU Time [208624.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T12:38:46.576699 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:38:45 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [156182.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:38:46.577601 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:38:44 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202687000], Memory % [3.38], CPU Time [155353.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:38:46.578576 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:38:43 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [53153.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:38:46.579525 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:38:40 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [247630.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T12:38:46.580355 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:38:42 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347860000], Memory % [5.04], CPU Time [106771.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T12:38:46.581203 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:38:37 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213441000], Memory % [3.51], CPU Time [50378.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T12:38:46.586199 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:38:41 UTC], Process Info: Memory Usage [617459712], Memory Size [1078005760], Proportional Set Size: [458325000], Memory % [7.53], CPU Time [1281.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T12:38:46.590131 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:38:37 UTC], Process Info: Memory Usage [602427392], Memory Size [960933888], Proportional Set Size: [445684000], Memory % [7.34], CPU Time [1160.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T12:38:46.591130 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:38:44 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358595000], Memory % [5.27], CPU Time [217321.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T12:38:46.592085 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:38:45 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [53104.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:38:46.592955 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:38:43 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166763000], Memory % [3.16], CPU Time [40048.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T12:38:46.593501 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80807], State: [ok], Delivered in [0.026699644] seconds [----] I, [2016-09-13T12:38:55.741707 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:38:55.772553 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80808], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:38:55.806017 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80809], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:38:56.207352 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:38:56.734173 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80809], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.957972608] seconds [----] I, [2016-09-13T12:38:56.734395 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80809], Delivering... [----] I, [2016-09-13T12:38:56.741567 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035991668701171875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036306381225585938, :pending_vm_jobs=>0.0009636878967285156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0067102909088134766} [----] I, [2016-09-13T12:38:56.742103 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80809], State: [ok], Delivered in [0.007707719] seconds [----] I, [2016-09-13T12:38:56.877262 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80808], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.131149717] seconds [----] I, [2016-09-13T12:38:56.877464 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80808], Delivering... [----] I, [2016-09-13T12:38:56.883482 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80808], State: [ok], Delivered in [0.00598629] seconds [----] I, [2016-09-13T12:39:02.924198 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004161357879638672, :worker_monitor=>1.7018837928771973, :worker_dequeue=>0.00690913200378418, :total_time=>1.7132596969604492} [----] I, [2016-09-13T12:39:07.924650 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:39:07 UTC]... [----] I, [2016-09-13T12:39:07.943259 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:39:07 UTC]...Complete [----] I, [2016-09-13T12:39:10.817517 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:39:10.863439 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80810], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:39:12.969359 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:39:13.092209 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80810], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.268151196] seconds [----] I, [2016-09-13T12:39:13.092403 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80810], Delivering... [----] I, [2016-09-13T12:39:13.098648 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003286600112915039, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003308534622192383, :pending_vm_jobs=>0.0007486343383789062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057811737060546875} [----] I, [2016-09-13T12:39:13.099077 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80810], State: [ok], Delivered in [0.00667151] seconds [----] I, [2016-09-13T12:39:19.318663 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003391742706298828, :worker_monitor=>1.333305835723877, :worker_dequeue=>0.0071985721588134766, :total_time=>1.3440814018249512} [----] I, [2016-09-13T12:39:25.877378 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:39:25.892009 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80811], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:39:25.909021 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80812], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:39:25.932239 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80813], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:39:25.949057 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80814], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:39:29.353573 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:39:30.001221 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80811], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.119418589] seconds [----] I, [2016-09-13T12:39:30.001539 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80811], Delivering... [----] I, [2016-09-13T12:39:30.023973 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80814], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.086253697] seconds [----] I, [2016-09-13T12:39:30.024271 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80814], Delivering... [----] I, [2016-09-13T12:39:30.032909 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004472970962524414, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004568338394165039, :pending_vm_jobs=>0.0010592937469482422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008004188537597656} [----] I, [2016-09-13T12:39:30.033327 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80814], State: [ok], Delivered in [0.00907723] seconds [----] I, [2016-09-13T12:39:30.041718 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80812], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.144326387] seconds [----] I, [2016-09-13T12:39:30.041953 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80812], Delivering... [----] I, [2016-09-13T12:39:30.045202 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80812], State: [ok], Delivered in [0.003298792] seconds [----] I, [2016-09-13T12:39:30.081003 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80811], State: [ok], Delivered in [0.079405956] seconds [----] I, [2016-09-13T12:39:30.098094 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80813], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.181345121] seconds [----] I, [2016-09-13T12:39:30.098352 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80813], Delivering... [----] I, [2016-09-13T12:39:30.103985 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80813], State: [ok], Delivered in [0.005649511] seconds [----] I, [2016-09-13T12:39:35.551396 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003269195556640625, :worker_monitor=>1.179487943649292, :worker_dequeue=>0.009680032730102539, :total_time=>1.1926870346069336} [----] I, [2016-09-13T12:39:40.551994 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:39:40 UTC]... [----] I, [2016-09-13T12:39:40.594950 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:39:40 UTC]...Complete [----] I, [2016-09-13T12:39:40.961285 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:39:40.984974 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80815], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:39:45.623575 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:39:46.265603 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80815], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.295549342] seconds [----] I, [2016-09-13T12:39:46.265892 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80815], Delivering... [----] I, [2016-09-13T12:39:46.273270 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004060029983520508, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004153728485107422, :pending_vm_jobs=>0.0007882118225097656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068509578704833984} [----] I, [2016-09-13T12:39:46.273637 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80815], State: [ok], Delivered in [0.007782922] seconds [----] I, [2016-09-13T12:39:51.806600 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004038095474243164, :worker_monitor=>1.1630120277404785, :worker_dequeue=>0.008479118347167969, :total_time=>1.175837516784668} [----] I, [2016-09-13T12:39:55.995754 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:39:56.018130 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80816], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:39:56.052136 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80817], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:39:57.023927 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:39:57.173675 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80817], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.15069747] seconds [----] I, [2016-09-13T12:39:57.173925 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80817], Delivering... [----] I, [2016-09-13T12:39:57.181350 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003909111022949219, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00393223762512207, :pending_vm_jobs=>0.0008890628814697266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006958961486816406} [----] I, [2016-09-13T12:39:57.181773 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80817], State: [ok], Delivered in [0.00787273] seconds [----] I, [2016-09-13T12:39:57.327533 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80816], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.328362267] seconds [----] I, [2016-09-13T12:39:57.327867 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80816], Delivering... [----] I, [2016-09-13T12:39:57.336569 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80816], State: [ok], Delivered in [0.008678165] seconds [----] I, [2016-09-13T12:40:08.881376 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002894163131713867, :worker_monitor=>1.8252761363983154, :worker_dequeue=>0.008580684661865234, :total_time=>1.836986780166626} [----] I, [2016-09-13T12:40:11.060340 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T12:40:11.081334 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80818], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:40:11.098208 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80819], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:40:11.115565 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80820], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:40:11.143923 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80821], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:40:13.881910 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:40:13 UTC]... [----] I, [2016-09-13T12:40:13.903769 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:40:13 UTC]...Complete [----] I, [2016-09-13T12:40:13.915160 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:40:14.498406 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80818], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.433433185] seconds [----] I, [2016-09-13T12:40:14.498629 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80818], Delivering... [----] I, [2016-09-13T12:40:14.505120 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003299236297607422, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003325223922729492, :pending_vm_jobs=>0.0008058547973632812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0060002803802490234} [----] I, [2016-09-13T12:40:14.505511 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80818], State: [ok], Delivered in [0.006880721] seconds [----] I, [2016-09-13T12:40:15.292624 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80819], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.205245873] seconds [----] I, [2016-09-13T12:40:15.292758 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80819], Delivering... [----] I, [2016-09-13T12:40:15.294528 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80819], State: [ok], Delivered in [0.001764914] seconds [----] I, [2016-09-13T12:40:15.332862 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80820], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.229526719] seconds [----] I, [2016-09-13T12:40:15.333045 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80820], Delivering... [----] I, [2016-09-13T12:40:15.341006 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80820], State: [ok], Delivered in [0.00794058] seconds [----] I, [2016-09-13T12:40:15.373225 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80821], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.251784515] seconds [----] I, [2016-09-13T12:40:15.373482 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80821], Delivering... [----] I, [2016-09-13T12:40:15.378341 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80821], State: [ok], Delivered in [0.004871797] seconds [----] I, [2016-09-13T12:40:25.649528 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004289865493774414, :worker_monitor=>1.699906826019287, :worker_dequeue=>0.005965709686279297, :total_time=>1.7104485034942627} [----] I, [2016-09-13T12:40:26.152567 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:40:26.167186 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80822], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:40:26.184087 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80823], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:40:26.201393 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80824], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:40:26.218366 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80825], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:40:30.659367 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:40:31.613020 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80822], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.457249755] seconds [----] I, [2016-09-13T12:40:31.613172 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80822], Delivering... [----] I, [2016-09-13T12:40:31.664659 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80825], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.455330975] seconds [----] I, [2016-09-13T12:40:31.664832 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80825], Delivering... [----] I, [2016-09-13T12:40:31.671441 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034742355346679688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034945011138916016, :pending_vm_jobs=>0.0007739067077636719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006209850311279297} [----] I, [2016-09-13T12:40:31.671752 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80825], State: [ok], Delivered in [0.006908351] seconds [----] I, [2016-09-13T12:40:31.686160 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80822], State: [ok], Delivered in [0.072965733] seconds [----] I, [2016-09-13T12:40:33.458970 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80823], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.286120588] seconds [----] I, [2016-09-13T12:40:33.459167 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80823], Delivering... [----] I, [2016-09-13T12:40:33.462622 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80823], State: [ok], Delivered in [0.003446685] seconds [----] I, [2016-09-13T12:40:33.521970 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80824], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.330296194] seconds [----] I, [2016-09-13T12:40:33.522197 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80824], Delivering... [----] I, [2016-09-13T12:40:33.527958 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80824], State: [ok], Delivered in [0.005759317] seconds [----] I, [2016-09-13T12:40:41.232204 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:40:41.266805 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80826], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:40:41.928014 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:40:41.933759 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003757953643798828, :worker_monitor=>1.2387402057647705, :worker_dequeue=>0.012899637222290039, :total_time=>1.2557878494262695} [----] I, [2016-09-13T12:40:42.538402 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80826], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.302332708] seconds [----] I, [2016-09-13T12:40:42.538673 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80826], Delivering... [----] I, [2016-09-13T12:40:42.546028 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00432586669921875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004351139068603516, :pending_vm_jobs=>0.0007669925689697266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006878852844238281} [----] I, [2016-09-13T12:40:42.546398 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80826], State: [ok], Delivered in [0.007722143] seconds [----] I, [2016-09-13T12:40:46.934289 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:40:46 UTC]... [----] I, [2016-09-13T12:40:46.955018 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:40:46 UTC]...Complete [----] I, [2016-09-13T12:40:56.285843 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:40:56.303929 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80827], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:40:56.321849 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80828], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:40:58.474563 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:40:58.477615 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033080577850341797, :server_monitor=>0.08615922927856445, :worker_monitor=>1.379051923751831, :worker_dequeue=>0.006239652633666992, :total_time=>1.4750823974609375} [----] I, [2016-09-13T12:40:58.943982 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80828], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.634970235] seconds [----] I, [2016-09-13T12:40:58.944237 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80828], Delivering... [----] I, [2016-09-13T12:40:58.952214 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004655361175537109, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004681110382080078, :pending_vm_jobs=>0.0008339881896972656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007471799850463867} [----] I, [2016-09-13T12:40:58.952613 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80828], State: [ok], Delivered in [0.008389459] seconds [----] I, [2016-09-13T12:41:00.658183 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80827], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.368316339] seconds [----] I, [2016-09-13T12:41:00.658347 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80827], Delivering... [----] I, [2016-09-13T12:41:00.662692 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80827], State: [ok], Delivered in [0.00433586] seconds [----] I, [2016-09-13T12:41:11.331653 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:41:11.350254 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80829], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:41:15.243519 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:41:15.248606 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036563873291015625, :worker_monitor=>1.72957444190979, :worker_dequeue=>0.010834455490112305, :total_time=>1.7443170547485352} [----] I, [2016-09-13T12:41:15.691174 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80829], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.35550064] seconds [----] I, [2016-09-13T12:41:15.691332 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80829], Delivering... [----] I, [2016-09-13T12:41:15.696522 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026803016662597656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026998519897460938, :pending_vm_jobs=>0.0006349086761474609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004789590835571289} [----] I, [2016-09-13T12:41:15.696954 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80829], State: [ok], Delivered in [0.005568387] seconds [----] I, [2016-09-13T12:41:20.248982 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:41:20 UTC]... [----] I, [2016-09-13T12:41:20.262462 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:41:20 UTC]...Complete [----] I, [2016-09-13T12:41:26.358578 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:41:26.377040 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80830], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:41:26.399917 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80831], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:41:26.434190 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80832], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:41:26.462624 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80833], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:41:31.368745 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:41:31.372178 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00262451171875, :worker_monitor=>1.0686497688293457, :worker_dequeue=>0.008542537689208984, :total_time=>1.0801079273223877} [----] I, [2016-09-13T12:41:32.297841 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80830], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.932313383] seconds [----] I, [2016-09-13T12:41:32.298049 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80830], Delivering... [----] I, [2016-09-13T12:41:32.330346 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80833], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.890478941] seconds [----] I, [2016-09-13T12:41:32.330658 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80833], Delivering... [----] I, [2016-09-13T12:41:32.344303 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.009217023849487305, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.009254693984985352, :pending_vm_jobs=>0.0011098384857177734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.013056516647338867} [----] I, [2016-09-13T12:41:32.344824 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80833], State: [ok], Delivered in [0.014161097] seconds [----] I, [2016-09-13T12:41:32.451612 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80830], State: [ok], Delivered in [0.153531416] seconds [----] I, [2016-09-13T12:41:33.800772 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80831], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.418086382] seconds [----] I, [2016-09-13T12:41:33.801083 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80831], Delivering... [----] I, [2016-09-13T12:41:33.806451 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80831], State: [ok], Delivered in [0.005313054] seconds [----] I, [2016-09-13T12:41:33.806802 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80832], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.399062685] seconds [----] I, [2016-09-13T12:41:33.807023 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80832], Delivering... [----] I, [2016-09-13T12:41:33.813109 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80832], State: [ok], Delivered in [0.006066667] seconds [----] I, [2016-09-13T12:41:41.410411 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T12:41:41.475574 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:41:41.508979 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80834], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:41:47.570613 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:41:47.573358 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0034711360931396484, :worker_monitor=>1.140376329421997, :worker_dequeue=>0.0057795047760009766, :total_time=>1.1498894691467285} [----] I, [2016-09-13T12:41:47.610731 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80834], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.12911576] seconds [----] I, [2016-09-13T12:41:47.610845 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80834], Delivering... [----] I, [2016-09-13T12:41:47.614705 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020341873168945312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0020492076873779297, :pending_vm_jobs=>0.0004756450653076172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003599405288696289} [----] I, [2016-09-13T12:41:47.614948 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80834], State: [ok], Delivered in [0.004085511] seconds [----] I, [2016-09-13T12:41:52.574016 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:41:52 UTC]... [----] I, [2016-09-13T12:41:52.595159 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:41:52 UTC]...Complete [----] I, [2016-09-13T12:41:56.519043 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:41:56.547919 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80835], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:41:56.576214 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80836], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:41:57.693858 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:41:57.730819 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80836], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.178045176] seconds [----] I, [2016-09-13T12:41:57.731054 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80836], Delivering... [----] I, [2016-09-13T12:41:57.737520 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004004478454589844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004026651382446289, :pending_vm_jobs=>0.0006558895111083984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0061016082763671875} [----] I, [2016-09-13T12:41:57.737903 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80836], State: [ok], Delivered in [0.006858186] seconds [----] I, [2016-09-13T12:41:57.988159 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80835], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.466167289] seconds [----] I, [2016-09-13T12:41:57.988312 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80835], Delivering... [----] I, [2016-09-13T12:41:57.992627 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80835], State: [ok], Delivered in [0.004285281] seconds [----] I, [2016-09-13T12:42:04.028088 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.008444070816040039, :worker_monitor=>1.314401626586914, :worker_dequeue=>0.008453845977783203, :total_time=>1.3316845893859863} [----] I, [2016-09-13T12:42:11.588173 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:42:11.610798 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80837], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:42:14.063071 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:42:14.681963 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80837], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.082729605] seconds [----] I, [2016-09-13T12:42:14.682313 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80837], Delivering... [----] I, [2016-09-13T12:42:14.695272 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.006682395935058594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.006720781326293945, :pending_vm_jobs=>0.0016851425170898438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.012246847152709961} [----] I, [2016-09-13T12:42:14.695895 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80837], State: [ok], Delivered in [0.013583207] seconds [----] I, [2016-09-13T12:42:20.565703 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005121946334838867, :worker_monitor=>1.483137607574463, :worker_dequeue=>0.008337259292602539, :total_time=>1.4969596862792969} [----] I, [2016-09-13T12:42:25.566164 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:42:25 UTC]... [----] I, [2016-09-13T12:42:25.605837 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:42:25 UTC]...Complete [----] I, [2016-09-13T12:42:26.619466 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:42:26.640432 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80838], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:42:26.668262 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80839], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:42:26.702307 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80840], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:42:26.731130 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80841], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:42:30.626614 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:42:30.868819 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80838], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.244880327] seconds [----] I, [2016-09-13T12:42:30.868973 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80838], Delivering... [----] I, [2016-09-13T12:42:30.908251 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80838], State: [ok], Delivered in [0.039253133] seconds [----] I, [2016-09-13T12:42:30.954159 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80841], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.246391845] seconds [----] I, [2016-09-13T12:42:30.954285 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80841], Delivering... [----] I, [2016-09-13T12:42:30.958068 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002090930938720703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002103090286254883, :pending_vm_jobs=>0.0004405975341796875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0035429000854492188} [----] I, [2016-09-13T12:42:30.958308 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80841], State: [ok], Delivered in [0.004017844] seconds [----] I, [2016-09-13T12:42:31.074741 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80839], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.430524744] seconds [----] I, [2016-09-13T12:42:31.075065 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80839], Delivering... [----] I, [2016-09-13T12:42:31.086969 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80839], State: [ok], Delivered in [0.011859122] seconds [----] I, [2016-09-13T12:42:31.142733 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80840], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.467635075] seconds [----] I, [2016-09-13T12:42:31.142883 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80840], Delivering... [----] I, [2016-09-13T12:42:31.146551 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80840], State: [ok], Delivered in [0.003657598] seconds [----] I, [2016-09-13T12:42:38.031927 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005976438522338867, :worker_monitor=>2.387766122817993, :worker_dequeue=>0.006278514862060547, :total_time=>2.400386333465576} [----] I, [2016-09-13T12:42:41.741685 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:42:41.759779 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80842], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:42:43.042025 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:42:43.108484 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80842], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.358818935] seconds [----] I, [2016-09-13T12:42:43.108641 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80842], Delivering... [----] I, [2016-09-13T12:42:43.113820 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002641439437866211, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002661466598510742, :pending_vm_jobs=>0.0006840229034423828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004903078079223633} [----] I, [2016-09-13T12:42:43.114154 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80842], State: [ok], Delivered in [0.005486161] seconds [----] I, [2016-09-13T12:42:54.983071 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005351543426513672, :worker_monitor=>1.9091277122497559, :worker_dequeue=>0.011780500411987305, :total_time=>1.9268364906311035} [----] I, [2016-09-13T12:42:56.771688 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:42:56.812684 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80843], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:42:56.920914 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80844], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:42:59.983730 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:42:59 UTC]... [----] I, [2016-09-13T12:43:00.009269 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:42:59 UTC]...Complete [----] I, [2016-09-13T12:43:00.137511 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:43:00.195374 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80844], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.379067424] seconds [----] I, [2016-09-13T12:43:00.195619 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80844], Delivering... [----] I, [2016-09-13T12:43:00.201956 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035500526428222656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003573179244995117, :pending_vm_jobs=>0.0007188320159912109, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005906581878662109} [----] I, [2016-09-13T12:43:00.202311 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80844], State: [ok], Delivered in [0.006696776] seconds [----] I, [2016-09-13T12:43:01.263682 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80843], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.489033432] seconds [----] I, [2016-09-13T12:43:01.263827 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80843], Delivering... [----] I, [2016-09-13T12:43:01.274464 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80843], State: [ok], Delivered in [0.010526251] seconds [----] I, [2016-09-13T12:43:11.691832 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004197835922241211, :worker_monitor=>1.5179705619812012, :worker_dequeue=>0.011905193328857422, :total_time=>1.5344369411468506} [----] I, [2016-09-13T12:43:11.937198 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:43:11.955146 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80845], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:43:16.700362 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:43:17.423973 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80845], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.480945042] seconds [----] I, [2016-09-13T12:43:17.424221 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80845], Delivering... [----] I, [2016-09-13T12:43:17.432771 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004353523254394531, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004381656646728516, :pending_vm_jobs=>0.0011339187622070312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008043527603149414} [----] I, [2016-09-13T12:43:17.433251 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80845], State: [ok], Delivered in [0.009031805] seconds [----] I, [2016-09-13T12:43:26.966324 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:43:26.984583 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80846], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:43:27.006146 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80847], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:43:27.029370 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80848], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:43:27.075039 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80849], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:43:28.070544 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:43:28.074797 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003674030303955078, :worker_monitor=>1.3395874500274658, :worker_dequeue=>0.011221885681152344, :total_time=>1.3548836708068848} [----] I, [2016-09-13T12:43:28.367113 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80846], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.397533867] seconds [----] I, [2016-09-13T12:43:28.367353 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80846], Delivering... [----] I, [2016-09-13T12:43:28.424195 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80849], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.39089402] seconds [----] I, [2016-09-13T12:43:28.424549 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80849], Delivering... [----] I, [2016-09-13T12:43:28.437808 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.006708383560180664, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.006754875183105469, :pending_vm_jobs=>0.0018036365509033203, :vm_jobs_to_dispatch_count=>0, :total_time=>0.012500524520874023} [----] I, [2016-09-13T12:43:28.438463 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80849], State: [ok], Delivered in [0.013871884] seconds [----] I, [2016-09-13T12:43:28.447191 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80846], State: [ok], Delivered in [0.079799981] seconds [----] I, [2016-09-13T12:43:28.481045 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80847], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.493070448] seconds [----] I, [2016-09-13T12:43:28.481270 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80847], Delivering... [----] I, [2016-09-13T12:43:28.485038 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80847], State: [ok], Delivered in [0.003741693] seconds [----] I, [2016-09-13T12:43:28.510301 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80848], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.498788283] seconds [----] I, [2016-09-13T12:43:28.510545 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80848], Delivering... [----] I, [2016-09-13T12:43:28.515921 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80848], State: [ok], Delivered in [0.005332355] seconds [----] I, [2016-09-13T12:43:33.075247 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:43:33 UTC]... [----] I, [2016-09-13T12:43:33.092394 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:43:33 UTC]...Complete [----] I, [2016-09-13T12:43:42.086011 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:43:42.110692 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80850], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:43:42.121247 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80851], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:43:42.132969 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80852], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:43:44.563614 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:43:44.567526 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004135847091674805, :worker_monitor=>1.4372048377990723, :worker_dequeue=>0.00791621208190918, :total_time=>1.4495694637298584} [----] I, [2016-09-13T12:43:44.641814 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80850], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.545899393] seconds [----] I, [2016-09-13T12:43:44.642001 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80850], Delivering... [----] I, [2016-09-13T12:43:44.648044 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032167434692382812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032346248626708984, :pending_vm_jobs=>0.0007381439208984375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057222843170166016} [----] I, [2016-09-13T12:43:44.648347 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80850], State: [ok], Delivered in [0.006337802] seconds [----] I, [2016-09-13T12:43:44.750366 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80851], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.636478122] seconds [----] I, [2016-09-13T12:43:44.750566 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80851], Delivering... [----] I, [2016-09-13T12:43:44.751395 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T12:43:44.751589 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4597006336 [----] I, [2016-09-13T12:43:44.751676 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4357103616 [----] I, [2016-09-13T12:43:44.751755 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 239902720 [----] I, [2016-09-13T12:43:44.751833 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T12:43:44.751922 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4300378112 [----] I, [2016-09-13T12:43:44.752001 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T12:43:44.752084 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T12:43:44.752156 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 562810880 [----] I, [2016-09-13T12:43:44.752232 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T12:43:44.752308 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6832730112 [----] I, [2016-09-13T12:43:44.752382 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T12:43:44.752484 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T12:43:44.752563 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T12:43:44.752638 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T12:43:44.752715 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T12:43:44.752786 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T12:43:44.752872 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T12:43:44.752953 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T12:43:44.753030 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T12:43:44.753104 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T12:43:44.753182 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272404480 [----] I, [2016-09-13T12:43:44.753259 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55205888 [----] I, [2016-09-13T12:43:44.753353 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217198592 [----] I, [2016-09-13T12:43:44.753447 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6094848 [----] I, [2016-09-13T12:43:44.753533 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142376960 [----] I, [2016-09-13T12:43:44.753607 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3389509632 [----] I, [2016-09-13T12:43:44.753684 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3066920960 [----] I, [2016-09-13T12:43:44.753758 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T12:43:44.753834 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T12:43:44.753917 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T12:43:44.753994 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36663296 [----] I, [2016-09-13T12:43:44.754066 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76939264 [----] I, [2016-09-13T12:43:44.754141 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49627136 [----] I, [2016-09-13T12:43:44.754219 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111931392 [----] I, [2016-09-13T12:43:44.754292 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126566400 [----] I, [2016-09-13T12:43:44.754367 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T12:43:44.754458 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T12:43:44.754541 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T12:43:44.754618 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T12:43:44.754701 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T12:43:44.754779 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T12:43:44.754855 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T12:43:44.754950 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 8192 [----] I, [2016-09-13T12:43:44.755026 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T12:43:44.762070 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80852], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.637310029] seconds [----] I, [2016-09-13T12:43:44.762249 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80852], Delivering... [----] I, [2016-09-13T12:43:44.769068 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:43:41 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163164000], Memory % [3.1], CPU Time [39166.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T12:43:44.769559 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:43:43 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359296000], Memory % [5.28], CPU Time [208662.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T12:43:44.770033 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:43:43 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202687000], Memory % [3.38], CPU Time [155407.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:43:44.770452 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:43:43 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [156259.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:43:44.770896 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:43:41 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [53207.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:43:44.771307 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:43:42 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [247753.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T12:43:44.771707 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:43:43 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347860000], Memory % [5.04], CPU Time [106822.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T12:43:44.772092 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:43:37 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213441000], Memory % [3.51], CPU Time [50414.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T12:43:44.774835 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:43:41 UTC], Process Info: Memory Usage [617459712], Memory Size [1078005760], Proportional Set Size: [458325000], Memory % [7.53], CPU Time [1292.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T12:43:44.777085 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:43:37 UTC], Process Info: Memory Usage [602697728], Memory Size [975233024], Proportional Set Size: [445964000], Memory % [7.35], CPU Time [1171.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T12:43:44.777622 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:43:43 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358595000], Memory % [5.27], CPU Time [217367.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T12:43:44.778078 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:43:43 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [53155.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:43:44.778504 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:43:44 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166763000], Memory % [3.16], CPU Time [40087.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T12:43:44.778789 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80852], State: [ok], Delivered in [0.016546319] seconds [----] I, [2016-09-13T12:43:44.806286 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T12:43:44.806495 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T12:43:44.810037 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T12:43:44.812703 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T12:43:44.815787 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T12:43:44.818816 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T12:43:44.821791 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T12:43:44.824610 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 860 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T12:43:44.827758 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T12:43:44.830857 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T12:43:44.833880 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.9 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T12:43:44.836927 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T12:43:44.840007 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T12:43:44.843304 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T12:43:44.845803 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:43:44.845973 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:43:44.846073 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T12:43:44.850288 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358595000], Memory % [5.27], CPU Time [217357.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T12:43:44.856246 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80851], State: [ok], Delivered in [0.105628229] seconds [----] I, [2016-09-13T12:43:57.147224 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:43:57.178947 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80853], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:43:57.207458 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80854], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:44:00.999736 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:44:01.008022 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003692150115966797, :worker_monitor=>1.3719801902770996, :worker_dequeue=>0.017618179321289062, :total_time=>1.393601417541504} [----] I, [2016-09-13T12:44:01.664404 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80854], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.478044726] seconds [----] I, [2016-09-13T12:44:01.664636 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80854], Delivering... [----] I, [2016-09-13T12:44:01.671515 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003563404083251953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035905838012695312, :pending_vm_jobs=>0.0008258819580078125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0064661502838134766} [----] I, [2016-09-13T12:44:01.671834 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80854], State: [ok], Delivered in [0.007201107] seconds [----] I, [2016-09-13T12:44:01.687255 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80853], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.534066279] seconds [----] I, [2016-09-13T12:44:01.687468 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80853], Delivering... [----] I, [2016-09-13T12:44:01.692676 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80853], State: [ok], Delivered in [0.005226378] seconds [----] I, [2016-09-13T12:44:06.008678 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:44:06 UTC]... [----] I, [2016-09-13T12:44:06.030108 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:44:06 UTC]...Complete [----] I, [2016-09-13T12:44:12.220947 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:44:12.241691 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80855], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:44:17.500460 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:44:17.504208 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002871990203857422, :worker_monitor=>1.3192954063415527, :worker_dequeue=>0.00808405876159668, :total_time=>1.3305513858795166} [----] I, [2016-09-13T12:44:18.064991 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80855], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.837038077] seconds [----] I, [2016-09-13T12:44:18.065229 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80855], Delivering... [----] I, [2016-09-13T12:44:18.073138 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004225015640258789, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004250764846801758, :pending_vm_jobs=>0.0010769367218017578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007428407669067383} [----] I, [2016-09-13T12:44:18.073659 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80855], State: [ok], Delivered in [0.008403481] seconds [----] I, [2016-09-13T12:44:27.253390 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:44:27.271570 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80856], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:44:27.288072 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80857], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:44:27.311251 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80858], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:44:27.334395 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80859], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:44:27.524116 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:44:28.178844 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80856], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.92206485] seconds [----] I, [2016-09-13T12:44:28.179121 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80856], Delivering... [----] I, [2016-09-13T12:44:28.196947 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80859], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.880476146] seconds [----] I, [2016-09-13T12:44:28.197145 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80859], Delivering... [----] I, [2016-09-13T12:44:28.202321 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028972625732421875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0029163360595703125, :pending_vm_jobs=>0.0006318092346191406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004860639572143555} [----] I, [2016-09-13T12:44:28.202705 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80859], State: [ok], Delivered in [0.005563907] seconds [----] I, [2016-09-13T12:44:28.225560 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80856], State: [ok], Delivered in [0.046453489] seconds [----] I, [2016-09-13T12:44:28.791572 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80857], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.516019352] seconds [----] I, [2016-09-13T12:44:28.791764 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80857], Delivering... [----] I, [2016-09-13T12:44:28.795005 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80857], State: [ok], Delivered in [0.003224703] seconds [----] I, [2016-09-13T12:44:28.814986 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80858], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.521380487] seconds [----] I, [2016-09-13T12:44:28.815292 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80858], Delivering... [----] I, [2016-09-13T12:44:28.822549 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80858], State: [ok], Delivered in [0.007260596] seconds [----] I, [2016-09-13T12:44:33.707515 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004806995391845703, :worker_monitor=>1.161031723022461, :worker_dequeue=>0.011111974716186523, :total_time=>1.1786763668060303} [----] I, [2016-09-13T12:44:38.708037 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:44:38 UTC]... [----] I, [2016-09-13T12:44:38.773906 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:44:38 UTC]...Complete [----] I, [2016-09-13T12:44:42.351387 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:44:42.398242 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80860], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:44:43.794467 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:44:43.877298 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80860], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.516588718] seconds [----] I, [2016-09-13T12:44:43.877452 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80860], Delivering... [----] I, [2016-09-13T12:44:43.883736 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003324747085571289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033452510833740234, :pending_vm_jobs=>0.0008039474487304688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00597071647644043} [----] I, [2016-09-13T12:44:43.884112 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80860], State: [ok], Delivered in [0.006658046] seconds [----] I, [2016-09-13T12:44:50.386348 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003959178924560547, :worker_monitor=>1.5756757259368896, :worker_dequeue=>0.00704193115234375, :total_time=>1.5871431827545166} [----] I, [2016-09-13T12:44:57.414833 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:44:57.443412 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80861], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:44:57.466049 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80862], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:45:00.410236 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:45:00.454707 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80862], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.003203012] seconds [----] I, [2016-09-13T12:45:00.454986 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80862], Delivering... [----] I, [2016-09-13T12:45:00.462710 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00405573844909668, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004099130630493164, :pending_vm_jobs=>0.0008311271667480469, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00722503662109375} [----] I, [2016-09-13T12:45:00.463178 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80862], State: [ok], Delivered in [0.008194121] seconds [----] I, [2016-09-13T12:45:02.010785 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80861], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.591041657] seconds [----] I, [2016-09-13T12:45:02.010977 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80861], Delivering... [----] I, [2016-09-13T12:45:02.015544 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80861], State: [ok], Delivered in [0.004546559] seconds [----] I, [2016-09-13T12:45:07.000261 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0029327869415283203, :worker_monitor=>1.5724327564239502, :worker_dequeue=>0.01003885269165039, :total_time=>1.5856726169586182} [----] I, [2016-09-13T12:45:12.000906 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:45:12 UTC]... [----] I, [2016-09-13T12:45:12.025658 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:45:12 UTC]...Complete [----] I, [2016-09-13T12:45:12.481227 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:45:12.523048 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80863], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:45:17.167788 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:45:17.655994 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80863], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.167850372] seconds [----] I, [2016-09-13T12:45:17.656334 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80863], Delivering... [----] I, [2016-09-13T12:45:17.667650 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0053863525390625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005426883697509766, :pending_vm_jobs=>0.0015301704406738281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009685754776000977} [----] I, [2016-09-13T12:45:17.668278 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80863], State: [ok], Delivered in [0.01192916] seconds [----] I, [2016-09-13T12:45:23.569480 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0065042972564697266, :worker_monitor=>1.3813767433166504, :worker_dequeue=>0.008033275604248047, :total_time=>1.396305799484253} [----] I, [2016-09-13T12:45:27.531437 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:45:27.557288 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80864], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:45:27.580213 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80865], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:45:27.603229 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80866], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:45:27.625907 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80867], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:45:28.585281 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:45:28.734891 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80864], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.200223189] seconds [----] I, [2016-09-13T12:45:28.735106 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80864], Delivering... [----] I, [2016-09-13T12:45:28.791695 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80867], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.182818608] seconds [----] I, [2016-09-13T12:45:28.791823 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80867], Delivering... [----] I, [2016-09-13T12:45:28.797566 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003279447555541992, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032999515533447266, :pending_vm_jobs=>0.0008313655853271484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005377769470214844} [----] I, [2016-09-13T12:45:28.797913 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80867], State: [ok], Delivered in [0.006060324] seconds [----] I, [2016-09-13T12:45:28.831776 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80864], State: [ok], Delivered in [0.096629202] seconds [----] I, [2016-09-13T12:45:29.157486 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80865], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.595506224] seconds [----] I, [2016-09-13T12:45:29.157674 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80865], Delivering... [----] I, [2016-09-13T12:45:29.163489 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80865], State: [ok], Delivered in [0.005777515] seconds [----] I, [2016-09-13T12:45:29.267643 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80866], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.678327243] seconds [----] I, [2016-09-13T12:45:29.267919 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80866], Delivering... [----] I, [2016-09-13T12:45:29.274917 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80866], State: [ok], Delivered in [0.006977166] seconds [----] I, [2016-09-13T12:45:39.827760 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0030488967895507812, :worker_monitor=>1.205815315246582, :worker_dequeue=>0.009425640106201172, :total_time=>1.2186484336853027} [----] I, [2016-09-13T12:45:42.678697 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:45:42.701286 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80868], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:45:44.828283 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:45:44 UTC]... [----] I, [2016-09-13T12:45:44.862345 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:45:44 UTC]...Complete [----] I, [2016-09-13T12:45:44.874209 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:45:44.975396 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80868], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.287943572] seconds [----] I, [2016-09-13T12:45:44.975626 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80868], Delivering... [----] I, [2016-09-13T12:45:44.982406 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036742687225341797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003693103790283203, :pending_vm_jobs=>0.0008490085601806641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006409883499145508} [----] I, [2016-09-13T12:45:44.982847 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80868], State: [ok], Delivered in [0.007212452] seconds [----] I, [2016-09-13T12:45:56.189572 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004429817199707031, :worker_monitor=>1.2901427745819092, :worker_dequeue=>0.0064465999603271484, :total_time=>1.3013427257537842} [----] I, [2016-09-13T12:45:57.714127 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:45:57.735937 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80869], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:45:57.758933 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80870], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:46:01.203079 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:46:02.101342 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80870], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.358585324] seconds [----] I, [2016-09-13T12:46:02.101575 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80870], Delivering... [----] I, [2016-09-13T12:46:02.108142 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034275054931640625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003459930419921875, :pending_vm_jobs=>0.00084686279296875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006178617477416992} [----] I, [2016-09-13T12:46:02.108561 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80870], State: [ok], Delivered in [0.006982259] seconds [----] I, [2016-09-13T12:46:02.347472 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80869], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.627807131] seconds [----] I, [2016-09-13T12:46:02.347784 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80869], Delivering... [----] I, [2016-09-13T12:46:02.356329 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80869], State: [ok], Delivered in [0.008539718] seconds [----] I, [2016-09-13T12:46:12.410953 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005486011505126953, :worker_monitor=>1.1642286777496338, :worker_dequeue=>0.013418912887573242, :total_time=>1.1835212707519531} [----] I, [2016-09-13T12:46:12.772682 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:46:12.794230 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80871], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:46:17.411622 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:46:17 UTC]... [----] I, [2016-09-13T12:46:17.451367 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:46:17 UTC]...Complete [----] I, [2016-09-13T12:46:17.559516 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:46:18.247128 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80871], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.467473051] seconds [----] I, [2016-09-13T12:46:18.247322 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80871], Delivering... [----] I, [2016-09-13T12:46:18.253784 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003500223159790039, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003519296646118164, :pending_vm_jobs=>0.0007946491241455078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006089210510253906} [----] I, [2016-09-13T12:46:18.254129 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80871], State: [ok], Delivered in [0.006789966] seconds [----] I, [2016-09-13T12:46:27.808463 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:46:27.824640 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80872], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:46:27.839545 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80873], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:46:27.863886 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80874], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:46:27.897064 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80875], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:46:28.808711 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:46:28.813137 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003759145736694336, :worker_monitor=>1.2185051441192627, :worker_dequeue=>0.009720563888549805, :total_time=>1.2322971820831299} [----] I, [2016-09-13T12:46:29.332384 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80872], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.518205068] seconds [----] I, [2016-09-13T12:46:29.332654 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80872], Delivering... [----] I, [2016-09-13T12:46:29.354985 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80875], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.485120468] seconds [----] I, [2016-09-13T12:46:29.355155 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80875], Delivering... [----] I, [2016-09-13T12:46:29.361240 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031507015228271484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031685829162597656, :pending_vm_jobs=>0.0007791519165039062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00575566291809082} [----] I, [2016-09-13T12:46:29.361603 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80875], State: [ok], Delivered in [0.006442334] seconds [----] I, [2016-09-13T12:46:29.395036 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80872], State: [ok], Delivered in [0.062391078] seconds [----] I, [2016-09-13T12:46:29.466750 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80873], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.636609425] seconds [----] I, [2016-09-13T12:46:29.466948 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80873], Delivering... [----] I, [2016-09-13T12:46:29.470133 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80873], State: [ok], Delivered in [0.003180774] seconds [----] I, [2016-09-13T12:46:29.481023 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80874], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.633603822] seconds [----] I, [2016-09-13T12:46:29.481213 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80874], Delivering... [----] I, [2016-09-13T12:46:29.486722 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80874], State: [ok], Delivered in [0.005508191] seconds [----] I, [2016-09-13T12:46:42.913393 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:46:42.932154 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80876], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:46:43.855061 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T12:46:44.977139 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:46:44.980068 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0059261322021484375, :log_active_servers=>0.010160207748413086, :worker_monitor=>1.1185479164123535, :worker_dequeue=>0.006136894226074219, :total_time=>1.1411786079406738} [----] I, [2016-09-13T12:46:45.549949 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80876], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.628100793] seconds [----] I, [2016-09-13T12:46:45.550146 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80876], Delivering... [----] I, [2016-09-13T12:46:45.557888 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003718852996826172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037910938262939453, :pending_vm_jobs=>0.0008692741394042969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006523847579956055} [----] I, [2016-09-13T12:46:45.558285 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80876], State: [ok], Delivered in [0.008117089] seconds [----] I, [2016-09-13T12:46:49.980744 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:46:49 UTC]... [----] I, [2016-09-13T12:46:50.006588 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:46:49 UTC]...Complete [----] I, [2016-09-13T12:46:58.349116 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:46:58.373647 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80877], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:46:58.389509 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80878], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:47:01.418546 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:47:01.422375 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004616975784301758, :worker_monitor=>1.366919755935669, :worker_dequeue=>0.008176088333129883, :total_time=>1.380070686340332} [----] I, [2016-09-13T12:47:01.648658 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80878], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.266575396] seconds [----] I, [2016-09-13T12:47:01.649021 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80878], Delivering... [----] I, [2016-09-13T12:47:01.659991 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005853176116943359, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0058825016021728516, :pending_vm_jobs=>0.0014312267303466797, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010354995727539062} [----] I, [2016-09-13T12:47:01.660552 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80878], State: [ok], Delivered in [0.011537209] seconds [----] I, [2016-09-13T12:47:02.630232 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80877], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.272906018] seconds [----] I, [2016-09-13T12:47:02.630599 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80877], Delivering... [----] I, [2016-09-13T12:47:02.637405 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80877], State: [ok], Delivered in [0.006817913] seconds [----] I, [2016-09-13T12:47:13.400601 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:47:13.423976 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80879], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:47:17.705259 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:47:17.712189 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004555463790893555, :worker_monitor=>1.2274203300476074, :worker_dequeue=>0.011428117752075195, :total_time=>1.2438750267028809} [----] I, [2016-09-13T12:47:17.726277 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80879], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.318417299] seconds [----] I, [2016-09-13T12:47:17.726487 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80879], Delivering... [----] I, [2016-09-13T12:47:17.733218 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003487110137939453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003511190414428711, :pending_vm_jobs=>0.0008726119995117188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006304502487182617} [----] I, [2016-09-13T12:47:17.733663 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80879], State: [ok], Delivered in [0.007193363] seconds [----] I, [2016-09-13T12:47:22.712839 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:47:22 UTC]... [----] I, [2016-09-13T12:47:22.731954 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:47:22 UTC]...Complete [----] I, [2016-09-13T12:47:28.438883 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:47:28.470664 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80880], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:47:28.498104 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80881], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:47:28.520723 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80882], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:47:28.543529 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80883], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:47:34.068586 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:47:34.071476 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004956245422363281, :worker_monitor=>1.179323434829712, :worker_dequeue=>0.00635075569152832, :total_time=>1.191004753112793} [----] I, [2016-09-13T12:47:34.898041 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80880], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.453447685] seconds [----] I, [2016-09-13T12:47:34.898186 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80880], Delivering... [----] I, [2016-09-13T12:47:34.943875 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80880], State: [ok], Delivered in [0.045644556] seconds [----] I, [2016-09-13T12:47:34.989731 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80883], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.460377983] seconds [----] I, [2016-09-13T12:47:34.989912 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80883], Delivering... [----] I, [2016-09-13T12:47:34.994537 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025675296783447266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002582550048828125, :pending_vm_jobs=>0.0005347728729248047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004357099533081055} [----] I, [2016-09-13T12:47:34.994844 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80883], State: [ok], Delivered in [0.004928363] seconds [----] I, [2016-09-13T12:47:35.696553 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80881], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.217543727] seconds [----] I, [2016-09-13T12:47:35.697584 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80881], Delivering... [----] I, [2016-09-13T12:47:35.709629 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80881], State: [ok], Delivered in [0.012050824] seconds [----] I, [2016-09-13T12:47:35.732276 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80882], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.224746564] seconds [----] I, [2016-09-13T12:47:35.732512 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80882], Delivering... [----] I, [2016-09-13T12:47:35.739353 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80882], State: [ok], Delivered in [0.006814828] seconds [----] I, [2016-09-13T12:47:43.557561 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:47:43.578087 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80884], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:47:44.161152 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:47:44.795109 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80884], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.230441503] seconds [----] I, [2016-09-13T12:47:44.795284 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80884], Delivering... [----] I, [2016-09-13T12:47:44.801982 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034236907958984375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034513473510742188, :pending_vm_jobs=>0.0008611679077148438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006303071975708008} [----] I, [2016-09-13T12:47:44.802351 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80884], State: [ok], Delivered in [0.007047435] seconds [----] I, [2016-09-13T12:47:50.431956 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004416227340698242, :worker_monitor=>1.2477059364318848, :worker_dequeue=>0.013370275497436523, :total_time=>1.2657783031463623} [----] I, [2016-09-13T12:47:55.432661 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:47:55 UTC]... [----] I, [2016-09-13T12:47:55.453505 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:47:55 UTC]...Complete [----] I, [2016-09-13T12:47:58.590808 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:47:58.628264 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80885], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:47:58.672022 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80886], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:48:00.480599 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:48:01.203269 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80886], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.564377601] seconds [----] I, [2016-09-13T12:48:01.203497 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80886], Delivering... [----] I, [2016-09-13T12:48:01.210055 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033571720123291016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003380298614501953, :pending_vm_jobs=>0.0008027553558349609, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006155490875244141} [----] I, [2016-09-13T12:48:01.210411 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80886], State: [ok], Delivered in [0.006946451] seconds [----] I, [2016-09-13T12:48:02.992698 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80885], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.396603528] seconds [----] I, [2016-09-13T12:48:02.992987 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80885], Delivering... [----] I, [2016-09-13T12:48:02.999189 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80885], State: [ok], Delivered in [0.006176854] seconds [----] I, [2016-09-13T12:48:06.860927 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033159255981445312, :worker_monitor=>1.3624610900878906, :worker_dequeue=>0.009455204010009766, :total_time=>1.3755364418029785} [----] I, [2016-09-13T12:48:13.710795 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:48:13.734962 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80887], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:48:16.887581 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:48:17.306731 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80887], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.588753785] seconds [----] I, [2016-09-13T12:48:17.306990 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80887], Delivering... [----] I, [2016-09-13T12:48:17.314133 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003758668899536133, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003785848617553711, :pending_vm_jobs=>0.0008924007415771484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006689310073852539} [----] I, [2016-09-13T12:48:17.314554 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80887], State: [ok], Delivered in [0.007554632] seconds [----] I, [2016-09-13T12:48:23.186043 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004049062728881836, :worker_monitor=>1.280712366104126, :worker_dequeue=>0.008595705032348633, :total_time=>1.2936673164367676} [----] I, [2016-09-13T12:48:28.186508 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:48:28 UTC]... [----] I, [2016-09-13T12:48:28.202957 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:48:28 UTC]...Complete [----] I, [2016-09-13T12:48:28.749320 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:48:28.792771 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80888], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:48:28.824318 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80889], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:48:28.847507 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80890], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:48:28.870654 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80891], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:48:33.293553 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:48:33.481762 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80888], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.727071074] seconds [----] I, [2016-09-13T12:48:33.481920 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80888], Delivering... [----] I, [2016-09-13T12:48:33.487294 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80891], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.629748745] seconds [----] I, [2016-09-13T12:48:33.487443 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80891], Delivering... [----] I, [2016-09-13T12:48:33.492266 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002690553665161133, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002705097198486328, :pending_vm_jobs=>0.0005512237548828125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004551410675048828} [----] I, [2016-09-13T12:48:33.492577 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80891], State: [ok], Delivered in [0.005140244] seconds [----] I, [2016-09-13T12:48:33.521471 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80888], State: [ok], Delivered in [0.039506655] seconds [----] I, [2016-09-13T12:48:36.042027 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80889], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.238888973] seconds [----] I, [2016-09-13T12:48:36.042255 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80889], Delivering... [----] I, [2016-09-13T12:48:36.045830 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80889], State: [ok], Delivered in [0.003574563] seconds [----] I, [2016-09-13T12:48:36.076148 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80890], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.236962714] seconds [----] I, [2016-09-13T12:48:36.076388 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80890], Delivering... [----] I, [2016-09-13T12:48:36.081943 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80890], State: [ok], Delivered in [0.005544298] seconds [----] I, [2016-09-13T12:48:39.543318 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004651069641113281, :worker_monitor=>1.2342829704284668, :worker_dequeue=>0.005583763122558594, :total_time=>1.244875431060791} [----] I, [2016-09-13T12:48:43.891817 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:48:43.910478 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80892], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:48:43.927369 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80893], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:48:43.938704 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80894], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:48:44.556324 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:48:44.579085 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80892], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.678028955] seconds [----] I, [2016-09-13T12:48:44.579230 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80892], Delivering... [----] I, [2016-09-13T12:48:44.584378 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002621173858642578, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002656221389770508, :pending_vm_jobs=>0.0007069110870361328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004885196685791016} [----] I, [2016-09-13T12:48:44.584748 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80892], State: [ok], Delivered in [0.00549559] seconds [----] I, [2016-09-13T12:48:44.612976 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80893], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.695870481] seconds [----] I, [2016-09-13T12:48:44.613114 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80893], Delivering... [----] I, [2016-09-13T12:48:44.614666 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T12:48:44.614806 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4583800832 [----] I, [2016-09-13T12:48:44.614881 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4343713792 [----] I, [2016-09-13T12:48:44.614936 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 240087040 [----] I, [2016-09-13T12:48:44.614987 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 916455424 [----] I, [2016-09-13T12:48:44.615035 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4286996480 [----] I, [2016-09-13T12:48:44.615082 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T12:48:44.615128 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T12:48:44.615173 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 562991104 [----] I, [2016-09-13T12:48:44.615218 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T12:48:44.615262 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6661226496 [----] I, [2016-09-13T12:48:44.615305 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T12:48:44.615352 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T12:48:44.615396 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T12:48:44.615471 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T12:48:44.615522 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T12:48:44.615569 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T12:48:44.615615 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T12:48:44.615660 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T12:48:44.615705 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T12:48:44.615762 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T12:48:44.615810 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272400384 [----] I, [2016-09-13T12:48:44.615867 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55205888 [----] I, [2016-09-13T12:48:44.615919 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217194496 [----] I, [2016-09-13T12:48:44.615964 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6111232 [----] I, [2016-09-13T12:48:44.616007 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 142376960 [----] I, [2016-09-13T12:48:44.616052 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3403403264 [----] I, [2016-09-13T12:48:44.616095 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3080634368 [----] I, [2016-09-13T12:48:44.616156 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T12:48:44.616209 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T12:48:44.616253 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T12:48:44.616296 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36401152 [----] I, [2016-09-13T12:48:44.616340 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76939264 [----] I, [2016-09-13T12:48:44.616386 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49467392 [----] I, [2016-09-13T12:48:44.616452 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111931392 [----] I, [2016-09-13T12:48:44.616511 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126406656 [----] I, [2016-09-13T12:48:44.616558 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T12:48:44.616605 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T12:48:44.616648 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T12:48:44.616693 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T12:48:44.616739 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T12:48:44.616782 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T12:48:44.616828 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T12:48:44.616889 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T12:48:44.616939 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T12:48:44.643434 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T12:48:44.643583 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T12:48:44.645795 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T12:48:44.647899 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T12:48:44.650543 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T12:48:44.652929 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T12:48:44.654698 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T12:48:44.656606 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 860 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T12:48:44.658446 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T12:48:44.660231 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T12:48:44.662065 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.9 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T12:48:44.663864 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T12:48:44.666317 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T12:48:44.668256 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T12:48:44.670047 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:48:44.670149 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:48:44.670215 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T12:48:44.672826 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [155472.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:48:44.673092 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80893], State: [ok], Delivered in [0.059969109] seconds [----] I, [2016-09-13T12:48:49.571055 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:48:49.670769 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80894], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.739322955] seconds [----] I, [2016-09-13T12:48:49.671003 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80894], Delivering... [----] I, [2016-09-13T12:48:49.681395 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:48:36 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163164000], Memory % [3.1], CPU Time [39176.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T12:48:49.682056 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:48:39 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359296000], Memory % [5.28], CPU Time [208701.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T12:48:49.682644 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:48:38 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202687000], Memory % [3.38], CPU Time [155476.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:48:49.683185 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:48:38 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [156331.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:48:49.683738 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:48:39 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [53224.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:48:49.684298 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:48:28 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [247927.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T12:48:49.684808 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:48:31 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347860000], Memory % [5.04], CPU Time [106842.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T12:48:49.685272 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:48:37 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213441000], Memory % [3.51], CPU Time [50425.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T12:48:49.688503 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:48:32 UTC], Process Info: Memory Usage [604684288], Memory Size [936796160], Proportional Set Size: [445850000], Memory % [7.37], CPU Time [1352.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T12:48:49.690711 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:48:38 UTC], Process Info: Memory Usage [602058752], Memory Size [944414720], Proportional Set Size: [445324000], Memory % [7.34], CPU Time [1234.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T12:48:49.691270 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:48:39 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358595000], Memory % [5.27], CPU Time [217403.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T12:48:49.691811 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:48:38 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [53173.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:48:49.692312 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:48:32 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166763000], Memory % [3.16], CPU Time [40100.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T12:48:49.692670 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80894], State: [ok], Delivered in [0.021669517] seconds [----] I, [2016-09-13T12:48:55.660067 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006211996078491211, :worker_monitor=>1.0718533992767334, :worker_dequeue=>0.005533695220947266, :total_time=>1.083977460861206} [----] I, [2016-09-13T12:48:58.950040 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:48:58.967515 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80895], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:48:58.990677 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80896], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:49:00.660636 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:49:00 UTC]... [----] I, [2016-09-13T12:49:00.685611 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:49:00 UTC]...Complete [----] I, [2016-09-13T12:49:00.698079 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:49:00.844661 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80896], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.871181338] seconds [----] I, [2016-09-13T12:49:00.844898 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80896], Delivering... [----] I, [2016-09-13T12:49:00.851836 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003734588623046875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038061141967773438, :pending_vm_jobs=>0.000843048095703125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006496906280517578} [----] I, [2016-09-13T12:49:00.852253 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80896], State: [ok], Delivered in [0.00736947] seconds [----] I, [2016-09-13T12:49:03.244922 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80895], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.289816359] seconds [----] I, [2016-09-13T12:49:03.245200 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80895], Delivering... [----] I, [2016-09-13T12:49:03.252038 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80895], State: [ok], Delivered in [0.006839314] seconds [----] I, [2016-09-13T12:49:12.152763 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004885673522949219, :worker_monitor=>1.4128646850585938, :worker_dequeue=>0.00878286361694336, :total_time=>1.4268999099731445} [----] I, [2016-09-13T12:49:14.004009 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T12:49:14.027693 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80897], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:49:14.050055 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80898], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:49:17.164268 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:49:17.953152 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80897], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.942184952] seconds [----] I, [2016-09-13T12:49:17.953345 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80897], Delivering... [----] I, [2016-09-13T12:49:17.959680 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033376216888427734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003355741500854492, :pending_vm_jobs=>0.0007748603820800781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005937099456787109} [----] I, [2016-09-13T12:49:17.960010 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80897], State: [ok], Delivered in [0.006661791] seconds [----] I, [2016-09-13T12:49:18.301752 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80898], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.256256976] seconds [----] I, [2016-09-13T12:49:18.301965 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80898], Delivering... [----] I, [2016-09-13T12:49:18.330461 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80899], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T12:49:18.330836 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80898], State: [ok], Delivered in [0.028884321] seconds [----] I, [2016-09-13T12:49:22.182950 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T12:49:22.891494 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [80899], MiqWorker id: [104], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [4.572665412] seconds [----] I, [2016-09-13T12:49:22.891807 #24051:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80899], Delivering... [----] I, [2016-09-13T12:49:22.897628 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T12:49:22.897911 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T12:49:22.898119 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T12:49:22.898378 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T12:49:22.898702 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:23.336053 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:23.653054 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:23.653241 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:24.166908 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:24.474395 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:24.474620 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:24.959548 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:25.258997 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:25.259188 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:25.755576 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:26.095819 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:26.096055 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:26.583194 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:26.886452 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:26.886716 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:27.367376 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:27.690510 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:27.690759 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:28.506901 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004251003265380859, :worker_monitor=>1.3087141513824463, :worker_dequeue=>0.01005244255065918, :total_time=>1.3233561515808105} [----] I, [2016-09-13T12:49:28.568386 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:28.864512 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:28.864692 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:29.066017 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T12:49:29.228744 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80900], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:49:29.272050 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80901], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:49:29.300639 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80902], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:49:29.323582 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80903], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:49:29.330949 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:29.346268 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80904], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:49:29.627190 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:29.627355 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:30.096134 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:30.388785 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:30.388940 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:30.862771 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:31.175592 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:31.175890 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:31.654480 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:31.964363 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:31.964538 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:32.428648 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:32.736599 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:32.736826 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:33.224509 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:33.507450 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:49:33 UTC]... [----] I, [2016-09-13T12:49:33.534772 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:49:33 UTC]...Complete [----] I, [2016-09-13T12:49:33.547746 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:33.547935 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:33.632877 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:49:34.025252 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:34.095111 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80900], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.024305889] seconds [----] I, [2016-09-13T12:49:34.095509 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80900], Delivering... [----] I, [2016-09-13T12:49:34.106385 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80903], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.800088939] seconds [----] I, [2016-09-13T12:49:34.106529 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80903], Delivering... [----] I, [2016-09-13T12:49:34.110188 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002092599868774414, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002105712890625, :pending_vm_jobs=>0.00040650367736816406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003428936004638672} [----] I, [2016-09-13T12:49:34.110435 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80903], State: [ok], Delivered in [0.00388958] seconds [----] I, [2016-09-13T12:49:34.157819 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80900], State: [ok], Delivered in [0.06240705] seconds [----] I, [2016-09-13T12:49:34.176795 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:34.315456 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:34.451371 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:34.584053 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:34.717919 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:34.852794 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:34.987372 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:35.134202 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:35.265511 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:35.399395 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:35.530115 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:35.668096 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:35.806455 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:35.939709 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:36.352379 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80901], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.117914636] seconds [----] I, [2016-09-13T12:49:36.352590 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80901], Delivering... [----] I, [2016-09-13T12:49:36.352995 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:36.355664 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80901], State: [ok], Delivered in [0.003064251] seconds [----] I, [2016-09-13T12:49:36.380707 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80902], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.098900593] seconds [----] I, [2016-09-13T12:49:36.380895 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80902], Delivering... [----] I, [2016-09-13T12:49:36.385167 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80902], State: [ok], Delivered in [0.004271044] seconds [----] I, [2016-09-13T12:49:36.409395 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80904], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.081522798] seconds [----] I, [2016-09-13T12:49:36.409635 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80904], Delivering... [----] I, [2016-09-13T12:49:36.502745 #2928:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 16:49:33 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_17' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 16:49:33.635614') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2927,,2016-09-13 16:49:33 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2936,2016-09-13 16:49:36 UTC,2016-09-13 16:49:36 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2946,,2016-09-13 16:49:36 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 16:49:36 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 16:49:36 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 16:49:35 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2986,,2016-09-13 16:49:33 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3, 2997,,2016-09-13 16:49:29 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 16:49:14.060863')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,7, 3011,,2016-09-13 16:26:31 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1384, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,527531, 3030,,2016-09-13 16:26:29 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1386, 3054,,2016-09-13 15:56:23 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3193, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,527529, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,527529, 3160,,2016-09-13 15:26:14 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,5002, 24059,,2016-09-13 16:49:22 UTC,"SELECT ""authentications"".* FROM ""authentications"" WHERE ""authentications"".""resource_id"" = $1 AND ""authentications"".""resource_type"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,13, 17563,,2016-09-13 16:26:26 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1390, 27056,,2016-09-13 16:26:24 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1391, 28888,,2016-09-13 15:56:27 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3188, ACTIVITY_STATS_CSV [----] I, [2016-09-13T12:49:36.503178 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80904], State: [ok], Delivered in [0.093534991] seconds [----] I, [2016-09-13T12:49:36.507796 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:36.646306 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:36.783192 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:36.932235 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:37.071748 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:37.210975 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:37.350163 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:37.489890 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:37.633891 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:37.782133 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:37.922683 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:38.072735 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:38.214593 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:38.355578 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:38.490272 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:38.631826 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:39.074144 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:44.359080 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:49:44.386580 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80905], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:49:45.084965 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:49:45.089830 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004679203033447266, :worker_monitor=>1.4195265769958496, :worker_dequeue=>0.01078033447265625, :total_time=>1.4353716373443604} [----] I, [2016-09-13T12:49:45.215168 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80905], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.849217746] seconds [----] I, [2016-09-13T12:49:45.215371 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80905], Delivering... [----] I, [2016-09-13T12:49:45.221863 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003464937210083008, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034873485565185547, :pending_vm_jobs=>0.0008378028869628906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006085634231567383} [----] I, [2016-09-13T12:49:45.222308 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80905], State: [ok], Delivered in [0.00692662] seconds [----] I, [2016-09-13T12:49:45.246482 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:45.386211 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:45.529381 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:45.667440 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:45.808456 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:45.956664 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:46.094653 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:46.233531 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:46.378547 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:46.517817 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:46.661675 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:46.808040 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:46.946757 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:47.094006 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:47.230692 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:47.368974 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:47.680124 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:47.834866 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:47.980286 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:48.131954 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:48.271061 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:48.448699 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:48.591244 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:48.733386 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:48.875762 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:49.020172 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:49.157834 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:49.300113 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:49.440937 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:49.589523 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:49.725206 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:49.857294 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:49.995298 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:50.377788 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:50.531163 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:50.671592 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:50.814183 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:50.951002 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:51.090119 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:51.232181 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:51.376149 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:51.516591 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:51.658896 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:51.800969 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:51.938301 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:52.076100 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:52.216796 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:52.364332 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:52.503738 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:52.644321 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:53.032511 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:53.196901 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:53.332761 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:53.478378 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:53.614907 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:53.756193 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:53.895270 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:54.040631 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:54.196325 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:54.335189 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:54.480057 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:54.616287 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:54.752121 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:54.896677 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:55.031807 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:55.166911 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:55.303256 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:55.659778 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:55.830784 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:55.979300 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:56.111951 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:56.255066 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:56.389227 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:56.533338 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:56.679822 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:56.818123 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:56.951305 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:57.091573 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:57.246214 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:57.384379 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:57.527213 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:57.681981 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:57.822781 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:57.963790 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:58.442796 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:58.595307 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:58.732712 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:58.880338 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:59.019325 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:59.162737 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:59.305630 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:59.401074 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:49:59.432798 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80906], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:49:59.445701 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:59.461180 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80907], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:49:59.584162 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:59.721871 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:49:59.863158 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:00.000954 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:00.136042 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:00.279921 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:00.424365 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:00.568762 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:00.707322 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:01.112349 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:01.269477 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:01.339900 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:50:01.343634 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0047054290771484375, :worker_monitor=>1.2132174968719482, :worker_dequeue=>0.008197307586669922, :total_time=>1.2264466285705566} [----] I, [2016-09-13T12:50:01.375251 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80907], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.932334824] seconds [----] I, [2016-09-13T12:50:01.375531 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80907], Delivering... [----] I, [2016-09-13T12:50:01.383236 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003837108612060547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038611888885498047, :pending_vm_jobs=>0.0009558200836181641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007200479507446289} [----] I, [2016-09-13T12:50:01.383782 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80907], State: [ok], Delivered in [0.008245591] seconds [----] I, [2016-09-13T12:50:01.406499 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:01.544623 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:01.696527 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:01.846690 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:01.983359 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:02.131022 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:02.271587 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:02.411101 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:02.548710 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:02.691197 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:02.835042 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:02.973625 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:03.114526 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:03.252488 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:03.390386 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:03.507944 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80906], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.101511759] seconds [----] I, [2016-09-13T12:50:03.508145 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80906], Delivering... [----] I, [2016-09-13T12:50:03.512814 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80906], State: [ok], Delivered in [0.004664878] seconds [----] I, [2016-09-13T12:50:03.900034 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:04.046575 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:04.189629 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:04.321386 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:04.458586 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:04.600711 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:04.740216 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:04.878396 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:05.019314 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:05.154639 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:05.298740 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:05.434930 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:05.576176 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:05.710842 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:05.857135 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:05.997763 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:06.140334 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:06.344197 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:50:06 UTC]... [----] I, [2016-09-13T12:50:06.357727 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:50:06 UTC]...Complete [----] I, [2016-09-13T12:50:06.538112 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:06.702541 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:06.848231 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:06.992242 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:07.135461 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:07.280599 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:07.417924 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:07.608787 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:07.761679 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:07.899827 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:08.038153 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:08.172770 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:08.311804 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:08.456013 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:14.481106 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:50:14.512769 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80908], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:50:14.529611 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80909], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:50:14.546774 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80910], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:50:14.570059 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80911], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:50:14.580586 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80912], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:50:14.592179 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80913], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:50:14.609197 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:14.750503 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:14.886279 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:15.297943 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:15.475477 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:15.612027 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:15.749613 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:15.892238 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:16.030664 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:16.173165 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:16.316806 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:16.461575 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:16.602888 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:16.741632 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:16.878887 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:17.022148 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:17.161776 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:17.301010 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:17.437910 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:17.576115 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:17.668178 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 6 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:50:17.671115 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004973888397216797, :worker_monitor=>1.272454023361206, :worker_dequeue=>0.006472587585449219, :total_time=>1.2842435836791992} [----] I, [2016-09-13T12:50:18.081278 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:18.236906 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:18.383610 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:18.478708 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80913], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.893062241] seconds [----] I, [2016-09-13T12:50:18.478939 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80913], Delivering... [----] I, [2016-09-13T12:50:18.485617 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036077499389648438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003641843795776367, :pending_vm_jobs=>0.0007572174072265625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006276369094848633} [----] I, [2016-09-13T12:50:18.485964 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80913], State: [ok], Delivered in [0.007020857] seconds [----] I, [2016-09-13T12:50:18.527880 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:18.564119 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80908], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.076573502] seconds [----] I, [2016-09-13T12:50:18.564309 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80908], Delivering... [----] I, [2016-09-13T12:50:18.588174 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80914], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 16:50:18 UTC] [----] I, [2016-09-13T12:50:18.604196 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80915], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 16:50:18 UTC] [----] I, [2016-09-13T12:50:18.604568 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80908], State: [ok], Delivered in [0.040250483] seconds [----] I, [2016-09-13T12:50:18.626748 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80909], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_all_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.109601519] seconds [----] I, [2016-09-13T12:50:18.626945 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80909], Delivering... [----] I, [2016-09-13T12:50:18.644258 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80916], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 16:50:18 UTC] [----] I, [2016-09-13T12:50:18.655837 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80910], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.120789226] seconds [----] I, [2016-09-13T12:50:18.656045 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80910], Delivering... [----] I, [2016-09-13T12:50:18.658644 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80910], State: [ok], Delivered in [0.002580169] seconds [----] I, [2016-09-13T12:50:18.661215 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80917], id: [], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [2016-03-17 16:50:18 UTC] [----] I, [2016-09-13T12:50:18.661565 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80909], State: [ok], Delivered in [0.03461575] seconds [----] I, [2016-09-13T12:50:18.670633 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:18.683893 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80911], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.130185399] seconds [----] I, [2016-09-13T12:50:18.684077 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80911], Delivering... [----] I, [2016-09-13T12:50:18.689562 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80912], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.113287026] seconds [----] I, [2016-09-13T12:50:18.689729 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80912], Delivering... [----] I, [2016-09-13T12:50:18.693646 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80911], State: [ok], Delivered in [0.009552723] seconds [----] I, [2016-09-13T12:50:18.695737 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80912], State: [ok], Delivered in [0.0059859] seconds [----] I, [2016-09-13T12:50:18.811804 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:18.959482 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:19.103972 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:19.253638 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:19.388706 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:19.530027 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:19.668707 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:19.807736 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:19.956199 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:20.103572 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:20.247476 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:20.389168 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:20.817316 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:20.968364 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:21.107454 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:21.258517 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:21.403185 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:21.550191 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:21.688215 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:21.830146 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:21.967701 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:22.106731 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:22.244962 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:22.394967 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:22.535940 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:22.679775 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:22.682411 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:50:22.823658 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:22.962898 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T12:50:23.099387 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T12:50:23.300914 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T12:50:23.301157 #24051:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T12:50:23.301353 #24051:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T12:50:23.301437 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T12:50:23.301528 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T12:50:23.323653 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T12:50:23.323949 #24051:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [80899], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T12:50:23.324115 #24051:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T12:50:23.324263 #24051:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T12:50:23.324375 #24051:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80899], State: [error], Delivered in [60.432624185] seconds [----] I, [2016-09-13T12:50:24.735482 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80914], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 16:50:18 UTC], Dequeued in: [6.163842004] seconds [----] I, [2016-09-13T12:50:24.735615 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80914], Delivering... [----] I, [2016-09-13T12:50:24.735880 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 16:50:18 UTC]... [----] I, [2016-09-13T12:50:24.738244 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T12:50:24.739897 #2928:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 16:50:18 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T12:50:24.740117 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80914], State: [ok], Delivered in [0.004497691] seconds [----] I, [2016-09-13T12:50:24.753612 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80915], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 16:50:18 UTC], Dequeued in: [6.158674115] seconds [----] I, [2016-09-13T12:50:24.753719 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80915], Delivering... [----] I, [2016-09-13T12:50:24.753906 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 16:50:18 UTC]... [----] I, [2016-09-13T12:50:24.755537 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_in_batches) Purging 100000 Vmdb database metrics. [----] I, [2016-09-13T12:50:24.756788 #2937:34713c] INFO -- : MIQ(VmdbDatabaseMetric.purge_by_date) Purging daily metrics older than [2016-03-17 16:50:18 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T12:50:24.756983 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80915], State: [ok], Delivered in [0.003254816] seconds [----] I, [2016-09-13T12:50:24.799857 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80916], MiqWorker id: [13], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_hourly], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 16:50:18 UTC], Dequeued in: [6.166450873] seconds [----] I, [2016-09-13T12:50:24.799987 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80916], Delivering... [----] I, [2016-09-13T12:50:24.800199 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 16:50:18 UTC]... [----] I, [2016-09-13T12:50:24.802166 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T12:50:24.805827 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80917], MiqWorker id: [14], Zone: [], Role: [database_operations], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbMetric.purge_daily], Timeout: [600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [2016-03-17 16:50:18 UTC], Dequeued in: [6.155298369] seconds [----] I, [2016-09-13T12:50:24.805994 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80917], Delivering... [----] I, [2016-09-13T12:50:24.806256 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 16:50:18 UTC]... [----] I, [2016-09-13T12:50:24.807951 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_in_batches) Purging 100000 Vmdb metrics. [----] I, [2016-09-13T12:50:24.847456 #2937:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging daily metrics older than [2016-03-17 16:50:18 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T12:50:24.847743 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80917], State: [ok], Delivered in [0.041743369] seconds [----] I, [2016-09-13T12:50:24.859733 #2928:34713c] INFO -- : MIQ(VmdbMetric.purge_by_date) Purging hourly metrics older than [2016-03-17 16:50:18 UTC]...Complete - Deleted 0 records [----] I, [2016-09-13T12:50:24.860093 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80916], State: [ok], Delivered in [0.060093541] seconds [----] I, [2016-09-13T12:50:29.604365 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:50:29.622345 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80918], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:50:29.645326 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80919], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:50:29.662005 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80920], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:50:29.685184 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80921], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:50:34.212903 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:50:34.218148 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004034757614135742, :worker_monitor=>1.498255729675293, :worker_dequeue=>0.013775348663330078, :total_time=>1.5163664817810059} [----] I, [2016-09-13T12:50:34.611400 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80918], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.002191659] seconds [----] I, [2016-09-13T12:50:34.611684 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80918], Delivering... [----] I, [2016-09-13T12:50:34.675127 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80918], State: [ok], Delivered in [0.063399465] seconds [----] I, [2016-09-13T12:50:34.702411 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80921], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.03491519] seconds [----] I, [2016-09-13T12:50:34.702631 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80921], Delivering... [----] I, [2016-09-13T12:50:34.708867 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003274202346801758, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032956600189208984, :pending_vm_jobs=>0.0007901191711425781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005868196487426758} [----] I, [2016-09-13T12:50:34.709255 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80921], State: [ok], Delivered in [0.006618229] seconds [----] I, [2016-09-13T12:50:36.931111 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80919], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.303179849] seconds [----] I, [2016-09-13T12:50:36.931293 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80919], Delivering... [----] I, [2016-09-13T12:50:36.934626 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80919], State: [ok], Delivered in [0.003319928] seconds [----] I, [2016-09-13T12:50:36.936907 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80920], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.283108006] seconds [----] I, [2016-09-13T12:50:36.937161 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80920], Delivering... [----] I, [2016-09-13T12:50:36.942207 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80920], State: [ok], Delivered in [0.005040305] seconds [----] I, [2016-09-13T12:50:39.218828 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:50:39 UTC]... [----] I, [2016-09-13T12:50:39.239273 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:50:39 UTC]...Complete [----] I, [2016-09-13T12:50:44.698348 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:50:44.727700 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80922], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:50:51.095412 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:50:51.100655 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004520893096923828, :worker_monitor=>1.7220878601074219, :worker_dequeue=>0.010573625564575195, :total_time=>1.737534761428833} [----] I, [2016-09-13T12:50:51.846397 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80922], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.141898909] seconds [----] I, [2016-09-13T12:50:51.846632 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80922], Delivering... [----] I, [2016-09-13T12:50:51.855044 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0045697689056396484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004597902297973633, :pending_vm_jobs=>0.0012392997741699219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008006572723388672} [----] I, [2016-09-13T12:50:51.855472 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80922], State: [ok], Delivered in [0.008792924] seconds [----] I, [2016-09-13T12:50:59.739591 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:50:59.754775 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80923], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:50:59.783568 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80924], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:51:01.121669 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:51:01.932764 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80924], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.172623166] seconds [----] I, [2016-09-13T12:51:01.933011 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80924], Delivering... [----] I, [2016-09-13T12:51:01.939940 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038213729858398438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003841400146484375, :pending_vm_jobs=>0.0008342266082763672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006498813629150391} [----] I, [2016-09-13T12:51:01.940332 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80924], State: [ok], Delivered in [0.007323494] seconds [----] I, [2016-09-13T12:51:04.051993 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80923], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.307923224] seconds [----] I, [2016-09-13T12:51:04.052137 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80923], Delivering... [----] I, [2016-09-13T12:51:04.055512 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80923], State: [ok], Delivered in [0.003374627] seconds [----] I, [2016-09-13T12:51:07.652960 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004405498504638672, :worker_monitor=>1.5112762451171875, :worker_dequeue=>0.009051322937011719, :total_time=>1.5250980854034424} [----] I, [2016-09-13T12:51:12.653647 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:51:12 UTC]... [----] I, [2016-09-13T12:51:12.674821 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:51:12 UTC]...Complete [----] I, [2016-09-13T12:51:14.794853 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:51:14.812061 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80925], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:51:17.700624 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:51:18.138260 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80925], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.336171789] seconds [----] I, [2016-09-13T12:51:18.138502 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80925], Delivering... [----] I, [2016-09-13T12:51:18.145342 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037543773651123047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00377655029296875, :pending_vm_jobs=>0.0007946491241455078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006459236145019531} [----] I, [2016-09-13T12:51:18.145744 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80925], State: [ok], Delivered in [0.007239727] seconds [----] I, [2016-09-13T12:51:23.861917 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0051043033599853516, :worker_monitor=>1.140695571899414, :worker_dequeue=>0.010093927383422852, :total_time=>1.156257152557373} [----] I, [2016-09-13T12:51:29.825312 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:51:29.848227 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80926], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:51:29.865388 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80927], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:51:29.887873 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80928], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:51:29.905545 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80929], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:51:33.884859 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:51:34.116911 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80926], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.283419942] seconds [----] I, [2016-09-13T12:51:34.117116 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80926], Delivering... [----] I, [2016-09-13T12:51:34.173967 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80929], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.28246847] seconds [----] I, [2016-09-13T12:51:34.174145 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80929], Delivering... [----] I, [2016-09-13T12:51:34.179547 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80926], State: [ok], Delivered in [0.062406176] seconds [----] I, [2016-09-13T12:51:34.180569 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032587051391601562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003276824951171875, :pending_vm_jobs=>0.0008025169372558594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00594782829284668} [----] I, [2016-09-13T12:51:34.180944 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80929], State: [ok], Delivered in [0.006785762] seconds [----] I, [2016-09-13T12:51:34.203229 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80927], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.349339039] seconds [----] I, [2016-09-13T12:51:34.203405 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80927], Delivering... [----] I, [2016-09-13T12:51:34.206661 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80927], State: [ok], Delivered in [0.003244297] seconds [----] I, [2016-09-13T12:51:34.208447 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80928], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.335234092] seconds [----] I, [2016-09-13T12:51:34.208637 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80928], Delivering... [----] I, [2016-09-13T12:51:34.213529 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80928], State: [ok], Delivered in [0.004884719] seconds [----] I, [2016-09-13T12:51:40.243250 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005490541458129883, :worker_monitor=>1.3283495903015137, :worker_dequeue=>0.018900394439697266, :total_time=>1.3531394004821777} [----] I, [2016-09-13T12:51:44.916831 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:51:44.946366 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80930], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:51:45.244349 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:51:45 UTC]... [----] I, [2016-09-13T12:51:45.259449 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:51:45 UTC]...Complete [----] I, [2016-09-13T12:51:45.363157 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T12:51:45.366469 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:51:46.282735 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80930], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.361338648] seconds [----] I, [2016-09-13T12:51:46.282949 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80930], Delivering... [----] I, [2016-09-13T12:51:46.289534 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033974647521972656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003415346145629883, :pending_vm_jobs=>0.0008587837219238281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0061647891998291016} [----] I, [2016-09-13T12:51:46.289943 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80930], State: [ok], Delivered in [0.006988303] seconds [----] I, [2016-09-13T12:51:56.593135 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002460002899169922, :worker_monitor=>1.1981322765350342, :worker_dequeue=>0.009624719619750977, :total_time=>1.210435390472412} [----] I, [2016-09-13T12:51:59.956523 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:51:59.974041 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80931], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:51:59.985463 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80932], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:52:01.603095 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:52:02.437407 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80932], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.458032958] seconds [----] I, [2016-09-13T12:52:02.437637 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80932], Delivering... [----] I, [2016-09-13T12:52:02.446782 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005183696746826172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00521087646484375, :pending_vm_jobs=>0.0013723373413085938, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00867915153503418} [----] I, [2016-09-13T12:52:02.447163 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80932], State: [ok], Delivered in [0.009523286] seconds [----] I, [2016-09-13T12:52:04.347603 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80931], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.386453406] seconds [----] I, [2016-09-13T12:52:04.347892 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80931], Delivering... [----] I, [2016-09-13T12:52:04.352750 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80931], State: [ok], Delivered in [0.00486809] seconds [----] I, [2016-09-13T12:52:12.938155 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040471553802490234, :worker_monitor=>1.304612398147583, :worker_dequeue=>0.007326602935791016, :total_time=>1.3163461685180664} [----] I, [2016-09-13T12:52:14.997708 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:52:15.020368 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80933], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:52:17.938689 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:52:17 UTC]... [----] I, [2016-09-13T12:52:17.957470 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:52:17 UTC]...Complete [----] I, [2016-09-13T12:52:17.973503 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:52:18.563299 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80933], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.558862159] seconds [----] I, [2016-09-13T12:52:18.563532 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80933], Delivering... [----] I, [2016-09-13T12:52:18.570760 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037136077880859375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038068294525146484, :pending_vm_jobs=>0.0009987354278564453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006848573684692383} [----] I, [2016-09-13T12:52:18.571159 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80933], State: [ok], Delivered in [0.007624787] seconds [----] I, [2016-09-13T12:52:29.468515 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004236459732055664, :worker_monitor=>1.4596068859100342, :worker_dequeue=>0.010432004928588867, :total_time=>1.474597692489624} [----] I, [2016-09-13T12:52:30.034632 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:52:30.049225 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80934], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:52:30.066688 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80935], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:52:30.077595 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80936], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:52:30.089201 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80937], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:52:34.477268 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:52:34.792634 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80934], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.754006254] seconds [----] I, [2016-09-13T12:52:34.792949 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80934], Delivering... [----] I, [2016-09-13T12:52:34.849404 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80934], State: [ok], Delivered in [0.056452543] seconds [----] I, [2016-09-13T12:52:34.878304 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80937], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.796141364] seconds [----] I, [2016-09-13T12:52:34.878517 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80937], Delivering... [----] I, [2016-09-13T12:52:34.884972 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034246444702148438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003444194793701172, :pending_vm_jobs=>0.0007936954498291016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006071567535400391} [----] I, [2016-09-13T12:52:34.885350 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80937], State: [ok], Delivered in [0.006822638] seconds [----] I, [2016-09-13T12:52:34.912280 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80935], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.858432798] seconds [----] I, [2016-09-13T12:52:34.912479 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80935], Delivering... [----] I, [2016-09-13T12:52:34.915481 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80935], State: [ok], Delivered in [0.003000401] seconds [----] I, [2016-09-13T12:52:34.946805 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80936], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.873687515] seconds [----] I, [2016-09-13T12:52:34.946997 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80936], Delivering... [----] I, [2016-09-13T12:52:34.951392 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80936], State: [ok], Delivered in [0.004387523] seconds [----] I, [2016-09-13T12:52:45.098964 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:52:45.121789 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80938], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:52:45.677655 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:52:45.681864 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038421154022216797, :worker_monitor=>1.1768620014190674, :worker_dequeue=>0.009994983673095703, :total_time=>1.1910555362701416} [----] I, [2016-09-13T12:52:46.150542 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80938], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.046689275] seconds [----] I, [2016-09-13T12:52:46.150766 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80938], Delivering... [----] I, [2016-09-13T12:52:46.155784 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00261688232421875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002633333206176758, :pending_vm_jobs=>0.0005881786346435547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0046422481536865234} [----] I, [2016-09-13T12:52:46.156087 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80938], State: [ok], Delivered in [0.005336737] seconds [----] I, [2016-09-13T12:52:50.682514 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:52:50 UTC]... [----] I, [2016-09-13T12:52:50.704803 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:52:50 UTC]...Complete [----] I, [2016-09-13T12:53:00.132543 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:53:00.155808 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80939], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:53:00.184804 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80940], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:53:02.954744 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:53:02.959530 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004111051559448242, :worker_monitor=>2.079937219619751, :worker_dequeue=>0.010779857635498047, :total_time=>2.0951738357543945} [----] I, [2016-09-13T12:53:03.305757 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80940], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.146695662] seconds [----] I, [2016-09-13T12:53:03.306016 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80940], Delivering... [----] I, [2016-09-13T12:53:03.313766 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004104137420654297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0041315555572509766, :pending_vm_jobs=>0.001033782958984375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007275581359863281} [----] I, [2016-09-13T12:53:03.314257 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80940], State: [ok], Delivered in [0.008238757] seconds [----] I, [2016-09-13T12:53:04.922871 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80939], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.787400164] seconds [----] I, [2016-09-13T12:53:04.923058 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80939], Delivering... [----] I, [2016-09-13T12:53:04.927433 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80939], State: [ok], Delivered in [0.004336825] seconds [----] I, [2016-09-13T12:53:15.192220 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:53:15.214078 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80941], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:53:19.486294 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:53:19.489811 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0043065547943115234, :worker_monitor=>1.483720302581787, :worker_dequeue=>0.0077381134033203125, :total_time=>1.4960765838623047} [----] I, [2016-09-13T12:53:20.031465 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80941], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.835123909] seconds [----] I, [2016-09-13T12:53:20.031680 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80941], Delivering... [----] I, [2016-09-13T12:53:20.041289 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004955291748046875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004990577697753906, :pending_vm_jobs=>0.0014696121215820312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009132146835327148} [----] I, [2016-09-13T12:53:20.041880 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80941], State: [ok], Delivered in [0.010166838] seconds [----] I, [2016-09-13T12:53:24.490304 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:53:24 UTC]... [----] I, [2016-09-13T12:53:24.512604 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:53:24 UTC]...Complete [----] I, [2016-09-13T12:53:30.222237 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:53:30.266011 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80942], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:53:30.288901 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80943], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:53:30.311765 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80944], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:53:30.334569 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80945], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:53:36.153772 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:53:36.158866 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041086673736572266, :worker_monitor=>1.601700782775879, :worker_dequeue=>0.010178565979003906, :total_time=>1.6163063049316406} [----] I, [2016-09-13T12:53:36.559087 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80942], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.333100483] seconds [----] I, [2016-09-13T12:53:36.559476 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80942], Delivering... [----] I, [2016-09-13T12:53:36.586592 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80945], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.267105711] seconds [----] I, [2016-09-13T12:53:36.586800 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80945], Delivering... [----] I, [2016-09-13T12:53:36.593991 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037338733673095703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00376129150390625, :pending_vm_jobs=>0.0009286403656005859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00675201416015625} [----] I, [2016-09-13T12:53:36.594363 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80945], State: [ok], Delivered in [0.007552256] seconds [----] I, [2016-09-13T12:53:36.643149 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80942], State: [ok], Delivered in [0.083745619] seconds [----] I, [2016-09-13T12:53:38.140537 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80943], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.868117046] seconds [----] I, [2016-09-13T12:53:38.140784 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80943], Delivering... [----] I, [2016-09-13T12:53:38.144643 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80943], State: [ok], Delivered in [0.003857659] seconds [----] I, [2016-09-13T12:53:38.186645 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80944], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.88880691] seconds [----] I, [2016-09-13T12:53:38.186931 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80944], Delivering... [----] I, [2016-09-13T12:53:38.194011 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80944], State: [ok], Delivered in [0.007061456] seconds [----] I, [2016-09-13T12:53:45.346915 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:53:45.403320 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80946], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:53:45.414189 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80947], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:53:45.425695 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80948], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:53:46.176959 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:53:46.712094 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80946], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.359874365] seconds [----] I, [2016-09-13T12:53:46.712318 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80946], Delivering... [----] I, [2016-09-13T12:53:46.720341 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004077434539794922, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004136323928833008, :pending_vm_jobs=>0.001096963882446289, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0075800418853759766} [----] I, [2016-09-13T12:53:46.720879 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80946], State: [ok], Delivered in [0.008538455] seconds [----] I, [2016-09-13T12:53:46.752039 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80947], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.344074924] seconds [----] I, [2016-09-13T12:53:46.752284 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80947], Delivering... [----] I, [2016-09-13T12:53:46.753744 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T12:53:46.753970 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4634124288 [----] I, [2016-09-13T12:53:46.754077 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4393750528 [----] I, [2016-09-13T12:53:46.754168 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 240373760 [----] I, [2016-09-13T12:53:46.754263 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 960495616 [----] I, [2016-09-13T12:53:46.754356 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4337012736 [----] I, [2016-09-13T12:53:46.754472 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T12:53:46.754575 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T12:53:46.754670 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 563310592 [----] I, [2016-09-13T12:53:46.754765 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T12:53:46.754871 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6825730048 [----] I, [2016-09-13T12:53:46.754964 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T12:53:46.755059 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T12:53:46.755148 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T12:53:46.755235 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T12:53:46.755320 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T12:53:46.755403 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T12:53:46.755517 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T12:53:46.755607 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T12:53:46.755701 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T12:53:46.755811 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T12:53:46.755914 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272412672 [----] I, [2016-09-13T12:53:46.756002 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55218176 [----] I, [2016-09-13T12:53:46.756093 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217194496 [----] I, [2016-09-13T12:53:46.756181 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T12:53:46.756268 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 143077376 [----] I, [2016-09-13T12:53:46.756357 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3352162304 [----] I, [2016-09-13T12:53:46.756464 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3029114880 [----] I, [2016-09-13T12:53:46.756564 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T12:53:46.756656 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T12:53:46.756745 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T12:53:46.756843 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37212160 [----] I, [2016-09-13T12:53:46.756939 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76918784 [----] I, [2016-09-13T12:53:46.757023 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49852416 [----] I, [2016-09-13T12:53:46.757112 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111964160 [----] I, [2016-09-13T12:53:46.757201 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126771200 [----] I, [2016-09-13T12:53:46.757284 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T12:53:46.757368 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T12:53:46.757479 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T12:53:46.757572 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T12:53:46.757664 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T12:53:46.757756 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T12:53:46.757856 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T12:53:46.757945 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T12:53:46.758028 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T12:53:46.769657 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80948], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.352769161] seconds [----] I, [2016-09-13T12:53:46.769965 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80948], Delivering... [----] I, [2016-09-13T12:53:46.783537 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:53:34 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163164000], Memory % [3.1], CPU Time [39187.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T12:53:46.784522 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:53:35 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359294000], Memory % [5.28], CPU Time [208780.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T12:53:46.785513 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:53:35 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [156438.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:53:46.786387 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:53:35 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202687000], Memory % [3.38], CPU Time [155573.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:53:46.787315 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:53:34 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [53240.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:53:46.788235 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:53:30 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [248054.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T12:53:46.789108 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:53:31 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347858000], Memory % [5.04], CPU Time [106858.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T12:53:46.789929 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:53:26 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213440000], Memory % [3.51], CPU Time [50434.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T12:53:46.794778 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:53:33 UTC], Process Info: Memory Usage [650592256], Memory Size [1078210560], Proportional Set Size: [490706000], Memory % [7.93], CPU Time [1503.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T12:53:46.798793 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:53:28 UTC], Process Info: Memory Usage [602263552], Memory Size [957521920], Proportional Set Size: [445523000], Memory % [7.34], CPU Time [1245.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T12:53:46.799720 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:53:35 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358593000], Memory % [5.27], CPU Time [217491.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T12:53:46.800567 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:53:33 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [53190.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:53:46.801270 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:53:32 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166763000], Memory % [3.16], CPU Time [40110.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T12:53:46.801775 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80948], State: [ok], Delivered in [0.031833481] seconds [----] I, [2016-09-13T12:53:46.818025 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T12:53:46.818285 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T12:53:46.822392 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T12:53:46.825370 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T12:53:46.828820 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T12:53:46.832339 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T12:53:46.835853 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T12:53:46.839516 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 860 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T12:53:46.843279 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T12:53:46.847004 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T12:53:46.850667 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.8 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T12:53:46.854308 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T12:53:46.857960 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 175 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T12:53:46.861535 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T12:53:46.865062 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:53:46.865300 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:53:46.865434 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T12:53:46.870655 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358593000], Memory % [5.27], CPU Time [156439.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T12:53:46.871114 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80947], State: [ok], Delivered in [0.118839768] seconds [----] I, [2016-09-13T12:53:52.661475 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0029833316802978516, :server_monitor=>0.07521200180053711, :worker_monitor=>1.39202880859375, :worker_dequeue=>0.009063482284545898, :total_time=>1.4796860218048096} [----] I, [2016-09-13T12:53:57.662026 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:53:57 UTC]... [----] I, [2016-09-13T12:53:57.682933 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:53:57 UTC]...Complete [----] I, [2016-09-13T12:54:00.435483 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:54:00.462776 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80949], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:54:00.477496 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80950], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:54:02.710403 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:54:03.005021 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80950], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.538508997] seconds [----] I, [2016-09-13T12:54:03.005299 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80950], Delivering... [----] I, [2016-09-13T12:54:03.015469 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005040884017944336, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0050754547119140625, :pending_vm_jobs=>0.0015156269073486328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009563446044921875} [----] I, [2016-09-13T12:54:03.016010 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80950], State: [ok], Delivered in [0.010732471] seconds [----] I, [2016-09-13T12:54:05.260770 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80949], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.820658394] seconds [----] I, [2016-09-13T12:54:05.261019 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80949], Delivering... [----] I, [2016-09-13T12:54:05.266970 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80949], State: [ok], Delivered in [0.005926617] seconds [----] I, [2016-09-13T12:54:08.954034 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0028378963470458984, :worker_monitor=>1.2299106121063232, :worker_dequeue=>0.0058367252349853516, :total_time=>1.2388198375701904} [----] I, [2016-09-13T12:54:15.487552 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:54:15.517657 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80951], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:54:18.973777 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:54:19.134990 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80951], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.641304307] seconds [----] I, [2016-09-13T12:54:19.135191 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80951], Delivering... [----] I, [2016-09-13T12:54:19.142348 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034966468811035156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003522157669067383, :pending_vm_jobs=>0.0009272098541259766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0067653656005859375} [----] I, [2016-09-13T12:54:19.142735 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80951], State: [ok], Delivered in [0.007538669] seconds [----] I, [2016-09-13T12:54:25.068846 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003871440887451172, :worker_monitor=>1.0816330909729004, :worker_dequeue=>0.005503416061401367, :total_time=>1.0912768840789795} [----] I, [2016-09-13T12:54:30.069299 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:54:30 UTC]... [----] I, [2016-09-13T12:54:30.094885 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:54:30 UTC]...Complete [----] I, [2016-09-13T12:54:30.528578 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:54:30.540688 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80952], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:54:30.563692 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80953], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:54:30.586600 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80954], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:54:30.597843 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80955], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:54:35.112371 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:54:35.232217 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80952], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.700487959] seconds [----] I, [2016-09-13T12:54:35.232383 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80952], Delivering... [----] I, [2016-09-13T12:54:35.278101 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80955], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.687344786] seconds [----] I, [2016-09-13T12:54:35.278293 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80955], Delivering... [----] I, [2016-09-13T12:54:35.284802 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003263235092163086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033805370330810547, :pending_vm_jobs=>0.0007958412170410156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006099224090576172} [----] I, [2016-09-13T12:54:35.285384 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80955], State: [ok], Delivered in [0.007049227] seconds [----] I, [2016-09-13T12:54:35.307915 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80952], State: [ok], Delivered in [0.075482156] seconds [----] I, [2016-09-13T12:54:35.387141 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80953], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.84189652] seconds [----] I, [2016-09-13T12:54:35.387467 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80953], Delivering... [----] I, [2016-09-13T12:54:35.391773 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80954], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.821407971] seconds [----] I, [2016-09-13T12:54:35.391905 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80954], Delivering... [----] I, [2016-09-13T12:54:35.395065 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80954], State: [ok], Delivered in [0.003158412] seconds [----] I, [2016-09-13T12:54:35.399202 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80953], State: [ok], Delivered in [0.011759907] seconds [----] I, [2016-09-13T12:54:41.487152 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004179716110229492, :worker_monitor=>1.3558619022369385, :worker_dequeue=>0.010929346084594727, :total_time=>1.3713035583496094} [----] I, [2016-09-13T12:54:45.605885 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:54:45.632368 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80956], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:54:46.499034 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:54:47.421149 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80956], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.811353023] seconds [----] I, [2016-09-13T12:54:47.421326 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80956], Delivering... [----] I, [2016-09-13T12:54:47.427569 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003185749053955078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032088756561279297, :pending_vm_jobs=>0.0008099079132080078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005883693695068359} [----] I, [2016-09-13T12:54:47.435283 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80956], State: [ok], Delivered in [0.013920267] seconds [----] I, [2016-09-13T12:54:57.978804 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00414729118347168, :worker_monitor=>1.2767739295959473, :worker_dequeue=>0.016240358352661133, :total_time=>1.2973973751068115} [----] I, [2016-09-13T12:55:00.642452 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:55:00.661003 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80957], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:55:00.689669 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80958], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:55:02.979384 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:55:02 UTC]... [----] I, [2016-09-13T12:55:03.009599 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:55:02 UTC]...Complete [----] I, [2016-09-13T12:55:03.018561 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:55:03.541151 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80958], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.875068069] seconds [----] I, [2016-09-13T12:55:03.541337 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80958], Delivering... [----] I, [2016-09-13T12:55:03.547187 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031697750091552734, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031871795654296875, :pending_vm_jobs=>0.0007121562957763672, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005469799041748047} [----] I, [2016-09-13T12:55:03.547485 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80958], State: [ok], Delivered in [0.006155723] seconds [----] I, [2016-09-13T12:55:05.523942 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80957], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.87740704] seconds [----] I, [2016-09-13T12:55:05.524080 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80957], Delivering... [----] I, [2016-09-13T12:55:05.528935 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80957], State: [ok], Delivered in [0.004813643] seconds [----] I, [2016-09-13T12:55:14.515576 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003131866455078125, :worker_monitor=>1.4721248149871826, :worker_dequeue=>0.010149955749511719, :total_time=>1.485687017440796} [----] I, [2016-09-13T12:55:15.703274 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:55:15.733882 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80959], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:55:19.523654 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:55:19.816355 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80959], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.103984646] seconds [----] I, [2016-09-13T12:55:19.816589 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80959], Delivering... [----] I, [2016-09-13T12:55:19.823448 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003454923629760742, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003556966781616211, :pending_vm_jobs=>0.0008652210235595703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006436824798583984} [----] I, [2016-09-13T12:55:19.823815 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80959], State: [ok], Delivered in [0.007209435] seconds [----] I, [2016-09-13T12:55:30.745537 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:55:30.761211 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80960], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:55:30.807105 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80961], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:55:30.850552 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80962], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:55:30.907625 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80963], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:55:31.004512 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:55:31.009102 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040683746337890625, :worker_monitor=>1.4509661197662354, :worker_dequeue=>0.009802818298339844, :total_time=>1.4651978015899658} [----] I, [2016-09-13T12:55:31.781758 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80960], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.032445147] seconds [----] I, [2016-09-13T12:55:31.781993 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80960], Delivering... [----] I, [2016-09-13T12:55:31.844361 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80960], State: [ok], Delivered in [0.062345445] seconds [----] I, [2016-09-13T12:55:31.869851 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80963], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.013416374] seconds [----] I, [2016-09-13T12:55:31.870030 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80963], Delivering... [----] I, [2016-09-13T12:55:31.875668 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003070831298828125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031003952026367188, :pending_vm_jobs=>0.0008101463317871094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005302906036376953} [----] I, [2016-09-13T12:55:31.875867 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80963], State: [ok], Delivered in [0.00585939] seconds [----] I, [2016-09-13T12:55:32.589759 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80961], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.823942456] seconds [----] I, [2016-09-13T12:55:32.589956 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80961], Delivering... [----] I, [2016-09-13T12:55:32.593705 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80961], State: [ok], Delivered in [0.003741902] seconds [----] I, [2016-09-13T12:55:32.619370 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80962], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.805580287] seconds [----] I, [2016-09-13T12:55:32.619590 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80962], Delivering... [----] I, [2016-09-13T12:55:32.624536 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80962], State: [ok], Delivered in [0.004947154] seconds [----] I, [2016-09-13T12:55:36.009716 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:55:36 UTC]... [----] I, [2016-09-13T12:55:36.029893 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:55:36 UTC]...Complete [----] I, [2016-09-13T12:55:45.919353 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:55:45.938465 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80964], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:55:47.350335 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:55:47.353871 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003791332244873047, :worker_monitor=>1.2818517684936523, :worker_dequeue=>0.0075168609619140625, :total_time=>1.2934563159942627} [----] I, [2016-09-13T12:55:47.664476 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80964], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.73935498] seconds [----] I, [2016-09-13T12:55:47.664669 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80964], Delivering... [----] I, [2016-09-13T12:55:47.671576 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035567283630371094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003615140914916992, :pending_vm_jobs=>0.0008585453033447266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006468772888183594} [----] I, [2016-09-13T12:55:47.671918 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80964], State: [ok], Delivered in [0.007243398] seconds [----] I, [2016-09-13T12:56:00.949869 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:56:00.973236 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80965], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:56:00.996267 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80966], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:56:03.998911 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:56:04.003703 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004737377166748047, :worker_monitor=>1.4923930168151855, :worker_dequeue=>0.010423660278320312, :total_time=>1.5078966617584229} [----] I, [2016-09-13T12:56:04.123341 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80966], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.144279722] seconds [----] I, [2016-09-13T12:56:04.123585 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80966], Delivering... [----] I, [2016-09-13T12:56:04.131663 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0040247440338134766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004100322723388672, :pending_vm_jobs=>0.0010554790496826172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007561206817626953} [----] I, [2016-09-13T12:56:04.132068 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80966], State: [ok], Delivered in [0.008482805] seconds [----] I, [2016-09-13T12:56:05.739343 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80965], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.784812357] seconds [----] I, [2016-09-13T12:56:05.739613 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80965], Delivering... [----] I, [2016-09-13T12:56:05.745677 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80965], State: [ok], Delivered in [0.006045275] seconds [----] I, [2016-09-13T12:56:09.004271 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:56:09 UTC]... [----] I, [2016-09-13T12:56:09.024312 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:56:09 UTC]...Complete [----] I, [2016-09-13T12:56:16.009066 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:56:16.030466 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80967], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:56:20.500069 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:56:20.503713 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0045125484466552734, :worker_monitor=>1.4371771812438965, :worker_dequeue=>0.007876396179199219, :total_time=>1.4500083923339844} [----] I, [2016-09-13T12:56:20.819589 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80967], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.80326185] seconds [----] I, [2016-09-13T12:56:20.819816 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80967], Delivering... [----] I, [2016-09-13T12:56:20.825970 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003378629684448242, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034062862396240234, :pending_vm_jobs=>0.0007348060607910156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005756378173828125} [----] I, [2016-09-13T12:56:20.826338 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80967], State: [ok], Delivered in [0.006498134] seconds [----] I, [2016-09-13T12:56:31.044396 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:56:31.079928 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80968], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:56:31.093489 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80969], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:56:31.116587 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80970], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:56:31.145196 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80971], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:56:36.654221 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [104], PID: [24051], GUID: [ee14426a-79c6-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:56:36.654408 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker] with ID: [104], PID: [24051], GUID: [ee14426a-79c6-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:56:36.682587 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [103], PID: [17555], GUID: [1dd6952c-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:56:36.682748 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher] with ID: [103], PID: [17555], GUID: [1dd6952c-79b6-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:56:36.693703 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:56:36.693873 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqEventHandler] with ID: [12], PID: [2918], GUID: [c655b6de-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:56:36.705134 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:56:36.705285 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [14], PID: [2937], GUID: [c763bdbe-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:56:36.710927 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:56:36.711072 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqGenericWorker] with ID: [13], PID: [2928], GUID: [c6f52fac-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:56:36.722231 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:56:36.722449 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [16], PID: [2957], GUID: [c7fde0a6-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:56:36.727932 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:56:36.728074 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqPriorityWorker] with ID: [15], PID: [2947], GUID: [c7a7f470-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:56:36.739474 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:56:36.739660 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [18], PID: [2978], GUID: [c87e430e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:56:36.763558 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:56:36.763772 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqReportingWorker] with ID: [17], PID: [2967], GUID: [c82f25a8-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:56:36.773731 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:56:36.773958 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqScheduleWorker] with ID: [19], PID: [2989], GUID: [c8ab90a2-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:56:36.796899 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:56:36.797126 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebsocketWorker] with ID: [20], PID: [3003], GUID: [c8d608fa-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:56:36.819687 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:56:36.819969 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqUiWorker] with ID: [21], PID: [3022], GUID: [cc964d2e-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:56:36.854316 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_active_roles [----] I, [2016-09-13T12:56:36.854557 #2763:34713c] INFO -- : MIQ(MiqServer#worker_set_message) Worker [MiqWebServiceWorker] with ID: [22], PID: [3046], GUID: [cce2ed5a-7505-11e6-87c1-fa163e7d01a3] is being requested to sync_config [----] I, [2016-09-13T12:56:36.864470 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:56:36.869225 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0043544769287109375, :worker_monitor=>1.322669506072998, :worker_dequeue=>0.010385751724243164, :total_time=>1.3378348350524902} [----] I, [2016-09-13T12:56:37.202500 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:56:37.202684 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:56:37.202785 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:56:37.305630 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:56:37.305896 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:56:37.306061 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:56:37.379852 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80968], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.327072594] seconds [----] I, [2016-09-13T12:56:37.380035 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80968], Delivering... [----] I, [2016-09-13T12:56:37.410975 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:56:37.411942 #2967:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T12:56:37.412032 #2967:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:56:37.412087 #2967:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:56:37.412134 #2967:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:56:37.412174 #2967:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T12:56:37.412211 #2967:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T12:56:37.412247 #2967:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:56:37.412284 #2967:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T12:56:37.412322 #2967:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:56:37.412363 #2967:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:56:37.412400 #2967:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:56:37.412480 #2967:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:56:37.412529 #2967:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T12:56:37.412567 #2967:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T12:56:37.412601 #2967:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T12:56:37.412637 #2967:34713c] INFO -- : --- [----] I, [2016-09-13T12:56:37.412981 #2967:34713c] INFO -- : :guid: c82f25a8-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:56:37.413151 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:56:37.448156 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80968], State: [ok], Delivered in [0.068099116] seconds [----] I, [2016-09-13T12:56:37.476856 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80971], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.355019568] seconds [----] I, [2016-09-13T12:56:37.477035 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80971], Delivering... [----] I, [2016-09-13T12:56:37.483185 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032045841217041016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032262802124023438, :pending_vm_jobs=>0.00078582763671875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00581669807434082} [----] I, [2016-09-13T12:56:37.483545 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80971], State: [ok], Delivered in [0.006510751] seconds [----] I, [2016-09-13T12:56:37.488346 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:56:37.489173 #2957:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T12:56:37.489251 #2957:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:56:37.489296 #2957:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:56:37.489338 #2957:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:56:37.489374 #2957:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T12:56:37.489407 #2957:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T12:56:37.489497 #2957:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:56:37.489538 #2957:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T12:56:37.489576 #2957:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:56:37.489611 #2957:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:56:37.489644 #2957:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:56:37.489677 #2957:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:56:37.489709 #2957:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T12:56:37.489743 #2957:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T12:56:37.489775 #2957:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T12:56:37.489805 #2957:34713c] INFO -- : --- [----] I, [2016-09-13T12:56:37.490116 #2957:34713c] INFO -- : :guid: c7fde0a6-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:56:37.490272 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:56:38.360484 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T12:56:38.360632 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T12:56:38.360718 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T12:56:38.409281 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:56:38.409535 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_active_roles) MIQ(MiqWebServiceWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:56:38.409660 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:56:38.522250 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#sync_config) ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:56:38.523135 #17555:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T12:56:38.523242 #17555:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:56:38.523291 #17555:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:56:38.523331 #17555:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:56:38.523367 #17555:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T12:56:38.523401 #17555:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T12:56:38.523479 #17555:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:56:38.523523 #17555:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T12:56:38.523559 #17555:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:56:38.523592 #17555:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:56:38.523625 #17555:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:56:38.523658 #17555:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:56:38.523690 #17555:34713c] INFO -- : :flooding_events_per_minute: 30 [----] I, [2016-09-13T12:56:38.523722 #17555:34713c] INFO -- : :flooding_monitor_enabled: false [----] I, [2016-09-13T12:56:38.523754 #17555:34713c] INFO -- : :ems_event_page_size: 100 [----] I, [2016-09-13T12:56:38.523786 #17555:34713c] INFO -- : :ems_event_thread_shutdown_timeout: 10 [----] I, [2016-09-13T12:56:38.523817 #17555:34713c] INFO -- : --- [----] I, [2016-09-13T12:56:38.524211 #17555:34713c] INFO -- : :guid: 1dd6952c-79b6-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:56:38.524277 #17555:34713c] INFO -- : :ems_id: 17 [----] I, [2016-09-13T12:56:38.524407 #17555:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T12:56:38.570941 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#sync_config) ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:56:38.571688 #3046:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T12:56:38.571775 #3046:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:56:38.571818 #3046:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:56:38.571878 #3046:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:56:38.571915 #3046:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T12:56:38.571949 #3046:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T12:56:38.571982 #3046:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:56:38.572015 #3046:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T12:56:38.572047 #3046:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:56:38.572079 #3046:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:56:38.572110 #3046:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:56:38.572142 #3046:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:56:38.572174 #3046:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T12:56:38.572205 #3046:65fdc4] INFO -- : --- [----] I, [2016-09-13T12:56:38.572507 #3046:65fdc4] INFO -- : :guid: cce2ed5a-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:56:38.572783 #3046:65fdc4] INFO -- : MIQ(MiqWebServiceWorker::Runner#message_sync_config) MIQ(MiqWebServiceWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:56:38.854797 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80969], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.769270959] seconds [----] I, [2016-09-13T12:56:38.855065 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80969], Delivering... [----] I, [2016-09-13T12:56:38.858536 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80969], State: [ok], Delivered in [0.003474948] seconds [----] I, [2016-09-13T12:56:38.882587 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80970], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.781677484] seconds [----] I, [2016-09-13T12:56:38.882772 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80970], Delivering... [----] I, [2016-09-13T12:56:38.887746 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80970], State: [ok], Delivered in [0.004961474] seconds [----] I, [2016-09-13T12:56:41.086479 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:56:41.086645 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_active_roles) MIQ(MiqEventHandler::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:56:41.086724 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:56:41.235866 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#sync_config) ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:56:41.236783 #2918:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T12:56:41.236895 #2918:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:56:41.236947 #2918:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:56:41.236988 #2918:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:56:41.237026 #2918:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T12:56:41.237062 #2918:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T12:56:41.237098 #2918:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:56:41.237133 #2918:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T12:56:41.237168 #2918:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:56:41.237202 #2918:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:56:41.237237 #2918:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:56:41.237272 #2918:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:56:41.237305 #2918:34713c] INFO -- : :cpu_usage_threshold: 0 [----] I, [2016-09-13T12:56:41.237338 #2918:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T12:56:41.237371 #2918:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T12:56:41.237403 #2918:34713c] INFO -- : --- [----] I, [2016-09-13T12:56:41.237750 #2918:34713c] INFO -- : :guid: c655b6de-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:56:41.237938 #2918:34713c] INFO -- : MIQ(MiqEventHandler::Runner#message_sync_config) MIQ(MiqEventHandler::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:56:41.869784 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:56:41 UTC]... [----] I, [2016-09-13T12:56:41.894740 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:56:41 UTC]...Complete [----] I, [2016-09-13T12:56:41.904557 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:56:41.904768 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:56:41.904920 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:56:42.082369 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:56:42.083278 #2928:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T12:56:42.083362 #2928:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:56:42.083409 #2928:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:56:42.083503 #2928:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:56:42.083549 #2928:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T12:56:42.083592 #2928:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T12:56:42.083630 #2928:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:56:42.083668 #2928:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T12:56:42.083704 #2928:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:56:42.083743 #2928:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:56:42.083777 #2928:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:56:42.083811 #2928:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:56:42.083869 #2928:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T12:56:42.083911 #2928:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T12:56:42.083946 #2928:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T12:56:42.083978 #2928:34713c] INFO -- : --- [----] I, [2016-09-13T12:56:42.084298 #2928:34713c] INFO -- : :guid: c6f52fac-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:56:42.084529 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:56:43.802026 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:56:43.802180 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_active_roles) MIQ(MiqReportingWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:56:43.802259 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:56:43.820334 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:56:43.820506 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_active_roles) MIQ(MiqUiWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:56:43.820607 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:56:43.914097 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles... [----] I, [2016-09-13T12:56:43.914290 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_active_roles) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing active roles complete... [----] I, [2016-09-13T12:56:43.914405 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration... [----] I, [2016-09-13T12:56:43.963804 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#sync_config) ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:56:43.964712 #2978:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T12:56:43.964795 #2978:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:56:43.964860 #2978:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:56:43.964905 #2978:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:56:43.964945 #2978:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T12:56:43.964983 #2978:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T12:56:43.965019 #2978:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:56:43.965060 #2978:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T12:56:43.965095 #2978:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:56:43.965129 #2978:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:56:43.965162 #2978:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:56:43.965198 #2978:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:56:43.965238 #2978:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T12:56:43.965273 #2978:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T12:56:43.965313 #2978:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T12:56:43.965346 #2978:34713c] INFO -- : --- [----] I, [2016-09-13T12:56:43.965683 #2978:34713c] INFO -- : :guid: c87e430e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:56:43.965863 #2978:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#message_sync_config) MIQ(MiqReportingWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:56:43.979173 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#sync_config) ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:56:43.979959 #3022:65fdc4] INFO -- : :count: 1 [----] I, [2016-09-13T12:56:43.980046 #3022:65fdc4] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:56:43.980093 #3022:65fdc4] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:56:43.980131 #3022:65fdc4] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:56:43.980167 #3022:65fdc4] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T12:56:43.980202 #3022:65fdc4] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T12:56:43.980236 #3022:65fdc4] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:56:43.980269 #3022:65fdc4] INFO -- : :poll: 3 [----] I, [2016-09-13T12:56:43.980303 #3022:65fdc4] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:56:43.980336 #3022:65fdc4] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:56:43.980369 #3022:65fdc4] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:56:43.980443 #3022:65fdc4] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:56:43.980499 #3022:65fdc4] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T12:56:43.980535 #3022:65fdc4] INFO -- : --- [----] I, [2016-09-13T12:56:43.980804 #3022:65fdc4] INFO -- : :guid: cc964d2e-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:56:43.981074 #3022:65fdc4] INFO -- : MIQ(MiqUiWorker::Runner#message_sync_config) MIQ(MiqUiWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:56:44.078230 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#sync_config) ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:56:44.079061 #24051:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T12:56:44.079144 #24051:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:56:44.079194 #24051:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:56:44.079231 #24051:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:56:44.079270 #24051:34713c] INFO -- : :memory_threshold: 2147483648 [----] I, [2016-09-13T12:56:44.079304 #24051:34713c] INFO -- : :nice_delta: 7 [----] I, [2016-09-13T12:56:44.079341 #24051:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:56:44.079374 #24051:34713c] INFO -- : :poll: 10 [----] I, [2016-09-13T12:56:44.079486 #24051:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:56:44.079567 #24051:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:56:44.079614 #24051:34713c] INFO -- : :restart_interval: 7200 [----] I, [2016-09-13T12:56:44.079649 #24051:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:56:44.079682 #24051:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T12:56:44.079717 #24051:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T12:56:44.079749 #24051:34713c] INFO -- : :queue_timeout: 7200 [----] I, [2016-09-13T12:56:44.079780 #24051:34713c] INFO -- : --- [----] I, [2016-09-13T12:56:44.080146 #24051:34713c] INFO -- : :guid: ee14426a-79c6-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:56:44.080209 #24051:34713c] INFO -- : :ems_id: 17 [----] I, [2016-09-13T12:56:44.080368 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#message_sync_config) EMS [livingontheedge.hawkular.org] as [jdoe] Synchronizing configuration complete... [----] I, [2016-09-13T12:56:44.558336 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:56:44.558513 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_active_roles) MIQ(MiqPriorityWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:56:44.558597 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:56:44.704366 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#sync_config) ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:56:44.705217 #2947:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T12:56:44.705311 #2947:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:56:44.705358 #2947:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:56:44.705395 #2947:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:56:44.705470 #2947:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T12:56:44.705518 #2947:34713c] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T12:56:44.705553 #2947:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:56:44.705587 #2947:34713c] INFO -- : :poll: 1 [----] I, [2016-09-13T12:56:44.705619 #2947:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:56:44.705655 #2947:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:56:44.705686 #2947:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:56:44.705716 #2947:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:56:44.705748 #2947:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T12:56:44.705779 #2947:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T12:56:44.705809 #2947:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T12:56:44.705858 #2947:34713c] INFO -- : --- [----] I, [2016-09-13T12:56:44.706143 #2947:34713c] INFO -- : :guid: c7a7f470-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:56:44.706292 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#message_sync_config) MIQ(MiqPriorityWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:56:44.968328 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:56:44.968524 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_active_roles) MIQ(MiqWebsocketWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:56:44.968611 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:56:45.114936 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#sync_config) ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:56:45.115654 #3003:6676a0] INFO -- : :count: 1 [----] I, [2016-09-13T12:56:45.115734 #3003:6676a0] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:56:45.115780 #3003:6676a0] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:56:45.115816 #3003:6676a0] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:56:45.115877 #3003:6676a0] INFO -- : :memory_threshold: 1073741824 [----] I, [2016-09-13T12:56:45.115915 #3003:6676a0] INFO -- : :nice_delta: 1 [----] I, [2016-09-13T12:56:45.115950 #3003:6676a0] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:56:45.115983 #3003:6676a0] INFO -- : :poll: 3 [----] I, [2016-09-13T12:56:45.116017 #3003:6676a0] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:56:45.116048 #3003:6676a0] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:56:45.116079 #3003:6676a0] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:56:45.116111 #3003:6676a0] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:56:45.116144 #3003:6676a0] INFO -- : :connection_pool_size: 8 [----] I, [2016-09-13T12:56:45.116174 #3003:6676a0] INFO -- : --- [----] I, [2016-09-13T12:56:45.116461 #3003:6676a0] INFO -- : :guid: c8d608fa-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:56:45.116747 #3003:6676a0] INFO -- : MIQ(MiqWebsocketWorker::Runner#message_sync_config) MIQ(MiqWebsocketWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:56:46.157490 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:56:46.157686 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_active_roles) MIQ(MiqScheduleWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:56:46.157767 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:56:46.291564 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#sync_config) ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:56:46.293013 #2989:34713c] INFO -- : :count: 1 [----] I, [2016-09-13T12:56:46.293102 #2989:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:56:46.293151 #2989:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:56:46.293190 #2989:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:56:46.293227 #2989:34713c] INFO -- : :memory_threshold: 314572800 [----] I, [2016-09-13T12:56:46.293262 #2989:34713c] INFO -- : :nice_delta: 3 [----] I, [2016-09-13T12:56:46.293296 #2989:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:56:46.293329 #2989:34713c] INFO -- : :poll: 15 [----] I, [2016-09-13T12:56:46.293362 #2989:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:56:46.293395 #2989:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:56:46.293468 #2989:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:56:46.293515 #2989:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:56:46.293549 #2989:34713c] INFO -- : :authentication_check_interval: 86400 [----] I, [2016-09-13T12:56:46.293581 #2989:34713c] INFO -- : :db_diagnostics_interval: 1800 [----] I, [2016-09-13T12:56:46.293614 #2989:34713c] INFO -- : :ems_events_purge_interval: 86400 [----] I, [2016-09-13T12:56:46.293647 #2989:34713c] INFO -- : :evm_snapshot_delete_delay_for_job_not_found: 3600 [----] I, [2016-09-13T12:56:46.293679 #2989:34713c] INFO -- : :evm_snapshot_interval: 3600 [----] I, [2016-09-13T12:56:46.293712 #2989:34713c] INFO -- : :job_proxy_dispatcher_interval: 15 [----] I, [2016-09-13T12:56:46.293745 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_check_interval: 60 [----] I, [2016-09-13T12:56:46.293780 #2989:34713c] INFO -- : :job_proxy_dispatcher_stale_message_timeout: 120 [----] I, [2016-09-13T12:56:46.293813 #2989:34713c] INFO -- : :job_timeout_interval: 60 [----] I, [2016-09-13T12:56:46.293872 #2989:34713c] INFO -- : :log_active_configuration_interval: 86400 [----] I, [2016-09-13T12:56:46.293911 #2989:34713c] INFO -- : :log_database_statistics_interval: 86400 [----] I, [2016-09-13T12:56:46.293943 #2989:34713c] INFO -- : :orchestration_stack_retired_interval: 600 [----] I, [2016-09-13T12:56:46.293976 #2989:34713c] INFO -- : :performance_collection_interval: 180 [----] I, [2016-09-13T12:56:46.294010 #2989:34713c] INFO -- : :performance_collection_start_delay: 300 [----] I, [2016-09-13T12:56:46.294042 #2989:34713c] INFO -- : :performance_realtime_purging_interval: 900 [----] I, [2016-09-13T12:56:46.294075 #2989:34713c] INFO -- : :performance_realtime_purging_start_delay: 300 [----] I, [2016-09-13T12:56:46.294108 #2989:34713c] INFO -- : :performance_rollup_purging_interval: 14400 [----] I, [2016-09-13T12:56:46.294142 #2989:34713c] INFO -- : :performance_rollup_purging_start_delay: 300 [----] I, [2016-09-13T12:56:46.294175 #2989:34713c] INFO -- : :policy_events_purge_interval: 86400 [----] I, [2016-09-13T12:56:46.294224 #2989:34713c] INFO -- : :server_log_stats_interval: 300 [----] I, [2016-09-13T12:56:46.294261 #2989:34713c] INFO -- : :server_stats_interval: 60 [----] I, [2016-09-13T12:56:46.294294 #2989:34713c] INFO -- : :service_retired_interval: 600 [----] I, [2016-09-13T12:56:46.294325 #2989:34713c] INFO -- : :session_timeout_interval: 30 [----] I, [2016-09-13T12:56:46.294358 #2989:34713c] INFO -- : :storage_file_collection_interval: 86400 [----] I, [2016-09-13T12:56:46.294391 #2989:34713c] INFO -- : :storage_file_collection_time_utc: 21600 [----] I, [2016-09-13T12:56:46.294457 #2989:34713c] INFO -- : :vm_retired_interval: 600 [----] I, [2016-09-13T12:56:46.294502 #2989:34713c] INFO -- : --- [----] I, [2016-09-13T12:56:46.294782 #2989:34713c] INFO -- : :guid: c8ab90a2-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:56:46.294956 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#message_sync_config) MIQ(MiqScheduleWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:56:46.295041 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:56:46.310983 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80972], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:56:46.936877 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T12:56:46.942592 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:56:47.598393 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80972], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.297147276] seconds [----] I, [2016-09-13T12:56:47.598644 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80972], Delivering... [----] I, [2016-09-13T12:56:47.605289 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036411285400390625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003660440444946289, :pending_vm_jobs=>0.0007758140563964844, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006241798400878906} [----] I, [2016-09-13T12:56:47.605667 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80972], State: [ok], Delivered in [0.007041325] seconds [----] I, [2016-09-13T12:56:47.930168 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles... [----] I, [2016-09-13T12:56:47.930357 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_active_roles) MIQ(MiqGenericWorker::Runner) Synchronizing active roles complete... [----] I, [2016-09-13T12:56:47.930479 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration... [----] I, [2016-09-13T12:56:48.098629 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#sync_config) ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Zone [default], Active Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Assigned Roles [automate,database_operations,database_owner,ems_inventory,ems_operations,event,reporting,scheduler,smartstate,user_interface,web_services,websocket], Configuration: [----] I, [2016-09-13T12:56:48.099411 #2937:34713c] INFO -- : :count: 2 [----] I, [2016-09-13T12:56:48.099524 #2937:34713c] INFO -- : :gc_interval: 900 [----] I, [2016-09-13T12:56:48.099572 #2937:34713c] INFO -- : :heartbeat_freq: 10 [----] I, [2016-09-13T12:56:48.099615 #2937:34713c] INFO -- : :heartbeat_timeout: 120 [----] I, [2016-09-13T12:56:48.099651 #2937:34713c] INFO -- : :memory_threshold: 419430400 [----] I, [2016-09-13T12:56:48.099686 #2937:34713c] INFO -- : :nice_delta: 10 [----] I, [2016-09-13T12:56:48.099721 #2937:34713c] INFO -- : :parent_time_threshold: 180 [----] I, [2016-09-13T12:56:48.099759 #2937:34713c] INFO -- : :poll: 3 [----] I, [2016-09-13T12:56:48.099793 #2937:34713c] INFO -- : :poll_escalate_max: 30 [----] I, [2016-09-13T12:56:48.099845 #2937:34713c] INFO -- : :poll_method: :normal [----] I, [2016-09-13T12:56:48.099890 #2937:34713c] INFO -- : :restart_interval: 0 [----] I, [2016-09-13T12:56:48.099925 #2937:34713c] INFO -- : :starting_timeout: 600 [----] I, [2016-09-13T12:56:48.099960 #2937:34713c] INFO -- : :cpu_usage_threshold: 100 [----] I, [2016-09-13T12:56:48.099991 #2937:34713c] INFO -- : :dequeue_method: :drb [----] I, [2016-09-13T12:56:48.100024 #2937:34713c] INFO -- : :queue_timeout: 600 [----] I, [2016-09-13T12:56:48.100053 #2937:34713c] INFO -- : --- [----] I, [2016-09-13T12:56:48.100351 #2937:34713c] INFO -- : :guid: c763bdbe-7505-11e6-87c1-fa163e7d01a3 [----] I, [2016-09-13T12:56:48.100554 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#message_sync_config) MIQ(MiqGenericWorker::Runner) Synchronizing configuration complete... [----] I, [2016-09-13T12:56:53.226865 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005381107330322266, :worker_monitor=>1.2635352611541748, :worker_dequeue=>0.009886503219604492, :total_time=>1.2791717052459717} [----] I, [2016-09-13T12:57:01.323716 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:57:01.340841 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80973], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:57:01.362858 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80974], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:57:03.366058 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:57:03.803012 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80974], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.456315259] seconds [----] I, [2016-09-13T12:57:03.803239 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80974], Delivering... [----] I, [2016-09-13T12:57:03.810717 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004051685333251953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0040740966796875, :pending_vm_jobs=>0.0009069442749023438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00700688362121582} [----] I, [2016-09-13T12:57:03.811135 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80974], State: [ok], Delivered in [0.007889141] seconds [----] I, [2016-09-13T12:57:06.174125 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80973], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.845583514] seconds [----] I, [2016-09-13T12:57:06.174340 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80973], Delivering... [----] I, [2016-09-13T12:57:06.179652 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80973], State: [ok], Delivered in [0.005308655] seconds [----] I, [2016-09-13T12:57:09.850254 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004700899124145508, :worker_monitor=>1.4613947868347168, :worker_dequeue=>0.00991058349609375, :total_time=>1.4763519763946533} [----] I, [2016-09-13T12:57:14.850790 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:57:14 UTC]... [----] I, [2016-09-13T12:57:14.865308 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:57:14 UTC]...Complete [----] I, [2016-09-13T12:57:16.374506 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:57:16.392653 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80975], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:57:19.889346 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:57:19.969547 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80975], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.590171228] seconds [----] I, [2016-09-13T12:57:19.969701 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80975], Delivering... [----] I, [2016-09-13T12:57:19.973873 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022280216217041016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022406578063964844, :pending_vm_jobs=>0.0005159378051757812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038514137268066406} [----] I, [2016-09-13T12:57:19.974136 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80975], State: [ok], Delivered in [0.004445985] seconds [----] I, [2016-09-13T12:57:26.145525 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003890514373779297, :worker_monitor=>1.2384977340698242, :worker_dequeue=>0.008771896362304688, :total_time=>1.2514705657958984} [----] I, [2016-09-13T12:57:31.405375 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:57:31.425850 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80976], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:57:31.442795 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80977], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:57:31.459906 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80978], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:57:31.471241 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80979], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:57:36.169811 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:57:36.254811 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80976], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.843994277] seconds [----] I, [2016-09-13T12:57:36.255037 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80976], Delivering... [----] I, [2016-09-13T12:57:36.311699 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80976], State: [ok], Delivered in [0.0566596] seconds [----] I, [2016-09-13T12:57:36.328964 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80979], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.863676048] seconds [----] I, [2016-09-13T12:57:36.329132 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80979], Delivering... [----] I, [2016-09-13T12:57:36.335666 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035033226013183594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003521442413330078, :pending_vm_jobs=>0.000804901123046875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00616145133972168} [----] I, [2016-09-13T12:57:36.336044 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80979], State: [ok], Delivered in [0.006893723] seconds [----] I, [2016-09-13T12:57:36.368807 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80977], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.937400679] seconds [----] I, [2016-09-13T12:57:36.369003 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80977], Delivering... [----] I, [2016-09-13T12:57:36.372077 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80977], State: [ok], Delivered in [0.003033663] seconds [----] I, [2016-09-13T12:57:36.391916 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80978], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.94125424] seconds [----] I, [2016-09-13T12:57:36.392100 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80978], Delivering... [----] I, [2016-09-13T12:57:36.396374 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80978], State: [ok], Delivered in [0.004264919] seconds [----] I, [2016-09-13T12:57:42.298798 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003874540328979492, :worker_monitor=>1.1111068725585938, :worker_dequeue=>0.008901357650756836, :total_time=>1.124157428741455} [----] I, [2016-09-13T12:57:46.483174 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:57:46.502933 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80980], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:57:47.299389 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:57:47 UTC]... [----] I, [2016-09-13T12:57:47.343165 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:57:47 UTC]...Complete [----] I, [2016-09-13T12:57:47.358818 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:57:48.166052 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80980], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.676574908] seconds [----] I, [2016-09-13T12:57:48.166185 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80980], Delivering... [----] I, [2016-09-13T12:57:48.170315 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023353099822998047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023488998413085938, :pending_vm_jobs=>0.0004894733428955078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038759708404541016} [----] I, [2016-09-13T12:57:48.170692 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80980], State: [ok], Delivered in [0.004499947] seconds [----] I, [2016-09-13T12:58:01.515751 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:58:01.538082 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80981], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:58:01.581451 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80982], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:58:03.392876 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:58:03.533100 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80982], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.986681246] seconds [----] I, [2016-09-13T12:58:03.533322 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80982], Delivering... [----] I, [2016-09-13T12:58:03.538473 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80981], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.017480063] seconds [----] I, [2016-09-13T12:58:03.538688 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80981], Delivering... [----] I, [2016-09-13T12:58:03.540661 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0038051605224609375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038251876831054688, :pending_vm_jobs=>0.0009593963623046875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006885528564453125} [----] I, [2016-09-13T12:58:03.541083 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80982], State: [ok], Delivered in [0.007763557] seconds [----] I, [2016-09-13T12:58:03.544040 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80981], State: [ok], Delivered in [0.005354562] seconds [----] I, [2016-09-13T12:58:14.699916 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040798187255859375, :worker_monitor=>1.2694008350372314, :worker_dequeue=>0.009191513061523438, :total_time=>1.2829554080963135} [----] I, [2016-09-13T12:58:16.593686 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:58:16.612579 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80983], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:58:19.702795 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:58:19 UTC]... [----] I, [2016-09-13T12:58:19.721052 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:58:19 UTC]...Complete [----] I, [2016-09-13T12:58:19.732611 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:58:20.378989 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80983], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.779095305] seconds [----] I, [2016-09-13T12:58:20.379220 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80983], Delivering... [----] I, [2016-09-13T12:58:20.386593 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0040187835693359375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00404047966003418, :pending_vm_jobs=>0.0009446144104003906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006911754608154297} [----] I, [2016-09-13T12:58:20.387066 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80983], State: [ok], Delivered in [0.007839044] seconds [----] I, [2016-09-13T12:58:31.184153 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004708528518676758, :worker_monitor=>1.4200870990753174, :worker_dequeue=>0.007579326629638672, :total_time=>1.4328498840332031} [----] I, [2016-09-13T12:58:31.626269 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:58:31.658892 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80984], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:58:31.687571 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80985], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:58:31.704403 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80986], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:58:31.721586 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80987], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:58:36.199940 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:58:36.498684 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80984], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.86649778] seconds [----] I, [2016-09-13T12:58:36.498924 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80984], Delivering... [----] I, [2016-09-13T12:58:36.533005 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80987], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.822421961] seconds [----] I, [2016-09-13T12:58:36.533193 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80987], Delivering... [----] I, [2016-09-13T12:58:36.539759 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033092498779296875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033295154571533203, :pending_vm_jobs=>0.0008742809295654297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006176471710205078} [----] I, [2016-09-13T12:58:36.540140 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80987], State: [ok], Delivered in [0.006938344] seconds [----] I, [2016-09-13T12:58:36.561482 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80984], State: [ok], Delivered in [0.062510997] seconds [----] I, [2016-09-13T12:58:36.670318 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80985], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.005051656] seconds [----] I, [2016-09-13T12:58:36.670539 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80985], Delivering... [----] I, [2016-09-13T12:58:36.673657 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80985], State: [ok], Delivered in [0.003106298] seconds [----] I, [2016-09-13T12:58:36.676107 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80986], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.979071069] seconds [----] I, [2016-09-13T12:58:36.676367 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80986], Delivering... [----] I, [2016-09-13T12:58:36.683585 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80986], State: [ok], Delivered in [0.007211998] seconds [----] I, [2016-09-13T12:58:46.736307 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:58:46.785140 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80988], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:58:46.801661 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80989], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:58:46.812998 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80990], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:58:47.685229 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:58:47.689991 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007231473922729492, :worker_monitor=>1.4518797397613525, :worker_dequeue=>0.011421918869018555, :total_time=>1.4711015224456787} [----] I, [2016-09-13T12:58:48.657320 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80988], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.911499148] seconds [----] I, [2016-09-13T12:58:48.657543 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80988], Delivering... [----] I, [2016-09-13T12:58:48.662490 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80989], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.871277955] seconds [----] I, [2016-09-13T12:58:48.662686 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80989], Delivering... [----] I, [2016-09-13T12:58:48.663687 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T12:58:48.663922 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4633059328 [----] I, [2016-09-13T12:58:48.664025 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4392464384 [----] I, [2016-09-13T12:58:48.664107 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 240594944 [----] I, [2016-09-13T12:58:48.664183 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 964689920 [----] I, [2016-09-13T12:58:48.664258 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4335718400 [----] I, [2016-09-13T12:58:48.664331 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T12:58:48.664294 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003574371337890625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036377906799316406, :pending_vm_jobs=>0.0008440017700195312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006381511688232422} [----] I, [2016-09-13T12:58:48.664466 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T12:58:48.664573 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 563548160 [----] I, [2016-09-13T12:58:48.664652 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T12:58:48.664682 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80988], State: [ok], Delivered in [0.007137726] seconds [----] I, [2016-09-13T12:58:48.664726 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6836645888 [----] I, [2016-09-13T12:58:48.664800 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T12:58:48.664901 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T12:58:48.664977 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T12:58:48.665050 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 4096 [----] I, [2016-09-13T12:58:48.665118 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T12:58:48.665188 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T12:58:48.665260 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T12:58:48.665352 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T12:58:48.665457 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T12:58:48.665567 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T12:58:48.665648 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272429056 [----] I, [2016-09-13T12:58:48.665723 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55218176 [----] I, [2016-09-13T12:58:48.665797 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217210880 [----] I, [2016-09-13T12:58:48.665902 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6144000 [----] I, [2016-09-13T12:58:48.665983 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 143028224 [----] I, [2016-09-13T12:58:48.666061 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3355000832 [----] I, [2016-09-13T12:58:48.666129 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3031715840 [----] I, [2016-09-13T12:58:48.666199 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T12:58:48.666288 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T12:58:48.666374 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T12:58:48.666485 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36958208 [----] I, [2016-09-13T12:58:48.666575 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76918784 [----] I, [2016-09-13T12:58:48.666649 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49737728 [----] I, [2016-09-13T12:58:48.666730 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 111964160 [----] I, [2016-09-13T12:58:48.666802 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126656512 [----] I, [2016-09-13T12:58:48.666900 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T12:58:48.666978 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T12:58:48.667050 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T12:58:48.667120 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T12:58:48.667195 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T12:58:48.667267 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T12:58:48.667340 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T12:58:48.667409 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T12:58:48.667537 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T12:58:48.698342 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T12:58:48.698575 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T12:58:48.702244 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T12:58:48.704945 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T12:58:48.708140 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T12:58:48.711353 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T12:58:48.714615 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T12:58:48.717783 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 860 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T12:58:48.720987 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T12:58:48.724111 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T12:58:48.727293 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.9 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T12:58:48.734323 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T12:58:48.740030 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 176 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T12:58:48.743762 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T12:58:48.746690 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:58:48.746890 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T12:58:48.747017 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T12:58:48.751565 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202687000], Memory % [3.38], CPU Time [155655.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T12:58:48.751919 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80989], State: [ok], Delivered in [0.089215557] seconds [----] I, [2016-09-13T12:58:52.690560 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:58:52 UTC]... [----] I, [2016-09-13T12:58:52.708180 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:58:52 UTC]...Complete [----] I, [2016-09-13T12:58:52.726513 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:58:52.748250 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80990], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.942207717] seconds [----] I, [2016-09-13T12:58:52.748472 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [80990], Delivering... [----] I, [2016-09-13T12:58:52.755905 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:58:44 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163164000], Memory % [3.1], CPU Time [39241.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T12:58:52.756507 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:58:45 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359294000], Memory % [5.28], CPU Time [208834.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T12:58:52.757098 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:58:46 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202687000], Memory % [3.38], CPU Time [155662.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:58:52.757573 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:58:46 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [156532.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T12:58:52.758099 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:58:47 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169751000], Memory % [3.14], CPU Time [53298.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:58:52.758633 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:58:46 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [248188.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T12:58:52.759080 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:58:44 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347859000], Memory % [5.04], CPU Time [106927.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T12:58:52.759526 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:58:38 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213441000], Memory % [3.51], CPU Time [50486.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T12:58:52.762389 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:58:44 UTC], Process Info: Memory Usage [650592256], Memory Size [1078210560], Proportional Set Size: [490707000], Memory % [7.93], CPU Time [1532.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T12:58:52.764584 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:58:38 UTC], Process Info: Memory Usage [602693632], Memory Size [973803520], Proportional Set Size: [446070000], Memory % [7.35], CPU Time [1273.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T12:58:52.765126 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:58:45 UTC], Process Info: Memory Usage [432578560], Memory Size [731521024], Proportional Set Size: [358593000], Memory % [5.27], CPU Time [217546.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T12:58:52.765654 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:58:46 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [53252.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T12:58:52.766129 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 16:58:45 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166763000], Memory % [3.16], CPU Time [40161.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T12:58:52.766502 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [80990], State: [ok], Delivered in [0.018056289] seconds [----] I, [2016-09-13T12:59:01.825067 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T12:59:01.846799 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80991], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:59:01.862563 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80992], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:59:03.870241 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:59:03.875910 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0026350021362304688, :worker_monitor=>1.110774040222168, :worker_dequeue=>0.015598773956298828, :total_time=>1.1292567253112793} [----] I, [2016-09-13T12:59:03.904016 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80992], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.051358793] seconds [----] I, [2016-09-13T12:59:03.904277 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80992], Delivering... [----] I, [2016-09-13T12:59:03.913202 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0042192935943603516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004246234893798828, :pending_vm_jobs=>0.0011303424835205078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.008407354354858398} [----] I, [2016-09-13T12:59:03.914131 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80992], State: [ok], Delivered in [0.009842586] seconds [----] I, [2016-09-13T12:59:06.806123 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80991], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.976591953] seconds [----] I, [2016-09-13T12:59:06.806328 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80991], Delivering... [----] I, [2016-09-13T12:59:06.811499 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80991], State: [ok], Delivered in [0.005140708] seconds [----] I, [2016-09-13T12:59:16.875228 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:59:16.897543 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80993], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:59:20.454985 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:59:20.458266 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004129171371459961, :worker_monitor=>1.4006962776184082, :worker_dequeue=>0.0071032047271728516, :total_time=>1.4122600555419922} [----] I, [2016-09-13T12:59:20.963960 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80993], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.082116946] seconds [----] I, [2016-09-13T12:59:20.964156 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80993], Delivering... [----] I, [2016-09-13T12:59:20.970635 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034160614013671875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034363269805908203, :pending_vm_jobs=>0.0008020401000976562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006086587905883789} [----] I, [2016-09-13T12:59:20.970990 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80993], State: [ok], Delivered in [0.00682487] seconds [----] I, [2016-09-13T12:59:25.458754 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:59:25 UTC]... [----] I, [2016-09-13T12:59:25.482880 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:59:25 UTC]...Complete [----] I, [2016-09-13T12:59:31.909596 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T12:59:31.929702 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80994], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:59:31.945584 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80995], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:59:31.962668 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80996], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:59:31.974048 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80997], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:59:36.811172 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:59:36.815759 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004606962203979492, :worker_monitor=>1.2894091606140137, :worker_dequeue=>0.009905099868774414, :total_time=>1.3042759895324707} [----] I, [2016-09-13T12:59:36.877337 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80994], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.963198817] seconds [----] I, [2016-09-13T12:59:36.877586 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80994], Delivering... [----] I, [2016-09-13T12:59:36.911779 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80997], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.94351926] seconds [----] I, [2016-09-13T12:59:36.912011 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80997], Delivering... [----] I, [2016-09-13T12:59:36.920187 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004051685333251953, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004072427749633789, :pending_vm_jobs=>0.0008363723754882812, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007748126983642578} [----] I, [2016-09-13T12:59:36.920556 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80997], State: [ok], Delivered in [0.008537902] seconds [----] I, [2016-09-13T12:59:36.939850 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80994], State: [ok], Delivered in [0.062236025] seconds [----] I, [2016-09-13T12:59:36.945662 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80995], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.009891447] seconds [----] I, [2016-09-13T12:59:36.945847 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80995], Delivering... [----] I, [2016-09-13T12:59:36.948687 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80995], State: [ok], Delivered in [0.002847612] seconds [----] I, [2016-09-13T12:59:36.974570 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80996], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.020815045] seconds [----] I, [2016-09-13T12:59:36.974803 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80996], Delivering... [----] I, [2016-09-13T12:59:36.981493 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80996], State: [ok], Delivered in [0.006649568] seconds [----] I, [2016-09-13T12:59:46.985663 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T12:59:47.002930 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80998], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T12:59:53.007241 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T12:59:53.011750 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004257678985595703, :worker_monitor=>1.1525304317474365, :worker_dequeue=>0.009595394134521484, :total_time=>1.1667158603668213} [----] I, [2016-09-13T12:59:53.192021 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [80998], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.200454118] seconds [----] I, [2016-09-13T12:59:53.192212 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [80998], Delivering... [----] I, [2016-09-13T12:59:53.198582 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033388137817382812, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003363370895385742, :pending_vm_jobs=>0.0007638931274414062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0059316158294677734} [----] I, [2016-09-13T12:59:53.198954 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [80998], State: [ok], Delivered in [0.006733788] seconds [----] I, [2016-09-13T12:59:58.012519 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:59:58 UTC]... [----] I, [2016-09-13T12:59:58.039010 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 16:59:58 UTC]...Complete [----] I, [2016-09-13T13:00:02.012939 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T13:00:02.038876 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [80999], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:00:02.054323 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81000], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:00:02.056603 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget] [----] I, [2016-09-13T13:00:02.072249 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81001], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473789600] [----] I, [2016-09-13T13:00:02.072482 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [18] [EVM: Recently Discovered Hosts] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T13:00:02.074577 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget] [----] I, [2016-09-13T13:00:02.095119 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81002], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473789600] [----] I, [2016-09-13T13:00:02.095314 #2989:34713c] INFO -- : MIQ(MiqSchedule.queue_scheduled_work) Queueing start of schedule id: [19] [EVM: Recently Discovered VMs] [MiqWidget] [generate_widget]...complete [----] I, [2016-09-13T13:00:03.076714 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:00:03.283127 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81000], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.23624347] seconds [----] I, [2016-09-13T13:00:03.283283 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81000], Delivering... [----] I, [2016-09-13T13:00:03.289031 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003011941909790039, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030307769775390625, :pending_vm_jobs=>0.0007197856903076172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005411624908447266} [----] I, [2016-09-13T13:00:03.289369 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81000], State: [ok], Delivered in [0.006074499] seconds [----] I, [2016-09-13T13:00:04.071926 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [80999], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.053419798] seconds [----] I, [2016-09-13T13:00:04.072119 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [80999], Delivering... [----] I, [2016-09-13T13:00:04.077084 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [80999], State: [ok], Delivered in [0.004955153] seconds [----] I, [2016-09-13T13:00:04.094665 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81001], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [18], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473789600], Dequeued in: [2.03616073] seconds [----] I, [2016-09-13T13:00:04.094806 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81001], Delivering... [----] I, [2016-09-13T13:00:04.100626 #2937:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered Hosts] invoking action: [generate_widget] for target: [rss_newest_hosts] [----] I, [2016-09-13T13:00:04.112046 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81002], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [19], Task id: [], Command: [MiqSchedule.invoke_actions], Timeout: [1200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["action_generate_widget", 1473789600], Dequeued in: [2.035535138] seconds [----] I, [2016-09-13T13:00:04.112220 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81002], Delivering... [----] I, [2016-09-13T13:00:04.122105 #2928:34713c] INFO -- : MIQ(MiqSchedule#invoke_actions) [EVM: Recently Discovered VMs] invoking action: [generate_widget] for target: [rss_newest_vms] [----] I, [2016-09-13T13:00:04.125999 #2937:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [227], Name: [Generate Widget: 'EVM: Recently Discovered Hosts'] for: [1] groups [----] I, [2016-09-13T13:00:04.137836 #2937:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered Hosts] ID: [18] Queueing Content Generation [----] I, [2016-09-13T13:00:04.166862 #2928:34713c] INFO -- : MIQ(MiqWidget#create_task) Created MiqTask ID: [228], Name: [Generate Widget: 'EVM: Recently Discovered VMs'] for: [1] groups [----] I, [2016-09-13T13:00:04.172831 #2937:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81003], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T13:00:04.173092 #2937:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered Hosts] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered Hosts] [----] I, [2016-09-13T13:00:04.183652 #2928:34713c] INFO -- : MIQ(MiqWidget#queue_generate_content) Widget: [EVM: Recently Discovered VMs] ID: [19] Queueing Content Generation [----] I, [2016-09-13T13:00:04.197608 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81001], State: [ok], Delivered in [0.10273828] seconds [----] I, [2016-09-13T13:00:04.233134 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81004], id: [], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]] [----] I, [2016-09-13T13:00:04.233500 #2928:34713c] INFO -- : MIQ(MiqSchedule#action_generate_widget) Action [EVM: Recently Discovered VMs] has been run for target type: [MiqWidget] with name: [EVM: Recently Discovered VMs] [----] I, [2016-09-13T13:00:04.276679 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81002], State: [ok], Delivered in [0.164359598] seconds [----] I, [2016-09-13T13:00:09.376934 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=reporting, wcount=2, priority=200 [----] I, [2016-09-13T13:00:09.378665 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040357112884521484, :worker_monitor=>1.2864630222320557, :worker_dequeue=>0.006946086883544922, :total_time=>1.297753095626831} [----] I, [2016-09-13T13:00:11.043871 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [81003], MiqWorker id: [17], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [18], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [6.895350069] seconds [----] I, [2016-09-13T13:00:11.044215 #2967:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81003], Delivering... [----] I, [2016-09-13T13:00:11.087339 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T13:00:11.164445 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered Hosts] ID: [18] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T13:00:11.164874 #2967:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81003], State: [ok], Delivered in [0.120695328] seconds [----] I, [2016-09-13T13:00:11.167486 #2967:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [81003], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T13:00:11.167653 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [18], MiqTask ID: [227], Status: [ok] [----] I, [2016-09-13T13:00:11.173146 #2967:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [227] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T13:00:11.221918 #2967:34713c] INFO -- : MIQ(MiqReportingWorker::Runner#get_message_via_drb) Message id: [81004], MiqWorker id: [17], Zone: [], Role: [reporting], Server: [], Ident: [reporting], Target id: [], Instance id: [19], Task id: [], Command: [MiqWidget.generate_content], Timeout: [3600], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: ["MiqGroup", "EvmGroup-super_administrator", nil, ["UTC"]], Dequeued in: [7.028306471] seconds [----] I, [2016-09-13T13:00:11.222094 #2967:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81004], Delivering... [----] I, [2016-09-13T13:00:11.246940 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]... [----] I, [2016-09-13T13:00:11.295843 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_one_content_for_group) Widget: [EVM: Recently Discovered VMs] ID: [19] for [MiqGroup] [EvmGroup-super_administrator]...Complete [----] I, [2016-09-13T13:00:11.296319 #2967:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81004], State: [ok], Delivered in [0.074192684] seconds [----] I, [2016-09-13T13:00:11.298871 #2967:34713c] INFO -- : MIQ(MiqQueue#m_callback) Message id: [81004], Invoking Callback with args: ["ok", "Message delivered successfully", "[#]"] [----] I, [2016-09-13T13:00:11.299032 #2967:34713c] INFO -- : MIQ(MiqWidget#generate_content_complete_callback) Widget ID: [19], MiqTask ID: [228], Status: [ok] [----] I, [2016-09-13T13:00:11.304322 #2967:34713c] INFO -- : MIQ(MiqTask#update_status) Task: [228] [Finished] [Ok] [Widget Generation for 1 groups complete] [----] I, [2016-09-13T13:00:17.112301 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T13:00:17.130122 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81005], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:00:17.153062 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81006], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:00:17.169950 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81007], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:00:17.187029 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81008], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:00:17.194878 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered Hosts] with id: [18] [----] I, [2016-09-13T13:00:17.195056 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_18 [----] I, [2016-09-13T13:00:17.198617 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T13:00:17.199062 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 18:00:00 UTC [----] I, [2016-09-13T13:00:17.200921 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered Hosts] schedule updated to run at 2016-09-13 18:00:00 UTC with interval 3600 [----] I, [2016-09-13T13:00:17.201319 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#reload_schedules) Reloading schedule: [EVM: Recently Discovered VMs] with id: [19] [----] I, [2016-09-13T13:00:17.201486 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#rufus_remove_schedules_by_tag) Unscheduling 1 jobs with tag: miq_schedules_19 [----] I, [2016-09-13T13:00:17.204498 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) sch_start_time: 2016-09-03 07:00:00 UTC [----] I, [2016-09-13T13:00:17.204916 #2989:34713c] INFO -- : MIQ(MiqSchedule#next_interval_time) next_time: 2016-09-13 18:00:00 UTC [----] I, [2016-09-13T13:00:17.206758 #2989:34713c] INFO -- : MIQ(MiqSchedule#rufus_schedule_opts) Schedule [EVM: Recently Discovered VMs] schedule updated to run at 2016-09-13 18:00:00 UTC with interval 3600 [----] I, [2016-09-13T13:00:19.522578 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:00:20.393398 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81008], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.217950605] seconds [----] I, [2016-09-13T13:00:20.393595 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81008], Delivering... [----] I, [2016-09-13T13:00:20.398761 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002775430679321289, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002791881561279297, :pending_vm_jobs=>0.0006299018859863281, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004819393157958984} [----] I, [2016-09-13T13:00:20.399087 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81008], State: [ok], Delivered in [0.005489474] seconds [----] I, [2016-09-13T13:00:22.273191 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81005], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.153688578] seconds [----] I, [2016-09-13T13:00:22.273377 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81005], Delivering... [----] I, [2016-09-13T13:00:22.275772 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81005], State: [ok], Delivered in [0.002387496] seconds [----] I, [2016-09-13T13:00:22.303532 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81006], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.167926982] seconds [----] I, [2016-09-13T13:00:22.303879 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81006], Delivering... [----] I, [2016-09-13T13:00:22.315239 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81006], State: [ok], Delivered in [0.011383572] seconds [----] I, [2016-09-13T13:00:22.341696 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81007], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.183191326] seconds [----] I, [2016-09-13T13:00:22.341911 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81007], Delivering... [----] I, [2016-09-13T13:00:22.346308 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81007], State: [ok], Delivered in [0.004394679] seconds [----] I, [2016-09-13T13:00:25.778515 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040972232818603516, :worker_monitor=>1.2401330471038818, :worker_dequeue=>0.006661653518676758, :total_time=>1.2511882781982422} [----] I, [2016-09-13T13:00:30.779022 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:00:30 UTC]... [----] I, [2016-09-13T13:00:30.799760 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:00:30 UTC]...Complete [----] I, [2016-09-13T13:00:32.211876 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:00:32.227276 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81009], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:00:32.244868 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81010], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:00:32.261442 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81011], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:00:32.272861 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81012], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:00:35.822092 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:00:36.524965 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81009], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.308009176] seconds [----] I, [2016-09-13T13:00:36.525152 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81009], Delivering... [----] I, [2016-09-13T13:00:36.558802 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81012], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.291880882] seconds [----] I, [2016-09-13T13:00:36.558963 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81012], Delivering... [----] I, [2016-09-13T13:00:36.563541 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024929046630859375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0025069713592529297, :pending_vm_jobs=>0.0005552768707275391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004317760467529297} [----] I, [2016-09-13T13:00:36.563830 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81012], State: [ok], Delivered in [0.004849827] seconds [----] I, [2016-09-13T13:00:36.576017 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81009], State: [ok], Delivered in [0.050857311] seconds [----] I, [2016-09-13T13:00:37.393626 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81010], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.160440025] seconds [----] I, [2016-09-13T13:00:37.393841 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81010], Delivering... [----] I, [2016-09-13T13:00:37.397112 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81010], State: [ok], Delivered in [0.00328959] seconds [----] I, [2016-09-13T13:00:37.445061 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81011], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.18891691] seconds [----] I, [2016-09-13T13:00:37.445240 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81011], Delivering... [----] I, [2016-09-13T13:00:37.449708 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81011], State: [ok], Delivered in [0.004452649] seconds [----] I, [2016-09-13T13:00:42.164978 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006600141525268555, :worker_monitor=>1.323754072189331, :worker_dequeue=>0.009079217910766602, :total_time=>1.3399240970611572} [----] I, [2016-09-13T13:00:47.286154 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:00:47.319368 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81013], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:00:52.188789 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:00:52.510561 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81013], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.215570449] seconds [----] I, [2016-09-13T13:00:52.510800 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81013], Delivering... [----] I, [2016-09-13T13:00:52.517854 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003726959228515625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037484169006347656, :pending_vm_jobs=>0.0008585453033447266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006575107574462891} [----] I, [2016-09-13T13:00:52.518264 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81013], State: [ok], Delivered in [0.007469974] seconds [----] I, [2016-09-13T13:00:58.479454 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004164934158325195, :worker_monitor=>1.270928144454956, :worker_dequeue=>0.008995771408081055, :total_time=>1.2843787670135498} [----] I, [2016-09-13T13:01:02.330330 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T13:01:02.347397 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81014], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:01:02.365506 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81015], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:01:02.381728 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81016], id: [], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:01:03.480024 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:01:03 UTC]... [----] I, [2016-09-13T13:01:03.501557 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:01:03 UTC]...Complete [----] I, [2016-09-13T13:01:03.511905 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:01:03.822051 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81015], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.470300925] seconds [----] I, [2016-09-13T13:01:03.822235 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81015], Delivering... [----] I, [2016-09-13T13:01:03.828246 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031805038452148438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003197908401489258, :pending_vm_jobs=>0.0007588863372802734, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005629062652587891} [----] I, [2016-09-13T13:01:03.828588 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81015], State: [ok], Delivered in [0.006353918] seconds [----] I, [2016-09-13T13:01:04.599271 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81014], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.263913077] seconds [----] I, [2016-09-13T13:01:04.599516 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81014], Delivering... [----] I, [2016-09-13T13:01:04.604628 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81014], State: [ok], Delivered in [0.00510774] seconds [----] I, [2016-09-13T13:01:04.622539 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81016], MiqWorker id: [13], Zone: [], Role: [database_owner], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabase.capture_metrics_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.247680088] seconds [----] I, [2016-09-13T13:01:04.622759 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81016], Delivering... [----] I, [2016-09-13T13:01:15.251678 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004540205001831055, :worker_monitor=>1.7105278968811035, :worker_dequeue=>0.00620579719543457, :total_time=>1.721580982208252} [----] I, [2016-09-13T13:01:17.393778 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:01:17.431215 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81017], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:01:20.333731 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:01:20.947156 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81017], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.544430881] seconds [----] I, [2016-09-13T13:01:20.947301 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81017], Delivering... [----] I, [2016-09-13T13:01:20.951698 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023279190063476562, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023407936096191406, :pending_vm_jobs=>0.0005345344543457031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004111528396606445} [----] I, [2016-09-13T13:01:20.951945 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81017], State: [ok], Delivered in [0.004645989] seconds [----] I, [2016-09-13T13:01:32.305787 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033042430877685547, :worker_monitor=>1.9352526664733887, :worker_dequeue=>0.008753538131713867, :total_time=>1.947580099105835} [----] I, [2016-09-13T13:01:32.443180 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:01:32.483066 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81018], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:01:32.515493 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81019], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:01:32.604679 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81020], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:01:32.641238 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81021], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:01:37.306286 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:01:37 UTC]... [----] I, [2016-09-13T13:01:37.522744 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:01:37 UTC]...Complete [----] I, [2016-09-13T13:01:37.529313 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:01:37.904622 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81018], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.457425417] seconds [----] I, [2016-09-13T13:01:37.904756 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81018], Delivering... [----] I, [2016-09-13T13:01:37.993687 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81018], State: [ok], Delivered in [0.088883811] seconds [----] I, [2016-09-13T13:01:38.248620 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81021], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.637439048] seconds [----] I, [2016-09-13T13:01:38.248892 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81021], Delivering... [----] I, [2016-09-13T13:01:38.259345 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00515294075012207, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005265235900878906, :pending_vm_jobs=>0.0014257431030273438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009934425354003906} [----] I, [2016-09-13T13:01:38.259851 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81021], State: [ok], Delivered in [0.010961415] seconds [----] I, [2016-09-13T13:01:38.362255 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81019], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.870137176] seconds [----] I, [2016-09-13T13:01:38.362444 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81019], Delivering... [----] I, [2016-09-13T13:01:38.365605 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81019], State: [ok], Delivered in [0.003187112] seconds [----] I, [2016-09-13T13:01:38.502741 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81020], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.975968905] seconds [----] I, [2016-09-13T13:01:38.502944 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81020], Delivering... [----] I, [2016-09-13T13:01:38.507404 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81020], State: [ok], Delivered in [0.004431384] seconds [----] I, [2016-09-13T13:01:47.568252 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T13:01:47.663992 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:01:47.690914 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81022], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:01:50.444836 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:01:50.451577 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004045963287353516, :log_active_servers=>0.01222085952758789, :worker_monitor=>2.868725538253784, :worker_dequeue=>0.014205455780029297, :total_time=>2.899548292160034} [----] I, [2016-09-13T13:01:50.554715 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81022], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.885328956] seconds [----] I, [2016-09-13T13:01:50.554934 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81022], Delivering... [----] I, [2016-09-13T13:01:50.560221 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002859354019165039, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002878904342651367, :pending_vm_jobs=>0.0006563663482666016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004925727844238281} [----] I, [2016-09-13T13:01:50.560561 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81022], State: [ok], Delivered in [0.005634975] seconds [----] I, [2016-09-13T13:02:02.986241 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:02:03.023464 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81023], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:02:03.064598 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81024], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:02:07.830899 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:02:07.834256 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00429844856262207, :worker_monitor=>2.328806161880493, :worker_dequeue=>0.007776975631713867, :total_time=>2.3412275314331055} [----] I, [2016-09-13T13:02:08.339387 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81024], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.30655007] seconds [----] I, [2016-09-13T13:02:08.339628 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81024], Delivering... [----] I, [2016-09-13T13:02:08.346355 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003612995147705078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003637075424194336, :pending_vm_jobs=>0.0008192062377929688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00629425048828125} [----] I, [2016-09-13T13:02:08.346775 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81024], State: [ok], Delivered in [0.007133794] seconds [----] I, [2016-09-13T13:02:08.845371 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81023], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.851022303] seconds [----] I, [2016-09-13T13:02:08.845622 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81023], Delivering... [----] I, [2016-09-13T13:02:08.851094 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81023], State: [ok], Delivered in [0.00545828] seconds [----] I, [2016-09-13T13:02:12.834878 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:02:12 UTC]... [----] I, [2016-09-13T13:02:12.916677 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:02:12 UTC]...Complete [----] I, [2016-09-13T13:02:18.078114 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T13:02:18.104875 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81025], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:02:18.193995 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81026], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:02:18.218908 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81027], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:02:24.946457 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:02:24.949482 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003966569900512695, :server_monitor=>0.12218928337097168, :worker_monitor=>1.8677802085876465, :worker_dequeue=>0.006867647171020508, :total_time=>2.0011823177337646} [----] I, [2016-09-13T13:02:25.530245 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81025], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.444776297] seconds [----] I, [2016-09-13T13:02:25.530487 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81025], Delivering... [----] I, [2016-09-13T13:02:25.538700 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0040776729583740234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004107236862182617, :pending_vm_jobs=>0.0010907649993896484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0077402591705322266} [----] I, [2016-09-13T13:02:25.539128 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81025], State: [ok], Delivered in [0.008660043] seconds [----] I, [2016-09-13T13:02:25.621659 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81026], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.511492647] seconds [----] I, [2016-09-13T13:02:25.621940 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81026], Delivering... [----] I, [2016-09-13T13:02:25.730027 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81026], State: [ok], Delivered in [0.108094727] seconds [----] I, [2016-09-13T13:02:26.987351 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81027], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.787281931] seconds [----] I, [2016-09-13T13:02:26.987511 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81027], Delivering... [----] I, [2016-09-13T13:02:26.992504 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81027], State: [ok], Delivered in [0.004962352] seconds [----] I, [2016-09-13T13:02:33.231790 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:02:33.272056 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81028], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:02:33.340907 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81029], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:02:34.971718 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:02:36.075491 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81029], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.795472413] seconds [----] I, [2016-09-13T13:02:36.075620 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81029], Delivering... [----] I, [2016-09-13T13:02:36.079585 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0021445751190185547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021584033966064453, :pending_vm_jobs=>0.0005085468292236328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003722667694091797} [----] I, [2016-09-13T13:02:36.079852 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81029], State: [ok], Delivered in [0.004224274] seconds [----] I, [2016-09-13T13:02:36.688410 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81028], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.4512204] seconds [----] I, [2016-09-13T13:02:36.688700 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81028], Delivering... [----] I, [2016-09-13T13:02:36.694558 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81028], State: [ok], Delivered in [0.005825724] seconds [----] I, [2016-09-13T13:02:42.184647 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005602836608886719, :worker_monitor=>2.194375514984131, :worker_dequeue=>0.009414911270141602, :total_time=>2.2098214626312256} [----] I, [2016-09-13T13:02:47.185217 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:02:47 UTC]... [----] I, [2016-09-13T13:02:47.240258 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:02:47 UTC]...Complete [----] I, [2016-09-13T13:02:48.357223 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:02:48.393044 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81030], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:02:50.851564 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81016], State: [ok], Delivered in [106.22879206] seconds [----] I, [2016-09-13T13:02:52.271773 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:02:52.468656 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81030], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.101767749] seconds [----] I, [2016-09-13T13:02:52.468794 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81030], Delivering... [----] I, [2016-09-13T13:02:52.472961 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022177696228027344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022335052490234375, :pending_vm_jobs=>0.0005192756652832031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038933753967285156} [----] I, [2016-09-13T13:02:52.473213 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81030], State: [ok], Delivered in [0.004415703] seconds [----] I, [2016-09-13T13:02:59.137532 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003183126449584961, :worker_monitor=>1.8518931865692139, :worker_dequeue=>0.007753849029541016, :total_time=>1.863133430480957} [----] I, [2016-09-13T13:03:03.407213 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:03:03.471285 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81031], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:03:03.499979 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81032], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:03:04.144638 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:03:04.636174 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81032], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.157421699] seconds [----] I, [2016-09-13T13:03:04.636301 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81032], Delivering... [----] I, [2016-09-13T13:03:04.639779 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0018508434295654297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0018630027770996094, :pending_vm_jobs=>0.0004208087921142578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0031931400299072266} [----] I, [2016-09-13T13:03:04.639995 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81032], State: [ok], Delivered in [0.003683936] seconds [----] I, [2016-09-13T13:03:06.054716 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81031], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.641662043] seconds [----] I, [2016-09-13T13:03:06.054908 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81031], Delivering... [----] I, [2016-09-13T13:03:06.059024 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81031], State: [ok], Delivered in [0.004122224] seconds [----] I, [2016-09-13T13:03:15.604745 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002883434295654297, :worker_monitor=>1.4298498630523682, :worker_dequeue=>0.010599374771118164, :total_time=>1.44356369972229} [----] I, [2016-09-13T13:03:18.515520 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:03:18.539624 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81033], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:03:18.568192 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81034], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:03:18.590976 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81035], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:03:18.638532 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81036], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:03:20.605244 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:03:20 UTC]... [----] I, [2016-09-13T13:03:20.630972 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:03:20 UTC]...Complete [----] I, [2016-09-13T13:03:20.638136 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:03:20.790814 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81033], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.265525618] seconds [----] I, [2016-09-13T13:03:20.790957 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81033], Delivering... [----] I, [2016-09-13T13:03:20.795065 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002120494842529297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021371841430664062, :pending_vm_jobs=>0.0005030632019042969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038690567016601562} [----] I, [2016-09-13T13:03:20.795341 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81033], State: [ok], Delivered in [0.004365785] seconds [----] I, [2016-09-13T13:03:20.836213 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81034], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.289653594] seconds [----] I, [2016-09-13T13:03:20.836342 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81034], Delivering... [----] I, [2016-09-13T13:03:20.876134 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81034], State: [ok], Delivered in [0.039758916] seconds [----] I, [2016-09-13T13:03:21.156820 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81035], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.579550929] seconds [----] I, [2016-09-13T13:03:21.157001 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81035], Delivering... [----] I, [2016-09-13T13:03:21.163161 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81035], State: [ok], Delivered in [0.006154378] seconds [----] I, [2016-09-13T13:03:21.213966 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81036], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.608897666] seconds [----] I, [2016-09-13T13:03:21.214136 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81036], Delivering... [----] I, [2016-09-13T13:03:21.218224 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81036], State: [ok], Delivered in [0.004072619] seconds [----] I, [2016-09-13T13:03:31.986955 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006566047668457031, :worker_monitor=>1.2229359149932861, :worker_dequeue=>0.005768299102783203, :total_time=>1.2355852127075195} [----] I, [2016-09-13T13:03:33.657351 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:03:33.680084 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81037], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:03:37.002977 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:03:37.300917 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81037], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.635477772] seconds [----] I, [2016-09-13T13:03:37.301145 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81037], Delivering... [----] I, [2016-09-13T13:03:37.306762 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034990310668945312, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003515005111694336, :pending_vm_jobs=>0.0005235671997070312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005211353302001953} [----] I, [2016-09-13T13:03:37.307092 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81037], State: [ok], Delivered in [0.005946798] seconds [----] I, [2016-09-13T13:03:48.309561 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004724979400634766, :worker_monitor=>1.2716000080108643, :worker_dequeue=>0.008678436279296875, :total_time=>1.285308837890625} [----] I, [2016-09-13T13:03:48.691339 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T13:03:48.726388 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81038], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:03:48.744734 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81039], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:03:48.773146 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81040], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:03:48.788900 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81041], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:03:53.310089 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:03:53 UTC]... [----] I, [2016-09-13T13:03:53.337493 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:03:53 UTC]...Complete [----] I, [2016-09-13T13:03:53.349929 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:03:53.469173 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81038], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.771462435] seconds [----] I, [2016-09-13T13:03:53.469378 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81038], Delivering... [----] I, [2016-09-13T13:03:53.475726 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0033736228942871094, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003391265869140625, :pending_vm_jobs=>0.0007746219635009766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005944252014160156} [----] I, [2016-09-13T13:03:53.476099 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81038], State: [ok], Delivered in [0.006720559] seconds [----] I, [2016-09-13T13:03:53.514822 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81039], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.781374276] seconds [----] I, [2016-09-13T13:03:53.514958 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [81039], Delivering... [----] I, [2016-09-13T13:03:53.515774 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T13:03:53.515919 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4590665728 [----] I, [2016-09-13T13:03:53.515981 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4349870080 [----] I, [2016-09-13T13:03:53.516042 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 240795648 [----] I, [2016-09-13T13:03:53.516124 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 922746880 [----] I, [2016-09-13T13:03:53.516184 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4293128192 [----] I, [2016-09-13T13:03:53.516233 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T13:03:53.516278 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T13:03:53.516321 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 564183040 [----] I, [2016-09-13T13:03:53.516366 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T13:03:53.516407 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6672158720 [----] I, [2016-09-13T13:03:53.516490 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T13:03:53.516557 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T13:03:53.516610 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T13:03:53.516654 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 2109440 [----] I, [2016-09-13T13:03:53.516697 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T13:03:53.516740 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T13:03:53.516783 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T13:03:53.516838 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T13:03:53.516897 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T13:03:53.516943 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T13:03:53.516989 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272863232 [----] I, [2016-09-13T13:03:53.517031 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55431168 [----] I, [2016-09-13T13:03:53.517073 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217432064 [----] I, [2016-09-13T13:03:53.517121 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6144000 [----] I, [2016-09-13T13:03:53.517163 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 143249408 [----] I, [2016-09-13T13:03:53.517204 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3397427200 [----] I, [2016-09-13T13:03:53.517247 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3073720320 [----] I, [2016-09-13T13:03:53.517290 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T13:03:53.517332 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T13:03:53.517374 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T13:03:53.517434 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 36700160 [----] I, [2016-09-13T13:03:53.517500 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76918784 [----] I, [2016-09-13T13:03:53.517550 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49487872 [----] I, [2016-09-13T13:03:53.517593 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 112177152 [----] I, [2016-09-13T13:03:53.517640 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126406656 [----] I, [2016-09-13T13:03:53.517684 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T13:03:53.517727 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T13:03:53.517772 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T13:03:53.517825 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T13:03:53.517874 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T13:03:53.517919 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T13:03:53.517962 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T13:03:53.518004 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T13:03:53.518052 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T13:03:53.552171 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T13:03:53.552371 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T13:03:53.555869 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T13:03:53.558404 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T13:03:53.561447 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T13:03:53.564410 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T13:03:53.567367 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T13:03:53.570182 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 860 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T13:03:53.573121 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T13:03:53.576036 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T13:03:53.579000 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.8 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T13:03:53.581998 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T13:03:53.584941 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 184 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T13:03:53.587711 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T13:03:53.590403 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T13:03:53.590574 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T13:03:53.590681 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T13:03:53.595032 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [155718.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T13:03:53.595381 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [81039], State: [ok], Delivered in [0.08038945] seconds [----] I, [2016-09-13T13:03:53.646244 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81040], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.894660688] seconds [----] I, [2016-09-13T13:03:53.646455 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [81040], Delivering... [----] I, [2016-09-13T13:03:53.653129 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:03:45 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163164000], Memory % [3.1], CPU Time [39251.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T13:03:53.653661 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:03:45 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359294000], Memory % [5.28], CPU Time [208884.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T13:03:53.654191 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:03:48 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202687000], Memory % [3.38], CPU Time [155724.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T13:03:53.654646 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:03:47 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [156594.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T13:03:53.655130 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:03:45 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169751000], Memory % [3.14], CPU Time [53316.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T13:03:53.655649 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:03:33 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [248347.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T13:03:53.656101 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:03:44 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347859000], Memory % [5.04], CPU Time [106944.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T13:03:53.656526 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:03:38 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213441000], Memory % [3.51], CPU Time [50495.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T13:03:53.659275 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:03:45 UTC], Process Info: Memory Usage [608509952], Memory Size [940871680], Proportional Set Size: [449611000], Memory % [7.42], CPU Time [1602.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T13:03:53.661389 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:03:39 UTC], Process Info: Memory Usage [602288128], Memory Size [946130944], Proportional Set Size: [445562000], Memory % [7.34], CPU Time [1332.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T13:03:53.661944 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:03:45 UTC], Process Info: Memory Usage [432582656], Memory Size [731521024], Proportional Set Size: [358601000], Memory % [5.27], CPU Time [219016.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T13:03:53.662442 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:03:47 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [53285.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T13:03:53.662891 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:03:45 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166763000], Memory % [3.16], CPU Time [40171.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T13:03:53.663171 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [81040], State: [ok], Delivered in [0.016742686] seconds [----] I, [2016-09-13T13:03:54.343937 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81041], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.563970851] seconds [----] I, [2016-09-13T13:03:54.344217 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81041], Delivering... [----] I, [2016-09-13T13:03:54.351349 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81041], State: [ok], Delivered in [0.007115262] seconds [----] I, [2016-09-13T13:04:03.806127 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:04:03.823334 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81042], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:04:05.157700 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:04:05.162729 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0042994022369384766, :worker_monitor=>1.7740581035614014, :worker_dequeue=>0.015219926834106445, :total_time=>1.7939095497131348} [----] I, [2016-09-13T13:04:05.206709 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81042], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.394361507] seconds [----] I, [2016-09-13T13:04:05.206973 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81042], Delivering... [----] I, [2016-09-13T13:04:05.213756 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036673545837402344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003686666488647461, :pending_vm_jobs=>0.0008172988891601562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006378650665283203} [----] I, [2016-09-13T13:04:05.214112 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81042], State: [ok], Delivered in [0.007143062] seconds [----] I, [2016-09-13T13:04:18.836976 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 14. [----] I, [2016-09-13T13:04:18.880992 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81043], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:04:18.909318 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81044], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:04:18.937607 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81045], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:04:18.972217 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81046], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:04:18.989183 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81047], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:04:21.397147 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:04:21.401087 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002939462661743164, :worker_monitor=>1.1972644329071045, :worker_dequeue=>0.00868678092956543, :total_time=>1.209151029586792} [----] I, [2016-09-13T13:04:21.429319 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81044], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.533929922] seconds [----] I, [2016-09-13T13:04:21.429490 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81044], Delivering... [----] I, [2016-09-13T13:04:21.434501 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026900768280029297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0027036666870117188, :pending_vm_jobs=>0.0006768703460693359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00470423698425293} [----] I, [2016-09-13T13:04:21.434748 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81044], State: [ok], Delivered in [0.005273995] seconds [----] I, [2016-09-13T13:04:21.481062 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81045], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.565232971] seconds [----] I, [2016-09-13T13:04:21.481280 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81045], Delivering... [----] I, [2016-09-13T13:04:21.532183 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81045], State: [ok], Delivered in [0.050890481] seconds [----] I, [2016-09-13T13:04:21.566890 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81043], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.704881319] seconds [----] I, [2016-09-13T13:04:21.567088 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81043], Delivering... [----] I, [2016-09-13T13:04:21.606674 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81048], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T13:04:21.606969 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81043], State: [ok], Delivered in [0.039886609] seconds [----] I, [2016-09-13T13:04:21.657942 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81046], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.716004916] seconds [----] I, [2016-09-13T13:04:21.658074 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81046], Delivering... [----] I, [2016-09-13T13:04:21.660157 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81046], State: [ok], Delivered in [0.002076289] seconds [----] I, [2016-09-13T13:04:21.680457 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81047], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.702274103] seconds [----] I, [2016-09-13T13:04:21.680572 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81047], Delivering... [----] I, [2016-09-13T13:04:21.683210 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81047], State: [ok], Delivered in [0.002646208] seconds [----] I, [2016-09-13T13:04:26.401599 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:04:26 UTC]... [----] I, [2016-09-13T13:04:26.423280 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:04:26 UTC]...Complete [----] I, [2016-09-13T13:04:26.519163 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T13:04:31.534258 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T13:04:34.000101 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:04:34.018210 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81049], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:04:35.374615 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [81048], MiqWorker id: [104], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [13.790270015] seconds [----] I, [2016-09-13T13:04:35.374940 #24051:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81048], Delivering... [----] I, [2016-09-13T13:04:35.380120 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T13:04:35.380370 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T13:04:35.380525 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T13:04:35.380687 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T13:04:35.380870 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:35.825797 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:36.154723 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:36.154929 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:36.625855 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:36.937519 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:36.937725 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:37.468276 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:37.776707 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:37.776922 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:38.212100 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:04:38.216091 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004076719284057617, :worker_monitor=>1.667754888534546, :worker_dequeue=>0.009143352508544922, :total_time=>1.6813600063323975} [----] I, [2016-09-13T13:04:38.263667 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:38.430015 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81049], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.423366488] seconds [----] I, [2016-09-13T13:04:38.430158 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81049], Delivering... [----] I, [2016-09-13T13:04:38.434710 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024726390838623047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024878978729248047, :pending_vm_jobs=>0.0005190372467041016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004282236099243164} [----] I, [2016-09-13T13:04:38.434971 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81049], State: [ok], Delivered in [0.00480539] seconds [----] I, [2016-09-13T13:04:38.560128 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:38.560262 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:39.053034 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:39.346964 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:39.347134 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:39.840830 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:40.190280 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:40.190501 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:40.664968 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:46.075398 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:46.075641 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:46.545890 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:46.863392 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:46.863638 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:47.345556 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:47.686174 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:47.686299 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:48.156671 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:48.450477 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:48.450646 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:48.942542 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:49.033629 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:04:49.063820 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81050], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:04:49.092535 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81051], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:04:49.274934 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:49.275138 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:49.734781 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:50.033444 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:50.033565 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:50.538461 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:50.879552 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:50.879738 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:51.348983 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:51.503925 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:51.637993 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:51.771992 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:52.024701 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:52.162116 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:52.298010 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:52.428731 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:52.564461 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:52.697488 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:52.835599 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:52.994398 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:53.132578 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:53.275174 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:53.411470 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:53.815275 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:53.970563 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:54.129123 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:54.270011 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:54.411284 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:54.557004 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:54.696949 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:54.861311 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:54.966202 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:04:54.974894 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003756284713745117, :worker_monitor=>1.70731520652771, :worker_dequeue=>0.018013715744018555, :total_time=>1.7295255661010742} [----] I, [2016-09-13T13:04:55.008537 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:55.054734 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81050], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.011539232] seconds [----] I, [2016-09-13T13:04:55.054970 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81050], Delivering... [----] I, [2016-09-13T13:04:55.062243 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003677845001220703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003701448440551758, :pending_vm_jobs=>0.0009543895721435547, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006854534149169922} [----] I, [2016-09-13T13:04:55.062677 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81050], State: [ok], Delivered in [0.007702916] seconds [----] I, [2016-09-13T13:04:55.129319 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81051], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.061335343] seconds [----] I, [2016-09-13T13:04:55.129685 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81051], Delivering... [----] I, [2016-09-13T13:04:55.138161 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81051], State: [ok], Delivered in [0.008439876] seconds [----] I, [2016-09-13T13:04:55.149946 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:55.295495 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:55.434530 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:55.573407 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:55.718279 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:55.868401 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:56.006639 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:56.150210 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:56.629182 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:56.792007 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:56.934341 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:58.186065 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:58.328081 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:58.465180 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:58.607076 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:58.757029 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:58.921171 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:59.057718 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:59.205191 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:59.342729 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:59.484661 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:59.623478 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:59.766712 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:59.911241 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:04:59.975642 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:04:59 UTC]... [----] I, [2016-09-13T13:05:00.008591 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:04:59 UTC]...Complete [----] I, [2016-09-13T13:05:00.053247 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:00.438204 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:00.597455 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:00.740342 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:00.880250 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:01.020360 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:01.199791 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:01.345401 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:01.484592 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:01.624750 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:01.761208 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:01.916347 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:02.068917 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:02.210952 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:02.350177 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:02.488529 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:02.631238 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:02.771591 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:03.276165 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:03.431562 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:03.577262 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:03.720562 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:03.860871 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:04.005866 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:04.103503 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:05:04.117108 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81052], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:05:04.153989 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:04.288906 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:04.430738 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:04.577577 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:04.724114 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:04.864944 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:05.005144 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:05.035430 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:05:05.150111 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:05.157314 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81052], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.046485805] seconds [----] I, [2016-09-13T13:05:05.157496 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81052], Delivering... [----] I, [2016-09-13T13:05:05.163248 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003216981887817383, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032341480255126953, :pending_vm_jobs=>0.0007364749908447266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005467414855957031} [----] I, [2016-09-13T13:05:05.163542 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81052], State: [ok], Delivered in [0.006048971] seconds [----] I, [2016-09-13T13:05:05.288622 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:05.427323 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:05.564122 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:05.928761 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:06.085245 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:06.219990 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:06.362596 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:06.504192 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:06.647790 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:06.790829 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:06.931903 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:07.077095 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:07.215118 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:07.359824 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:07.498691 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:07.644061 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:07.822629 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:07.960655 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:08.114480 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:08.255486 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:08.577587 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:08.737924 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:08.890379 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:11.595225 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006256580352783203, :worker_monitor=>1.5445942878723145, :worker_dequeue=>0.0057680606842041016, :total_time=>1.5571086406707764} [----] I, [2016-09-13T13:05:15.047287 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:15.195034 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:15.334880 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:15.477324 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:15.617845 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:15.761716 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:15.897316 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:16.036695 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:16.174684 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:16.319607 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:16.463512 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:16.612263 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:16.762644 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:16.918998 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:17.327317 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:17.482297 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:17.627619 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:17.766259 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:17.904777 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:18.044657 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:18.186269 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:18.331002 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:18.473904 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:18.613879 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:18.756498 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:18.898396 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:19.033192 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:19.127906 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:05:19.144322 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81053], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:05:19.155439 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81054], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:05:19.172875 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81055], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:05:19.175689 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:19.189727 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81056], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:05:19.326896 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:19.471052 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:19.619086 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:19.919270 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:20.078879 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:20.221726 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:20.374182 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:20.518745 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:20.663668 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:20.811395 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:20.955276 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:21.097121 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:21.238395 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:21.376966 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:21.511174 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:21.620391 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:05:21.648259 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:21.761397 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81053], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.627304373] seconds [----] I, [2016-09-13T13:05:21.761622 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81053], Delivering... [----] I, [2016-09-13T13:05:21.767764 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031533241271972656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031709671020507812, :pending_vm_jobs=>0.0007827281951904297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005760669708251953} [----] I, [2016-09-13T13:05:21.768133 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81053], State: [ok], Delivered in [0.006512065] seconds [----] I, [2016-09-13T13:05:21.795788 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81054], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.6469011] seconds [----] I, [2016-09-13T13:05:21.796056 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81054], Delivering... [----] I, [2016-09-13T13:05:21.806719 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:21.858509 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81054], State: [ok], Delivered in [0.062421944] seconds [----] I, [2016-09-13T13:05:21.863968 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81055], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.703042227] seconds [----] I, [2016-09-13T13:05:21.864073 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81055], Delivering... [----] I, [2016-09-13T13:05:21.865960 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81055], State: [ok], Delivered in [0.001884788] seconds [----] I, [2016-09-13T13:05:21.886660 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81056], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.703934074] seconds [----] I, [2016-09-13T13:05:21.886774 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81056], Delivering... [----] I, [2016-09-13T13:05:21.889516 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81056], State: [ok], Delivered in [0.002750024] seconds [----] I, [2016-09-13T13:05:21.958911 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:22.113244 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:22.266153 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:22.706378 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:22.868505 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:23.009512 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:23.147455 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:23.293267 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:23.432906 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:23.577646 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:23.723327 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:23.862772 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:24.000942 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:24.152066 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:24.293020 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:24.428626 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:24.577320 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:24.728576 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:24.869613 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:25.015994 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:25.456329 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:25.616970 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:25.758244 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:25.897528 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:28.066388 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003951549530029297, :server_monitor=>0.10328149795532227, :worker_monitor=>1.320744514465332, :worker_dequeue=>0.012659311294555664, :total_time=>1.4410748481750488} [----] I, [2016-09-13T13:05:32.065095 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:32.205934 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:32.343783 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:32.569367 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:32.717232 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:32.855232 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:32.997312 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:33.067036 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:05:33 UTC]... [----] I, [2016-09-13T13:05:33.115965 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:05:33 UTC]...Complete [----] I, [2016-09-13T13:05:33.146308 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:33.286783 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:33.432533 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:33.579784 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:33.733464 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:33.877568 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:34.202164 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:05:34.218450 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81057], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:05:34.340978 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:34.506238 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:34.651549 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:34.784791 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:34.926308 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:35.060692 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:35.201363 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:35.341810 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:35.481194 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:35.617812 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:35.759587 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:35.905715 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:36.062020 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:36.203227 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:36.344224 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:36.482670 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:36.619390 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:37.125046 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:37.276085 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:37.420018 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:37.554837 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:37.693614 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:37.831328 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:37.972515 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:38.108753 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:38.143949 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:05:38.245484 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:38.378687 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81057], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.170468239] seconds [----] I, [2016-09-13T13:05:38.378894 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81057], Delivering... [----] I, [2016-09-13T13:05:38.381151 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:38.386985 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004951000213623047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0049800872802734375, :pending_vm_jobs=>0.0008518695831298828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007710695266723633} [----] I, [2016-09-13T13:05:38.387357 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81057], State: [ok], Delivered in [0.008456972] seconds [----] I, [2016-09-13T13:05:38.531462 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:38.678485 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:38.834717 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:38.976194 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:39.119702 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:39.252870 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:39.399771 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:39.790103 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:39.954160 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:40.093139 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:40.240126 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:40.389449 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:40.530783 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:40.677088 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:40.819649 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:40.963685 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:41.106017 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:41.248187 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:41.400612 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:41.540285 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:41.684880 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:41.823138 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:41.962320 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:05:42.110512 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T13:05:42.305156 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T13:05:42.305523 #24051:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T13:05:42.305840 #24051:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T13:05:42.305943 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T13:05:42.306059 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T13:05:42.352747 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T13:05:42.353181 #24051:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [81048], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T13:05:42.353466 #24051:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T13:05:42.353713 #24051:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T13:05:42.353915 #24051:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81048], State: [error], Delivered in [66.979014639] seconds [----] I, [2016-09-13T13:05:44.286199 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.002521038055419922, :worker_monitor=>1.1266224384307861, :worker_dequeue=>0.007838726043701172, :total_time=>1.1372020244598389} [----] I, [2016-09-13T13:05:49.230937 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:05:49.247172 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81058], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:05:49.288234 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81059], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:05:49.296854 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:05:49.489462 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81058], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.252000447] seconds [----] I, [2016-09-13T13:05:49.489644 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81058], Delivering... [----] I, [2016-09-13T13:05:49.495322 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003093719482421875, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031125545501708984, :pending_vm_jobs=>0.0007245540618896484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00536036491394043} [----] I, [2016-09-13T13:05:49.495648 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81058], State: [ok], Delivered in [0.00599736] seconds [----] I, [2016-09-13T13:05:52.019180 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81059], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.767478266] seconds [----] I, [2016-09-13T13:05:52.019374 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81059], Delivering... [----] I, [2016-09-13T13:05:52.023995 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81059], State: [ok], Delivered in [0.004625716] seconds [----] I, [2016-09-13T13:06:00.604604 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004847049713134766, :worker_monitor=>1.2750639915466309, :worker_dequeue=>0.00751185417175293, :total_time=>1.2879219055175781} [----] I, [2016-09-13T13:06:04.301560 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:06:04.331590 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81060], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:06:05.605104 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:06:05 UTC]... [----] I, [2016-09-13T13:06:05.628563 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:06:05 UTC]...Complete [----] I, [2016-09-13T13:06:05.639740 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:06:06.206194 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81060], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.897919641] seconds [----] I, [2016-09-13T13:06:06.206449 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81060], Delivering... [----] I, [2016-09-13T13:06:06.212855 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034677982330322266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034868717193603516, :pending_vm_jobs=>0.0007510185241699219, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005964756011962891} [----] I, [2016-09-13T13:06:06.213177 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81060], State: [ok], Delivered in [0.006762675] seconds [----] I, [2016-09-13T13:06:17.215007 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004263162612915039, :worker_monitor=>1.5393779277801514, :worker_dequeue=>0.010071992874145508, :total_time=>1.5540392398834229} [----] I, [2016-09-13T13:06:19.344817 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:06:19.364586 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81061], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:06:19.375665 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81062], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:06:19.387005 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81063], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:06:19.404386 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81064], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:06:22.229021 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:06:22.427752 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81061], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.075481909] seconds [----] I, [2016-09-13T13:06:22.427970 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81061], Delivering... [----] I, [2016-09-13T13:06:22.435382 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035958290100097656, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036156177520751953, :pending_vm_jobs=>0.0008814334869384766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006954193115234375} [----] I, [2016-09-13T13:06:22.435891 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81061], State: [ok], Delivered in [0.007897488] seconds [----] I, [2016-09-13T13:06:22.450227 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81062], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.080742745] seconds [----] I, [2016-09-13T13:06:22.450409 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81062], Delivering... [----] I, [2016-09-13T13:06:22.507522 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81063], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.125854217] seconds [----] I, [2016-09-13T13:06:22.507706 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81063], Delivering... [----] I, [2016-09-13T13:06:22.510772 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81063], State: [ok], Delivered in [0.003053473] seconds [----] I, [2016-09-13T13:06:22.541851 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81062], State: [ok], Delivered in [0.091390727] seconds [----] I, [2016-09-13T13:06:22.553258 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81064], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.157579033] seconds [----] I, [2016-09-13T13:06:22.553473 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81064], Delivering... [----] I, [2016-09-13T13:06:22.558619 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81064], State: [ok], Delivered in [0.005129402] seconds [----] I, [2016-09-13T13:06:33.623018 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006608009338378906, :worker_monitor=>1.2171053886413574, :worker_dequeue=>0.005271196365356445, :total_time=>1.2293362617492676} [----] I, [2016-09-13T13:06:34.417118 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:06:34.432897 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81065], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:06:38.623616 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:06:38 UTC]... [----] I, [2016-09-13T13:06:38.639296 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:06:38 UTC]...Complete [----] I, [2016-09-13T13:06:38.647568 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:06:38.667444 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81065], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.244299732] seconds [----] I, [2016-09-13T13:06:38.667633 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81065], Delivering... [----] I, [2016-09-13T13:06:38.673712 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003067493438720703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00308990478515625, :pending_vm_jobs=>0.0007636547088623047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00570225715637207} [----] I, [2016-09-13T13:06:38.674048 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81065], State: [ok], Delivered in [0.006416181] seconds [----] I, [2016-09-13T13:06:48.687270 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T13:06:49.455829 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:06:49.490344 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81066], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:06:49.501658 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81067], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:06:50.121565 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:06:50.126015 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00413203239440918, :log_active_servers=>0.015217781066894531, :worker_monitor=>1.4285132884979248, :worker_dequeue=>0.00978231430053711, :total_time=>1.4581429958343506} [----] I, [2016-09-13T13:06:50.787089 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81066], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.319461207] seconds [----] I, [2016-09-13T13:06:50.787226 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81066], Delivering... [----] I, [2016-09-13T13:06:50.790787 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0019483566284179688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0019593238830566406, :pending_vm_jobs=>0.00043082237243652344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003317117691040039} [----] I, [2016-09-13T13:06:50.790999 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81066], State: [ok], Delivered in [0.00377351] seconds [----] I, [2016-09-13T13:06:52.262704 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81067], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.766725271] seconds [----] I, [2016-09-13T13:06:52.263054 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81067], Delivering... [----] I, [2016-09-13T13:06:52.271536 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81067], State: [ok], Delivered in [0.00847832] seconds [----] I, [2016-09-13T13:07:04.518168 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:07:04.536349 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81068], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:07:06.446626 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:07:06.452037 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0048029422760009766, :worker_monitor=>1.2879981994628906, :worker_dequeue=>0.01468205451965332, :total_time=>1.3078999519348145} [----] I, [2016-09-13T13:07:06.908314 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81068], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.381732939] seconds [----] I, [2016-09-13T13:07:06.908530 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81068], Delivering... [----] I, [2016-09-13T13:07:06.914698 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003202199935913086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003222227096557617, :pending_vm_jobs=>0.0007431507110595703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0057964324951171875} [----] I, [2016-09-13T13:07:06.915050 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81068], State: [ok], Delivered in [0.006517751] seconds [----] I, [2016-09-13T13:07:11.452892 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:07:11 UTC]... [----] I, [2016-09-13T13:07:11.473287 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:07:11 UTC]...Complete [----] I, [2016-09-13T13:07:19.554455 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:07:19.570516 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81069], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:07:19.581702 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81070], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:07:19.592964 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81071], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:07:19.604551 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81072], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:07:22.988041 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:07:22.990887 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003214120864868164, :worker_monitor=>1.478841781616211, :worker_dequeue=>0.0064013004302978516, :total_time=>1.4888029098510742} [----] I, [2016-09-13T13:07:23.033312 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81069], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.473604482] seconds [----] I, [2016-09-13T13:07:23.033466 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81069], Delivering... [----] I, [2016-09-13T13:07:23.037562 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.002284526824951172, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002299785614013672, :pending_vm_jobs=>0.00044798851013183594, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0038442611694335938} [----] I, [2016-09-13T13:07:23.037799 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81069], State: [ok], Delivered in [0.004318308] seconds [----] I, [2016-09-13T13:07:23.073531 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81070], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.499394928] seconds [----] I, [2016-09-13T13:07:23.073665 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81070], Delivering... [----] I, [2016-09-13T13:07:23.107619 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81070], State: [ok], Delivered in [0.033904482] seconds [----] I, [2016-09-13T13:07:25.376651 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81071], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.790603009] seconds [----] I, [2016-09-13T13:07:25.376848 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81071], Delivering... [----] I, [2016-09-13T13:07:25.379969 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81071], State: [ok], Delivered in [0.003110896] seconds [----] I, [2016-09-13T13:07:25.410730 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81072], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.813463507] seconds [----] I, [2016-09-13T13:07:25.410872 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81072], Delivering... [----] I, [2016-09-13T13:07:25.414100 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81072], State: [ok], Delivered in [0.003222846] seconds [----] I, [2016-09-13T13:07:34.612594 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:07:34.627685 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81073], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:07:39.745903 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:07:39.750907 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004567384719848633, :worker_monitor=>1.6055662631988525, :worker_dequeue=>0.010515928268432617, :total_time=>1.621002435684204} [----] I, [2016-09-13T13:07:40.662213 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81073], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.044526251] seconds [----] I, [2016-09-13T13:07:40.662379 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81073], Delivering... [----] I, [2016-09-13T13:07:40.668371 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003030538558959961, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003051280975341797, :pending_vm_jobs=>0.0007762908935546875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005599021911621094} [----] I, [2016-09-13T13:07:40.668726 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81073], State: [ok], Delivered in [0.00633185] seconds [----] I, [2016-09-13T13:07:44.751502 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:07:44 UTC]... [----] I, [2016-09-13T13:07:44.770398 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:07:44 UTC]...Complete [----] I, [2016-09-13T13:07:49.639117 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:07:49.662248 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81074], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:07:49.685114 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81075], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:07:49.795277 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:07:50.113926 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81074], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.468939451] seconds [----] I, [2016-09-13T13:07:50.114137 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81074], Delivering... [----] I, [2016-09-13T13:07:50.123664 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037491321563720703, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037729740142822266, :pending_vm_jobs=>0.0009028911590576172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0066869258880615234} [----] I, [2016-09-13T13:07:50.124042 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81074], State: [ok], Delivered in [0.009906629] seconds [----] I, [2016-09-13T13:07:50.154210 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81075], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.487859246] seconds [----] I, [2016-09-13T13:07:50.154458 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81075], Delivering... [----] I, [2016-09-13T13:07:50.159878 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81075], State: [ok], Delivered in [0.005431228] seconds [----] I, [2016-09-13T13:07:56.445200 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005942344665527344, :worker_monitor=>1.629969835281372, :worker_dequeue=>0.008995294570922852, :total_time=>1.6453635692596436} [----] I, [2016-09-13T13:08:04.698015 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:08:04.730975 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81076], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:08:06.470876 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:08:06.873986 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81076], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.169158814] seconds [----] I, [2016-09-13T13:08:06.874212 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81076], Delivering... [----] I, [2016-09-13T13:08:06.881904 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0039365291595458984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00406646728515625, :pending_vm_jobs=>0.0009381771087646484, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007169008255004883} [----] I, [2016-09-13T13:08:06.882309 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81076], State: [ok], Delivered in [0.008092848] seconds [----] I, [2016-09-13T13:08:12.770405 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0047838687896728516, :worker_monitor=>1.2809696197509766, :worker_dequeue=>0.008301496505737305, :total_time=>1.2943956851959229} [----] I, [2016-09-13T13:08:17.771019 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:08:17 UTC]... [----] I, [2016-09-13T13:08:17.787566 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:08:17 UTC]...Complete [----] I, [2016-09-13T13:08:19.745363 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:08:19.794274 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81077], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:08:19.819055 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81078], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:08:19.839528 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81079], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:08:19.857945 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81080], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:08:22.812311 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:08:22.983748 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81077], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.228569745] seconds [----] I, [2016-09-13T13:08:22.983973 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81077], Delivering... [----] I, [2016-09-13T13:08:22.991356 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036902427673339844, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037240982055664062, :pending_vm_jobs=>0.0009720325469970703, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068359375} [----] I, [2016-09-13T13:08:22.991777 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81077], State: [ok], Delivered in [0.007797693] seconds [----] I, [2016-09-13T13:08:23.031150 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81078], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.232387832] seconds [----] I, [2016-09-13T13:08:23.031375 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81078], Delivering... [----] I, [2016-09-13T13:08:23.102291 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81078], State: [ok], Delivered in [0.070894094] seconds [----] I, [2016-09-13T13:08:23.263390 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81079], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.438495311] seconds [----] I, [2016-09-13T13:08:23.263606 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81079], Delivering... [----] I, [2016-09-13T13:08:23.271202 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81079], State: [ok], Delivered in [0.007587349] seconds [----] I, [2016-09-13T13:08:23.308246 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81080], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.458567867] seconds [----] I, [2016-09-13T13:08:23.308462 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81080], Delivering... [----] I, [2016-09-13T13:08:23.312936 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81080], State: [ok], Delivered in [0.004493486] seconds [----] I, [2016-09-13T13:08:29.047531 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003798961639404297, :worker_monitor=>1.2173898220062256, :worker_dequeue=>0.009770870208740234, :total_time=>1.231212854385376} [----] I, [2016-09-13T13:08:34.875304 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:08:34.927531 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81081], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:08:39.182814 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:08:39.235247 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81081], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.353835809] seconds [----] I, [2016-09-13T13:08:39.235446 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81081], Delivering... [----] I, [2016-09-13T13:08:39.241828 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0031774044036865234, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003297567367553711, :pending_vm_jobs=>0.0008127689361572266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006010770797729492} [----] I, [2016-09-13T13:08:39.242130 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81081], State: [ok], Delivered in [0.006704264] seconds [----] I, [2016-09-13T13:08:45.499770 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003396749496459961, :worker_monitor=>1.2990295886993408, :worker_dequeue=>0.009582281112670898, :total_time=>1.31229567527771} [----] I, [2016-09-13T13:08:49.940972 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T13:08:49.960744 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81082], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:08:49.972199 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81083], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:08:49.995113 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81084], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:08:50.006319 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81085], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:08:50.500337 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:08:50 UTC]... [----] I, [2016-09-13T13:08:50.520635 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:08:50 UTC]...Complete [----] I, [2016-09-13T13:08:50.531328 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:08:51.218400 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81082], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.27063323] seconds [----] I, [2016-09-13T13:08:51.218743 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81082], Delivering... [----] I, [2016-09-13T13:08:51.230175 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0058135986328125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0059015750885009766, :pending_vm_jobs=>0.0015110969543457031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010778188705444336} [----] I, [2016-09-13T13:08:51.230724 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81082], State: [ok], Delivered in [0.011986556] seconds [----] I, [2016-09-13T13:08:51.258016 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81083], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.291996252] seconds [----] I, [2016-09-13T13:08:51.258203 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [81083], Delivering... [----] I, [2016-09-13T13:08:51.259639 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T13:08:51.259879 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4602482688 [----] I, [2016-09-13T13:08:51.259986 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4361211904 [----] I, [2016-09-13T13:08:51.260105 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 241270784 [----] I, [2016-09-13T13:08:51.260204 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 922746880 [----] I, [2016-09-13T13:08:51.260290 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4304519168 [----] I, [2016-09-13T13:08:51.260372 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T13:08:51.260492 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T13:08:51.260586 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 564445184 [----] I, [2016-09-13T13:08:51.260668 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T13:08:51.260751 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6791585792 [----] I, [2016-09-13T13:08:51.260852 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T13:08:51.260941 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T13:08:51.261025 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T13:08:51.261102 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T13:08:51.261182 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T13:08:51.261263 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T13:08:51.261348 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T13:08:51.261451 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T13:08:51.261554 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T13:08:51.261635 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T13:08:51.261712 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272633856 [----] I, [2016-09-13T13:08:51.261812 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55414784 [----] I, [2016-09-13T13:08:51.261903 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217219072 [----] I, [2016-09-13T13:08:51.261987 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6176768 [----] I, [2016-09-13T13:08:51.262080 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 143249408 [----] I, [2016-09-13T13:08:51.262165 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3385298944 [----] I, [2016-09-13T13:08:51.262249 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3061329920 [----] I, [2016-09-13T13:08:51.262337 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T13:08:51.262440 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T13:08:51.262540 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T13:08:51.262626 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37199872 [----] I, [2016-09-13T13:08:51.262706 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76918784 [----] I, [2016-09-13T13:08:51.262781 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49614848 [----] I, [2016-09-13T13:08:51.262884 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 112177152 [----] I, [2016-09-13T13:08:51.262964 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126533632 [----] I, [2016-09-13T13:08:51.263041 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T13:08:51.263122 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T13:08:51.263203 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T13:08:51.263280 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T13:08:51.263362 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T13:08:51.263471 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T13:08:51.263571 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T13:08:51.263655 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T13:08:51.263737 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T13:08:51.299441 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T13:08:51.299669 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T13:08:51.304157 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T13:08:51.307635 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T13:08:51.311403 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T13:08:51.315241 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T13:08:51.319142 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T13:08:51.322752 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 860 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T13:08:51.326531 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T13:08:51.330065 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T13:08:51.333879 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.9 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T13:08:51.337576 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T13:08:51.341071 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 176 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T13:08:51.344536 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T13:08:51.347681 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T13:08:51.347850 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T13:08:51.347971 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T13:08:51.352929 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202687000], Memory % [3.38], CPU Time [156689.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T13:08:51.358184 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [81083], State: [ok], Delivered in [0.099955049] seconds [----] I, [2016-09-13T13:08:53.488075 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81085], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.488810002] seconds [----] I, [2016-09-13T13:08:53.488294 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81085], Delivering... [----] I, [2016-09-13T13:08:53.493998 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81085], State: [ok], Delivered in [0.005705188] seconds [----] I, [2016-09-13T13:08:55.546323 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:08:56.406560 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81084], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.430231322] seconds [----] I, [2016-09-13T13:08:56.406717 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [81084], Delivering... [----] I, [2016-09-13T13:08:56.411777 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:08:42 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169751000], Memory % [3.14], CPU Time [53329.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T13:08:56.412202 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:08:34 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [248472.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T13:08:56.412568 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:08:44 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347859000], Memory % [5.04], CPU Time [106962.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T13:08:56.412924 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:08:38 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213441000], Memory % [3.51], CPU Time [50503.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T13:08:56.413323 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:08:42 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163164000], Memory % [3.1], CPU Time [39260.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T13:08:56.413735 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:08:44 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359294000], Memory % [5.28], CPU Time [208953.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T13:08:56.414175 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:08:45 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202687000], Memory % [3.38], CPU Time [155830.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T13:08:56.414547 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:08:45 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [156698.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T13:08:56.416480 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:08:42 UTC], Process Info: Memory Usage [619397120], Memory Size [1045045248], Proportional Set Size: [460250000], Memory % [7.55], CPU Time [1754.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T13:08:56.418041 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:08:39 UTC], Process Info: Memory Usage [602517504], Memory Size [960811008], Proportional Set Size: [445786000], Memory % [7.35], CPU Time [1345.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T13:08:56.418445 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:08:44 UTC], Process Info: Memory Usage [432582656], Memory Size [731521024], Proportional Set Size: [358601000], Memory % [5.27], CPU Time [219117.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T13:08:56.418838 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:08:42 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178490000], Memory % [3.2], CPU Time [53299.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T13:08:56.419177 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:08:33 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166764000], Memory % [3.16], CPU Time [40181.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T13:08:56.419451 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [81084], State: [ok], Delivered in [0.012729564] seconds [----] I, [2016-09-13T13:09:01.782490 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004091739654541016, :worker_monitor=>1.2137746810913086, :worker_dequeue=>0.01277780532836914, :total_time=>1.2309868335723877} [----] I, [2016-09-13T13:09:05.018638 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:09:05.041111 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81086], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:09:06.798359 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:09:07.494142 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81086], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.468185378] seconds [----] I, [2016-09-13T13:09:07.494354 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81086], Delivering... [----] I, [2016-09-13T13:09:07.501545 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037505626678466797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037755966186523438, :pending_vm_jobs=>0.0008268356323242188, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006680011749267578} [----] I, [2016-09-13T13:09:07.501932 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81086], State: [ok], Delivered in [0.007579049] seconds [----] I, [2016-09-13T13:09:18.169782 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005010843276977539, :worker_monitor=>1.3342511653900146, :worker_dequeue=>0.010033607482910156, :total_time=>1.3496694564819336} [----] I, [2016-09-13T13:09:20.053813 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:09:20.069577 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81087], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:09:20.080954 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81088], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:09:20.092147 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81089], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:09:20.103565 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81090], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:09:23.170468 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:09:23 UTC]... [----] I, [2016-09-13T13:09:23.201131 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:09:23 UTC]...Complete [----] I, [2016-09-13T13:09:23.213120 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:09:23.574044 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81087], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.514796326] seconds [----] I, [2016-09-13T13:09:23.574297 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81087], Delivering... [----] I, [2016-09-13T13:09:23.581696 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003876209259033203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003900289535522461, :pending_vm_jobs=>0.0008928775787353516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068705081939697266} [----] I, [2016-09-13T13:09:23.582050 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81087], State: [ok], Delivered in [0.007768629] seconds [----] I, [2016-09-13T13:09:23.589754 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81088], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.516672656] seconds [----] I, [2016-09-13T13:09:23.589959 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81088], Delivering... [----] I, [2016-09-13T13:09:23.618396 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81089], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.533052226] seconds [----] I, [2016-09-13T13:09:23.618635 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81089], Delivering... [----] I, [2016-09-13T13:09:23.622054 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81089], State: [ok], Delivered in [0.003414691] seconds [----] I, [2016-09-13T13:09:23.664261 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81090], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.565994083] seconds [----] I, [2016-09-13T13:09:23.664494 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81090], Delivering... [----] I, [2016-09-13T13:09:23.670298 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81090], State: [ok], Delivered in [0.005828264] seconds [----] I, [2016-09-13T13:09:23.675535 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81088], State: [ok], Delivered in [0.085543755] seconds [----] I, [2016-09-13T13:09:34.611354 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0043294429779052734, :worker_monitor=>1.3658015727996826, :worker_dequeue=>0.007334232330322266, :total_time=>1.3777825832366943} [----] I, [2016-09-13T13:09:35.115066 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:09:35.133038 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81091], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:09:39.732590 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:09:40.727099 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81091], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.605350714] seconds [----] I, [2016-09-13T13:09:40.727342 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81091], Delivering... [----] I, [2016-09-13T13:09:40.735082 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003982067108154297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004004955291748047, :pending_vm_jobs=>0.0009598731994628906, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007207632064819336} [----] I, [2016-09-13T13:09:40.735671 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81091], State: [ok], Delivered in [0.008293804] seconds [----] I, [2016-09-13T13:09:50.168256 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:09:50.201542 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81092], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:09:50.224197 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81093], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:09:50.920382 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:09:50.923029 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005536079406738281, :worker_monitor=>1.15277099609375, :worker_dequeue=>0.005693674087524414, :total_time=>1.164421796798706} [----] I, [2016-09-13T13:09:51.836002 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81092], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.661003359] seconds [----] I, [2016-09-13T13:09:51.836207 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81092], Delivering... [----] I, [2016-09-13T13:09:51.842699 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003488779067993164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003513813018798828, :pending_vm_jobs=>0.00081634521484375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006071567535400391} [----] I, [2016-09-13T13:09:51.843113 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81092], State: [ok], Delivered in [0.006901959] seconds [----] I, [2016-09-13T13:09:53.824396 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81093], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.61791412] seconds [----] I, [2016-09-13T13:09:53.824662 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81093], Delivering... [----] I, [2016-09-13T13:09:53.830397 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81093], State: [ok], Delivered in [0.005737709] seconds [----] I, [2016-09-13T13:09:55.923525 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:09:55 UTC]... [----] I, [2016-09-13T13:09:55.944549 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:09:55 UTC]...Complete [----] I, [2016-09-13T13:10:05.238804 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T13:10:05.264530 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81094], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:10:05.287289 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81095], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:10:05.310133 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81096], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:10:05.333015 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81097], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:10:07.088717 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:10:07.093110 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004528045654296875, :worker_monitor=>1.1035897731781006, :worker_dequeue=>0.009650945663452148, :total_time=>1.118103265762329} [----] I, [2016-09-13T13:10:07.972099 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81094], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.724265843] seconds [----] I, [2016-09-13T13:10:07.972304 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81094], Delivering... [----] I, [2016-09-13T13:10:07.979378 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003675222396850586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003699064254760742, :pending_vm_jobs=>0.0008838176727294922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006650209426879883} [----] I, [2016-09-13T13:10:07.979761 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81094], State: [ok], Delivered in [0.007445792] seconds [----] I, [2016-09-13T13:10:08.846037 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81095], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.574038775] seconds [----] I, [2016-09-13T13:10:08.846195 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81095], Delivering... [----] I, [2016-09-13T13:10:08.847963 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81095], State: [ok], Delivered in [0.001779573] seconds [----] I, [2016-09-13T13:10:08.886309 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81096], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.59177012] seconds [----] I, [2016-09-13T13:10:08.886555 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81096], Delivering... [----] I, [2016-09-13T13:10:08.899775 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81096], State: [ok], Delivered in [0.013201209] seconds [----] I, [2016-09-13T13:10:08.925981 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81097], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.608397175] seconds [----] I, [2016-09-13T13:10:08.926155 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81097], Delivering... [----] I, [2016-09-13T13:10:08.930359 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81097], State: [ok], Delivered in [0.004198748] seconds [----] I, [2016-09-13T13:10:20.349544 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:10:20.366217 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81098], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:10:20.377355 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81099], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:10:20.388893 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81100], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:10:20.417724 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81101], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:10:23.152453 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:10:23.156969 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004116058349609375, :worker_monitor=>1.0234851837158203, :worker_dequeue=>0.009768247604370117, :total_time=>1.0376529693603516} [----] I, [2016-09-13T13:10:23.983390 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81098], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.625728948] seconds [----] I, [2016-09-13T13:10:23.983593 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81098], Delivering... [----] I, [2016-09-13T13:10:23.989009 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81099], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.618085974] seconds [----] I, [2016-09-13T13:10:23.989147 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81099], Delivering... [----] I, [2016-09-13T13:10:23.990398 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034406185150146484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035114288330078125, :pending_vm_jobs=>0.0008792877197265625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006404399871826172} [----] I, [2016-09-13T13:10:23.990738 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81098], State: [ok], Delivered in [0.007143232] seconds [----] I, [2016-09-13T13:10:24.017603 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81100], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.634520246] seconds [----] I, [2016-09-13T13:10:24.017809 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81100], Delivering... [----] I, [2016-09-13T13:10:24.021136 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81100], State: [ok], Delivered in [0.00334119] seconds [----] I, [2016-09-13T13:10:24.040191 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81099], State: [ok], Delivered in [0.051024459] seconds [----] I, [2016-09-13T13:10:24.046110 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81101], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.649358627] seconds [----] I, [2016-09-13T13:10:24.046278 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81101], Delivering... [----] I, [2016-09-13T13:10:24.051056 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81101], State: [ok], Delivered in [0.00476857] seconds [----] I, [2016-09-13T13:10:28.157506 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:10:28 UTC]... [----] I, [2016-09-13T13:10:28.177440 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:10:28 UTC]...Complete [----] I, [2016-09-13T13:10:35.430295 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:10:35.451909 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81102], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:10:39.420903 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:10:39.424168 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0032606124877929688, :worker_monitor=>1.2055447101593018, :worker_dequeue=>0.00704193115234375, :total_time=>1.216111183166504} [----] I, [2016-09-13T13:10:40.172236 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81102], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.735579528] seconds [----] I, [2016-09-13T13:10:40.172525 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81102], Delivering... [----] I, [2016-09-13T13:10:40.180161 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003880739212036133, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003960132598876953, :pending_vm_jobs=>0.0010647773742675781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007195711135864258} [----] I, [2016-09-13T13:10:40.180683 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81102], State: [ok], Delivered in [0.008157265] seconds [----] I, [2016-09-13T13:10:50.463410 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:10:50.486848 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81103], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:10:50.514872 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81104], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:10:56.026595 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:10:56.031301 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0046443939208984375, :worker_monitor=>1.4521117210388184, :worker_dequeue=>0.010364294052124023, :total_time=>1.4674811363220215} [----] I, [2016-09-13T13:10:56.350966 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81103], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.881609749] seconds [----] I, [2016-09-13T13:10:56.351185 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81103], Delivering... [----] I, [2016-09-13T13:10:56.359811 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003519296646118164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003557920455932617, :pending_vm_jobs=>0.0008604526519775391, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006444692611694336} [----] I, [2016-09-13T13:10:56.360186 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81103], State: [ok], Delivered in [0.009010125] seconds [----] I, [2016-09-13T13:10:57.189832 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81104], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.699245143] seconds [----] I, [2016-09-13T13:10:57.190084 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81104], Delivering... [----] I, [2016-09-13T13:10:57.196239 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81104], State: [ok], Delivered in [0.006149292] seconds [----] I, [2016-09-13T13:11:01.031962 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:11:01 UTC]... [----] I, [2016-09-13T13:11:01.117824 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:11:01 UTC]...Complete [----] I, [2016-09-13T13:11:05.526951 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:11:05.546609 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81105], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:11:06.143666 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:11:06.221591 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81105], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.688653434] seconds [----] I, [2016-09-13T13:11:06.221736 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81105], Delivering... [----] I, [2016-09-13T13:11:06.226091 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0024106502532958984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0024251937866210938, :pending_vm_jobs=>0.0005145072937011719, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0040590763092041016} [----] I, [2016-09-13T13:11:06.226326 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81105], State: [ok], Delivered in [0.004586017] seconds [----] I, [2016-09-13T13:11:12.964302 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004575967788696289, :worker_monitor=>1.7988519668579102, :worker_dequeue=>0.012016773223876953, :total_time=>1.8157603740692139} [----] I, [2016-09-13T13:11:20.557745 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:11:20.578110 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81106], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:11:20.589523 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81107], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:11:20.606776 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81108], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:11:20.642167 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81109], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:11:22.998723 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:11:23.522084 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81106], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.956473027] seconds [----] I, [2016-09-13T13:11:23.522295 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81106], Delivering... [----] I, [2016-09-13T13:11:23.531405 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035321712493896484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003698110580444336, :pending_vm_jobs=>0.0009160041809082031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006720542907714844} [----] I, [2016-09-13T13:11:23.531828 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81106], State: [ok], Delivered in [0.009512683] seconds [----] I, [2016-09-13T13:11:23.556315 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81107], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.974047325] seconds [----] I, [2016-09-13T13:11:23.556523 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81107], Delivering... [----] I, [2016-09-13T13:11:23.619231 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81107], State: [ok], Delivered in [0.062661357] seconds [----] I, [2016-09-13T13:11:24.316473 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81108], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.719783214] seconds [----] I, [2016-09-13T13:11:24.316661 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81108], Delivering... [----] I, [2016-09-13T13:11:24.320094 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81108], State: [ok], Delivered in [0.00341701] seconds [----] I, [2016-09-13T13:11:24.322137 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81109], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.702639392] seconds [----] I, [2016-09-13T13:11:24.322327 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81109], Delivering... [----] I, [2016-09-13T13:11:24.329013 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81109], State: [ok], Delivered in [0.006684501] seconds [----] I, [2016-09-13T13:11:29.385412 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004992246627807617, :worker_monitor=>1.3666818141937256, :worker_dequeue=>0.008997201919555664, :total_time=>1.381009578704834} [----] I, [2016-09-13T13:11:34.386039 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:11:34 UTC]... [----] I, [2016-09-13T13:11:34.407670 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:11:34 UTC]...Complete [----] I, [2016-09-13T13:11:35.655135 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:11:35.676089 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81110], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:11:39.436281 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:11:39.756991 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81110], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.095843454] seconds [----] I, [2016-09-13T13:11:39.757207 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81110], Delivering... [----] I, [2016-09-13T13:11:39.764704 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.00402522087097168, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00407719612121582, :pending_vm_jobs=>0.0008969306945800781, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007065534591674805} [----] I, [2016-09-13T13:11:39.765130 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81110], State: [ok], Delivered in [0.007915986] seconds [----] I, [2016-09-13T13:11:45.503101 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004685640335083008, :server_monitor=>0.10402369499206543, :worker_monitor=>0.9396328926086426, :worker_dequeue=>0.007822751998901367, :total_time=>1.0565028190612793} [----] I, [2016-09-13T13:11:50.515140 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T13:11:50.686706 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:11:50.703970 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81111], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:11:50.716376 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81112], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:11:55.534162 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:11:55.858699 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81111], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.165910968] seconds [----] I, [2016-09-13T13:11:55.858945 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81111], Delivering... [----] I, [2016-09-13T13:11:55.866801 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0039904117584228516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004014015197753906, :pending_vm_jobs=>0.0009233951568603516, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0072939395904541016} [----] I, [2016-09-13T13:11:55.867176 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81111], State: [ok], Delivered in [0.008254351] seconds [----] I, [2016-09-13T13:11:57.458638 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81112], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.751786107] seconds [----] I, [2016-09-13T13:11:57.458852 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81112], Delivering... [----] I, [2016-09-13T13:11:57.463810 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81112], State: [ok], Delivered in [0.004958701] seconds [----] I, [2016-09-13T13:12:01.834850 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00410771369934082, :worker_monitor=>1.2819817066192627, :worker_dequeue=>0.007416486740112305, :total_time=>1.293813705444336} [----] I, [2016-09-13T13:12:05.725002 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:12:05.739836 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81113], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:12:06.835369 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:12:06 UTC]... [----] I, [2016-09-13T13:12:06.864454 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:12:06 UTC]...Complete [----] I, [2016-09-13T13:12:06.875558 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:12:07.070394 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81113], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.339561351] seconds [----] I, [2016-09-13T13:12:07.070610 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81113], Delivering... [----] I, [2016-09-13T13:12:07.077631 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003689289093017578, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00380706787109375, :pending_vm_jobs=>0.0008704662322998047, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006639242172241211} [----] I, [2016-09-13T13:12:07.078008 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81113], State: [ok], Delivered in [0.007389898] seconds [----] I, [2016-09-13T13:12:18.059848 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0043070316314697266, :worker_monitor=>1.1586172580718994, :worker_dequeue=>0.005436420440673828, :total_time=>1.1686511039733887} [----] I, [2016-09-13T13:12:20.751141 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:12:20.773053 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81114], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:12:20.784328 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81115], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:12:20.795860 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81116], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:12:20.813176 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81117], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:12:23.074223 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:12:23.173522 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81114], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.415547565] seconds [----] I, [2016-09-13T13:12:23.173720 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81114], Delivering... [----] I, [2016-09-13T13:12:23.180770 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035979747772216797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003701925277709961, :pending_vm_jobs=>0.0008542537689208984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00657963752746582} [----] I, [2016-09-13T13:12:23.181662 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81114], State: [ok], Delivered in [0.007917294] seconds [----] I, [2016-09-13T13:12:23.201679 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81115], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.424346241] seconds [----] I, [2016-09-13T13:12:23.201861 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81115], Delivering... [----] I, [2016-09-13T13:12:23.264639 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81115], State: [ok], Delivered in [0.06275289] seconds [----] I, [2016-09-13T13:12:24.515912 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81116], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.726377094] seconds [----] I, [2016-09-13T13:12:24.516069 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81116], Delivering... [----] I, [2016-09-13T13:12:24.518472 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81116], State: [ok], Delivered in [0.002401827] seconds [----] I, [2016-09-13T13:12:24.532865 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81117], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.72762635] seconds [----] I, [2016-09-13T13:12:24.532988 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81117], Delivering... [----] I, [2016-09-13T13:12:24.536249 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81117], State: [ok], Delivered in [0.003257012] seconds [----] I, [2016-09-13T13:12:34.304597 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006330013275146484, :worker_monitor=>1.1925466060638428, :worker_dequeue=>0.008684158325195312, :total_time=>1.2079715728759766} [----] I, [2016-09-13T13:12:35.827905 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:12:35.847669 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81118], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:12:39.305096 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:12:39 UTC]... [----] I, [2016-09-13T13:12:39.321576 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:12:39 UTC]...Complete [----] I, [2016-09-13T13:12:39.329723 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:12:39.384767 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81118], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.54740697] seconds [----] I, [2016-09-13T13:12:39.384970 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81118], Delivering... [----] I, [2016-09-13T13:12:39.391678 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035293102264404297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003551006317138672, :pending_vm_jobs=>0.0008461475372314453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0063211917877197266} [----] I, [2016-09-13T13:12:39.392016 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81118], State: [ok], Delivered in [0.00705282] seconds [----] I, [2016-09-13T13:12:50.391098 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0036547183990478516, :server_monitor=>0.09347224235534668, :worker_monitor=>0.9481546878814697, :worker_dequeue=>0.004915952682495117, :total_time=>1.0507068634033203} [----] I, [2016-09-13T13:12:50.864353 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:12:50.888186 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81119], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:12:50.899340 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81120], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:12:55.409103 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:12:55.437240 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81119], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.566935497] seconds [----] I, [2016-09-13T13:12:55.437569 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81119], Delivering... [----] I, [2016-09-13T13:12:55.448849 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005701541900634766, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005742073059082031, :pending_vm_jobs=>0.001421213150024414, :vm_jobs_to_dispatch_count=>0, :total_time=>0.010603189468383789} [----] I, [2016-09-13T13:12:55.449285 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81119], State: [ok], Delivered in [0.011720979] seconds [----] I, [2016-09-13T13:12:57.648406 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81120], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.75613891] seconds [----] I, [2016-09-13T13:12:57.648670 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81120], Delivering... [----] I, [2016-09-13T13:12:57.654558 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81120], State: [ok], Delivered in [0.00588846] seconds [----] I, [2016-09-13T13:13:05.911356 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:13:05.933716 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81121], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:13:06.429657 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:13:06.551624 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81121], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.632379991] seconds [----] I, [2016-09-13T13:13:06.551851 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81121], Delivering... [----] I, [2016-09-13T13:13:06.559048 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037686824798583984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037932395935058594, :pending_vm_jobs=>0.0009083747863769531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00679469108581543} [----] I, [2016-09-13T13:13:06.559482 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81121], State: [ok], Delivered in [0.007601218] seconds [----] I, [2016-09-13T13:13:11.432853 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:13:11 UTC]... [----] I, [2016-09-13T13:13:11.448492 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:13:11 UTC]...Complete [----] I, [2016-09-13T13:13:20.945677 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:13:20.963040 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81122], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:13:20.979858 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81123], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:13:20.996885 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81124], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:13:21.020262 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81125], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:13:22.843345 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:13:22.847612 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005774021148681641, :worker_monitor=>1.3417115211486816, :worker_dequeue=>0.011104106903076172, :total_time=>1.358978271484375} [----] I, [2016-09-13T13:13:23.700312 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81122], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.749210718] seconds [----] I, [2016-09-13T13:13:23.700571 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81122], Delivering... [----] I, [2016-09-13T13:13:23.706046 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81123], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.736047346] seconds [----] I, [2016-09-13T13:13:23.706366 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81123], Delivering... [----] I, [2016-09-13T13:13:23.707812 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003918647766113281, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003969430923461914, :pending_vm_jobs=>0.0009312629699707031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0068018436431884766} [----] I, [2016-09-13T13:13:23.708182 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81122], State: [ok], Delivered in [0.007632213] seconds [----] I, [2016-09-13T13:13:23.797151 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81123], State: [ok], Delivered in [0.090817266] seconds [----] I, [2016-09-13T13:13:24.751321 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81124], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.76305946] seconds [----] I, [2016-09-13T13:13:24.751498 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81124], Delivering... [----] I, [2016-09-13T13:13:24.757039 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81125], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.751249301] seconds [----] I, [2016-09-13T13:13:24.757206 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81125], Delivering... [----] I, [2016-09-13T13:13:24.758046 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81124], State: [ok], Delivered in [0.006546226] seconds [----] I, [2016-09-13T13:13:24.761495 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81125], State: [ok], Delivered in [0.004277662] seconds [----] I, [2016-09-13T13:13:36.032649 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:13:36.049730 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81126], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:13:39.226583 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:13:39.229763 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.007869482040405273, :worker_monitor=>1.3384790420532227, :worker_dequeue=>0.007078409194946289, :total_time=>1.353771686553955} [----] I, [2016-09-13T13:13:39.831527 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81126], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.792925574] seconds [----] I, [2016-09-13T13:13:39.831713 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81126], Delivering... [----] I, [2016-09-13T13:13:39.838203 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003540515899658203, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003560304641723633, :pending_vm_jobs=>0.0007634162902832031, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006102800369262695} [----] I, [2016-09-13T13:13:39.838561 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81126], State: [ok], Delivered in [0.006825558] seconds [----] I, [2016-09-13T13:13:44.230260 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:13:44 UTC]... [----] I, [2016-09-13T13:13:44.248330 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:13:44 UTC]...Complete [----] I, [2016-09-13T13:13:51.061295 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T13:13:51.077600 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81127], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:13:51.088805 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81128], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:13:51.100030 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81129], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:13:51.111691 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81130], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:13:55.794254 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:13:55.798766 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00403594970703125, :server_monitor=>0.11127042770385742, :worker_monitor=>1.3968539237976074, :worker_dequeue=>0.009824991226196289, :total_time=>1.5223770141601562} [----] I, [2016-09-13T13:13:55.974882 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81127], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.908900274] seconds [----] I, [2016-09-13T13:13:55.975094 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [81127], Delivering... [----] I, [2016-09-13T13:13:55.976371 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T13:13:55.976621 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4605370368 [----] I, [2016-09-13T13:13:55.976730 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4363804672 [----] I, [2016-09-13T13:13:55.976849 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 241565696 [----] I, [2016-09-13T13:13:55.976940 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 922746880 [----] I, [2016-09-13T13:13:55.977023 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4307046400 [----] I, [2016-09-13T13:13:55.977109 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T13:13:55.977188 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T13:13:55.977268 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 564813824 [----] I, [2016-09-13T13:13:55.977369 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T13:13:55.977492 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6809677824 [----] I, [2016-09-13T13:13:55.977587 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T13:13:55.977668 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T13:13:55.977746 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T13:13:55.977856 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 12288 [----] I, [2016-09-13T13:13:55.977942 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T13:13:55.978021 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T13:13:55.978098 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T13:13:55.978176 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T13:13:55.978253 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T13:13:55.978329 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T13:13:55.978407 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272687104 [----] I, [2016-09-13T13:13:55.978533 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55427072 [----] I, [2016-09-13T13:13:55.978622 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217260032 [----] I, [2016-09-13T13:13:55.978699 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6193152 [----] I, [2016-09-13T13:13:55.978794 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 143511552 [----] I, [2016-09-13T13:13:55.978884 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3382820864 [----] I, [2016-09-13T13:13:55.978964 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3058515968 [----] I, [2016-09-13T13:13:55.979039 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T13:13:55.979118 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T13:13:55.979197 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T13:13:55.979274 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37240832 [----] I, [2016-09-13T13:13:55.979351 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76918784 [----] I, [2016-09-13T13:13:55.979450 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49582080 [----] I, [2016-09-13T13:13:55.979559 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 112209920 [----] I, [2016-09-13T13:13:55.979642 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126500864 [----] I, [2016-09-13T13:13:55.979722 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T13:13:55.979819 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T13:13:55.979903 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T13:13:55.979981 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T13:13:55.980056 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T13:13:55.980131 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T13:13:55.980210 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T13:13:55.980285 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T13:13:55.980360 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T13:13:56.022399 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T13:13:56.022637 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T13:13:56.026626 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T13:13:56.029571 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T13:13:56.032972 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T13:13:56.036309 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T13:13:56.039677 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T13:13:56.042855 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 860 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T13:13:56.045668 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T13:13:56.048710 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T13:13:56.051968 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.8 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T13:13:56.055175 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T13:13:56.058130 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 176 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T13:13:56.061272 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T13:13:56.064175 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T13:13:56.064336 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T13:13:56.064487 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "smartstate"=>1, "ems_inventory"=>1}} [----] I, [2016-09-13T13:13:56.068936 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [155893.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T13:13:56.069268 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [81127], State: [ok], Delivered in [0.094165387] seconds [----] I, [2016-09-13T13:13:56.106527 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81128], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.025011181] seconds [----] I, [2016-09-13T13:13:56.106717 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [81128], Delivering... [----] I, [2016-09-13T13:13:56.113603 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:13:52 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163163000], Memory % [3.1], CPU Time [39299.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T13:13:56.114184 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:13:54 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359292000], Memory % [5.28], CPU Time [208999.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T13:13:56.114755 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:13:55 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202687000], Memory % [3.38], CPU Time [155904.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T13:13:56.115252 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:13:54 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [156767.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T13:13:56.115793 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:13:53 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [53376.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T13:13:56.116310 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:13:51 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [248604.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T13:13:56.116767 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:13:44 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347858000], Memory % [5.04], CPU Time [107027.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T13:13:56.117209 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:13:51 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213440000], Memory % [3.51], CPU Time [50547.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T13:13:56.119862 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:13:53 UTC], Process Info: Memory Usage [619356160], Memory Size [1042423808], Proportional Set Size: [460208000], Memory % [7.55], CPU Time [1767.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T13:13:56.122004 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:13:49 UTC], Process Info: Memory Usage [602882048], Memory Size [976740352], Proportional Set Size: [446156000], Memory % [7.35], CPU Time [1357.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T13:13:56.122576 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:13:54 UTC], Process Info: Memory Usage [432582656], Memory Size [731521024], Proportional Set Size: [358599000], Memory % [5.27], CPU Time [219155.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T13:13:56.123120 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:13:52 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [53355.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T13:13:56.123353 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81129], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.0295147] seconds [----] I, [2016-09-13T13:13:56.123587 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81129], Delivering... [----] I, [2016-09-13T13:13:56.123665 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:13:45 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166764000], Memory % [3.16], CPU Time [40223.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T13:13:56.124044 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [81128], State: [ok], Delivered in [0.017305047] seconds [----] I, [2016-09-13T13:13:56.131311 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003980398178100586, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004007101058959961, :pending_vm_jobs=>0.0009739398956298828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007268428802490234} [----] I, [2016-09-13T13:13:56.131719 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81129], State: [ok], Delivered in [0.008138634] seconds [----] I, [2016-09-13T13:13:57.895153 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81130], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.791282754] seconds [----] I, [2016-09-13T13:13:57.895377 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81130], Delivering... [----] I, [2016-09-13T13:13:57.901310 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81130], State: [ok], Delivered in [0.00592623] seconds [----] I, [2016-09-13T13:14:06.122163 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:14:06.140327 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81131], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:14:11.952232 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:14:11.955135 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004483461380004883, :worker_monitor=>1.1173758506774902, :worker_dequeue=>0.006396055221557617, :total_time=>1.1285879611968994} [----] I, [2016-09-13T13:14:12.266246 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81131], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.139538296] seconds [----] I, [2016-09-13T13:14:12.266486 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81131], Delivering... [----] I, [2016-09-13T13:14:12.273200 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035352706909179688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035772323608398438, :pending_vm_jobs=>0.0008742809295654297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006336212158203125} [----] I, [2016-09-13T13:14:12.273582 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81131], State: [ok], Delivered in [0.007121614] seconds [----] I, [2016-09-13T13:14:16.956215 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:14:16 UTC]... [----] I, [2016-09-13T13:14:16.975673 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:14:16 UTC]...Complete [----] I, [2016-09-13T13:14:21.148902 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:14:21.162645 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81132], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:14:21.168231 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81133], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:14:21.179720 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81134], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:14:21.191919 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81135], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:14:22.013228 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:14:22.317498 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81132], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.164701576] seconds [----] I, [2016-09-13T13:14:22.317681 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81132], Delivering... [----] I, [2016-09-13T13:14:22.324293 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003353118896484375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033745765686035156, :pending_vm_jobs=>0.0008590221405029297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006189107894897461} [----] I, [2016-09-13T13:14:22.324636 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81132], State: [ok], Delivered in [0.006945053] seconds [----] I, [2016-09-13T13:14:22.351738 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81133], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.186920238] seconds [----] I, [2016-09-13T13:14:22.351940 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81133], Delivering... [----] I, [2016-09-13T13:14:22.414538 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81133], State: [ok], Delivered in [0.062572555] seconds [----] I, [2016-09-13T13:14:24.999254 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81134], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.828068032] seconds [----] I, [2016-09-13T13:14:24.999488 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81134], Delivering... [----] I, [2016-09-13T13:14:25.003542 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81134], State: [ok], Delivered in [0.004076724] seconds [----] I, [2016-09-13T13:14:25.026355 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81135], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.842417196] seconds [----] I, [2016-09-13T13:14:25.026606 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81135], Delivering... [----] I, [2016-09-13T13:14:25.031999 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81135], State: [ok], Delivered in [0.005411746] seconds [----] I, [2016-09-13T13:14:28.342689 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005575418472290039, :worker_monitor=>1.307525873184204, :worker_dequeue=>0.01091623306274414, :total_time=>1.324434757232666} [----] I, [2016-09-13T13:14:36.200665 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:14:36.220645 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81136], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:14:38.367519 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:14:38.521709 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81136], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.314521984] seconds [----] I, [2016-09-13T13:14:38.521936 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81136], Delivering... [----] I, [2016-09-13T13:14:38.529000 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003674030303955078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0036954879760742188, :pending_vm_jobs=>0.0009088516235351562, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006671428680419922} [----] I, [2016-09-13T13:14:38.529499 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81136], State: [ok], Delivered in [0.007529469] seconds [----] I, [2016-09-13T13:14:44.655114 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005708932876586914, :worker_monitor=>1.267688512802124, :worker_dequeue=>0.008756160736083984, :total_time=>1.28255033493042} [----] I, [2016-09-13T13:14:49.655714 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:14:49 UTC]... [----] I, [2016-09-13T13:14:49.678841 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:14:49 UTC]...Complete [----] I, [2016-09-13T13:14:51.233996 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:14:51.249240 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81137], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:14:51.260403 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81138], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:14:54.837612 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:14:55.141185 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81137], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.900970202] seconds [----] I, [2016-09-13T13:14:55.141474 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81137], Delivering... [----] I, [2016-09-13T13:14:55.151624 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005002021789550781, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005033016204833984, :pending_vm_jobs=>0.0012812614440917969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009569644927978516} [----] I, [2016-09-13T13:14:55.152070 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81138], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.898309259] seconds [----] I, [2016-09-13T13:14:55.152233 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81138], Delivering... [----] I, [2016-09-13T13:14:55.152195 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81137], State: [ok], Delivered in [0.010751728] seconds [----] I, [2016-09-13T13:14:55.156678 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81138], State: [ok], Delivered in [0.004436175] seconds [----] I, [2016-09-13T13:15:01.279320 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00746917724609375, :worker_monitor=>1.419506549835205, :worker_dequeue=>0.009338855743408203, :total_time=>1.4366915225982666} [----] I, [2016-09-13T13:15:06.274482 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:15:06.306673 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81139], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:15:11.312557 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:15:11.753527 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81139], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.468889387] seconds [----] I, [2016-09-13T13:15:11.753784 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81139], Delivering... [----] I, [2016-09-13T13:15:11.761671 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004524707794189453, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00458836555480957, :pending_vm_jobs=>0.0011134147644042969, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007441282272338867} [----] I, [2016-09-13T13:15:11.761997 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81139], State: [ok], Delivered in [0.008248637] seconds [----] I, [2016-09-13T13:15:17.526571 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005704164505004883, :worker_monitor=>1.1973648071289062, :worker_dequeue=>0.006369829177856445, :total_time=>1.2098166942596436} [----] I, [2016-09-13T13:15:21.318977 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:15:21.335031 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81140], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:15:21.347039 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81141], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:15:21.357634 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81142], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:15:21.369030 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81143], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:15:22.527134 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:15:22 UTC]... [----] I, [2016-09-13T13:15:22.546389 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:15:22 UTC]...Complete [----] I, [2016-09-13T13:15:22.562470 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:15:22.884213 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81140], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.56013782] seconds [----] I, [2016-09-13T13:15:22.884389 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81140], Delivering... [----] I, [2016-09-13T13:15:22.889721 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003060579299926758, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0030786991119384766, :pending_vm_jobs=>0.0005741119384765625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004996299743652344} [----] I, [2016-09-13T13:15:22.889985 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81140], State: [ok], Delivered in [0.005587884] seconds [----] I, [2016-09-13T13:15:22.906973 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81141], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.568206015] seconds [----] I, [2016-09-13T13:15:22.907154 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81141], Delivering... [----] I, [2016-09-13T13:15:22.958174 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81141], State: [ok], Delivered in [0.050998205] seconds [----] I, [2016-09-13T13:15:25.244494 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81142], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.892379167] seconds [----] I, [2016-09-13T13:15:25.244700 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81142], Delivering... [----] I, [2016-09-13T13:15:25.248788 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81142], State: [ok], Delivered in [0.004038523] seconds [----] I, [2016-09-13T13:15:25.250472 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81143], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.885793248] seconds [----] I, [2016-09-13T13:15:25.250800 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81143], Delivering... [----] I, [2016-09-13T13:15:25.258863 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81143], State: [ok], Delivered in [0.008034553] seconds [----] I, [2016-09-13T13:15:33.704195 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003952980041503906, :worker_monitor=>1.1164884567260742, :worker_dequeue=>0.006804466247558594, :total_time=>1.1275088787078857} [----] I, [2016-09-13T13:15:36.379438 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:15:36.392547 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81144], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:15:38.713780 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:15:39.022606 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81144], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.637295887] seconds [----] I, [2016-09-13T13:15:39.022820 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81144], Delivering... [----] I, [2016-09-13T13:15:39.029515 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034644603729248047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003484964370727539, :pending_vm_jobs=>0.0008301734924316406, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006281614303588867} [----] I, [2016-09-13T13:15:39.029900 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81144], State: [ok], Delivered in [0.007084908] seconds [----] I, [2016-09-13T13:15:49.794234 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0045549869537353516, :worker_monitor=>1.0543982982635498, :worker_dequeue=>0.0058362483978271484, :total_time=>1.0650990009307861} [----] I, [2016-09-13T13:15:51.404362 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:15:51.421277 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81145], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:15:51.432667 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81146], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:15:54.794867 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:15:54 UTC]... [----] I, [2016-09-13T13:15:54.815643 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:15:54 UTC]...Complete [----] I, [2016-09-13T13:15:54.923896 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:15:55.187569 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81145], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.776620787] seconds [----] I, [2016-09-13T13:15:55.187802 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81145], Delivering... [----] I, [2016-09-13T13:15:55.194524 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003473997116088867, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003495454788208008, :pending_vm_jobs=>0.0008335113525390625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006280422210693359} [----] I, [2016-09-13T13:15:55.194910 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81145], State: [ok], Delivered in [0.007127277] seconds [----] I, [2016-09-13T13:15:55.358695 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81146], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.933340918] seconds [----] I, [2016-09-13T13:15:55.358935 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81146], Delivering... [----] I, [2016-09-13T13:15:55.364543 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81146], State: [ok], Delivered in [0.005618748] seconds [----] I, [2016-09-13T13:16:06.296268 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004731416702270508, :worker_monitor=>1.3389980792999268, :worker_dequeue=>0.00902557373046875, :total_time=>1.3532440662384033} [----] I, [2016-09-13T13:16:06.444541 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:16:06.461682 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81147], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:16:11.306402 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:16:12.266860 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81147], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.815891287] seconds [----] I, [2016-09-13T13:16:12.266993 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81147], Delivering... [----] I, [2016-09-13T13:16:12.270853 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0020911693572998047, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0021071434020996094, :pending_vm_jobs=>0.00048470497131347656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0036106109619140625} [----] I, [2016-09-13T13:16:12.271125 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81147], State: [ok], Delivered in [0.004130267] seconds [----] I, [2016-09-13T13:16:21.473898 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:16:21.496179 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81148], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:16:21.507235 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81149], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:16:21.518582 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81150], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:16:21.535858 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81151], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:16:22.777048 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:16:22.783040 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.003956317901611328, :worker_monitor=>1.4288690090179443, :worker_dequeue=>0.013124465942382812, :total_time=>1.446225881576538} [----] I, [2016-09-13T13:16:23.387178 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81148], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.90689141] seconds [----] I, [2016-09-13T13:16:23.387312 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81148], Delivering... [----] I, [2016-09-13T13:16:23.391752 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023550987243652344, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0023698806762695312, :pending_vm_jobs=>0.0005481243133544922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004167079925537109} [----] I, [2016-09-13T13:16:23.391994 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81148], State: [ok], Delivered in [0.004673626] seconds [----] I, [2016-09-13T13:16:23.393028 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81149], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.892552705] seconds [----] I, [2016-09-13T13:16:23.393173 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81149], Delivering... [----] I, [2016-09-13T13:16:23.450062 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81149], State: [ok], Delivered in [0.056863411] seconds [----] I, [2016-09-13T13:16:25.410074 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81150], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.897417642] seconds [----] I, [2016-09-13T13:16:25.410227 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81150], Delivering... [----] I, [2016-09-13T13:16:25.415998 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81150], State: [ok], Delivered in [0.005737236] seconds [----] I, [2016-09-13T13:16:25.449629 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81151], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.92312937] seconds [----] I, [2016-09-13T13:16:25.449885 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81151], Delivering... [----] I, [2016-09-13T13:16:25.455157 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81151], State: [ok], Delivered in [0.005264148] seconds [----] I, [2016-09-13T13:16:27.783599 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:16:27 UTC]... [----] I, [2016-09-13T13:16:27.798404 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:16:27 UTC]...Complete [----] I, [2016-09-13T13:16:36.547883 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:16:36.570262 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81152], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:16:39.121206 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:16:39.125861 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0061740875244140625, :worker_monitor=>1.2745954990386963, :worker_dequeue=>0.009816169738769531, :total_time=>1.2909846305847168} [----] I, [2016-09-13T13:16:39.515001 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81152], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.960807582] seconds [----] I, [2016-09-13T13:16:39.515189 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81152], Delivering... [----] I, [2016-09-13T13:16:39.521871 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003566741943359375, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035920143127441406, :pending_vm_jobs=>0.0008528232574462891, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006296396255493164} [----] I, [2016-09-13T13:16:39.522252 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81152], State: [ok], Delivered in [0.007054526] seconds [----] I, [2016-09-13T13:16:51.582516 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:16:51.605863 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81153], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:16:51.615947 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81154], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:16:54.164005 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T13:16:55.313791 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:16:55.316315 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0033080577850341797, :log_active_servers=>0.009206771850585938, :worker_monitor=>1.146371603012085, :worker_dequeue=>0.0056552886962890625, :total_time=>1.1648626327514648} [----] I, [2016-09-13T13:16:55.559128 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81153], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.966814184] seconds [----] I, [2016-09-13T13:16:55.559280 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81153], Delivering... [----] I, [2016-09-13T13:16:55.564109 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0025634765625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026090145111083984, :pending_vm_jobs=>0.0005562305450439453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004496097564697266} [----] I, [2016-09-13T13:16:55.564382 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81153], State: [ok], Delivered in [0.005101883] seconds [----] I, [2016-09-13T13:16:55.582378 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81154], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.973166946] seconds [----] I, [2016-09-13T13:16:55.582621 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81154], Delivering... [----] I, [2016-09-13T13:16:55.587624 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81154], State: [ok], Delivered in [0.004989477] seconds [----] I, [2016-09-13T13:17:00.316908 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:17:00 UTC]... [----] I, [2016-09-13T13:17:00.336408 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:17:00 UTC]...Complete [----] I, [2016-09-13T13:17:06.877058 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:17:06.964808 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81155], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:17:11.641321 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:17:11.645749 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004000186920166016, :worker_monitor=>1.1367037296295166, :worker_dequeue=>0.009467124938964844, :total_time=>1.1504557132720947} [----] I, [2016-09-13T13:17:11.799654 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81155], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.867405657] seconds [----] I, [2016-09-13T13:17:11.799887 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81155], Delivering... [----] I, [2016-09-13T13:17:11.804807 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0026044845581054688, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0026199817657470703, :pending_vm_jobs=>0.0006160736083984375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004529476165771484} [----] I, [2016-09-13T13:17:11.805094 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81155], State: [ok], Delivered in [0.005232448] seconds [----] I, [2016-09-13T13:17:21.973904 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:17:21.999466 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81156], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:17:22.010411 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81157], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:17:22.022044 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81158], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:17:22.040122 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81159], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:17:28.015444 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:17:28.017778 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0040531158447265625, :worker_monitor=>1.334059715270996, :worker_dequeue=>0.005213022232055664, :total_time=>1.3435850143432617} [----] I, [2016-09-13T13:17:28.674260 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81156], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.696118434] seconds [----] I, [2016-09-13T13:17:28.674391 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81156], Delivering... [----] I, [2016-09-13T13:17:28.678563 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0023202896118164062, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002333402633666992, :pending_vm_jobs=>0.0004830360412597656, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003919839859008789} [----] I, [2016-09-13T13:17:28.678812 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81156], State: [ok], Delivered in [0.004410125] seconds [----] I, [2016-09-13T13:17:28.690919 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81157], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.687579249] seconds [----] I, [2016-09-13T13:17:28.691035 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81157], Delivering... [----] I, [2016-09-13T13:17:28.713848 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81158], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.7000768] seconds [----] I, [2016-09-13T13:17:28.714073 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81158], Delivering... [----] I, [2016-09-13T13:17:28.717192 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81158], State: [ok], Delivered in [0.003120983] seconds [----] I, [2016-09-13T13:17:28.748121 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81157], State: [ok], Delivered in [0.057053436] seconds [----] I, [2016-09-13T13:17:28.759448 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81159], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.730274215] seconds [----] I, [2016-09-13T13:17:28.759579 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81159], Delivering... [----] I, [2016-09-13T13:17:28.762887 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81159], State: [ok], Delivered in [0.003297679] seconds [----] I, [2016-09-13T13:17:33.018293 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:17:33 UTC]... [----] I, [2016-09-13T13:17:33.039298 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:17:33 UTC]...Complete [----] I, [2016-09-13T13:17:37.051893 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:17:37.073897 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81160], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:17:38.070691 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:17:38.959439 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81160], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.899661542] seconds [----] I, [2016-09-13T13:17:38.959605 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81160], Delivering... [----] I, [2016-09-13T13:17:38.965998 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030541419982910156, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003082752227783203, :pending_vm_jobs=>0.0007631778717041016, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006062030792236328} [----] I, [2016-09-13T13:17:38.966301 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81160], State: [ok], Delivered in [0.006689243] seconds [----] I, [2016-09-13T13:17:44.507959 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0037767887115478516, :worker_monitor=>1.41896653175354, :worker_dequeue=>0.00812530517578125, :total_time=>1.4311671257019043} [----] I, [2016-09-13T13:17:52.086634 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:17:52.108686 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81161], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:17:52.125247 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81162], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:17:54.532731 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:17:55.114360 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81161], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.017453083] seconds [----] I, [2016-09-13T13:17:55.114618 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81161], Delivering... [----] I, [2016-09-13T13:17:55.121857 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003898143768310547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0039196014404296875, :pending_vm_jobs=>0.0009348392486572266, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006748676300048828} [----] I, [2016-09-13T13:17:55.122257 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81161], State: [ok], Delivered in [0.007640941] seconds [----] I, [2016-09-13T13:17:55.885352 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81162], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.769472856] seconds [----] I, [2016-09-13T13:17:55.885615 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81162], Delivering... [----] I, [2016-09-13T13:17:55.890952 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81162], State: [ok], Delivered in [0.005321918] seconds [----] I, [2016-09-13T13:18:00.881086 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004033565521240234, :worker_monitor=>1.3334803581237793, :worker_dequeue=>0.005570650100708008, :total_time=>1.3433828353881836} [----] I, [2016-09-13T13:18:05.881607 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:18:05 UTC]... [----] I, [2016-09-13T13:18:05.903320 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:18:05 UTC]...Complete [----] I, [2016-09-13T13:18:07.136815 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T13:18:07.153790 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81163], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:18:07.165161 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81164], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [3600] [----] I, [2016-09-13T13:18:11.056177 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:18:11.234093 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81163], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.093311961] seconds [----] I, [2016-09-13T13:18:11.234309 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81163], Delivering... [----] I, [2016-09-13T13:18:11.241217 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003690481185913086, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003709554672241211, :pending_vm_jobs=>0.0008523464202880859, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006479501724243164} [----] I, [2016-09-13T13:18:11.241620 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81163], State: [ok], Delivered in [0.007308971] seconds [----] I, [2016-09-13T13:18:13.938257 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81164], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_for_evm_snapshots], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [3600], Dequeued in: [6.780380354] seconds [----] I, [2016-09-13T13:18:13.938543 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81164], Delivering... [----] I, [2016-09-13T13:18:13.952815 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81164], State: [ok], Delivered in [0.014237828] seconds [----] I, [2016-09-13T13:18:17.356035 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004543781280517578, :worker_monitor=>1.2802472114562988, :worker_dequeue=>0.009820699691772461, :total_time=>1.2949326038360596} [----] I, [2016-09-13T13:18:22.176485 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:18:22.200693 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81165], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:18:22.211880 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81166], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:18:22.224343 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81167], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:18:22.240490 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81168], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:18:22.367094 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:18:22.978016 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81165], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.794509096] seconds [----] I, [2016-09-13T13:18:22.978221 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81165], Delivering... [----] I, [2016-09-13T13:18:22.985444 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037734508514404297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037987232208251953, :pending_vm_jobs=>0.0008754730224609375, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006715297698974609} [----] I, [2016-09-13T13:18:22.985867 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81165], State: [ok], Delivered in [0.00763713] seconds [----] I, [2016-09-13T13:18:23.018265 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81166], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.812921694] seconds [----] I, [2016-09-13T13:18:23.018534 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81166], Delivering... [----] I, [2016-09-13T13:18:23.024209 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81167], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.806596491] seconds [----] I, [2016-09-13T13:18:23.024534 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81167], Delivering... [----] I, [2016-09-13T13:18:23.029318 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81167], State: [ok], Delivered in [0.004758733] seconds [----] I, [2016-09-13T13:18:23.052201 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81168], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.819555145] seconds [----] I, [2016-09-13T13:18:23.052405 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81168], Delivering... [----] I, [2016-09-13T13:18:23.057396 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81168], State: [ok], Delivered in [0.004987901] seconds [----] I, [2016-09-13T13:18:23.098008 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81166], State: [ok], Delivered in [0.079446026] seconds [----] I, [2016-09-13T13:18:33.642525 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00429081916809082, :worker_monitor=>1.242595911026001, :worker_dequeue=>0.009644031524658203, :total_time=>1.2568087577819824} [----] I, [2016-09-13T13:18:37.251959 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:18:37.269540 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81169], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:18:38.643099 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:18:38 UTC]... [----] I, [2016-09-13T13:18:38.663560 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:18:38 UTC]...Complete [----] I, [2016-09-13T13:18:38.674504 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:18:39.458163 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81169], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.201029889] seconds [----] I, [2016-09-13T13:18:39.458368 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81169], Delivering... [----] I, [2016-09-13T13:18:39.465789 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037810802459716797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038018226623535156, :pending_vm_jobs=>0.0009818077087402344, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006956338882446289} [----] I, [2016-09-13T13:18:39.466191 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81169], State: [ok], Delivered in [0.007815334] seconds [----] I, [2016-09-13T13:18:49.933077 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004492998123168945, :worker_monitor=>1.2220203876495361, :worker_dequeue=>0.013224124908447266, :total_time=>1.2400884628295898} [----] I, [2016-09-13T13:18:52.282998 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 3. [----] I, [2016-09-13T13:18:52.304341 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81170], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:18:52.326961 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81171], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:18:52.350020 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81172], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:18:52.360788 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81173], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:18:54.944166 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:18:55.578333 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81170], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.289223332] seconds [----] I, [2016-09-13T13:18:55.578581 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [81170], Delivering... [----] I, [2016-09-13T13:18:55.579635 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T13:18:55.579858 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4590432256 [----] I, [2016-09-13T13:18:55.579959 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4348674048 [----] I, [2016-09-13T13:18:55.580039 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 241758208 [----] I, [2016-09-13T13:18:55.580117 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 920649728 [----] I, [2016-09-13T13:18:55.580194 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4291952640 [----] I, [2016-09-13T13:18:55.580265 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T13:18:55.580336 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T13:18:55.580453 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 564998144 [----] I, [2016-09-13T13:18:55.580549 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T13:18:55.580622 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6673592320 [----] I, [2016-09-13T13:18:55.580690 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T13:18:55.580784 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T13:18:55.580866 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T13:18:55.580936 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T13:18:55.581009 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T13:18:55.581080 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T13:18:55.581152 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T13:18:55.581222 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T13:18:55.581291 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T13:18:55.581363 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T13:18:55.581463 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 272678912 [----] I, [2016-09-13T13:18:55.581555 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55427072 [----] I, [2016-09-13T13:18:55.581629 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 217251840 [----] I, [2016-09-13T13:18:55.581714 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6160384 [----] I, [2016-09-13T13:18:55.581810 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 143511552 [----] I, [2016-09-13T13:18:55.581890 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3397677056 [----] I, [2016-09-13T13:18:55.581962 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 3073286144 [----] I, [2016-09-13T13:18:55.582031 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T13:18:55.582102 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T13:18:55.582174 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T13:18:55.582245 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37044224 [----] I, [2016-09-13T13:18:55.582316 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 76722176 [----] I, [2016-09-13T13:18:55.582388 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 49397760 [----] I, [2016-09-13T13:18:55.582499 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 112209920 [----] I, [2016-09-13T13:18:55.582577 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 126119936 [----] I, [2016-09-13T13:18:55.582652 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T13:18:55.582721 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T13:18:55.582813 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T13:18:55.582888 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T13:18:55.582960 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T13:18:55.583029 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T13:18:55.583101 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T13:18:55.583169 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T13:18:55.583238 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T13:18:55.626395 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T13:18:55.626620 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T13:18:55.630195 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T13:18:55.632903 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T13:18:55.635040 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81172], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.298192661] seconds [----] I, [2016-09-13T13:18:55.635302 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81172], Delivering... [----] I, [2016-09-13T13:18:55.637656 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T13:18:55.643030 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T13:18:55.645524 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0053424835205078125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005369901657104492, :pending_vm_jobs=>0.001310586929321289, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009618759155273438} [----] I, [2016-09-13T13:18:55.645971 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81172], State: [ok], Delivered in [0.010666519] seconds [----] I, [2016-09-13T13:18:55.648495 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T13:18:55.652918 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 862 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T13:18:55.658121 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T13:18:55.661389 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T13:18:55.664504 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 30.9 MB 478 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T13:18:55.667592 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 18 1048558 1% /tmp [----] I, [2016-09-13T13:18:55.670677 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 176 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T13:18:55.673984 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T13:18:55.676737 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T13:18:55.676905 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T13:18:55.677016 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{nil=>2, "ems_inventory"=>1}} [----] I, [2016-09-13T13:18:55.681251 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [432582656], Memory Size [731521024], Proportional Set Size: [358599000], Memory % [5.27], CPU Time [219186.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T13:18:55.681638 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [81170], State: [ok], Delivered in [0.103052575] seconds [----] I, [2016-09-13T13:18:56.188988 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81173], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.833959163] seconds [----] I, [2016-09-13T13:18:56.189215 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81173], Delivering... [----] I, [2016-09-13T13:18:56.194393 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81173], State: [ok], Delivered in [0.005191264] seconds [----] I, [2016-09-13T13:18:59.960714 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:19:00.703177 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81171], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [8.391383438] seconds [----] I, [2016-09-13T13:19:00.703361 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [81171], Delivering... [----] I, [2016-09-13T13:19:00.711025 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:18:49 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [156826.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T13:19:00.711561 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:18:49 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202687000], Memory % [3.38], CPU Time [155966.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T13:19:00.712114 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:18:47 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [53391.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T13:19:00.712683 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:18:37 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [248750.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T13:19:00.713152 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:18:45 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347858000], Memory % [5.04], CPU Time [107043.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T13:19:00.713605 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:18:39 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213440000], Memory % [3.51], CPU Time [50555.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T13:19:00.714150 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:18:47 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163163000], Memory % [3.1], CPU Time [39308.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T13:19:00.714676 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:18:47 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359292000], Memory % [5.28], CPU Time [209034.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T13:19:00.717543 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:18:44 UTC], Process Info: Memory Usage [604868608], Memory Size [936779776], Proportional Set Size: [446060000], Memory % [7.37], CPU Time [1826.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T13:19:00.719686 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:18:40 UTC], Process Info: Memory Usage [602292224], Memory Size [946298880], Proportional Set Size: [445564000], Memory % [7.34], CPU Time [1419.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T13:19:00.720232 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:18:47 UTC], Process Info: Memory Usage [432582656], Memory Size [731521024], Proportional Set Size: [358599000], Memory % [5.27], CPU Time [219195.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T13:19:00.720791 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:18:47 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [53369.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T13:19:00.721255 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:18:46 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166764000], Memory % [3.16], CPU Time [40233.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T13:19:00.721597 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [81171], State: [ok], Delivered in [0.018233921] seconds [----] I, [2016-09-13T13:19:06.247409 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00409245491027832, :worker_monitor=>1.2671751976013184, :worker_dequeue=>0.009667634963989258, :total_time=>1.2812199592590332} [----] I, [2016-09-13T13:19:07.372787 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 10. [----] I, [2016-09-13T13:19:07.388655 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81174], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:19:07.411582 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81175], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:19:11.247936 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:19:11 UTC]... [----] I, [2016-09-13T13:19:11.281494 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:19:11 UTC]...Complete [----] I, [2016-09-13T13:19:11.400446 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:19:11.806274 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81174], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.427548297] seconds [----] I, [2016-09-13T13:19:11.806486 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81174], Delivering... [----] I, [2016-09-13T13:19:11.812684 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032672882080078125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0033032894134521484, :pending_vm_jobs=>0.0007870197296142578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005841970443725586} [----] I, [2016-09-13T13:19:11.813030 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81174], State: [ok], Delivered in [0.006570883] seconds [----] I, [2016-09-13T13:19:14.259489 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81175], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [ManageIQ::Providers::Hawkular::MiddlewareManager.refresh_all_ems_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.854918595] seconds [----] I, [2016-09-13T13:19:14.259841 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81175], Delivering... [----] I, [2016-09-13T13:19:14.292030 #2928:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81176], id: [], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [ready], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]] [----] I, [2016-09-13T13:19:14.292471 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81175], State: [ok], Delivered in [0.032669478] seconds [----] I, [2016-09-13T13:19:16.414031 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T13:19:22.425935 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 6. [----] I, [2016-09-13T13:19:22.441004 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81177], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:19:22.451478 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81178], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:19:22.462825 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81179], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:19:22.474304 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81180], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:19:22.485724 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81181], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:19:22.576438 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 5 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:19:22.579075 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=ems_17, wcount=2, priority=200 [----] I, [2016-09-13T13:19:22.579183 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0041408538818359375, :worker_monitor=>1.1544651985168457, :worker_dequeue=>0.005890846252441406, :total_time=>1.1647939682006836} [----] I, [2016-09-13T13:19:22.868821 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81177], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.437248264] seconds [----] I, [2016-09-13T13:19:22.868984 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81177], Delivering... [----] I, [2016-09-13T13:19:22.875002 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030715465545654297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0031261444091796875, :pending_vm_jobs=>0.0007836818695068359, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0056989192962646484} [----] I, [2016-09-13T13:19:22.875323 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81177], State: [ok], Delivered in [0.00633187] seconds [----] I, [2016-09-13T13:19:22.897522 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81178], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.453952951] seconds [----] I, [2016-09-13T13:19:22.897678 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81178], Delivering... [----] I, [2016-09-13T13:19:22.948844 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81178], State: [ok], Delivered in [0.051140667] seconds [----] I, [2016-09-13T13:19:23.299310 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81179], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.843737128] seconds [----] I, [2016-09-13T13:19:23.299560 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81179], Delivering... [----] I, [2016-09-13T13:19:23.303229 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81179], State: [ok], Delivered in [0.003643843] seconds [----] I, [2016-09-13T13:19:23.331927 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81180], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.864107838] seconds [----] I, [2016-09-13T13:19:23.332103 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81180], Delivering... [----] I, [2016-09-13T13:19:23.336599 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81180], State: [ok], Delivered in [0.004475589] seconds [----] I, [2016-09-13T13:19:23.337838 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81181], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [VmdbDatabaseConnection.log_statistics], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.861059164] seconds [----] I, [2016-09-13T13:19:23.338033 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81181], Delivering... [----] I, [2016-09-13T13:19:23.426221 #2928:34713c] INFO -- : MIQ(VmdbDatabaseConnection.log_statistics) <<-ACTIVITY_STATS_CSV session_id,xact_start,last_request_start_time,command,task_state,login,application,request_id,net_address,host_name,client_port,wait_time_ms,blocked_by 2782,,2016-09-13 17:19:22 UTC,"SELECT id, lock_version, priority, role FROM ""miq_queue"" WHERE ( state = 'ready' AND (zone IS NULL OR zone = 'default') AND queue_name = 'ems_17' AND (role IS NULL OR role IN ('automate','database_operations','database_owner','ems_inventory','ems_operations','event','reporting','scheduler','smartstate','user_interface','web_services','websocket')) AND (server_guid IS NULL OR server_guid = '36647afc-71a3-11e6-838a-fa163e68952f') AND (deliver_on IS NULL OR deliver_on <= '2016-09-13 17:19:22.577826') AND (priority <= 200) ) ORDER BY ""miq_queue"".""priority"" ASC, ""miq_queue"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2927,,2016-09-13 17:19:20 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2936,2016-09-13 17:19:23 UTC,2016-09-13 17:19:23 UTC,"SELECT ""pg_stat_activity"".* FROM ""pg_stat_activity"" WHERE ""pg_stat_activity"".""datname"" = $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2946,2016-09-13 17:19:23 UTC,2016-09-13 17:19:23 UTC,COMMIT,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2955,,2016-09-13 17:19:22 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2966,,2016-09-13 17:19:22 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 2975,,2016-09-13 17:19:20 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2986,,2016-09-13 17:19:20 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,2, 2997,,2016-09-13 17:19:22 UTC,"SELECT ""miq_schedules"".* FROM ""miq_schedules"" WHERE (updated_at > '2016-09-13 17:19:07.420974')",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,0, 3011,,2016-09-13 16:56:45 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1358, 3019,,2016-09-07 14:17:24 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,529318, 3030,,2016-09-13 16:26:29 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3173, 3054,,2016-09-13 16:56:38 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1364, 3062,,2016-09-07 14:17:26 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,529316, 3074,,2016-09-07 14:17:27 UTC,"SELECT ""miq_databases"".* FROM ""miq_databases"" ORDER BY ""miq_databases"".""id"" ASC LIMIT $1",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,529316, 3160,,2016-09-13 16:56:43 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1359, 24059,,2016-09-13 17:19:14 UTC,SELECT pg_backend_pid(),false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,9, 17563,,2016-09-13 16:56:38 UTC,"SELECT ""blacklisted_events"".""event_name"" FROM ""blacklisted_events"" WHERE ""blacklisted_events"".""ems_id"" = $1 AND ""blacklisted_events"".""enabled"" = $2",false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,1364, 27056,,2016-09-13 16:26:24 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,3178, 28888,,2016-09-13 15:56:27 UTC,SELECT EXISTS(SELECT * FROM pg_available_extensions WHERE name = 'pglogical' AND installed_version IS NOT NULL) as enabled,false,root,/var/www/miq/vmdb/lib/workers/bin/evm_server.rb,16384,,,-1,4975, ACTIVITY_STATS_CSV [----] I, [2016-09-13T13:19:23.426705 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81181], State: [ok], Delivered in [0.088653807] seconds [----] I, [2016-09-13T13:19:24.105528 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker::Runner#get_message_via_drb) Message id: [81176], MiqWorker id: [104], Zone: [default], Role: [ems_inventory], Server: [], Ident: [ems_17], Target id: [], Instance id: [], Task id: [], Command: [EmsRefresh.refresh], Timeout: [7200], Priority: [100], State: [dequeue], Deliver On: [], Data: [], Args: [[["ManageIQ::Providers::Hawkular::MiddlewareManager", 17]]], Dequeued in: [9.823193449] seconds [----] I, [2016-09-13T13:19:24.105803 #24051:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81176], Delivering... [----] I, [2016-09-13T13:19:24.109719 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets... [----] I, [2016-09-13T13:19:24.109925 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refreshing targets for EMS... [----] I, [2016-09-13T13:19:24.110081 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T13:19:24.110255 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh_targets_for_ems) EMS: [Hawkular-Provider], id: [17] Refreshing target ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17]... [----] I, [2016-09-13T13:19:24.110493 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:30.567664 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:30.881377 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:30.881636 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:31.360885 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:31.646496 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:31.646679 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:32.119679 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:32.402587 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:32.402828 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:32.876713 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:33.181503 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:33.181707 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:33.648347 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:33.928370 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:33.928585 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:34.421872 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:34.735219 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:34.735444 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:35.232108 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:35.529823 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:35.530020 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:36.021271 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:36.323319 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:36.323595 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:36.793687 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:37.118980 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:37.119153 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:37.496468 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:19:37.520723 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81182], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:19:37.592564 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:37.908705 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:37.908868 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:38.409072 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:38.730319 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:38.730483 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:39.072334 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:19:39.075660 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005299568176269531, :worker_monitor=>1.4478905200958252, :worker_dequeue=>0.011479377746582031, :total_time=>1.4650275707244873} [----] I, [2016-09-13T13:19:39.098195 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81182], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.59251678] seconds [----] I, [2016-09-13T13:19:39.098495 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81182], Delivering... [----] I, [2016-09-13T13:19:39.108776 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0053179264068603516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005346775054931641, :pending_vm_jobs=>0.001344919204711914, :vm_jobs_to_dispatch_count=>0, :total_time=>0.00967717170715332} [----] I, [2016-09-13T13:19:39.109221 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81182], State: [ok], Delivered in [0.010754704] seconds [----] I, [2016-09-13T13:19:39.223060 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:39.534674 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:39.534893 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:40.022078 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:40.316448 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:40.316656 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:40.791092 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:40.961124 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:44.076124 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:19:44 UTC]... [----] I, [2016-09-13T13:19:44.091716 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:19:44 UTC]...Complete [----] I, [2016-09-13T13:19:47.114092 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:47.379553 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:47.521050 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:47.659233 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:47.804316 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:47.943147 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:48.083634 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:48.222864 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:48.367947 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:48.498706 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:48.636231 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:48.774260 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:48.908257 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:49.353341 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:49.513811 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:49.651579 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:49.801237 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:49.962341 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:50.131629 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:50.281651 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:50.417727 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:50.555922 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:50.700232 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:50.837366 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:50.979216 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:51.115558 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:51.254789 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:51.401601 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:51.539403 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:51.682326 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:52.095959 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:52.247632 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:52.389214 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:52.529162 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:52.533806 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:19:52.555002 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81183], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:19:52.566162 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81184], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:19:52.674598 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:52.825988 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:52.973135 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:53.128566 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:53.274457 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:53.435412 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:53.590166 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:53.751929 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:53.892024 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:54.027443 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:54.161871 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:54.363602 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:54.504205 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:54.840921 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:54.988798 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:55.123254 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:55.292003 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:55.431505 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:55.571817 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:55.651875 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:19:55.656576 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005007266998291016, :worker_monitor=>1.5198884010314941, :worker_dequeue=>0.01014256477355957, :total_time=>1.5353271961212158} [----] I, [2016-09-13T13:19:55.713785 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:55.852448 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:55.992519 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:56.138714 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:56.143873 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81183], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.603365217] seconds [----] I, [2016-09-13T13:19:56.144100 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81183], Delivering... [----] I, [2016-09-13T13:19:56.151007 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003695249557495117, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037200450897216797, :pending_vm_jobs=>0.0008590221405029297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006505727767944336} [----] I, [2016-09-13T13:19:56.151444 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81183], State: [ok], Delivered in [0.00733436] seconds [----] I, [2016-09-13T13:19:56.287326 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:56.425411 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:56.486510 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81184], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.927057139] seconds [----] I, [2016-09-13T13:19:56.486725 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81184], Delivering... [----] I, [2016-09-13T13:19:56.491803 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81184], State: [ok], Delivered in [0.005055623] seconds [----] I, [2016-09-13T13:19:56.565004 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:56.709040 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:56.848032 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:56.982313 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:57.119323 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:57.540742 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:57.697217 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:19:57.845049 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:03.999569 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:04.136440 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:04.280687 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:04.419736 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:04.557593 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:04.695939 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:04.893719 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:05.029262 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:05.163623 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:05.303694 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:05.445384 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:05.584609 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:05.723998 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:05.864350 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:06.236402 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:06.407907 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:06.544896 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:06.680143 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:06.825475 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:06.969138 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:07.140127 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:07.282912 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:07.424870 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:07.564743 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:07.581025 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 4. [----] I, [2016-09-13T13:20:07.606712 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81185], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:20:07.624675 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81186], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:20:07.640627 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81187], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:20:07.652008 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81188], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:20:07.705706 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:07.843142 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:07.979772 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:08.121848 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:08.255742 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:08.401897 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:08.544164 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:09.040274 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:09.194179 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:09.346039 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:09.488804 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:09.630833 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:09.771669 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:09.907087 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:10.044117 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:10.185833 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:10.323852 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:10.460375 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:10.597519 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:10.740229 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:10.882039 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:11.032244 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:11.172934 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:11.305959 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:11.737211 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:11.908826 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:11.965744 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:20:11.973868 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004230499267578125, :worker_monitor=>1.259873867034912, :worker_dequeue=>0.017578601837158203, :total_time=>1.2820005416870117} [----] I, [2016-09-13T13:20:12.044299 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:12.183037 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:12.276448 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81185], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.685630952] seconds [----] I, [2016-09-13T13:20:12.276654 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81185], Delivering... [----] I, [2016-09-13T13:20:12.283211 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0035169124603271484, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0035381317138671875, :pending_vm_jobs=>0.000774383544921875, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006143331527709961} [----] I, [2016-09-13T13:20:12.283571 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81185], State: [ok], Delivered in [0.006913156] seconds [----] I, [2016-09-13T13:20:12.320473 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:12.459925 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:12.604490 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:12.747201 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:12.893307 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:13.034294 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:13.178572 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:13.318619 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:13.460209 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:13.606120 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:13.752104 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:13.886502 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:14.034811 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:14.445287 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:14.550202 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81186], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Service.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.935037782] seconds [----] I, [2016-09-13T13:20:14.550375 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81186], Delivering... [----] I, [2016-09-13T13:20:14.552770 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81186], State: [ok], Delivered in [0.002369391] seconds [----] I, [2016-09-13T13:20:14.585516 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81187], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Vm.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.954638956] seconds [----] I, [2016-09-13T13:20:14.585696 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81187], Delivering... [----] I, [2016-09-13T13:20:14.590468 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81188], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [OrchestrationStack.retirement_check], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.943855272] seconds [----] I, [2016-09-13T13:20:14.590661 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81188], Delivering... [----] I, [2016-09-13T13:20:14.595377 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81187], State: [ok], Delivered in [0.009655281] seconds [----] I, [2016-09-13T13:20:14.598442 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81188], State: [ok], Delivered in [0.007745292] seconds [----] I, [2016-09-13T13:20:14.612284 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:14.750280 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:14.887270 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:16.974557 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:20:16 UTC]... [----] I, [2016-09-13T13:20:16.995563 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:20:16 UTC]...Complete [----] I, [2016-09-13T13:20:21.054539 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:21.196845 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:21.335607 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:21.479488 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:21.618170 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:21.760237 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:21.903861 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:22.036971 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:22.180694 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:22.322109 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:22.463073 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:22.598319 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:22.664149 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:20:22.681641 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81189], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:20:22.692883 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81190], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:20:22.710190 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81191], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:20:22.733095 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81192], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:20:22.734154 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:23.210952 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:23.357897 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:23.496881 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:23.643067 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:23.782999 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:23.924638 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:24.069329 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:24.215779 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:24.362646 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:24.506569 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:24.650239 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:24.804440 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:24.964987 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:25.107663 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:25.250219 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:25.389781 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:25.533352 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:25.965671 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:26.125487 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:26.266843 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:26.406608 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:26.596046 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:26.752581 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:26.891916 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:27.040719 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:27.180856 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:27.322440 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:27.468782 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:27.604503 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:27.747619 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:27.887049 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:28.030618 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:28.169619 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:28.307376 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:28.442345 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:20:28.445033 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004145622253417969, :worker_monitor=>1.2995820045471191, :worker_dequeue=>0.005792379379272461, :total_time=>1.3097889423370361} [----] I, [2016-09-13T13:20:28.712644 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:28.859713 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:28.996779 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:29.135631 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:29.275306 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:29.414701 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:29.426792 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81189], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.757638004] seconds [----] I, [2016-09-13T13:20:29.427062 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81189], Delivering... [----] I, [2016-09-13T13:20:29.437041 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005265712738037109, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0052928924560546875, :pending_vm_jobs=>0.0013074874877929688, :vm_jobs_to_dispatch_count=>0, :total_time=>0.009508848190307617} [----] I, [2016-09-13T13:20:29.437502 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81189], State: [ok], Delivered in [0.010402156] seconds [----] I, [2016-09-13T13:20:29.453269 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81190], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.768730664] seconds [----] I, [2016-09-13T13:20:29.453502 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81190], Delivering... [----] I, [2016-09-13T13:20:29.504689 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81190], State: [ok], Delivered in [0.051196245] seconds [----] I, [2016-09-13T13:20:29.563702 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:29.653205 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81191], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.956207848] seconds [----] I, [2016-09-13T13:20:29.653394 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81191], Delivering... [----] I, [2016-09-13T13:20:29.656371 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81191], State: [ok], Delivered in [0.002952249] seconds [----] I, [2016-09-13T13:20:29.675962 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81192], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.959132802] seconds [----] I, [2016-09-13T13:20:29.676135 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81192], Delivering... [----] I, [2016-09-13T13:20:29.681185 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81192], State: [ok], Delivered in [0.005028628] seconds [----] I, [2016-09-13T13:20:29.697920 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:29.842053 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:29.987226 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:30.129393 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:30.269513 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:30.402047 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:30.541289 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:30.684362 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:30.823093 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:30.965851 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:31.361640 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:31.521810 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:31.661177 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:31.820726 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:37.744174 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:20:37.756100 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81193], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:20:37.979119 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:38.127313 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:38.281539 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:38.424147 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:38.467058 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:20:38.522192 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81193], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.771756848] seconds [----] I, [2016-09-13T13:20:38.522365 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81193], Delivering... [----] I, [2016-09-13T13:20:38.528560 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032134056091308594, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032317638397216797, :pending_vm_jobs=>0.0007805824279785156, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005823612213134766} [----] I, [2016-09-13T13:20:38.528889 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81193], State: [ok], Delivered in [0.006511914] seconds [----] I, [2016-09-13T13:20:38.563617 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:38.706980 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:38.851020 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:38.992435 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:39.135789 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:39.276090 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:39.420078 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:39.559540 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:39.709126 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:40.077032 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:40.230061 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:40.373697 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:40.516345 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:40.653883 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:40.824986 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:40.962055 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:41.105133 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:41.248389 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:41.379160 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:41.519950 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:41.664196 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:41.819385 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:41.955806 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:42.100624 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:42.238775 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] I, [2016-09-13T13:20:42.392043 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager#with_provider_connection) Connecting through ManageIQ::Providers::Hawkular::MiddlewareManager: [Hawkular-Provider] [----] E, [2016-09-13T13:20:42.593907 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Refresh failed [----] E, [2016-09-13T13:20:42.594257 #24051:34713c] ERROR -- : [Hawkular::BaseClient::HawkularException]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in block in refresh] [----] E, [2016-09-13T13:20:42.594603 #24051:34713c] ERROR -- : /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:210:in `handle_fault' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:53:in `rescue in http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/base_client.rb:48:in `http_post' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/hawkular-client-2.6.0/lib/hawkular/metrics/metric_api.rb:168:in `raw_data' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:155:in `fetch_availability' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:22:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresh_parser.rb:7:in `ems_inv_to_hashes' /var/www/miq/vmdb/app/models/manageiq/providers/hawkular/middleware_manager/refresher.rb:6:in `parse_legacy_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `block in parse_targeted_inventory' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:122:in `parse_targeted_inventory' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:87:in `block in refresh_targets_for_ems' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:86:in `refresh_targets_for_ems' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block (2 levels) in refresh' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:24:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `each' /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:14:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] E, [2016-09-13T13:20:42.594737 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) EMS: [Hawkular-Provider], id: [17] Unable to perform refresh for the following targets: [----] E, [2016-09-13T13:20:42.594888 #24051:34713c] ERROR -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) --- ManageIQ::Providers::Hawkular::MiddlewareManager [Hawkular-Provider] id [17] [----] I, [2016-09-13T13:20:42.621405 #24051:34713c] INFO -- : MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::Refresher#refresh) Refreshing all targets...Complete [----] E, [2016-09-13T13:20:42.621769 #24051:34713c] ERROR -- : MIQ(MiqQueue#deliver) Message id: [81176], Error: [WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace:] [----] E, [2016-09-13T13:20:42.621970 #24051:34713c] ERROR -- : [EmsRefresh::Refreshers::EmsRefresherMixin::PartialRefreshError]: WELD-000052: Cannot return null from a non-dependent producer method: Producer for Producer Method [MetricsService] with qualifiers [@Any @Default] declared as [[BackedAnnotatedMethod] @Produces @ApplicationScoped public org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService()] declared on Managed Bean [class org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle] with qualifiers [@Any @Default] at org.hawkular.metrics.api.jaxrs.MetricsServiceLifecycle.getMetricsService(MetricsServiceLifecycle.java:0) StackTrace: Method:[rescue in deliver] [----] E, [2016-09-13T13:20:42.622158 #24051:34713c] ERROR -- : /var/www/miq/vmdb/app/models/ems_refresh/refreshers/ems_refresher_mixin.rb:50:in `refresh' /var/www/miq/vmdb/app/models/manageiq/providers/base_manager/refresher.rb:10:in `refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:76:in `block in refresh' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `each' /var/www/miq/vmdb/app/models/ems_refresh.rb:75:in `refresh' /var/www/miq/vmdb/app/models/miq_queue.rb:347:in `block in deliver' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:91:in `block in timeout' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `block in catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:33:in `catch' /opt/rubies/ruby-2.3.1/lib/ruby/2.3.0/timeout.rb:106:in `timeout' /var/www/miq/vmdb/app/models/miq_queue.rb:343:in `deliver' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:106:in `deliver_queue_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:134:in `deliver_message' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:152:in `block in do_work' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `loop' /var/www/miq/vmdb/app/models/miq_queue_worker_base/runner.rb:146:in `do_work' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:334:in `block in do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:331:in `do_work_loop' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:153:in `run' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:128:in `start' /var/www/miq/vmdb/app/models/miq_worker/runner.rb:21:in `start_worker' /var/www/miq/vmdb/app/models/miq_worker.rb:343:in `block in start' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /opt/rubies/ruby-2.3.1/lib/ruby/gems/2.3.0/gems/nakayoshi_fork-0.0.3/lib/nakayoshi_fork.rb:24:in `fork' /var/www/miq/vmdb/app/models/miq_worker.rb:341:in `start' /var/www/miq/vmdb/app/models/miq_worker.rb:270:in `start_worker' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:68:in `start_worker_for_ems' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:46:in `block in sync_workers' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `each' /var/www/miq/vmdb/app/models/mixins/per_ems_worker_mixin.rb:45:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:52:in `block in sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `each' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:50:in `sync_workers' /var/www/miq/vmdb/app/models/miq_server/worker_management/monitor.rb:22:in `monitor_workers' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `block in monitor' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:350:in `monitor' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block (2 levels) in monitor_loop' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:11:in `realtime_store' /var/www/miq/vmdb/gems/pending/util/extensions/miq-benchmark.rb:30:in `realtime_block' /var/www/miq/vmdb/app/models/miq_server.rb:372:in `block in monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `loop' /var/www/miq/vmdb/app/models/miq_server.rb:371:in `monitor_loop' /var/www/miq/vmdb/app/models/miq_server.rb:254:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:65:in `start' /var/www/miq/vmdb/lib/workers/evm_server.rb:92:in `start' /var/www/miq/vmdb/lib/workers/bin/evm_server.rb:4:in `
' [----] I, [2016-09-13T13:20:42.622312 #24051:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81176], State: [error], Delivered in [78.516555784] seconds [----] I, [2016-09-13T13:20:44.797916 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.00506901741027832, :worker_monitor=>1.3148601055145264, :worker_dequeue=>0.0073277950286865234, :total_time=>1.3276257514953613} [----] I, [2016-09-13T13:20:49.798579 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:20:49 UTC]... [----] I, [2016-09-13T13:20:49.818144 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:20:49 UTC]...Complete [----] I, [2016-09-13T13:20:52.768784 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:20:52.788442 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81194], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:20:52.799495 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81195], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:20:54.850391 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:20:55.656744 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81194], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.881641541] seconds [----] I, [2016-09-13T13:20:55.656971 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81194], Delivering... [----] I, [2016-09-13T13:20:55.663207 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003278017044067383, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032966136932373047, :pending_vm_jobs=>0.0007643699645996094, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0058710575103759766} [----] I, [2016-09-13T13:20:55.663562 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81194], State: [ok], Delivered in [0.006590759] seconds [----] I, [2016-09-13T13:20:56.806737 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81195], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.013818172] seconds [----] I, [2016-09-13T13:20:56.806966 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81195], Delivering... [----] I, [2016-09-13T13:20:56.811848 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81195], State: [ok], Delivered in [0.004881678] seconds [----] I, [2016-09-13T13:21:01.176988 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004178524017333984, :worker_monitor=>1.3088221549987793, :worker_dequeue=>0.009063959121704102, :total_time=>1.3223819732666016} [----] I, [2016-09-13T13:21:07.810868 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:21:07.828149 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81196], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:21:11.200329 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:21:11.799765 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81196], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.982998814] seconds [----] I, [2016-09-13T13:21:11.799939 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81196], Delivering... [----] I, [2016-09-13T13:21:11.805828 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0030057430267333984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003023386001586914, :pending_vm_jobs=>0.0007710456848144531, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0055501461029052734} [----] I, [2016-09-13T13:21:11.806142 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81196], State: [ok], Delivered in [0.006202187] seconds [----] I, [2016-09-13T13:21:17.628207 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0038695335388183594, :worker_monitor=>1.4105618000030518, :worker_dequeue=>0.008518695831298828, :total_time=>1.4232275485992432} [----] I, [2016-09-13T13:21:22.629067 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:21:22 UTC]... [----] I, [2016-09-13T13:21:22.662720 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:21:22 UTC]...Complete [----] I, [2016-09-13T13:21:22.840208 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:21:22.856941 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81197], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:21:22.874300 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81198], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:21:22.903130 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81199], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:21:22.925569 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81200], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:21:27.805840 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:21:27.919980 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81197], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.072985119] seconds [----] I, [2016-09-13T13:21:27.920103 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81197], Delivering... [----] I, [2016-09-13T13:21:27.924149 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0022399425506591797, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0022530555725097656, :pending_vm_jobs=>0.0004971027374267578, :vm_jobs_to_dispatch_count=>0, :total_time=>0.003823518753051758} [----] I, [2016-09-13T13:21:27.924388 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81197], State: [ok], Delivered in [0.004276901] seconds [----] I, [2016-09-13T13:21:27.925471 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81198], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.064253123] seconds [----] I, [2016-09-13T13:21:27.925591 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81198], Delivering... [----] I, [2016-09-13T13:21:27.959552 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81198], State: [ok], Delivered in [0.033944119] seconds [----] I, [2016-09-13T13:21:29.851655 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81199], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.971405196] seconds [----] I, [2016-09-13T13:21:29.851916 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81199], Delivering... [----] I, [2016-09-13T13:21:29.857622 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81199], State: [ok], Delivered in [0.005697913] seconds [----] I, [2016-09-13T13:21:29.879883 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81200], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.96782405] seconds [----] I, [2016-09-13T13:21:29.880060 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81200], Delivering... [----] I, [2016-09-13T13:21:29.884944 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81200], State: [ok], Delivered in [0.004876202] seconds [----] I, [2016-09-13T13:21:34.104266 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004301309585571289, :worker_monitor=>1.2816050052642822, :worker_dequeue=>0.009435415267944336, :total_time=>1.295625925064087} [----] I, [2016-09-13T13:21:37.938200 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:21:37.960178 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81201], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:21:39.113908 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:21:40.023731 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81201], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.079135] seconds [----] I, [2016-09-13T13:21:40.024024 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81201], Delivering... [----] I, [2016-09-13T13:21:40.031492 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004442691802978516, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.004464864730834961, :pending_vm_jobs=>0.0007793903350830078, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007029294967651367} [----] I, [2016-09-13T13:21:40.031866 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81201], State: [ok], Delivered in [0.007884343] seconds [----] I, [2016-09-13T13:21:50.483645 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0044400691986083984, :worker_monitor=>1.3407549858093262, :worker_dequeue=>0.005999565124511719, :total_time=>1.3515100479125977} [----] I, [2016-09-13T13:21:52.972653 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:21:53.017810 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81202], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:21:53.028850 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81203], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:21:55.484304 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:21:55 UTC]... [----] I, [2016-09-13T13:21:55.497291 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:21:55 UTC]...Complete [----] I, [2016-09-13T13:21:55.514525 #2763:34713c] INFO -- : MiqServer: local=Y, master=Y, status= started, id=00001, pid=02763, guid=36647afc-71a3-11e6-838a-fa163e68952f, name=EVM, zone=default, hostname=host-192-168-100-106, ipaddress=192.168.100.106, version=master, build=20160907101630_30b49fa, active roles=automate:database_operations:database_owner:ems_inventory:ems_operations:event:reporting:scheduler:smartstate:user_interface:web_services:websocket [----] I, [2016-09-13T13:21:55.520184 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:21:56.172081 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81202], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.188870573] seconds [----] I, [2016-09-13T13:21:56.172278 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81202], Delivering... [----] I, [2016-09-13T13:21:56.178726 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003389120101928711, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003407716751098633, :pending_vm_jobs=>0.0008084774017333984, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006045818328857422} [----] I, [2016-09-13T13:21:56.179109 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81202], State: [ok], Delivered in [0.006830203] seconds [----] I, [2016-09-13T13:21:56.988902 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81203], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.966470872] seconds [----] I, [2016-09-13T13:21:56.989055 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81203], Delivering... [----] I, [2016-09-13T13:21:56.992680 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81203], State: [ok], Delivered in [0.003625091] seconds [----] I, [2016-09-13T13:22:06.964267 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004218578338623047, :worker_monitor=>1.4039287567138672, :worker_dequeue=>0.015507936477661133, :total_time=>1.424048662185669} [----] I, [2016-09-13T13:22:08.041807 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:22:08.063262 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81204], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:22:11.975024 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:22:12.040589 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81204], MiqWorker id: [13], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.992001009] seconds [----] I, [2016-09-13T13:22:12.040831 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81204], Delivering... [----] I, [2016-09-13T13:22:12.047167 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0032567977905273438, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0032744407653808594, :pending_vm_jobs=>0.0007979869842529297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005926609039306641} [----] I, [2016-09-13T13:22:12.047537 #2928:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81204], State: [ok], Delivered in [0.006709724] seconds [----] I, [2016-09-13T13:22:23.075894 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:22:23.091658 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81205], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:22:23.103839 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81206], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:22:23.131630 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81207], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:22:23.154608 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81208], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:22:23.240995 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:22:23.245472 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004767894744873047, :worker_monitor=>1.2317235469818115, :worker_dequeue=>0.012164115905761719, :total_time=>1.2490427494049072} [----] I, [2016-09-13T13:22:23.395124 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81205], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.311818983] seconds [----] I, [2016-09-13T13:22:23.395340 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81205], Delivering... [----] I, [2016-09-13T13:22:23.403627 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036208629608154297, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.00363922119140625, :pending_vm_jobs=>0.0007984638214111328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006255626678466797} [----] I, [2016-09-13T13:22:23.404055 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81205], State: [ok], Delivered in [0.008704268] seconds [----] I, [2016-09-13T13:22:23.456623 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81206], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.360058026] seconds [----] I, [2016-09-13T13:22:23.456842 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81206], Delivering... [----] I, [2016-09-13T13:22:23.513580 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81206], State: [ok], Delivered in [0.056713967] seconds [----] I, [2016-09-13T13:22:24.079467 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81207], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.96987845] seconds [----] I, [2016-09-13T13:22:24.079687 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81207], Delivering... [----] I, [2016-09-13T13:22:24.088077 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81207], State: [ok], Delivered in [0.008367352] seconds [----] I, [2016-09-13T13:22:24.102139 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81208], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [0.964839195] seconds [----] I, [2016-09-13T13:22:24.102319 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81208], Delivering... [----] I, [2016-09-13T13:22:24.107316 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81208], State: [ok], Delivered in [0.004982692] seconds [----] I, [2016-09-13T13:22:28.246018 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:22:28 UTC]... [----] I, [2016-09-13T13:22:28.261789 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:22:28 UTC]...Complete [----] I, [2016-09-13T13:22:38.165378 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:22:38.199800 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81209], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:22:39.727832 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:22:39.732542 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004378557205200195, :worker_monitor=>1.3125782012939453, :worker_dequeue=>0.010034799575805664, :total_time=>1.327308177947998} [----] I, [2016-09-13T13:22:39.931371 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81209], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.758586415] seconds [----] I, [2016-09-13T13:22:39.931591 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81209], Delivering... [----] I, [2016-09-13T13:22:39.938059 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034220218658447266, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0034437179565429688, :pending_vm_jobs=>0.0007851123809814453, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006066560745239258} [----] I, [2016-09-13T13:22:39.938445 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81209], State: [ok], Delivered in [0.006824403] seconds [----] I, [2016-09-13T13:22:53.213381 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:22:53.245718 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81210], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:22:53.292563 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81211], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:22:56.098998 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:22:56.103223 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005980491638183594, :worker_monitor=>1.326498031616211, :worker_dequeue=>0.008929014205932617, :total_time=>1.3418397903442383} [----] I, [2016-09-13T13:22:56.119560 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81210], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.899955207] seconds [----] I, [2016-09-13T13:22:56.119701 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81210], Delivering... [----] I, [2016-09-13T13:22:56.124835 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0028536319732666016, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.002873659133911133, :pending_vm_jobs=>0.0005619525909423828, :vm_jobs_to_dispatch_count=>0, :total_time=>0.004806995391845703} [----] I, [2016-09-13T13:22:56.125105 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81210], State: [ok], Delivered in [0.005400973] seconds [----] I, [2016-09-13T13:22:57.605493 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81211], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.355134279] seconds [----] I, [2016-09-13T13:22:57.605727 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81211], Delivering... [----] I, [2016-09-13T13:22:57.610739 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81211], State: [ok], Delivered in [0.005007334] seconds [----] I, [2016-09-13T13:23:01.103717 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:23:01 UTC]... [----] I, [2016-09-13T13:23:01.125248 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:23:01 UTC]...Complete [----] I, [2016-09-13T13:23:08.305831 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:23:08.335388 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81212], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:23:08.375363 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81213], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:23:12.677267 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:23:12.688039 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0028753280639648438, :worker_monitor=>1.5153698921203613, :worker_dequeue=>0.015928268432617188, :total_time=>1.5344197750091553} [----] I, [2016-09-13T13:23:12.732624 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81213], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqAlert.evaluate_hourly_timer], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.391248548] seconds [----] I, [2016-09-13T13:23:12.732911 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81213], Delivering... [----] I, [2016-09-13T13:23:12.733457 #2928:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Starting [----] I, [2016-09-13T13:23:12.741455 #2928:34713c] INFO -- : MIQ(MiqAlert.evaluate_hourly_timer) Complete [----] I, [2016-09-13T13:23:12.741954 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81213], State: [ok], Delivered in [0.009026901] seconds [----] I, [2016-09-13T13:23:12.749445 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81212], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.437257325] seconds [----] I, [2016-09-13T13:23:12.749653 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81212], Delivering... [----] I, [2016-09-13T13:23:12.756289 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003526449203491211, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003551959991455078, :pending_vm_jobs=>0.0008029937744140625, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006227970123291016} [----] I, [2016-09-13T13:23:12.756660 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81212], State: [ok], Delivered in [0.007012354] seconds [----] I, [2016-09-13T13:23:23.388584 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:23:23.411513 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81214], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:23:23.422719 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81215], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:23:23.434024 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81216], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:23:23.451311 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81217], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:23:28.983282 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:23:28.988299 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004479169845581055, :worker_monitor=>1.2545218467712402, :worker_dequeue=>0.011979818344116211, :total_time=>1.2713146209716797} [----] I, [2016-09-13T13:23:29.411883 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81214], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.016569023] seconds [----] I, [2016-09-13T13:23:29.412094 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81214], Delivering... [----] I, [2016-09-13T13:23:29.417589 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81215], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.001322404] seconds [----] I, [2016-09-13T13:23:29.417837 #2947:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81215], Delivering... [----] I, [2016-09-13T13:23:29.428566 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.004029273986816406, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0041162967681884766, :pending_vm_jobs=>0.008075952529907227, :vm_jobs_to_dispatch_count=>0, :total_time=>0.015948057174682617} [----] I, [2016-09-13T13:23:29.429174 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81214], State: [ok], Delivered in [0.017051635] seconds [----] I, [2016-09-13T13:23:29.491869 #2947:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81215], State: [ok], Delivered in [0.07400492] seconds [----] I, [2016-09-13T13:23:30.840083 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81216], MiqWorker id: [13], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.411410914] seconds [----] I, [2016-09-13T13:23:30.840286 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81216], Delivering... [----] I, [2016-09-13T13:23:30.843687 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81216], State: [ok], Delivered in [0.003415039] seconds [----] I, [2016-09-13T13:23:30.859708 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81217], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [7.417319119] seconds [----] I, [2016-09-13T13:23:30.860036 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81217], Delivering... [----] I, [2016-09-13T13:23:30.865359 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81217], State: [ok], Delivered in [0.005340289] seconds [----] I, [2016-09-13T13:23:33.988997 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:23:33 UTC]... [----] I, [2016-09-13T13:23:34.040044 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:23:33 UTC]...Complete [----] I, [2016-09-13T13:23:38.464476 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:23:43.001409 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81218], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:23:45.571822 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81219], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:23:49.402821 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81220], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:23:58.782446 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 3 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:23:58.786731 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005427122116088867, :worker_monitor=>14.650622367858887, :worker_dequeue=>0.009331703186035156, :total_time=>14.665761232376099} [----] I, [2016-09-13T13:23:59.683495 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81218], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [21.212814746] seconds [----] I, [2016-09-13T13:23:59.683720 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81218], Delivering... [----] I, [2016-09-13T13:23:59.690917 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003778696060180664, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038034915924072266, :pending_vm_jobs=>0.0008914470672607422, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0067250728607177734} [----] I, [2016-09-13T13:23:59.691276 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81218], State: [ok], Delivered in [0.007557555] seconds [----] I, [2016-09-13T13:23:59.751726 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81220], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqWorker.log_status_all], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [14.175506841] seconds [----] I, [2016-09-13T13:23:59.751950 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [81220], Delivering... [----] I, [2016-09-13T13:23:59.759093 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebServiceWorker#log_status) [Web Services Worker] Worker ID [22], PID [3046], GUID [cce2ed5a-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:23:51 UTC], Process Info: Memory Usage [287567872], Memory Size [602968064], Proportional Set Size: [213440000], Memory % [3.51], CPU Time [50563.0], CPU % [0.1], Priority [21] [----] I, [2016-09-13T13:23:59.759819 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqEventHandler#log_status) [Event Handler] Worker ID [12], PID [2918], GUID [c655b6de-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:23:57 UTC], Process Info: Memory Usage [254459904], Memory Size [574877696], Proportional Set Size: [163163000], Memory % [3.1], CPU Time [39318.0], CPU % [0.07], Priority [27] [----] I, [2016-09-13T13:23:59.760455 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [14], PID [2937], GUID [c763bdbe-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:23:57 UTC], Process Info: Memory Usage [433213440], Memory Size [732471296], Proportional Set Size: [359289000], Memory % [5.28], CPU Time [209109.0], CPU % [0.4], Priority [30] [----] I, [2016-09-13T13:23:59.761067 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [15], PID [2947], GUID [c7a7f470-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:23:57 UTC], Process Info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [156941.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T13:23:59.761610 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqPriorityWorker#log_status) [Priority Worker] Worker ID [16], PID [2957], GUID [c7fde0a6-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:23:57 UTC], Process Info: Memory Usage [277401600], Memory Size [578035712], Proportional Set Size: [202687000], Memory % [3.38], CPU Time [156074.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T13:23:59.762210 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [18], PID [2978], GUID [c87e430e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:23:57 UTC], Process Info: Memory Usage [257740800], Memory Size [582246400], Proportional Set Size: [169750000], Memory % [3.14], CPU Time [53407.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T13:23:59.762830 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqScheduleWorker#log_status) [Schedule Worker] Worker ID [19], PID [2989], GUID [c8ab90a2-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:23:49 UTC], Process Info: Memory Usage [288956416], Memory Size [627494912], Proportional Set Size: [208117000], Memory % [3.52], CPU Time [248880.0], CPU % [0.47], Priority [23] [----] I, [2016-09-13T13:23:59.763339 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqUiWorker#log_status) [User Interface Worker] Worker ID [21], PID [3022], GUID [cc964d2e-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:23:57 UTC], Process Info: Memory Usage [413081600], Memory Size [726491136], Proportional Set Size: [347857000], Memory % [5.04], CPU Time [107061.0], CPU % [0.2], Priority [21] [----] I, [2016-09-13T13:23:59.766269 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::RefreshWorker#log_status) [Refresh Worker for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [104], PID [24051], GUID [ee14426a-79c6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:23:52 UTC], Process Info: Memory Usage [617046016], Memory Size [1078493184], Proportional Set Size: [457952000], Memory % [7.52], CPU Time [1975.0], CPU % [0.0], Priority [27] [----] I, [2016-09-13T13:23:59.768728 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(ManageIQ::Providers::Hawkular::MiddlewareManager::EventCatcher#log_status) [Event Monitor for Cloud/Infrastructure Providers: Hawkular-Provider] Worker ID [103], PID [17555], GUID [1dd6952c-79b6-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:23:50 UTC], Process Info: Memory Usage [602537984], Memory Size [962027520], Proportional Set Size: [445801000], Memory % [7.35], CPU Time [1433.0], CPU % [0.0], Priority [21] [----] I, [2016-09-13T13:23:59.768908 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81219], MiqWorker id: [15], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [log_status], Command: [MiqServer.log_status], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [16.761160092] seconds [----] I, [2016-09-13T13:23:59.769095 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#deliver) Message id: [81219], Delivering... [----] I, [2016-09-13T13:23:59.769349 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqGenericWorker#log_status) [Generic Worker] Worker ID [13], PID [2928], GUID [c6f52fac-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:23:57 UTC], Process Info: Memory Usage [432582656], Memory Size [731521024], Proportional Set Size: [358596000], Memory % [5.27], CPU Time [219281.0], CPU % [0.42], Priority [30] [----] I, [2016-09-13T13:23:59.769979 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqReportingWorker#log_status) [Reporting Worker] Worker ID [17], PID [2967], GUID [c82f25a8-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:23:57 UTC], Process Info: Memory Usage [262713344], Memory Size [579088384], Proportional Set Size: [178489000], Memory % [3.2], CPU Time [53386.0], CPU % [0.1], Priority [27] [----] I, [2016-09-13T13:23:59.770538 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqWebsocketWorker#log_status) [Websocket Worker] Worker ID [20], PID [3003], GUID [c8d608fa-7505-11e6-87c1-fa163e7d01a3], Last Heartbeat [2016-09-13 17:23:58 UTC], Process Info: Memory Usage [259391488], Memory Size [593883136], Proportional Set Size: [166762000], Memory % [3.16], CPU Time [40244.0], CPU % [0.08], Priority [21] [----] I, [2016-09-13T13:23:59.770573 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] System Status: [----] I, [2016-09-13T13:23:59.770811 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active: 4606377984 [----] I, [2016-09-13T13:23:59.770922 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(anon): 4364288000 [----] I, [2016-09-13T13:23:59.770892 #2957:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [81220], State: [ok], Delivered in [0.018938087] seconds [----] I, [2016-09-13T13:23:59.771014 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Active(file): 242089984 [----] I, [2016-09-13T13:23:59.771102 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonHugePages: 920649728 [----] I, [2016-09-13T13:23:59.771186 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] AnonPages: 4307480576 [----] I, [2016-09-13T13:23:59.771267 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Bounce: 0 [----] I, [2016-09-13T13:23:59.771353 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Buffers: 6221824 [----] I, [2016-09-13T13:23:59.771464 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Cached: 566312960 [----] I, [2016-09-13T13:23:59.771571 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] CommitLimit: 10392850432 [----] I, [2016-09-13T13:23:59.771674 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Committed_AS: 6840479744 [----] I, [2016-09-13T13:23:59.771780 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap1G: 7516192768 [----] I, [2016-09-13T13:23:59.771876 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap2M: 3128950784 [----] I, [2016-09-13T13:23:59.771959 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] DirectMap4k: 92139520 [----] I, [2016-09-13T13:23:59.772046 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Dirty: 8192 [----] I, [2016-09-13T13:23:59.772124 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HardwareCorrupted: 0 [----] I, [2016-09-13T13:23:59.772204 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Free: 0 [----] I, [2016-09-13T13:23:59.772290 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Rsvd: 0 [----] I, [2016-09-13T13:23:59.772379 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Surp: 0 [----] I, [2016-09-13T13:23:59.772508 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] HugePages_Total: 0 [----] I, [2016-09-13T13:23:59.772602 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Hugepagesize: 2097152 [----] I, [2016-09-13T13:23:59.772689 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive: 273620992 [----] I, [2016-09-13T13:23:59.772822 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(anon): 55451648 [----] I, [2016-09-13T13:23:59.772925 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Inactive(file): 218169344 [----] I, [2016-09-13T13:23:59.773008 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] KernelStack: 6307840 [----] I, [2016-09-13T13:23:59.773087 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mapped: 143544320 [----] I, [2016-09-13T13:23:59.773172 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemAvailable: 3219247104 [----] I, [2016-09-13T13:23:59.773251 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemFree: 2661855232 [----] I, [2016-09-13T13:23:59.773334 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MemTotal: 8202797056 [----] I, [2016-09-13T13:23:59.773447 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Mlocked: 0 [----] I, [2016-09-13T13:23:59.773551 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] NFS_Unstable: 0 [----] I, [2016-09-13T13:23:59.773639 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] PageTables: 37871616 [----] I, [2016-09-13T13:23:59.773722 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SReclaimable: 356605952 [----] I, [2016-09-13T13:23:59.773833 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SUnreclaim: 100241408 [----] I, [2016-09-13T13:23:59.773920 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Shmem: 112275456 [----] I, [2016-09-13T13:23:59.774016 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Slab: 456847360 [----] I, [2016-09-13T13:23:59.774099 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapCached: 0 [----] I, [2016-09-13T13:23:59.774187 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapFree: 6291451904 [----] I, [2016-09-13T13:23:59.774271 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] SwapTotal: 6291451904 [----] I, [2016-09-13T13:23:59.774357 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Unevictable: 0 [----] I, [2016-09-13T13:23:59.774464 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocChunk: 35184306028544 [----] I, [2016-09-13T13:23:59.774565 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocTotal: 35184372087808 [----] I, [2016-09-13T13:23:59.774652 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] VmallocUsed: 30887936 [----] I, [2016-09-13T13:23:59.774751 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Writeback: 0 [----] I, [2016-09-13T13:23:59.774843 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] WritebackTmp: 0 [----] I, [2016-09-13T13:23:59.814840 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Disk Usage: [----] I, [2016-09-13T13:23:59.815058 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] Filesystem Type Total Used Available %Used iTotal iUsed iFree %iUsed Mounted on [----] I, [2016-09-13T13:23:59.819342 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_os xfs 4.49 GB 2.69 GB 1.8 GB 60% 4718592 147658 4570934 4% / [----] I, [2016-09-13T13:23:59.822974 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] devtmpfs devtmpfs 3.81 GB 0 Bytes 3.81 GB 0% 998537 407 998130 1% /dev [----] I, [2016-09-13T13:23:59.826836 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] tmpfs tmpfs 3.82 GB 4 KB 3.82 GB 1% 1001318 1 1001317 1% /dev/shm [----] I, [2016-09-13T13:23:59.830726 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vdb vfat 4.99 GB 4 KB 4.99 GB 1% 0 0 0 0% /mnt [----] I, [2016-09-13T13:23:59.834589 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_home xfs 1010 MB 32.2 MB 982 MB 4% 1048576 3 1048573 1% /home [----] I, [2016-09-13T13:23:59.838394 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var xfs 1.99 GB 864 MB 1.15 GB 43% 2097152 33776 2063376 2% /var [----] I, [2016-09-13T13:23:59.842272 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda3 xfs 9.99 GB 32.2 MB 9.96 GB 1% 10485760 3 10485757 1% /var/www/miq_tmp [----] I, [2016-09-13T13:23:59.846116 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log xfs 1010 MB 59.2 MB 955 MB 6% 1048576 52 1048524 1% /var/log [----] I, [2016-09-13T13:23:59.849982 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_var_log_audit xfs 509 MB 32.8 MB 476 MB 7% 524288 4 524284 1% /var/log/audit [----] I, [2016-09-13T13:23:59.852447 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_system-lv_tmp xfs 1010 MB 32.3 MB 982 MB 4% 1048576 19 1048557 1% /tmp [----] I, [2016-09-13T13:23:59.854723 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/mapper/vg_data-lv_pg xfs 13.5 GB 176 MB 13.3 GB 2% 14131200 3243 14127957 1% /var/opt/rh/rh-postgresql95/lib/pgsql/data [----] I, [2016-09-13T13:23:59.856950 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] /dev/vda1 xfs 509 MB 127 MB 382 MB 25% 524288 330 523958 1% /boot [----] I, [2016-09-13T13:23:59.860522 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["dequeue"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T13:23:59.860626 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["error"] by zone and role: {"default"=>{nil=>1}} [----] I, [2016-09-13T13:23:59.860700 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_system_status) [EVM Server (2763)] MiqQueue count for state=["ready"] by zone and role: {"default"=>{"ems_inventory"=>1}} [----] I, [2016-09-13T13:23:59.863685 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqServer.log_status) [EVM Server (2763)] Process info: Memory Usage [275689472], Memory Size [574287872], Proportional Set Size: [201171000], Memory % [3.36], CPU Time [156932.0], CPU % [0.3], Priority [21] [----] I, [2016-09-13T13:23:59.863996 #2947:34713c] INFO -- : Q-task_id([log_status]) MIQ(MiqQueue#delivered) Message id: [81219], State: [ok], Delivered in [0.094910022] seconds [----] I, [2016-09-13T13:24:04.450171 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:24:04.489161 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81221], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:24:04.511819 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81222], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:24:05.029054 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:24:05.033718 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004397392272949219, :worker_monitor=>1.231750249862671, :worker_dequeue=>0.010034561157226562, :total_time=>1.2464866638183594} [----] I, [2016-09-13T13:24:05.889336 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81222], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.394539053] seconds [----] I, [2016-09-13T13:24:05.889583 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81222], Delivering... [----] I, [2016-09-13T13:24:05.896589 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037403106689453125, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003760099411010742, :pending_vm_jobs=>0.0008611679077148438, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006589651107788086} [----] I, [2016-09-13T13:24:05.896969 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81222], State: [ok], Delivered in [0.007383126] seconds [----] I, [2016-09-13T13:24:07.410056 #2928:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81221], MiqWorker id: [13], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.955152755] seconds [----] I, [2016-09-13T13:24:07.410269 #2928:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81221], Delivering... [----] I, [2016-09-13T13:24:07.414928 #2928:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81221], State: [ok], Delivered in [0.004646338] seconds [----] I, [2016-09-13T13:24:10.034219 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:24:10 UTC]... [----] I, [2016-09-13T13:24:11.572881 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:24:10 UTC]...Complete [----] I, [2016-09-13T13:24:11.590050 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:heartbeat=>1.5388970375061035, :server_dequeue=>0.007153034210205078, :worker_dequeue=>0.009493112564086914, :total_time=>1.5558860301971436} [----] I, [2016-09-13T13:24:19.524155 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:24:19.579402 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81223], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:24:22.967929 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:24:22.971538 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004107952117919922, :worker_monitor=>1.3543624877929688, :worker_dequeue=>0.007442474365234375, :total_time=>1.3662850856781006} [----] I, [2016-09-13T13:24:23.036367 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81223], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.505607712] seconds [----] I, [2016-09-13T13:24:23.036596 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81223], Delivering... [----] I, [2016-09-13T13:24:23.043937 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0037522315979003906, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0037841796875, :pending_vm_jobs=>0.0009775161743164062, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006898641586303711} [----] I, [2016-09-13T13:24:23.044327 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81223], State: [ok], Delivered in [0.007724008] seconds [----] I, [2016-09-13T13:24:34.591805 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:24:34.601840 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81224], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:24:34.613124 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81225], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:24:34.624761 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81226], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:24:34.641719 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81227], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:24:39.375088 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:24:39.379383 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.0039882659912109375, :server_monitor=>0.10762500762939453, :worker_monitor=>1.2422738075256348, :worker_dequeue=>0.009303569793701172, :total_time=>1.3635656833648682} [----] I, [2016-09-13T13:24:40.076350 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81224], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.480601012] seconds [----] I, [2016-09-13T13:24:40.076582 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81224], Delivering... [----] I, [2016-09-13T13:24:40.181574 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81224], State: [ok], Delivered in [0.104978936] seconds [----] I, [2016-09-13T13:24:40.190939 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81227], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.561106765] seconds [----] I, [2016-09-13T13:24:40.191109 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81227], Delivering... [----] I, [2016-09-13T13:24:40.197680 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003488779067993164, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003534555435180664, :pending_vm_jobs=>0.0007922649383544922, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006204128265380859} [----] I, [2016-09-13T13:24:40.198037 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81227], State: [ok], Delivered in [0.006914838] seconds [----] I, [2016-09-13T13:24:40.213561 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81225], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.607500605] seconds [----] I, [2016-09-13T13:24:40.213723 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81225], Delivering... [----] I, [2016-09-13T13:24:40.216717 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81225], State: [ok], Delivered in [0.002984827] seconds [----] I, [2016-09-13T13:24:40.247957 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81226], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.629263418] seconds [----] I, [2016-09-13T13:24:40.248119 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81226], Delivering... [----] I, [2016-09-13T13:24:40.252637 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81226], State: [ok], Delivered in [0.004510836] seconds [----] I, [2016-09-13T13:24:44.380093 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:24:44 UTC]... [----] I, [2016-09-13T13:24:44.402159 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:24:44 UTC]...Complete [----] I, [2016-09-13T13:24:49.651953 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:24:49.671869 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81228], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:24:55.752825 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:24:55.757191 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004012346267700195, :worker_monitor=>1.3114614486694336, :worker_dequeue=>0.009427785873413086, :total_time=>1.3252372741699219} [----] I, [2016-09-13T13:24:56.316809 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81228], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [6.658857528] seconds [----] I, [2016-09-13T13:24:56.317026 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81228], Delivering... [----] I, [2016-09-13T13:24:56.324643 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003948688507080078, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0040094852447509766, :pending_vm_jobs=>0.0009357929229736328, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007153987884521484} [----] I, [2016-09-13T13:24:56.325040 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81228], State: [ok], Delivered in [0.00801419] seconds [----] I, [2016-09-13T13:25:04.684172 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:25:04.700013 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81229], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:25:04.710827 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81230], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:25:05.776273 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:25:06.426030 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81230], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.720527852] seconds [----] I, [2016-09-13T13:25:06.426257 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81230], Delivering... [----] I, [2016-09-13T13:25:06.433788 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003968954086303711, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003992795944213867, :pending_vm_jobs=>0.0008795261383056641, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007056474685668945} [----] I, [2016-09-13T13:25:06.434147 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81230], State: [ok], Delivered in [0.007897538] seconds [----] I, [2016-09-13T13:25:07.362289 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81229], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.673561548] seconds [----] I, [2016-09-13T13:25:07.362530 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81229], Delivering... [----] I, [2016-09-13T13:25:07.368086 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81229], State: [ok], Delivered in [0.005558435] seconds [----] I, [2016-09-13T13:25:11.951374 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004098415374755859, :worker_monitor=>1.1514947414398193, :worker_dequeue=>0.016205310821533203, :total_time=>1.1721208095550537} [----] I, [2016-09-13T13:25:16.952132 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:25:16 UTC]... [----] I, [2016-09-13T13:25:17.043276 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:25:16 UTC]...Complete [----] I, [2016-09-13T13:25:19.723107 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:25:19.745725 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81231], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:25:22.065857 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:25:22.443269 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81231], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.713379769] seconds [----] I, [2016-09-13T13:25:22.443617 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81231], Delivering... [----] I, [2016-09-13T13:25:22.455313 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.005912303924560547, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.005953311920166016, :pending_vm_jobs=>0.0015151500701904297, :vm_jobs_to_dispatch_count=>0, :total_time=>0.011021137237548828} [----] I, [2016-09-13T13:25:22.455885 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81231], State: [ok], Delivered in [0.012250701] seconds [----] I, [2016-09-13T13:25:28.271313 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004034280776977539, :worker_monitor=>1.183666467666626, :worker_dequeue=>0.012481451034545898, :total_time=>1.2005000114440918} [----] I, [2016-09-13T13:25:34.757629 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 5. [----] I, [2016-09-13T13:25:34.768786 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81232], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:25:34.785953 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81233], id: [], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:25:34.803082 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81234], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:25:34.814464 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81235], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:25:38.403990 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 4 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:25:38.637859 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81232], MiqWorker id: [16], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [MiqServer.status_update], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.875352935] seconds [----] I, [2016-09-13T13:25:38.638064 #2957:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81232], Delivering... [----] I, [2016-09-13T13:25:38.678831 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81235], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [3.870529308] seconds [----] I, [2016-09-13T13:25:38.679057 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81235], Delivering... [----] I, [2016-09-13T13:25:38.686515 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003801107406616211, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003828763961791992, :pending_vm_jobs=>0.0009577274322509766, :vm_jobs_to_dispatch_count=>0, :total_time=>0.0070171356201171875} [----] I, [2016-09-13T13:25:38.686930 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81235], State: [ok], Delivered in [0.007862304] seconds [----] I, [2016-09-13T13:25:38.711628 #2957:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81232], State: [ok], Delivered in [0.073543542] seconds [----] I, [2016-09-13T13:25:40.523270 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81233], MiqWorker id: [14], Zone: [default], Role: [], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Job.check_jobs_for_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.749485912] seconds [----] I, [2016-09-13T13:25:40.523493 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81233], Delivering... [----] I, [2016-09-13T13:25:40.526827 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81233], State: [ok], Delivered in [0.003321644] seconds [----] I, [2016-09-13T13:25:40.551842 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81234], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [5.758278864] seconds [----] I, [2016-09-13T13:25:40.552031 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81234], Delivering... [----] I, [2016-09-13T13:25:40.556890 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81234], State: [ok], Delivered in [0.004852618] seconds [----] I, [2016-09-13T13:25:44.458434 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.006756782531738281, :worker_monitor=>1.0343894958496094, :worker_dequeue=>0.00775456428527832, :total_time=>1.0492517948150635} [----] I, [2016-09-13T13:25:49.458922 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:25:49 UTC]... [----] I, [2016-09-13T13:25:49.540379 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:25:49 UTC]...Complete [----] I, [2016-09-13T13:25:49.827936 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:25:49.849202 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81236], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:25:54.564412 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:25:54.822403 #2947:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81236], MiqWorker id: [15], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [4.98628395] seconds [----] I, [2016-09-13T13:25:54.822666 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81236], Delivering... [----] I, [2016-09-13T13:25:54.830244 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.003862619400024414, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.0038869380950927734, :pending_vm_jobs=>0.0009174346923828125, :vm_jobs_to_dispatch_count=>0, :total_time=>0.006968975067138672} [----] I, [2016-09-13T13:25:54.830610 #2947:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81236], State: [ok], Delivered in [0.007948684] seconds [----] I, [2016-09-13T13:26:00.842859 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.004713535308837891, :worker_monitor=>1.2638037204742432, :worker_dequeue=>0.005248069763183594, :total_time=>1.2741594314575195} [----] I, [2016-09-13T13:26:04.863760 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 2. [----] I, [2016-09-13T13:26:04.875447 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81237], id: [], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:26:04.892808 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81238], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:26:05.853699 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 2 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:26:05.915899 #2957:34713c] INFO -- : MIQ(MiqPriorityWorker::Runner#get_message_via_drb) Message id: [81238], MiqWorker id: [16], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [1.037205691] seconds [----] I, [2016-09-13T13:26:05.916084 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81238], Delivering... [----] I, [2016-09-13T13:26:05.922002 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0034329891204833984, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003476381301879883, :pending_vm_jobs=>0.0006587505340576172, :vm_jobs_to_dispatch_count=>0, :total_time=>0.005560874938964844} [----] I, [2016-09-13T13:26:05.922346 #2957:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81238], State: [ok], Delivered in [0.006255245] seconds [----] I, [2016-09-13T13:26:07.688578 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81237], MiqWorker id: [14], Zone: [default], Role: [], Server: [36647afc-71a3-11e6-838a-fa163e68952f], Ident: [generic], Target id: [], Instance id: [], Task id: [], Command: [Session.check_session_timeout], Timeout: [600], Priority: [90], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.821670173] seconds [----] I, [2016-09-13T13:26:07.688816 #2937:34713c] INFO -- : MIQ(MiqQueue#deliver) Message id: [81237], Delivering... [----] I, [2016-09-13T13:26:07.694522 #2937:34713c] INFO -- : MIQ(MiqQueue#delivered) Message id: [81237], State: [ok], Delivered in [0.005702285] seconds [----] I, [2016-09-13T13:26:17.107866 #2763:34713c] INFO -- : MIQ(MiqServer#monitor_loop) Server Monitoring Complete - Timings: {:server_dequeue=>0.005423069000244141, :worker_monitor=>1.2198419570922852, :worker_dequeue=>0.00950169563293457, :total_time=>1.2351880073547363} [----] I, [2016-09-13T13:26:19.901763 #2989:34713c] INFO -- : MIQ(MiqScheduleWorker::Runner#do_work) Number of scheduled items to be processed: 1. [----] I, [2016-09-13T13:26:19.930644 #2989:34713c] INFO -- : MIQ(MiqQueue.put) Message id: [81239], id: [], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [ready], Deliver On: [], Data: [], Args: [] [----] I, [2016-09-13T13:26:22.108526 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:26:22 UTC]... [----] I, [2016-09-13T13:26:22.129001 #2763:34713c] INFO -- : MIQ(MiqServer#heartbeat) Heartbeat [2016-09-13 17:26:22 UTC]...Complete [----] I, [2016-09-13T13:26:22.140994 #2763:34713c] INFO -- : MIQ(MiqServer#populate_queue_messages) Fetched 1 miq_queue rows for queue_name=generic, wcount=4, priority=200 [----] I, [2016-09-13T13:26:22.769089 #2937:34713c] INFO -- : MIQ(MiqGenericWorker::Runner#get_message_via_drb) Message id: [81239], MiqWorker id: [14], Zone: [default], Role: [smartstate], Server: [], Ident: [generic], Target id: [], Instance id: [], Task id: [job_dispatcher], Command: [JobProxyDispatcher.dispatch], Timeout: [600], Priority: [20], State: [dequeue], Deliver On: [], Data: [], Args: [], Dequeued in: [2.860648719] seconds [----] I, [2016-09-13T13:26:22.769224 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#deliver) Message id: [81239], Delivering... [----] I, [2016-09-13T13:26:22.776791 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(JobProxyDispatcher#dispatch) Complete - Timings: {:pending_container_jobs=>0.0036563873291015625, :container_jobs_to_dispatch_count=>0, :container_dispatching=>0.003679990768432617, :pending_vm_jobs=>0.0010423660278320312, :vm_jobs_to_dispatch_count=>0, :total_time=>0.007203340530395508} [----] I, [2016-09-13T13:26:22.777190 #2937:34713c] INFO -- : Q-task_id([job_dispatcher]) MIQ(MiqQueue#delivered) Message id: [81239], State: [ok], Delivered in [0.007933853] seconds